2024-04-14T23:42:53.449 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-14T23:42:53.449 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} --archive /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603 --name teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/orig.config.yaml 2024-04-14T23:42:53.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T23:42:53.588 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603 branch: squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7656603' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - slow request - SLOW_OPS - MON_DOWN sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 840 sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 sleep_before_teardown: 0 subset: 427/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg1QjYOm/XCwPoI964+rvcDmXRZJoCgq5O6XZklDrKVFZkARNlsIk0PfGQ8Egv9y3LEjQ8qW1HUjH4WohwvuhE= smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKoaKdSXSa5MDypAEXZKA09QF0pnbK88cIyQahnI0ihDdIDOOsadRfRxL4WIKmM83/pql8uGT3FmP8TmL3DAg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-14_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-14T23:42:53.589 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa; will attempt to use it 2024-04-14T23:42:53.589 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks 2024-04-14T23:42:53.590 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-14T23:42:53.591 INFO:teuthology.task.internal:Checking packages... 2024-04-14T23:42:53.616 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a9a752df26c63acad72e1b3569fd79a515ca0765' 2024-04-14T23:42:53.616 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-14T23:42:53.616 INFO:teuthology.packaging:ref: None 2024-04-14T23:42:53.616 INFO:teuthology.packaging:tag: None 2024-04-14T23:42:53.616 INFO:teuthology.packaging:branch: squid 2024-04-14T23:42:53.617 INFO:teuthology.packaging:sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:42:53.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-14T23:42:53.909 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2114.ga9a752df 2024-04-14T23:42:53.910 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-14T23:42:53.918 INFO:teuthology.task.internal:no buildpackages task found 2024-04-14T23:42:53.918 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-14T23:42:53.926 INFO:teuthology.task.internal:Saving configuration 2024-04-14T23:42:53.943 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-14T23:42:53.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T23:42:53.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:37:25.024840', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg1QjYOm/XCwPoI964+rvcDmXRZJoCgq5O6XZklDrKVFZkARNlsIk0PfGQ8Egv9y3LEjQ8qW1HUjH4WohwvuhE='} 2024-04-14T23:42:53.999 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:37:25.023354', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKoaKdSXSa5MDypAEXZKA09QF0pnbK88cIyQahnI0ihDdIDOOsadRfRxL4WIKmM83/pql8uGT3FmP8TmL3DAg='} 2024-04-14T23:42:53.999 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-14T23:42:54.006 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-14T23:42:54.006 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-14T23:42:54.006 INFO:teuthology.run_tasks:Running task console_log... 2024-04-14T23:42:54.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff2e20920d0>, signals=[15]) 2024-04-14T23:42:54.073 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-14T23:42:54.079 INFO:teuthology.task.internal:Opening connections... 2024-04-14T23:42:54.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-04-14T23:42:54.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:42:54.186 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-04-14T23:42:54.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:42:54.289 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-14T23:42:54.296 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-14T23:42:54.313 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-14T23:42:54.313 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-14T23:42:54.370 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T23:42:54.371 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T23:42:54.371 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T23:42:54.371 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-14T23:42:54.397 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-04-14T23:42:54.415 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-04-14T23:42:54.415 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-04-14T23:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T23:42:54.473 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-04-14T23:42:54.473 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T23:42:54.473 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T23:42:54.473 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T23:42:54.473 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-04-14T23:42:54.498 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-14T23:42:54.507 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-14T23:42:54.514 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-14T23:42:54.515 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-04-14T23:42:54.517 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-04-14T23:42:54.533 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-14T23:42:54.544 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-14T23:42:54.544 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-04-14T23:42:54.574 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-04-14T23:42:54.603 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-14T23:42:54.657 INFO:teuthology.run_tasks:Running task kernel... 2024-04-14T23:42:54.673 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-14T23:42:54.673 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-14T23:42:54.674 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T23:42:54.674 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T23:42:54.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:42:54.690 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-04-14T23:42:54.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:42:54.691 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-14T23:42:54.748 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-361.el9.x86_64 2024-04-14T23:42:54.748 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-361.el9.x86_64 2024-04-14T23:42:54.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-04-14T23:42:54.749 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-361.el9.x86_64 2024-04-14T23:42:54.749 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-361.el9.x86_64 2024-04-14T23:42:54.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-04-14T23:42:57.079 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-04-14T23:42:57.905 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-04-14T23:42:58.745 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 8.7 MB/s | 2.5 MB 00:00 2024-04-14T23:42:59.606 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.5 MB 00:00 2024-04-14T23:42:59.936 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-14T23:43:00.908 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.0 MB 00:00 2024-04-14T23:43:01.982 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-14T23:43:02.952 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-14T23:43:08.104 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.2 MB 00:01 2024-04-14T23:43:09.574 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 16 kB 00:00 2024-04-14T23:43:10.885 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-14T23:43:13.662 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 800 kB/s | 6.2 MB 00:07 2024-04-14T23:43:15.155 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-04-14T23:43:16.136 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.508 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.509 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.510 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.511 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-14T23:43:18.512 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.513 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.514 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.515 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.516 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:43:18.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.516 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:43:18.823 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 21 MB 00:03 2024-04-14T23:43:18.963 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T23:43:18.963 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T23:43:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-14T23:43:19.097 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-14T23:43:19.097 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-04-14T23:43:19.097 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-14T23:43:19.097 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:43:19.098 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-14T23:43:19.099 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-14T23:43:19.099 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-04-14T23:43:19.099 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:43:19.100 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 77 M 2024-04-14T23:43:19.100 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 123 M 2024-04-14T23:43:19.100 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-14T23:43:19.432 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 789 kB/s | 214 kB 00:00 2024-04-14T23:43:19.900 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 20 MB/s | 15 MB 00:00 2024-04-14T23:43:20.708 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 22 MB/s | 34 MB 00:01 2024-04-14T23:43:21.517 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 13 MB/s | 28 MB 00:02 2024-04-14T23:43:21.520 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:43:21.520 INFO:teuthology.orchestra.run.smithi029.stdout:Total 32 MB/s | 77 MB 00:02 2024-04-14T23:43:22.219 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-14T23:43:22.660 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-14T23:43:22.660 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-14T23:43:23.699 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-14T23:43:23.699 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-14T23:43:24.131 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-04-14T23:43:26.317 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-14T23:43:26.469 INFO:teuthology.orchestra.run.smithi037.stderr:Modular dependency problems: 2024-04-14T23:43:26.469 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-14T23:43:26.469 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 1: conflicting requests 2024-04-14T23:43:26.469 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.469 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 2: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 3: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 4: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 5: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 6: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 7: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 8: conflicting requests 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.470 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 9: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 10: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 11: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 12: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 13: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 14: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 15: conflicting requests 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.471 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 16: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 17: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 18: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 19: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 20: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 21: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 22: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 23: conflicting requests 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.472 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 24: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 25: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 26: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 27: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 28: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 29: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 30: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 31: conflicting requests 2024-04-14T23:43:26.473 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 32: conflicting requests 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 33: conflicting requests 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 34: conflicting requests 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 35: conflicting requests 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 36: conflicting requests 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.474 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 37: conflicting requests 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 39: conflicting requests 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.475 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:43:26.476 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:43:26.477 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.478 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.478 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.478 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:43:26.955 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T23:43:26.956 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T23:43:27.007 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:43:27.066 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-14T23:43:27.072 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-04-14T23:43:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:43:27.074 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 77 M 2024-04-14T23:43:27.074 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 123 M 2024-04-14T23:43:27.074 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-14T23:43:27.114 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:43:27.324 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 1.5 MB/s | 214 kB 00:00 2024-04-14T23:43:27.658 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 32 MB/s | 15 MB 00:00 2024-04-14T23:43:28.142 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 35 MB/s | 34 MB 00:00 2024-04-14T23:43:28.550 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 23 MB/s | 28 MB 00:01 2024-04-14T23:43:28.550 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:43:28.551 INFO:teuthology.orchestra.run.smithi037.stdout:Total 52 MB/s | 77 MB 00:01 2024-04-14T23:43:29.252 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-14T23:43:29.663 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-14T23:43:29.663 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-14T23:43:29.997 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:43:30.199 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:43:30.721 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-14T23:43:30.721 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-14T23:43:33.322 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-14T23:43:33.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:43:34.026 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:43:35.270 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:43:35.323 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:43:36.939 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:43:37.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:43:40.430 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:43:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:43:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:43:47.303 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:13.411 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:13.411 INFO:teuthology.orchestra.run.smithi029.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T23:44:13.411 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:44:13.458 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:13.962 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:13.962 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:44:13.962 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:44:13.962 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:44:14.427 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-14T23:44:14.879 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:44:15.053 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:44:15.053 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:44:15.054 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T23:44:15.054 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T23:44:15.054 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T23:44:15.054 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-14T23:44:15.054 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T23:44:15.054 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:44:15.138 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:44:15.138 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:44:15.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-04-14T23:44:15.184 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 68.el9 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8264254 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-04-14T23:44:15.185 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:44:15.186 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T23:44:15.187 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T23:44:15.187 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-435.el9.x86_64 2024-04-14T23:44:15.187 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T23:44:15.904 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-04-14T23:44:17.506 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T23:44:17.532 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-04-14T23:44:17.534 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-14T23:44:17.549 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.xkos6Tt3xJ 2024-04-14T23:44:17.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xkos6Tt3xJ 2024-04-14T23:44:17.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.xkos6Tt3xJ 2024-04-14T23:44:17.771 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.xkos6Tt3xJ is 6KB 2024-04-14T23:44:17.819 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.xkos6Tt3xJ 2024-04-14T23:44:17.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T23:44:17.905 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T23:44:17.906 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T23:44:17.906 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T23:44:17.906 INFO:teuthology.orchestra.run.smithi029.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T23:44:17.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T23:44:17.976 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:17.976 INFO:teuthology.orchestra.run.smithi037.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T23:44:17.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:44:18.024 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:18.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-04-14T23:44:18.430 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:18.430 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:44:18.430 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:44:18.430 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:44:18.867 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:44:18.867 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:44:18.867 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-14T23:44:18.867 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T23:44:18.868 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T23:44:18.868 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T23:44:18.868 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T23:44:18.868 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:44:18.868 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-14T23:44:19.175 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:44:19.283 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:44:19.283 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:44:19.283 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T23:44:19.283 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T23:44:19.283 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T23:44:19.283 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-14T23:44:19.284 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T23:44:19.284 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:44:19.366 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:44:19.367 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:44:19.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-04-14T23:44:19.408 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 68.el9 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8264254 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-04-14T23:44:19.409 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:44:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T23:44:19.411 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T23:44:19.411 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-435.el9.x86_64 2024-04-14T23:44:19.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T23:44:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-04-14T23:44:21.442 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T23:44:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-04-14T23:44:21.476 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-04-14T23:44:21.492 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.4UoBxVC0k1 2024-04-14T23:44:21.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4UoBxVC0k1 2024-04-14T23:44:21.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.4UoBxVC0k1 2024-04-14T23:44:21.709 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.4UoBxVC0k1 is 6KB 2024-04-14T23:44:21.757 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.4UoBxVC0k1 2024-04-14T23:44:21.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T23:44:21.841 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T23:44:21.841 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T23:44:21.841 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T23:44:21.841 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T23:44:21.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T23:44:21.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-04-14T23:44:48.085 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-14T23:44:48.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T23:44:48.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:44:52.001 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-14T23:44:52.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-14T23:44:52.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:45:06.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T23:45:10.430 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-04-14T23:45:15.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T23:45:15.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:45:19.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-14T23:45:19.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:45:37.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-04-14T23:45:49.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-14T23:45:49.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:45:50.407 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-04-14T23:45:50.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-14T23:45:50.867 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-435.el9.x86_64"... 2024-04-14T23:45:50.867 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-04-14T23:45:50.881 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-435.el9.x86_64 2024-04-14T23:45:50.881 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T23:45:50.882 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T23:45:50.882 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T23:45:51.882 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-14T23:45:51.882 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-14T23:45:51.956 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-04-14T23:45:52.002 DEBUG:teuthology.parallel:result is None 2024-04-14T23:46:15.597 DEBUG:teuthology.orchestra.remote:timed out 2024-04-14T23:46:27.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T23:46:27.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:46:27.971 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-14T23:46:28.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T23:46:28.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-435.el9.x86_64"... 2024-04-14T23:46:28.466 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-14T23:46:28.482 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-435.el9.x86_64 2024-04-14T23:46:28.482 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T23:46:28.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T23:46:28.482 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T23:46:29.483 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-14T23:46:29.483 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-14T23:46:29.575 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-04-14T23:46:29.614 DEBUG:teuthology.parallel:result is None 2024-04-14T23:46:29.614 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-14T23:46:29.625 INFO:teuthology.task.internal:Creating test directory... 2024-04-14T23:46:29.625 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T23:46:29.627 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T23:46:29.646 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-14T23:46:29.654 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-14T23:46:29.761 INFO:teuthology.task.internal:Creating archive directory... 2024-04-14T23:46:29.761 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T23:46:29.764 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T23:46:29.796 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-14T23:46:29.804 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-14T23:46:29.804 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T23:46:29.830 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T23:46:29.863 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:46:29.876 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:46:29.877 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:46:29.890 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:46:29.892 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-14T23:46:29.899 INFO:teuthology.task.internal:Configuring sudo... 2024-04-14T23:46:29.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T23:46:29.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T23:46:29.952 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-14T23:46:29.961 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-14T23:46:29.961 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T23:46:29.995 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T23:46:30.012 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:46:30.099 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:46:30.166 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:46:30.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:46:30.255 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:46:30.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T23:46:30.326 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:46:30.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:46:30.423 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:46:30.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:46:30.552 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:46:30.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T23:46:30.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-04-14T23:46:30.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-04-14T23:46:30.669 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T23:46:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T23:46:31.028 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-14T23:46:31.036 INFO:teuthology.task.internal:Starting timer... 2024-04-14T23:46:31.037 INFO:teuthology.run_tasks:Running task pcp... 2024-04-14T23:46:31.054 INFO:teuthology.run_tasks:Running task selinux... 2024-04-14T23:46:31.066 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-14T23:46:31.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-04-14T23:46:31.146 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-04-14T23:46:31.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-04-14T23:46:31.200 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-04-14T23:46:31.202 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-14T23:46:31.202 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-04-14T23:46:31.222 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-04-14T23:46:31.223 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-04-14T23:46:31.251 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-04-14T23:46:31.251 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi037.front.sepia.ceph.com': 'permissive'} 2024-04-14T23:46:31.252 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T23:46:31.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:46:31.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T23:46:31.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:46:31.321 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-14T23:46:31.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-04-14T23:46:31.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-04-14T23:46:31.411 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-14T23:46:31.422 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-14T23:46:31.440 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-14T23:46:31.442 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi037.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-14T23:51:01.783 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi037.front.sepia.ceph.com')] 2024-04-14T23:51:01.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T23:51:01.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:51:01.881 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-14T23:51:01.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T23:51:01.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-14T23:51:01.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:51:02.055 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-04-14T23:51:02.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-14T23:51:02.140 INFO:teuthology.run_tasks:Running task clock... 2024-04-14T23:51:02.151 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-14T23:51:02.151 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T23:51:02.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T23:51:02.154 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T23:51:02.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T23:51:02.183 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T23:51:02.199 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T23:51:02.212 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T23:51:02.229 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-04-14T23:51:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T23:51:02.242 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-04-14T23:51:02.259 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T23:51:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-04-14T23:51:02.275 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-04-14T23:51:02.275 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T23:51:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T23:51:02.308 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T23:51:02.327 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-04-14T23:51:02.331 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T23:51:02.331 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-04-14T23:51:02.331 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.331 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.332 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.332 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.367 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-14T23:51:02.370 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T23:51:02.370 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-14T23:51:02.370 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.371 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.371 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.371 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:51:02.371 INFO:teuthology.run_tasks:Running task install... 2024-04-14T23:51:02.379 DEBUG:teuthology.task.install:project ceph 2024-04-14T23:51:02.380 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}} 2024-04-14T23:51:02.380 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'} 2024-04-14T23:51:02.380 INFO:teuthology.task.install:Using flavor: default 2024-04-14T23:51:02.386 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-14T23:51:02.386 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-14T23:51:02.386 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-14T23:51:02.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:51:02.389 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-14T23:51:02.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:51:02.558 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-14T23:51:02.558 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-14T23:51:02.606 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-14T23:51:02.606 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-14T23:51:02.730 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T23:51:02.730 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:51:02.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T23:51:02.759 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T23:51:02.759 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T23:51:02.781 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T23:51:02.781 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:51:02.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T23:51:02.809 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T23:51:02.809 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T23:51:02.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T23:51:02.878 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T23:51:02.907 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T23:51:02.957 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T23:51:02.973 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-04-14T23:51:02.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-04-14T23:51:03.023 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-04-14T23:51:03.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-04-14T23:51:03.239 INFO:teuthology.orchestra.run.smithi037.stdout:74 files removed 2024-04-14T23:51:03.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T23:51:03.269 INFO:teuthology.orchestra.run.smithi029.stdout:74 files removed 2024-04-14T23:51:03.296 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T23:51:03.882 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 270 kB/s | 83 kB 00:00 2024-04-14T23:51:04.085 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 173 kB/s | 83 kB 00:00 2024-04-14T23:51:04.324 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-04-14T23:51:04.536 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-04-14T23:51:04.691 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-04-14T23:51:04.904 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-04-14T23:51:05.213 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-14T23:51:05.457 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - AppStream 16 MB/s | 8.1 MB 00:00 2024-04-14T23:51:06.902 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 8.3 MB/s | 2.5 MB 00:00 2024-04-14T23:51:07.159 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.5 MB 00:00 2024-04-14T23:51:08.743 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-04-14T23:51:09.794 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-04-14T23:51:13.019 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 19 MB 00:03 2024-04-14T23:51:15.180 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 19 MB 00:04 2024-04-14T23:51:17.614 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.2 MB 00:00 2024-04-14T23:51:19.221 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-04-14T23:51:20.717 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-14T23:51:20.934 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-04-14T23:51:22.620 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-14T23:51:23.564 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-04-14T23:51:26.015 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-04-14T23:51:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:Modular dependency problems: 2024-04-14T23:51:28.708 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-14T23:51:28.708 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 1: conflicting requests 2024-04-14T23:51:28.708 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 2: conflicting requests 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 3: conflicting requests 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 4: conflicting requests 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 5: conflicting requests 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 6: conflicting requests 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 7: conflicting requests 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.709 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 8: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 9: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 10: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 11: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 12: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 13: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 14: conflicting requests 2024-04-14T23:51:28.710 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 15: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 16: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 17: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 18: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 19: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 20: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 21: conflicting requests 2024-04-14T23:51:28.711 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 22: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 23: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 24: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 25: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 26: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 27: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 28: conflicting requests 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.712 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 29: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 30: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 31: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 32: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 33: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 34: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 35: conflicting requests 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.713 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 36: conflicting requests 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 37: conflicting requests 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 39: conflicting requests 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.714 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.715 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.716 INFO:teuthology.orchestra.run.smithi037.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:51:28.717 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.717 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.717 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.717 INFO:teuthology.orchestra.run.smithi037.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:51:28.999 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-14T23:51:29.169 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:51:29.170 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:51:29.202 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T23:51:29.204 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T23:51:29.205 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T23:51:29.205 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T23:51:29.207 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T23:51:29.210 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T23:51:29.211 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T23:51:29.312 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-14T23:51:29.342 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================= 2024-04-14T23:51:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-14T23:51:29.342 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================= 2024-04-14T23:51:29.342 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-14T23:51:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T23:51:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 68 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 443 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.0 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 53 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 20 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-14T23:51:29.343 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 M 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 289 M 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 179 M 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 680 M 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 222 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 27 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 18 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T23:51:29.344 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.4 M 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 109 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 M 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 52 M 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-14T23:51:29.345 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 615 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 769 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.1 M 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 337 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 516 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 52 M 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.3 M 2024-04-14T23:51:29.346 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-14T23:51:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T23:51:29.348 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 23 M 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T23:51:29.349 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T23:51:29.350 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T23:51:29.351 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T23:51:29.352 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T23:51:29.353 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T23:51:29.354 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T23:51:29.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T23:51:29.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T23:51:29.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T23:51:29.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T23:51:29.357 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-14T23:51:29.358 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================= 2024-04-14T23:51:29.359 INFO:teuthology.orchestra.run.smithi037.stdout:Install 172 Packages 2024-04-14T23:51:29.359 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 24 Packages 2024-04-14T23:51:29.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:51:29.359 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.2 G 2024-04-14T23:51:29.359 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-14T23:51:30.191 INFO:teuthology.orchestra.run.smithi037.stdout:(1/196): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 32 kB/s | 6.6 kB 00:00 2024-04-14T23:51:31.686 INFO:teuthology.orchestra.run.smithi029.stderr:Modular dependency problems: 2024-04-14T23:51:31.686 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 1: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 2: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 3: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 4: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 5: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 6: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 7: conflicting requests 2024-04-14T23:51:31.687 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 8: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 9: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 10: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 11: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 12: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 13: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 14: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 15: conflicting requests 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.688 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 16: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 17: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 18: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 19: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 20: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 21: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 22: conflicting requests 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.689 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 23: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 24: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 25: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 26: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 27: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 28: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 29: conflicting requests 2024-04-14T23:51:31.690 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 30: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 31: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 32: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 33: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 34: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 35: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 36: conflicting requests 2024-04-14T23:51:31.691 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 37: conflicting requests 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 39: conflicting requests 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.692 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.693 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:51:31.694 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:51:31.695 INFO:teuthology.orchestra.run.smithi029.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:51:32.267 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:51:32.268 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:51:32.305 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T23:51:32.306 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T23:51:32.307 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T23:51:32.309 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T23:51:32.311 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T23:51:32.314 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T23:51:32.315 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T23:51:32.418 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-14T23:51:32.449 INFO:teuthology.orchestra.run.smithi037.stdout:(2/196): ceph-base-19.0.0-2114.ga9a752df.el7.x8 2.2 MB/s | 5.3 MB 00:02 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================================= 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================================= 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-14T23:51:32.451 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 68 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 443 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.0 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 53 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 20 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 289 M 2024-04-14T23:51:32.452 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 179 M 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 680 M 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 222 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 27 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 18 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-14T23:51:32.453 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.4 M 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 109 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 M 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 52 M 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 615 k 2024-04-14T23:51:32.454 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 769 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.1 M 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 337 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 516 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 52 M 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.3 M 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T23:51:32.455 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T23:51:32.456 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-debuginfo x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 23 M 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-14T23:51:32.457 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T23:51:32.458 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T23:51:32.459 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T23:51:32.460 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T23:51:32.461 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T23:51:32.462 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T23:51:32.463 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T23:51:32.464 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2024-04-14T23:51:32.465 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================================= 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout:Install 172 Packages 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 24 Packages 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:51:32.466 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 2.2 G 2024-04-14T23:51:32.467 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-14T23:51:33.695 INFO:teuthology.orchestra.run.smithi029.stdout:(1/196): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 20 kB/s | 6.6 kB 00:00 2024-04-14T23:51:36.041 INFO:teuthology.orchestra.run.smithi037.stdout:(3/196): ceph-common-19.0.0-2114.ga9a752df.el7. 3.5 MB/s | 21 MB 00:05 2024-04-14T23:51:36.079 INFO:teuthology.orchestra.run.smithi029.stdout:(2/196): ceph-base-19.0.0-2114.ga9a752df.el7.x8 2.0 MB/s | 5.3 MB 00:02 2024-04-14T23:51:44.174 INFO:teuthology.orchestra.run.smithi037.stdout:(4/196): ceph-debuginfo-19.0.0-2114.ga9a752df.e 2.8 MB/s | 23 MB 00:08 2024-04-14T23:51:44.574 INFO:teuthology.orchestra.run.smithi037.stdout:(5/196): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 2.2 MB/s | 891 kB 00:00 2024-04-14T23:51:46.046 INFO:teuthology.orchestra.run.smithi029.stdout:(3/196): ceph-common-19.0.0-2114.ga9a752df.el7. 1.7 MB/s | 21 MB 00:12 2024-04-14T23:51:46.249 INFO:teuthology.orchestra.run.smithi037.stdout:(6/196): ceph-fuse-debuginfo-19.0.0-2114.ga9a75 3.6 MB/s | 6.0 MB 00:01 2024-04-14T23:51:46.341 INFO:teuthology.orchestra.run.smithi037.stdout:(7/196): ceph-immutable-object-cache-19.0.0-211 1.5 MB/s | 145 kB 00:00 2024-04-14T23:51:46.783 INFO:teuthology.orchestra.run.smithi037.stdout:(8/196): ceph-immutable-object-cache-debuginfo- 3.3 MB/s | 1.5 MB 00:00 2024-04-14T23:51:47.383 INFO:teuthology.orchestra.run.smithi037.stdout:(9/196): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 3.9 MB/s | 2.4 MB 00:00 2024-04-14T23:51:54.567 INFO:teuthology.orchestra.run.smithi037.stdout:(10/196): ceph-base-debuginfo-19.0.0-2114.ga9a7 2.8 MB/s | 68 MB 00:24 2024-04-14T23:51:54.829 INFO:teuthology.orchestra.run.smithi029.stdout:(4/196): ceph-debuginfo-19.0.0-2114.ga9a752df.e 2.6 MB/s | 23 MB 00:08 2024-04-14T23:51:55.067 INFO:teuthology.orchestra.run.smithi037.stdout:(11/196): ceph-mds-debuginfo-19.0.0-2114.ga9a75 6.9 MB/s | 53 MB 00:07 2024-04-14T23:51:55.072 INFO:teuthology.orchestra.run.smithi029.stdout:(5/196): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 3.6 MB/s | 891 kB 00:00 2024-04-14T23:51:55.108 INFO:teuthology.orchestra.run.smithi037.stdout:(12/196): ceph-mgr-19.0.0-2114.ga9a752df.el7.x8 2.8 MB/s | 1.5 MB 00:00 2024-04-14T23:51:56.342 INFO:teuthology.orchestra.run.smithi037.stdout:(13/196): ceph-mon-19.0.0-2114.ga9a752df.el7.x8 3.8 MB/s | 4.7 MB 00:01 2024-04-14T23:51:57.267 INFO:teuthology.orchestra.run.smithi037.stdout:(14/196): ceph-mgr-debuginfo-19.0.0-2114.ga9a75 9.1 MB/s | 20 MB 00:02 2024-04-14T23:51:57.397 INFO:teuthology.orchestra.run.smithi029.stdout:(6/196): ceph-fuse-debuginfo-19.0.0-2114.ga9a75 2.6 MB/s | 6.0 MB 00:02 2024-04-14T23:51:57.491 INFO:teuthology.orchestra.run.smithi029.stdout:(7/196): ceph-immutable-object-cache-19.0.0-211 1.5 MB/s | 145 kB 00:00 2024-04-14T23:51:58.074 INFO:teuthology.orchestra.run.smithi029.stdout:(8/196): ceph-immutable-object-cache-debuginfo- 2.5 MB/s | 1.5 MB 00:00 2024-04-14T23:51:58.942 INFO:teuthology.orchestra.run.smithi029.stdout:(9/196): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 2.7 MB/s | 2.4 MB 00:00 2024-04-14T23:51:58.976 INFO:teuthology.orchestra.run.smithi037.stdout:(15/196): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 9.8 MB/s | 17 MB 00:01 2024-04-14T23:52:03.651 INFO:teuthology.orchestra.run.smithi029.stdout:(10/196): ceph-base-debuginfo-19.0.0-2114.ga9a7 2.3 MB/s | 68 MB 00:30 2024-04-14T23:52:04.435 INFO:teuthology.orchestra.run.smithi029.stdout:(11/196): ceph-mgr-19.0.0-2114.ga9a752df.el7.x8 1.9 MB/s | 1.5 MB 00:00 2024-04-14T23:52:11.935 INFO:teuthology.orchestra.run.smithi029.stdout:(12/196): ceph-mds-debuginfo-19.0.0-2114.ga9a75 4.1 MB/s | 53 MB 00:12 2024-04-14T23:52:13.002 INFO:teuthology.orchestra.run.smithi029.stdout:(13/196): ceph-mgr-debuginfo-19.0.0-2114.ga9a75 2.3 MB/s | 20 MB 00:08 2024-04-14T23:52:13.269 INFO:teuthology.orchestra.run.smithi029.stdout:(14/196): ceph-mon-19.0.0-2114.ga9a752df.el7.x8 3.5 MB/s | 4.7 MB 00:01 2024-04-14T23:52:16.295 INFO:teuthology.orchestra.run.smithi029.stdout:(15/196): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 5.6 MB/s | 17 MB 00:03 2024-04-14T23:52:17.266 INFO:teuthology.orchestra.run.smithi037.stdout:(16/196): ceph-mon-debuginfo-19.0.0-2114.ga9a75 4.7 MB/s | 99 MB 00:20 2024-04-14T23:52:19.658 INFO:teuthology.orchestra.run.smithi037.stdout:(17/196): ceph-radosgw-19.0.0-2114.ga9a752df.el 4.1 MB/s | 9.9 MB 00:02 2024-04-14T23:52:34.969 INFO:teuthology.orchestra.run.smithi029.stdout:(16/196): ceph-mon-debuginfo-19.0.0-2114.ga9a75 4.5 MB/s | 99 MB 00:21 2024-04-14T23:52:36.904 INFO:teuthology.orchestra.run.smithi029.stdout:(17/196): ceph-radosgw-19.0.0-2114.ga9a752df.el 5.1 MB/s | 9.9 MB 00:01 2024-04-14T23:52:37.198 INFO:teuthology.orchestra.run.smithi037.stdout:(18/196): ceph-osd-debuginfo-19.0.0-2114.ga9a75 7.6 MB/s | 289 MB 00:38 2024-04-14T23:52:37.548 INFO:teuthology.orchestra.run.smithi037.stdout:(19/196): ceph-selinux-19.0.0-2114.ga9a752df.el 72 kB/s | 25 kB 00:00 2024-04-14T23:52:44.973 INFO:teuthology.orchestra.run.smithi037.stdout:(20/196): ceph-radosgw-debuginfo-19.0.0-2114.ga 7.1 MB/s | 179 MB 00:25 2024-04-14T23:52:50.956 INFO:teuthology.orchestra.run.smithi037.stdout:(21/196): ceph-test-19.0.0-2114.ga9a752df.el7.x 3.6 MB/s | 48 MB 00:13 2024-04-14T23:52:51.106 INFO:teuthology.orchestra.run.smithi037.stdout:(22/196): cephfs-mirror-19.0.0-2114.ga9a752df.e 1.4 MB/s | 222 kB 00:00 2024-04-14T23:52:51.190 INFO:teuthology.orchestra.run.smithi037.stdout:(23/196): cephfs-shell-19.0.0-2114.ga9a752df.el 326 kB/s | 27 kB 00:00 2024-04-14T23:52:51.273 INFO:teuthology.orchestra.run.smithi037.stdout:(24/196): libcephfs-devel-19.0.0-2114.ga9a752df 380 kB/s | 32 kB 00:00 2024-04-14T23:52:51.507 INFO:teuthology.orchestra.run.smithi037.stdout:(25/196): libcephfs2-19.0.0-2114.ga9a752df.el7. 3.1 MB/s | 746 kB 00:00 2024-04-14T23:52:52.649 INFO:teuthology.orchestra.run.smithi037.stdout:(26/196): libcephfs2-debuginfo-19.0.0-2114.ga9a 4.7 MB/s | 5.4 MB 00:01 2024-04-14T23:52:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:(27/196): libcephsqlite-19.0.0-2114.ga9a752df.e 1.8 MB/s | 164 kB 00:00 2024-04-14T23:52:52.833 INFO:teuthology.orchestra.run.smithi037.stdout:(28/196): librados-devel-19.0.0-2114.ga9a752df. 1.3 MB/s | 127 kB 00:00 2024-04-14T23:52:52.925 INFO:teuthology.orchestra.run.smithi037.stdout:(29/196): librados-devel-debuginfo-19.0.0-2114. 1.2 MB/s | 109 kB 00:00 2024-04-14T23:53:01.508 INFO:teuthology.orchestra.run.smithi037.stdout:(30/196): librados2-debuginfo-19.0.0-2114.ga9a7 5.3 MB/s | 45 MB 00:08 2024-04-14T23:53:01.675 INFO:teuthology.orchestra.run.smithi037.stdout:(31/196): libradosstriper1-19.0.0-2114.ga9a752d 2.9 MB/s | 501 kB 00:00 2024-04-14T23:53:08.974 INFO:teuthology.orchestra.run.smithi037.stdout:(32/196): librbd1-debuginfo-19.0.0-2114.ga9a752 7.1 MB/s | 52 MB 00:07 2024-04-14T23:53:09.433 INFO:teuthology.orchestra.run.smithi037.stdout:(33/196): librgw2-19.0.0-2114.ga9a752df.el7.x86 11 MB/s | 5.2 MB 00:00 2024-04-14T23:53:09.474 INFO:teuthology.orchestra.run.smithi037.stdout:(34/196): python3-ceph-argparse-19.0.0-2114.ga9 1.1 MB/s | 45 kB 00:00 2024-04-14T23:53:09.533 INFO:teuthology.orchestra.run.smithi037.stdout:(35/196): python3-ceph-common-19.0.0-2114.ga9a7 2.2 MB/s | 131 kB 00:00 2024-04-14T23:53:09.600 INFO:teuthology.orchestra.run.smithi037.stdout:(36/196): python3-cephfs-19.0.0-2114.ga9a752df. 2.4 MB/s | 162 kB 00:00 2024-04-14T23:53:09.675 INFO:teuthology.orchestra.run.smithi037.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-2114. 8.0 MB/s | 615 kB 00:00 2024-04-14T23:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout:(38/196): python3-rados-19.0.0-2114.ga9a752df.e 4.2 MB/s | 320 kB 00:00 2024-04-14T23:53:09.859 INFO:teuthology.orchestra.run.smithi037.stdout:(39/196): python3-rados-debuginfo-19.0.0-2114.g 6.9 MB/s | 769 kB 00:00 2024-04-14T23:53:09.926 INFO:teuthology.orchestra.run.smithi037.stdout:(40/196): python3-rbd-19.0.0-2114.ga9a752df.el7 4.4 MB/s | 298 kB 00:00 2024-04-14T23:53:09.969 INFO:teuthology.orchestra.run.smithi029.stdout:(18/196): ceph-radosgw-debuginfo-19.0.0-2114.ga 5.4 MB/s | 179 MB 00:33 2024-04-14T23:53:10.060 INFO:teuthology.orchestra.run.smithi037.stdout:(41/196): python3-rbd-debuginfo-19.0.0-2114.ga9 8.4 MB/s | 1.1 MB 00:00 2024-04-14T23:53:10.070 INFO:teuthology.orchestra.run.smithi029.stdout:(19/196): ceph-selinux-19.0.0-2114.ga9a752df.el 252 kB/s | 25 kB 00:00 2024-04-14T23:53:10.119 INFO:teuthology.orchestra.run.smithi037.stdout:(42/196): python3-rgw-19.0.0-2114.ga9a752df.el7 1.7 MB/s | 99 kB 00:00 2024-04-14T23:53:10.202 INFO:teuthology.orchestra.run.smithi037.stdout:(43/196): python3-rgw-debuginfo-19.0.0-2114.ga9 4.0 MB/s | 337 kB 00:00 2024-04-14T23:53:10.286 INFO:teuthology.orchestra.run.smithi037.stdout:(44/196): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.0 MB/s | 85 kB 00:00 2024-04-14T23:53:10.394 INFO:teuthology.orchestra.run.smithi037.stdout:(45/196): rbd-fuse-debuginfo-19.0.0-2114.ga9a75 4.7 MB/s | 516 kB 00:00 2024-04-14T23:53:10.886 INFO:teuthology.orchestra.run.smithi037.stdout:(46/196): rbd-mirror-19.0.0-2114.ga9a752df.el7. 6.3 MB/s | 3.1 MB 00:00 2024-04-14T23:53:13.920 INFO:teuthology.orchestra.run.smithi029.stdout:(20/196): ceph-osd-debuginfo-19.0.0-2114.ga9a75 5.0 MB/s | 289 MB 00:57 2024-04-14T23:53:18.019 INFO:teuthology.orchestra.run.smithi037.stdout:(47/196): rbd-mirror-debuginfo-19.0.0-2114.ga9a 7.2 MB/s | 52 MB 00:07 2024-04-14T23:53:18.186 INFO:teuthology.orchestra.run.smithi037.stdout:(48/196): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 1.0 MB/s | 171 kB 00:00 2024-04-14T23:53:18.587 INFO:teuthology.orchestra.run.smithi037.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-2114.ga9a752 3.2 MB/s | 1.3 MB 00:00 2024-04-14T23:53:18.670 INFO:teuthology.orchestra.run.smithi037.stdout:(50/196): ceph-grafana-dashboards-19.0.0-2114.g 382 kB/s | 32 kB 00:00 2024-04-14T23:53:18.770 INFO:teuthology.orchestra.run.smithi037.stdout:(51/196): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.4 MB/s | 139 kB 00:00 2024-04-14T23:53:20.029 INFO:teuthology.orchestra.run.smithi037.stdout:(52/196): ceph-mgr-dashboard-19.0.0-2114.ga9a75 2.8 MB/s | 3.5 MB 00:01 2024-04-14T23:53:20.604 INFO:teuthology.orchestra.run.smithi029.stdout:(21/196): ceph-test-19.0.0-2114.ga9a752df.el7.x 4.5 MB/s | 48 MB 00:10 2024-04-14T23:53:20.763 INFO:teuthology.orchestra.run.smithi029.stdout:(22/196): cephfs-mirror-19.0.0-2114.ga9a752df.e 1.4 MB/s | 222 kB 00:00 2024-04-14T23:53:20.847 INFO:teuthology.orchestra.run.smithi029.stdout:(23/196): cephfs-shell-19.0.0-2114.ga9a752df.el 324 kB/s | 27 kB 00:00 2024-04-14T23:53:20.931 INFO:teuthology.orchestra.run.smithi029.stdout:(24/196): libcephfs-devel-19.0.0-2114.ga9a752df 380 kB/s | 32 kB 00:00 2024-04-14T23:53:21.164 INFO:teuthology.orchestra.run.smithi029.stdout:(25/196): libcephfs2-19.0.0-2114.ga9a752df.el7. 3.1 MB/s | 746 kB 00:00 2024-04-14T23:53:21.379 INFO:teuthology.orchestra.run.smithi037.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 5.5 MB/s | 7.4 MB 00:01 2024-04-14T23:53:21.479 INFO:teuthology.orchestra.run.smithi037.stdout:(54/196): ceph-mgr-modules-core-19.0.0-2114.ga9 2.4 MB/s | 248 kB 00:00 2024-04-14T23:53:21.563 INFO:teuthology.orchestra.run.smithi037.stdout:(55/196): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 592 kB/s | 49 kB 00:00 2024-04-14T23:53:21.648 INFO:teuthology.orchestra.run.smithi037.stdout:(56/196): ceph-prometheus-alerts-19.0.0-2114.ga 184 kB/s | 15 kB 00:00 2024-04-14T23:53:21.748 INFO:teuthology.orchestra.run.smithi037.stdout:(57/196): ceph-volume-19.0.0-2114.ga9a752df.el7 2.6 MB/s | 264 kB 00:00 2024-04-14T23:53:22.014 INFO:teuthology.orchestra.run.smithi037.stdout:(58/196): cephadm-19.0.0-2114.ga9a752df.el7.noa 2.7 MB/s | 749 kB 00:00 2024-04-14T23:53:22.098 INFO:teuthology.orchestra.run.smithi029.stdout:(26/196): libcephfs2-debuginfo-19.0.0-2114.ga9a 5.8 MB/s | 5.4 MB 00:00 2024-04-14T23:53:22.108 INFO:teuthology.orchestra.run.smithi037.stdout:(59/196): cephfs-top-19.0.0-2114.ga9a752df.el7. 219 kB/s | 18 kB 00:00 2024-04-14T23:53:22.181 INFO:teuthology.orchestra.run.smithi037.stdout:(60/196): libaio-devel-0.3.112-1.el8.x86_64.rpm 211 kB/s | 18 kB 00:00 2024-04-14T23:53:22.190 INFO:teuthology.orchestra.run.smithi029.stdout:(27/196): libcephsqlite-19.0.0-2114.ga9a752df.e 1.9 MB/s | 164 kB 00:00 2024-04-14T23:53:22.252 INFO:teuthology.orchestra.run.smithi037.stdout:(61/196): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-04-14T23:53:22.268 INFO:teuthology.orchestra.run.smithi029.stdout:(28/196): librados-devel-19.0.0-2114.ga9a752df. 1.5 MB/s | 127 kB 00:00 2024-04-14T23:53:22.324 INFO:teuthology.orchestra.run.smithi037.stdout:(62/196): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-04-14T23:53:22.364 INFO:teuthology.orchestra.run.smithi029.stdout:(29/196): librados-devel-debuginfo-19.0.0-2114. 1.2 MB/s | 109 kB 00:00 2024-04-14T23:53:22.424 INFO:teuthology.orchestra.run.smithi037.stdout:(63/196): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2024-04-14T23:53:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:(64/196): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-14T23:53:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:(65/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 218 kB 00:00 2024-04-14T23:53:22.667 INFO:teuthology.orchestra.run.smithi037.stdout:(66/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-14T23:53:22.825 INFO:teuthology.orchestra.run.smithi037.stdout:(67/196): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-04-14T23:53:22.893 INFO:teuthology.orchestra.run.smithi037.stdout:(68/196): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-14T23:53:22.959 INFO:teuthology.orchestra.run.smithi037.stdout:(69/196): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-14T23:53:23.018 INFO:teuthology.orchestra.run.smithi037.stdout:(70/196): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-14T23:53:23.101 INFO:teuthology.orchestra.run.smithi037.stdout:(71/196): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-14T23:53:24.602 INFO:teuthology.orchestra.run.smithi037.stdout:(72/196): automake-1.16.2-8.el9.noarch.rpm 459 kB/s | 689 kB 00:01 2024-04-14T23:53:25.268 INFO:teuthology.orchestra.run.smithi037.stdout:(73/196): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-04-14T23:53:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:(74/196): boost-program-options-1.75.0-8.el9.x8 257 kB/s | 107 kB 00:00 2024-04-14T23:53:25.952 INFO:teuthology.orchestra.run.smithi037.stdout:(75/196): elfutils-libelf-devel-0.190-2.el9.x86 81 kB/s | 21 kB 00:00 2024-04-14T23:53:26.836 INFO:teuthology.orchestra.run.smithi037.stdout:(76/196): flex-2.6.4-9.el9.x86_64.rpm 355 kB/s | 313 kB 00:00 2024-04-14T23:53:27.094 INFO:teuthology.orchestra.run.smithi037.stdout:(77/196): flexiblas-3.0.4-8.el9.x86_64.rpm 127 kB/s | 33 kB 00:00 2024-04-14T23:53:29.344 INFO:teuthology.orchestra.run.smithi029.stdout:(30/196): librados2-debuginfo-19.0.0-2114.ga9a7 6.5 MB/s | 45 MB 00:06 2024-04-14T23:53:29.552 INFO:teuthology.orchestra.run.smithi029.stdout:(31/196): libradosstriper1-19.0.0-2114.ga9a752d 2.3 MB/s | 501 kB 00:00 2024-04-14T23:53:30.403 INFO:teuthology.orchestra.run.smithi037.stdout:(78/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 925 kB/s | 3.0 MB 00:03 2024-04-14T23:53:30.661 INFO:teuthology.orchestra.run.smithi037.stdout:(79/196): flexiblas-openblas-openmp-3.0.4-8.el9 71 kB/s | 18 kB 00:00 2024-04-14T23:53:31.228 INFO:teuthology.orchestra.run.smithi037.stdout:(80/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 283 kB/s | 160 kB 00:00 2024-04-14T23:53:31.562 INFO:teuthology.orchestra.run.smithi037.stdout:(81/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 136 kB/s | 45 kB 00:00 2024-04-14T23:53:32.220 INFO:teuthology.orchestra.run.smithi037.stdout:(82/196): librdkafka-1.6.1-102.el9.x86_64.rpm 1.0 MB/s | 662 kB 00:00 2024-04-14T23:53:32.812 INFO:teuthology.orchestra.run.smithi037.stdout:(83/196): libtool-2.4.6-45.el9.x86_64.rpm 984 kB/s | 582 kB 00:00 2024-04-14T23:53:33.071 INFO:teuthology.orchestra.run.smithi037.stdout:(84/196): libuuid-devel-2.37.4-18.el9.x86_64.rp 99 kB/s | 25 kB 00:00 2024-04-14T23:53:33.413 INFO:teuthology.orchestra.run.smithi037.stdout:(85/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-04-14T23:53:34.288 INFO:teuthology.orchestra.run.smithi037.stdout:(86/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-04-14T23:53:34.830 INFO:teuthology.orchestra.run.smithi037.stdout:(87/196): lua-5.4.4-4.el9.x86_64.rpm 348 kB/s | 188 kB 00:00 2024-04-14T23:53:35.122 INFO:teuthology.orchestra.run.smithi037.stdout:(88/196): openblas-0.3.21-2.el9.x86_64.rpm 121 kB/s | 35 kB 00:00 2024-04-14T23:53:36.456 INFO:teuthology.orchestra.run.smithi037.stdout:(89/196): openblas-openmp-0.3.21-2.el9.x86_64.r 3.6 MB/s | 4.7 MB 00:01 2024-04-14T23:53:39.277 INFO:teuthology.orchestra.run.smithi029.stdout:(32/196): librbd1-debuginfo-19.0.0-2114.ga9a752 5.3 MB/s | 52 MB 00:09 2024-04-14T23:53:39.581 INFO:teuthology.orchestra.run.smithi037.stdout:(90/196): ceph-common-debuginfo-19.0.0-2114.ga9 3.5 MB/s | 443 MB 02:07 2024-04-14T23:53:40.344 INFO:teuthology.orchestra.run.smithi029.stdout:(33/196): librgw2-19.0.0-2114.ga9a752df.el7.x86 4.8 MB/s | 5.2 MB 00:01 2024-04-14T23:53:40.372 INFO:teuthology.orchestra.run.smithi037.stdout:(91/196): postgresql-13.14-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-04-14T23:53:40.445 INFO:teuthology.orchestra.run.smithi029.stdout:(34/196): python3-ceph-argparse-19.0.0-2114.ga9 451 kB/s | 45 kB 00:00 2024-04-14T23:53:40.545 INFO:teuthology.orchestra.run.smithi029.stdout:(35/196): python3-ceph-common-19.0.0-2114.ga9a7 1.3 MB/s | 131 kB 00:00 2024-04-14T23:53:40.638 INFO:teuthology.orchestra.run.smithi029.stdout:(36/196): python3-cephfs-19.0.0-2114.ga9a752df. 1.7 MB/s | 162 kB 00:00 2024-04-14T23:53:40.805 INFO:teuthology.orchestra.run.smithi029.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-2114. 3.6 MB/s | 615 kB 00:00 2024-04-14T23:53:40.914 INFO:teuthology.orchestra.run.smithi029.stdout:(38/196): python3-rados-19.0.0-2114.ga9a752df.e 2.9 MB/s | 320 kB 00:00 2024-04-14T23:53:41.148 INFO:teuthology.orchestra.run.smithi029.stdout:(39/196): python3-rados-debuginfo-19.0.0-2114.g 3.2 MB/s | 769 kB 00:00 2024-04-14T23:53:41.258 INFO:teuthology.orchestra.run.smithi029.stdout:(40/196): python3-rbd-19.0.0-2114.ga9a752df.el7 2.6 MB/s | 298 kB 00:00 2024-04-14T23:53:41.601 INFO:teuthology.orchestra.run.smithi029.stdout:(41/196): python3-rbd-debuginfo-19.0.0-2114.ga9 3.3 MB/s | 1.1 MB 00:00 2024-04-14T23:53:41.710 INFO:teuthology.orchestra.run.smithi029.stdout:(42/196): python3-rgw-19.0.0-2114.ga9a752df.el7 913 kB/s | 99 kB 00:00 2024-04-14T23:53:41.827 INFO:teuthology.orchestra.run.smithi029.stdout:(43/196): python3-rgw-debuginfo-19.0.0-2114.ga9 2.8 MB/s | 337 kB 00:00 2024-04-14T23:53:41.936 INFO:teuthology.orchestra.run.smithi029.stdout:(44/196): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 785 kB/s | 85 kB 00:00 2024-04-14T23:53:42.120 INFO:teuthology.orchestra.run.smithi029.stdout:(45/196): rbd-fuse-debuginfo-19.0.0-2114.ga9a75 2.7 MB/s | 516 kB 00:00 2024-04-14T23:53:42.139 INFO:teuthology.orchestra.run.smithi037.stdout:(92/196): postgresql-contrib-13.14-1.el9.x86_64 516 kB/s | 911 kB 00:01 2024-04-14T23:53:42.348 INFO:teuthology.orchestra.run.smithi037.stdout:(93/196): openssl-devel-3.0.7-27.el9.x86_64.rpm 718 kB/s | 4.1 MB 00:05 2024-04-14T23:53:42.573 INFO:teuthology.orchestra.run.smithi037.stdout:(94/196): postgresql-private-libs-13.14-1.el9.x 307 kB/s | 133 kB 00:00 2024-04-14T23:53:42.879 INFO:teuthology.orchestra.run.smithi029.stdout:(46/196): rbd-mirror-19.0.0-2114.ga9a752df.el7. 4.1 MB/s | 3.1 MB 00:00 2024-04-14T23:53:44.306 INFO:teuthology.orchestra.run.smithi037.stdout:(95/196): protobuf-3.14.0-13.el9.x86_64.rpm 596 kB/s | 1.0 MB 00:01 2024-04-14T23:53:44.648 INFO:teuthology.orchestra.run.smithi037.stdout:(96/196): python3-attrs-20.3.0-7.el9.noarch.rpm 256 kB/s | 87 kB 00:00 2024-04-14T23:53:46.332 INFO:teuthology.orchestra.run.smithi037.stdout:(97/196): postgresql-server-13.14-1.el9.x86_64. 1.5 MB/s | 5.8 MB 00:03 2024-04-14T23:53:46.798 INFO:teuthology.orchestra.run.smithi037.stdout:(98/196): python3-babel-2.9.1-2.el9.noarch.rpm 2.8 MB/s | 6.0 MB 00:02 2024-04-14T23:53:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:(99/196): python3-devel-3.9.17-2.el9.x86_64.rpm 491 kB/s | 245 kB 00:00 2024-04-14T23:53:47.091 INFO:teuthology.orchestra.run.smithi037.stdout:(100/196): python3-jsonpatch-1.21-16.el9.noarch 99 kB/s | 26 kB 00:00 2024-04-14T23:53:47.299 INFO:teuthology.orchestra.run.smithi037.stdout:(101/196): python3-jinja2-2.11.3-5.el9.noarch.r 495 kB/s | 248 kB 00:00 2024-04-14T23:53:47.358 INFO:teuthology.orchestra.run.smithi037.stdout:(102/196): python3-jsonpointer-2.0-4.el9.noarch 72 kB/s | 19 kB 00:00 2024-04-14T23:53:47.616 INFO:teuthology.orchestra.run.smithi037.stdout:(103/196): python3-markupsafe-1.1.1-12.el9.x86_ 134 kB/s | 35 kB 00:00 2024-04-14T23:53:47.808 INFO:teuthology.orchestra.run.smithi037.stdout:(104/196): python3-mako-1.1.4-6.el9.noarch.rpm 338 kB/s | 172 kB 00:00 2024-04-14T23:53:48.317 INFO:teuthology.orchestra.run.smithi037.stdout:(105/196): python3-numpy-f2py-1.20.1-5.el9.x86_ 493 kB/s | 250 kB 00:00 2024-04-14T23:53:48.817 INFO:teuthology.orchestra.run.smithi037.stdout:(106/196): python3-oauthlib-3.1.1-5.el9.noarch. 444 kB/s | 222 kB 00:00 2024-04-14T23:53:48.837 INFO:teuthology.orchestra.run.smithi029.stdout:(47/196): ceph-common-debuginfo-19.0.0-2114.ga9 3.3 MB/s | 443 MB 02:12 2024-04-14T23:53:48.959 INFO:teuthology.orchestra.run.smithi037.stdout:(107/196): python3-numpy-1.20.1-5.el9.x86_64.rp 3.8 MB/s | 5.1 MB 00:01 2024-04-14T23:53:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:(108/196): python3-packaging-20.9-5.el9.noarch. 193 kB/s | 77 kB 00:00 2024-04-14T23:53:49.309 INFO:teuthology.orchestra.run.smithi037.stdout:(109/196): python3-prettytable-0.7.2-27.el9.noa 121 kB/s | 42 kB 00:00 2024-04-14T23:53:49.530 INFO:teuthology.orchestra.run.smithi029.stdout:(48/196): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 247 kB/s | 171 kB 00:00 2024-04-14T23:53:49.743 INFO:teuthology.orchestra.run.smithi037.stdout:(110/196): python3-protobuf-3.14.0-13.el9.noarc 513 kB/s | 269 kB 00:00 2024-04-14T23:53:49.768 INFO:teuthology.orchestra.run.smithi037.stdout:(111/196): python3-pyasn1-0.4.8-6.el9.noarch.rp 346 kB/s | 159 kB 00:00 2024-04-14T23:53:50.119 INFO:teuthology.orchestra.run.smithi037.stdout:(112/196): python3-pytz-2021.1-5.el9.noarch.rpm 146 kB/s | 51 kB 00:00 2024-04-14T23:53:50.261 INFO:teuthology.orchestra.run.smithi037.stdout:(113/196): python3-pyasn1-modules-0.4.8-6.el9.n 539 kB/s | 279 kB 00:00 2024-04-14T23:53:50.405 INFO:teuthology.orchestra.run.smithi029.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-2114.ga9a752 1.5 MB/s | 1.3 MB 00:00 2024-04-14T23:53:50.461 INFO:teuthology.orchestra.run.smithi037.stdout:(114/196): python3-requests-oauthlib-1.3.0-12.e 157 kB/s | 54 kB 00:00 2024-04-14T23:53:50.720 INFO:teuthology.orchestra.run.smithi037.stdout:(115/196): python3-toml-0.10.2-6.el9.noarch.rpm 161 kB/s | 42 kB 00:00 2024-04-14T23:53:50.973 INFO:teuthology.orchestra.run.smithi029.stdout:(50/196): ceph-grafana-dashboards-19.0.0-2114.g 56 kB/s | 32 kB 00:00 2024-04-14T23:53:51.062 INFO:teuthology.orchestra.run.smithi037.stdout:(116/196): python3-wcwidth-0.2.5-8.el9.noarch.r 129 kB/s | 44 kB 00:00 2024-04-14T23:53:51.562 INFO:teuthology.orchestra.run.smithi037.stdout:(117/196): qatlib-24.02.0-1.el9.x86_64.rpm 442 kB/s | 221 kB 00:00 2024-04-14T23:53:51.623 INFO:teuthology.orchestra.run.smithi029.stdout:(51/196): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 214 kB/s | 139 kB 00:00 2024-04-14T23:53:51.821 INFO:teuthology.orchestra.run.smithi037.stdout:(118/196): qatlib-service-24.02.0-1.el9.x86_64. 139 kB/s | 36 kB 00:00 2024-04-14T23:53:52.396 INFO:teuthology.orchestra.run.smithi037.stdout:(119/196): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-04-14T23:53:52.500 INFO:teuthology.orchestra.run.smithi029.stdout:(52/196): ceph-mgr-dashboard-19.0.0-2114.ga9a75 4.0 MB/s | 3.5 MB 00:00 2024-04-14T23:53:53.121 INFO:teuthology.orchestra.run.smithi037.stdout:(120/196): socat-1.7.4.1-5.el9.x86_64.rpm 421 kB/s | 305 kB 00:00 2024-04-14T23:53:53.463 INFO:teuthology.orchestra.run.smithi037.stdout:(121/196): uuid-1.6.2-55.el9.x86_64.rpm 169 kB/s | 58 kB 00:00 2024-04-14T23:53:53.805 INFO:teuthology.orchestra.run.smithi037.stdout:(122/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 274 kB/s | 94 kB 00:00 2024-04-14T23:53:53.934 INFO:teuthology.orchestra.run.smithi029.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 5.2 MB/s | 7.4 MB 00:01 2024-04-14T23:53:54.076 INFO:teuthology.orchestra.run.smithi029.stdout:(54/196): ceph-mgr-modules-core-19.0.0-2114.ga9 1.7 MB/s | 248 kB 00:00 2024-04-14T23:53:54.155 INFO:teuthology.orchestra.run.smithi037.stdout:(123/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 64 kB 00:00 2024-04-14T23:53:54.160 INFO:teuthology.orchestra.run.smithi029.stdout:(55/196): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 591 kB/s | 49 kB 00:00 2024-04-14T23:53:54.244 INFO:teuthology.orchestra.run.smithi029.stdout:(56/196): ceph-prometheus-alerts-19.0.0-2114.ga 183 kB/s | 15 kB 00:00 2024-04-14T23:53:54.336 INFO:teuthology.orchestra.run.smithi029.stdout:(57/196): ceph-volume-19.0.0-2114.ga9a752df.el7 2.8 MB/s | 264 kB 00:00 2024-04-14T23:53:54.496 INFO:teuthology.orchestra.run.smithi029.stdout:(58/196): cephadm-19.0.0-2114.ga9a752df.el7.noa 4.6 MB/s | 749 kB 00:00 2024-04-14T23:53:54.564 INFO:teuthology.orchestra.run.smithi037.stdout:(124/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-04-14T23:53:54.579 INFO:teuthology.orchestra.run.smithi029.stdout:(59/196): cephfs-top-19.0.0-2114.ga9a752df.el7. 219 kB/s | 18 kB 00:00 2024-04-14T23:53:54.589 INFO:teuthology.orchestra.run.smithi037.stdout:(125/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 104 kB/s | 45 kB 00:00 2024-04-14T23:53:54.688 INFO:teuthology.orchestra.run.smithi029.stdout:(60/196): libaio-devel-0.3.112-1.el8.x86_64.rpm 162 kB/s | 18 kB 00:00 2024-04-14T23:53:54.831 INFO:teuthology.orchestra.run.smithi029.stdout:(61/196): fuse-2.9.9-15.el9.x86_64.rpm 566 kB/s | 80 kB 00:00 2024-04-14T23:53:54.914 INFO:teuthology.orchestra.run.smithi029.stdout:(62/196): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-04-14T23:53:55.040 INFO:teuthology.orchestra.run.smithi029.stdout:(63/196): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-04-14T23:53:55.165 INFO:teuthology.orchestra.run.smithi037.stdout:(126/196): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-04-14T23:53:55.266 INFO:teuthology.orchestra.run.smithi029.stdout:(64/196): libquadmath-11.4.1-3.el9.x86_64.rpm 867 kB/s | 195 kB 00:00 2024-04-14T23:53:55.360 INFO:teuthology.orchestra.run.smithi029.stdout:(65/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-04-14T23:53:55.757 INFO:teuthology.orchestra.run.smithi037.stdout:(127/196): abseil-cpp-20211102.0-3.el9.x86_64.r 927 kB/s | 548 kB 00:00 2024-04-14T23:53:56.185 INFO:teuthology.orchestra.run.smithi029.stdout:(66/196): rbd-mirror-debuginfo-19.0.0-2114.ga9a 3.9 MB/s | 52 MB 00:13 2024-04-14T23:53:56.219 INFO:teuthology.orchestra.run.smithi029.stdout:(67/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 295 kB/s | 253 kB 00:00 2024-04-14T23:53:56.265 INFO:teuthology.orchestra.run.smithi037.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 608 kB/s | 309 kB 00:00 2024-04-14T23:53:56.303 INFO:teuthology.orchestra.run.smithi029.stdout:(68/196): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-14T23:53:56.307 INFO:teuthology.orchestra.run.smithi037.stdout:(129/196): protobuf-compiler-3.14.0-13.el9.x86_ 503 kB/s | 863 kB 00:01 2024-04-14T23:53:56.371 INFO:teuthology.orchestra.run.smithi029.stdout:(69/196): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-14T23:53:56.429 INFO:teuthology.orchestra.run.smithi029.stdout:(70/196): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-14T23:53:56.505 INFO:teuthology.orchestra.run.smithi029.stdout:(71/196): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-04-14T23:53:56.532 INFO:teuthology.orchestra.run.smithi037.stdout:(130/196): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-14T23:53:56.631 INFO:teuthology.orchestra.run.smithi029.stdout:(72/196): python3-urllib3-1.26.5-5.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-04-14T23:53:56.715 INFO:teuthology.orchestra.run.smithi029.stdout:(73/196): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-04-14T23:53:56.782 INFO:teuthology.orchestra.run.smithi029.stdout:(74/196): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-14T23:53:56.799 INFO:teuthology.orchestra.run.smithi037.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-04-14T23:53:56.832 INFO:teuthology.orchestra.run.smithi029.stdout:(75/196): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-04-14T23:53:56.908 INFO:teuthology.orchestra.run.smithi029.stdout:(76/196): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-04-14T23:53:56.942 INFO:teuthology.orchestra.run.smithi029.stdout:(77/196): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-14T23:53:56.969 INFO:teuthology.orchestra.run.smithi029.stdout:(78/196): flexiblas-3.0.4-8.el9.x86_64.rpm 538 kB/s | 33 kB 00:00 2024-04-14T23:53:57.028 INFO:teuthology.orchestra.run.smithi029.stdout:(79/196): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-14T23:53:57.120 INFO:teuthology.orchestra.run.smithi029.stdout:(80/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-14T23:53:57.149 INFO:teuthology.orchestra.run.smithi037.stdout:(132/196): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-14T23:53:57.179 INFO:teuthology.orchestra.run.smithi029.stdout:(81/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-14T23:53:57.363 INFO:teuthology.orchestra.run.smithi029.stdout:(82/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.1 MB/s | 3.0 MB 00:00 2024-04-14T23:53:57.397 INFO:teuthology.orchestra.run.smithi029.stdout:(83/196): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-04-14T23:53:57.408 INFO:teuthology.orchestra.run.smithi037.stdout:(133/196): libarrow-9.0.0-10.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-04-14T23:53:57.456 INFO:teuthology.orchestra.run.smithi029.stdout:(84/196): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-04-14T23:53:57.491 INFO:teuthology.orchestra.run.smithi037.stdout:(134/196): libunwind-1.6.2-1.el9.x86_64.rpm 197 kB/s | 67 kB 00:00 2024-04-14T23:53:57.498 INFO:teuthology.orchestra.run.smithi029.stdout:(85/196): libtool-2.4.6-45.el9.x86_64.rpm 4.2 MB/s | 582 kB 00:00 2024-04-14T23:53:57.524 INFO:teuthology.orchestra.run.smithi029.stdout:(86/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 703 kB/s | 47 kB 00:00 2024-04-14T23:53:57.558 INFO:teuthology.orchestra.run.smithi029.stdout:(87/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 292 kB 00:00 2024-04-14T23:53:57.617 INFO:teuthology.orchestra.run.smithi029.stdout:(88/196): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-14T23:53:57.642 INFO:teuthology.orchestra.run.smithi029.stdout:(89/196): openblas-0.3.21-2.el9.x86_64.rpm 418 kB/s | 35 kB 00:00 2024-04-14T23:53:57.833 INFO:teuthology.orchestra.run.smithi037.stdout:(135/196): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-14T23:53:58.134 INFO:teuthology.orchestra.run.smithi029.stdout:(90/196): openssl-devel-3.0.7-27.el9.x86_64.rpm 8.4 MB/s | 4.1 MB 00:00 2024-04-14T23:53:58.158 INFO:teuthology.orchestra.run.smithi037.stdout:(136/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-14T23:53:58.360 INFO:teuthology.orchestra.run.smithi029.stdout:(91/196): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-04-14T23:53:58.426 INFO:teuthology.orchestra.run.smithi037.stdout:(137/196): python3-asyncssh-2.13.2-5.el9.noarch 926 kB/s | 548 kB 00:00 2024-04-14T23:53:58.479 INFO:teuthology.orchestra.run.smithi029.stdout:(92/196): postgresql-contrib-13.14-1.el9.x86_64 7.5 MB/s | 911 kB 00:00 2024-04-14T23:53:58.509 INFO:teuthology.orchestra.run.smithi037.stdout:(138/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 124 kB/s | 43 kB 00:00 2024-04-14T23:53:58.546 INFO:teuthology.orchestra.run.smithi029.stdout:(93/196): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-14T23:53:58.701 INFO:teuthology.orchestra.run.smithi037.stdout:(139/196): python3-cachetools-4.2.4-1.el9.noarc 117 kB/s | 32 kB 00:00 2024-04-14T23:53:58.705 INFO:teuthology.orchestra.run.smithi029.stdout:(94/196): openblas-openmp-0.3.21-2.el9.x86_64.r 4.4 MB/s | 4.7 MB 00:01 2024-04-14T23:53:58.768 INFO:teuthology.orchestra.run.smithi037.stdout:(140/196): python3-certifi-2021.10.8-2.el9.noar 58 kB/s | 15 kB 00:00 2024-04-14T23:53:58.956 INFO:teuthology.orchestra.run.smithi029.stdout:(95/196): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-04-14T23:53:59.014 INFO:teuthology.orchestra.run.smithi029.stdout:(96/196): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-14T23:53:59.135 INFO:teuthology.orchestra.run.smithi037.stdout:(141/196): python3-cheroot-8.6.0-4.el9.noarch.r 396 kB/s | 172 kB 00:00 2024-04-14T23:53:59.273 INFO:teuthology.orchestra.run.smithi029.stdout:(97/196): postgresql-server-13.14-1.el9.x86_64. 8.0 MB/s | 5.8 MB 00:00 2024-04-14T23:53:59.277 INFO:teuthology.orchestra.run.smithi037.stdout:(142/196): python3-cherrypy-18.6.1-2.el9.noarch 705 kB/s | 358 kB 00:00 2024-04-14T23:53:59.332 INFO:teuthology.orchestra.run.smithi029.stdout:(98/196): python3-devel-3.9.17-2.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-04-14T23:53:59.399 INFO:teuthology.orchestra.run.smithi029.stdout:(99/196): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-04-14T23:53:59.458 INFO:teuthology.orchestra.run.smithi029.stdout:(100/196): python3-jsonpatch-1.21-16.el9.noarch 437 kB/s | 26 kB 00:00 2024-04-14T23:53:59.517 INFO:teuthology.orchestra.run.smithi029.stdout:(101/196): python3-jsonpointer-2.0-4.el9.noarch 328 kB/s | 19 kB 00:00 2024-04-14T23:53:59.544 INFO:teuthology.orchestra.run.smithi037.stdout:(143/196): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-04-14T23:53:59.584 INFO:teuthology.orchestra.run.smithi029.stdout:(102/196): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-14T23:53:59.643 INFO:teuthology.orchestra.run.smithi029.stdout:(103/196): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-04-14T23:53:59.652 INFO:teuthology.orchestra.run.smithi037.stdout:(144/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 586 kB/s | 303 kB 00:00 2024-04-14T23:54:00.078 INFO:teuthology.orchestra.run.smithi037.stdout:(145/196): python3-google-auth-2.28.2-1.el9.noa 380 kB/s | 203 kB 00:00 2024-04-14T23:54:00.236 INFO:teuthology.orchestra.run.smithi029.stdout:(104/196): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-04-14T23:54:00.345 INFO:teuthology.orchestra.run.smithi029.stdout:(105/196): python3-numpy-1.20.1-5.el9.x86_64.rp 7.3 MB/s | 5.1 MB 00:00 2024-04-14T23:54:00.388 INFO:teuthology.orchestra.run.smithi029.stdout:(106/196): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.6 MB/s | 250 kB 00:00 2024-04-14T23:54:00.422 INFO:teuthology.orchestra.run.smithi029.stdout:(107/196): python3-oauthlib-3.1.1-5.el9.noarch. 2.8 MB/s | 222 kB 00:00 2024-04-14T23:54:00.457 INFO:teuthology.orchestra.run.smithi029.stdout:(108/196): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-04-14T23:54:00.482 INFO:teuthology.orchestra.run.smithi029.stdout:(109/196): python3-prettytable-0.7.2-27.el9.noa 714 kB/s | 42 kB 00:00 2024-04-14T23:54:00.503 INFO:teuthology.orchestra.run.smithi037.stdout:(146/196): python3-grpcio-tools-1.46.7-10.el9.x 340 kB/s | 144 kB 00:00 2024-04-14T23:54:00.541 INFO:teuthology.orchestra.run.smithi029.stdout:(110/196): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 159 kB 00:00 2024-04-14T23:54:00.553 INFO:teuthology.orchestra.run.smithi037.stdout:(147/196): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-04-14T23:54:00.575 INFO:teuthology.orchestra.run.smithi029.stdout:(111/196): python3-protobuf-3.14.0-13.el9.noarc 2.2 MB/s | 269 kB 00:00 2024-04-14T23:54:00.609 INFO:teuthology.orchestra.run.smithi029.stdout:(112/196): python3-pyasn1-modules-0.4.8-6.el9.n 4.0 MB/s | 279 kB 00:00 2024-04-14T23:54:00.634 INFO:teuthology.orchestra.run.smithi029.stdout:(113/196): python3-pytz-2021.1-5.el9.noarch.rpm 862 kB/s | 51 kB 00:00 2024-04-14T23:54:00.668 INFO:teuthology.orchestra.run.smithi029.stdout:(114/196): python3-requests-oauthlib-1.3.0-12.e 912 kB/s | 54 kB 00:00 2024-04-14T23:54:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:(148/196): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-14T23:54:00.727 INFO:teuthology.orchestra.run.smithi029.stdout:(115/196): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-04-14T23:54:00.786 INFO:teuthology.orchestra.run.smithi029.stdout:(116/196): python3-wcwidth-0.2.5-8.el9.noarch.r 756 kB/s | 44 kB 00:00 2024-04-14T23:54:00.837 INFO:teuthology.orchestra.run.smithi037.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 62 kB/s | 18 kB 00:00 2024-04-14T23:54:00.853 INFO:teuthology.orchestra.run.smithi029.stdout:(117/196): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-14T23:54:00.912 INFO:teuthology.orchestra.run.smithi029.stdout:(118/196): qatlib-service-24.02.0-1.el9.x86_64. 615 kB/s | 36 kB 00:00 2024-04-14T23:54:00.954 INFO:teuthology.orchestra.run.smithi037.stdout:(150/196): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-14T23:54:00.971 INFO:teuthology.orchestra.run.smithi029.stdout:(119/196): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-04-14T23:54:01.040 INFO:teuthology.orchestra.run.smithi029.stdout:(120/196): socat-1.7.4.1-5.el9.x86_64.rpm 4.3 MB/s | 305 kB 00:00 2024-04-14T23:54:01.099 INFO:teuthology.orchestra.run.smithi029.stdout:(121/196): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-04-14T23:54:01.104 INFO:teuthology.orchestra.run.smithi037.stdout:(151/196): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-04-14T23:54:01.157 INFO:teuthology.orchestra.run.smithi029.stdout:(122/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-04-14T23:54:01.208 INFO:teuthology.orchestra.run.smithi029.stdout:(123/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-14T23:54:01.221 INFO:teuthology.orchestra.run.smithi037.stdout:(152/196): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-14T23:54:01.259 INFO:teuthology.orchestra.run.smithi029.stdout:(124/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-04-14T23:54:01.309 INFO:teuthology.orchestra.run.smithi029.stdout:(125/196): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-04-14T23:54:01.435 INFO:teuthology.orchestra.run.smithi029.stdout:(126/196): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-04-14T23:54:01.580 INFO:teuthology.orchestra.run.smithi037.stdout:(153/196): python3-logutils-0.3.5-21.el9.noarch 129 kB/s | 46 kB 00:00 2024-04-14T23:54:01.780 INFO:teuthology.orchestra.run.smithi037.stdout:(154/196): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-14T23:54:01.922 INFO:teuthology.orchestra.run.smithi037.stdout:(155/196): python3-more-itertools-8.12.0-2.el9. 231 kB/s | 79 kB 00:00 2024-04-14T23:54:02.027 INFO:teuthology.orchestra.run.smithi029.stdout:(127/196): abseil-cpp-20211102.0-3.el9.x86_64.r 926 kB/s | 548 kB 00:00 2024-04-14T23:54:02.130 INFO:teuthology.orchestra.run.smithi037.stdout:(156/196): python3-natsort-7.1.1-5.el9.noarch.r 165 kB/s | 58 kB 00:00 2024-04-14T23:54:02.389 INFO:teuthology.orchestra.run.smithi037.stdout:(157/196): python3-portend-3.1.0-2.el9.noarch.r 63 kB/s | 16 kB 00:00 2024-04-14T23:54:02.431 INFO:teuthology.orchestra.run.smithi037.stdout:(158/196): python3-pecan-1.4.2-3.el9.noarch.rpm 535 kB/s | 272 kB 00:00 2024-04-14T23:54:02.628 INFO:teuthology.orchestra.run.smithi029.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 515 kB/s | 309 kB 00:00 2024-04-14T23:54:02.698 INFO:teuthology.orchestra.run.smithi037.stdout:(159/196): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-14T23:54:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:(160/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 263 kB/s | 90 kB 00:00 2024-04-14T23:54:02.895 INFO:teuthology.orchestra.run.smithi029.stdout:(129/196): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-14T23:54:02.957 INFO:teuthology.orchestra.run.smithi037.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2024-04-14T23:54:03.157 INFO:teuthology.orchestra.run.smithi037.stdout:(162/196): python3-routes-2.5.1-5.el9.noarch.rp 444 kB/s | 188 kB 00:00 2024-04-14T23:54:03.262 INFO:teuthology.orchestra.run.smithi029.stdout:(130/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-04-14T23:54:03.299 INFO:teuthology.orchestra.run.smithi037.stdout:(163/196): python3-rsa-4.9-2.el9.noarch.rpm 173 kB/s | 59 kB 00:00 2024-04-14T23:54:03.416 INFO:teuthology.orchestra.run.smithi037.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 138 kB/s | 36 kB 00:00 2024-04-14T23:54:03.530 INFO:teuthology.orchestra.run.smithi029.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-04-14T23:54:03.642 INFO:teuthology.orchestra.run.smithi037.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-14T23:54:03.872 INFO:teuthology.orchestra.run.smithi029.stdout:(132/196): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-04-14T23:54:03.917 INFO:teuthology.orchestra.run.smithi037.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 459 kB/s | 230 kB 00:00 2024-04-14T23:54:03.983 INFO:teuthology.orchestra.run.smithi037.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 262 kB/s | 90 kB 00:00 2024-04-14T23:54:04.223 INFO:teuthology.orchestra.run.smithi029.stdout:(133/196): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-14T23:54:04.242 INFO:teuthology.orchestra.run.smithi037.stdout:(168/196): python3-zc-lockfile-2.0-10.el9.noarc 77 kB/s | 20 kB 00:00 2024-04-14T23:54:04.341 INFO:teuthology.orchestra.run.smithi029.stdout:(134/196): libarrow-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-04-14T23:54:04.576 INFO:teuthology.orchestra.run.smithi037.stdout:(169/196): python3-werkzeug-2.0.3-3.el9.1.noarc 648 kB/s | 427 kB 00:00 2024-04-14T23:54:04.692 INFO:teuthology.orchestra.run.smithi029.stdout:(135/196): luarocks-3.9.2-1.el9.noarch.rpm 322 kB/s | 151 kB 00:00 2024-04-14T23:54:04.743 INFO:teuthology.orchestra.run.smithi037.stdout:(170/196): re2-20211101-3.el9.x86_64.rpm 383 kB/s | 192 kB 00:00 2024-04-14T23:54:05.026 INFO:teuthology.orchestra.run.smithi029.stdout:(136/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-14T23:54:05.327 INFO:teuthology.orchestra.run.smithi037.stdout:(171/196): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-04-14T23:54:05.343 INFO:teuthology.orchestra.run.smithi029.stdout:(137/196): python3-asyncssh-2.13.2-5.el9.noarch 842 kB/s | 548 kB 00:00 2024-04-14T23:54:05.368 INFO:teuthology.orchestra.run.smithi029.stdout:(138/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-14T23:54:05.611 INFO:teuthology.orchestra.run.smithi029.stdout:(139/196): python3-cachetools-4.2.4-1.el9.noarc 120 kB/s | 32 kB 00:00 2024-04-14T23:54:05.636 INFO:teuthology.orchestra.run.smithi029.stdout:(140/196): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-14T23:54:06.037 INFO:teuthology.orchestra.run.smithi029.stdout:(141/196): python3-cheroot-8.6.0-4.el9.noarch.r 403 kB/s | 172 kB 00:00 2024-04-14T23:54:06.154 INFO:teuthology.orchestra.run.smithi029.stdout:(142/196): python3-cherrypy-18.6.1-2.el9.noarch 693 kB/s | 358 kB 00:00 2024-04-14T23:54:06.293 INFO:teuthology.orchestra.run.smithi037.stdout:(172/196): librbd1-19.0.0-2114.ga9a752df.el7.x8 3.2 MB/s | 3.1 MB 00:00 2024-04-14T23:54:06.421 INFO:teuthology.orchestra.run.smithi029.stdout:(143/196): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-04-14T23:54:06.469 INFO:teuthology.orchestra.run.smithi037.stdout:(173/196): NetworkManager-1.47.4-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-04-14T23:54:06.547 INFO:teuthology.orchestra.run.smithi029.stdout:(144/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 595 kB/s | 303 kB 00:00 2024-04-14T23:54:06.611 INFO:teuthology.orchestra.run.smithi037.stdout:(174/196): NetworkManager-libnm-1.47.4-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-04-14T23:54:06.661 INFO:teuthology.orchestra.run.smithi037.stdout:(175/196): NetworkManager-team-1.47.4-1.el9.x86 842 kB/s | 42 kB 00:00 2024-04-14T23:54:06.736 INFO:teuthology.orchestra.run.smithi037.stdout:(176/196): NetworkManager-tui-1.47.4-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-04-14T23:54:06.798 INFO:teuthology.orchestra.run.smithi037.stdout:(177/196): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 71 kB 00:00 2024-04-14T23:54:06.840 INFO:teuthology.orchestra.run.smithi037.stdout:(178/196): elfutils-debuginfod-client-0.190-2.e 879 kB/s | 36 kB 00:00 2024-04-14T23:54:06.907 INFO:teuthology.orchestra.run.smithi037.stdout:(179/196): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-14T23:54:06.948 INFO:teuthology.orchestra.run.smithi029.stdout:(145/196): python3-google-auth-2.28.2-1.el9.noa 385 kB/s | 203 kB 00:00 2024-04-14T23:54:06.982 INFO:teuthology.orchestra.run.smithi037.stdout:(180/196): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-04-14T23:54:07.024 INFO:teuthology.orchestra.run.smithi037.stdout:(181/196): libacl-2.3.1-4.el9.x86_64.rpm 556 kB/s | 23 kB 00:00 2024-04-14T23:54:07.091 INFO:teuthology.orchestra.run.smithi037.stdout:(182/196): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-04-14T23:54:07.158 INFO:teuthology.orchestra.run.smithi037.stdout:(183/196): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-04-14T23:54:07.226 INFO:teuthology.orchestra.run.smithi037.stdout:(184/196): libmount-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 136 kB 00:00 2024-04-14T23:54:07.275 INFO:teuthology.orchestra.run.smithi037.stdout:(185/196): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-04-14T23:54:07.317 INFO:teuthology.orchestra.run.smithi037.stdout:(186/196): libuuid-2.37.4-18.el9.x86_64.rpm 689 kB/s | 29 kB 00:00 2024-04-14T23:54:07.336 INFO:teuthology.orchestra.run.smithi029.stdout:(146/196): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-04-14T23:54:07.387 INFO:teuthology.orchestra.run.smithi029.stdout:(147/196): python3-grpcio-tools-1.46.7-10.el9.x 329 kB/s | 144 kB 00:00 2024-04-14T23:54:07.443 INFO:teuthology.orchestra.run.smithi037.stdout:(187/196): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-04-14T23:54:07.521 INFO:teuthology.orchestra.run.smithi029.stdout:(148/196): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-14T23:54:07.602 INFO:teuthology.orchestra.run.smithi037.stdout:(188/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-04-14T23:54:07.647 INFO:teuthology.orchestra.run.smithi029.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 68 kB/s | 18 kB 00:00 2024-04-14T23:54:07.777 INFO:teuthology.orchestra.run.smithi037.stdout:(189/196): util-linux-2.37.4-18.el9.x86_64.rpm 13 MB/s | 2.3 MB 00:00 2024-04-14T23:54:07.789 INFO:teuthology.orchestra.run.smithi029.stdout:(150/196): python3-jaraco-collections-3.0.0-8.e 86 kB/s | 23 kB 00:00 2024-04-14T23:54:07.869 INFO:teuthology.orchestra.run.smithi037.stdout:(190/196): util-linux-core-2.37.4-18.el9.x86_64 5.0 MB/s | 465 kB 00:00 2024-04-14T23:54:07.916 INFO:teuthology.orchestra.run.smithi029.stdout:(151/196): python3-jaraco-functools-3.5.0-2.el9 72 kB/s | 19 kB 00:00 2024-04-14T23:54:07.944 INFO:teuthology.orchestra.run.smithi037.stdout:(191/196): librados2-19.0.0-2114.ga9a752df.el7. 1.1 MB/s | 3.4 MB 00:03 2024-04-14T23:54:07.961 INFO:teuthology.orchestra.run.smithi037.stdout:(192/196): util-linux-user-2.37.4-18.el9.x86_64 339 kB/s | 31 kB 00:00 2024-04-14T23:54:08.036 INFO:teuthology.orchestra.run.smithi037.stdout:(193/196): xfsdump-3.1.12-4.el9.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2024-04-14T23:54:08.058 INFO:teuthology.orchestra.run.smithi029.stdout:(152/196): python3-jaraco-text-3.2.0-6.el9.noar 73 kB/s | 20 kB 00:00 2024-04-14T23:54:08.112 INFO:teuthology.orchestra.run.smithi037.stdout:(194/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.1 MB/s | 1.1 MB 00:00 2024-04-14T23:54:08.409 INFO:teuthology.orchestra.run.smithi029.stdout:(153/196): python3-logutils-0.3.5-21.el9.noarch 132 kB/s | 46 kB 00:00 2024-04-14T23:54:08.618 INFO:teuthology.orchestra.run.smithi029.stdout:(154/196): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-14T23:54:08.752 INFO:teuthology.orchestra.run.smithi029.stdout:(155/196): python3-more-itertools-8.12.0-2.el9. 230 kB/s | 79 kB 00:00 2024-04-14T23:54:08.961 INFO:teuthology.orchestra.run.smithi029.stdout:(156/196): python3-natsort-7.1.1-5.el9.noarch.r 168 kB/s | 58 kB 00:00 2024-04-14T23:54:09.228 INFO:teuthology.orchestra.run.smithi029.stdout:(157/196): python3-portend-3.1.0-2.el9.noarch.r 62 kB/s | 16 kB 00:00 2024-04-14T23:54:09.270 INFO:teuthology.orchestra.run.smithi029.stdout:(158/196): python3-pecan-1.4.2-3.el9.noarch.rpm 526 kB/s | 272 kB 00:00 2024-04-14T23:54:09.538 INFO:teuthology.orchestra.run.smithi029.stdout:(159/196): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-14T23:54:09.579 INFO:teuthology.orchestra.run.smithi029.stdout:(160/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 256 kB/s | 90 kB 00:00 2024-04-14T23:54:09.805 INFO:teuthology.orchestra.run.smithi029.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-14T23:54:10.014 INFO:teuthology.orchestra.run.smithi029.stdout:(162/196): python3-routes-2.5.1-5.el9.noarch.rp 434 kB/s | 188 kB 00:00 2024-04-14T23:54:10.156 INFO:teuthology.orchestra.run.smithi029.stdout:(163/196): python3-rsa-4.9-2.el9.noarch.rpm 168 kB/s | 59 kB 00:00 2024-04-14T23:54:10.290 INFO:teuthology.orchestra.run.smithi029.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 130 kB/s | 36 kB 00:00 2024-04-14T23:54:10.492 INFO:teuthology.orchestra.run.smithi029.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 152 kB/s | 51 kB 00:00 2024-04-14T23:54:10.810 INFO:teuthology.orchestra.run.smithi029.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 442 kB/s | 230 kB 00:00 2024-04-14T23:54:10.960 INFO:teuthology.orchestra.run.smithi029.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 192 kB/s | 90 kB 00:00 2024-04-14T23:54:11.227 INFO:teuthology.orchestra.run.smithi029.stdout:(168/196): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-14T23:54:11.403 INFO:teuthology.orchestra.run.smithi029.stdout:(169/196): python3-werkzeug-2.0.3-3.el9.1.noarc 720 kB/s | 427 kB 00:00 2024-04-14T23:54:11.578 INFO:teuthology.orchestra.run.smithi037.stdout:(195/196): ceph-test-debuginfo-19.0.0-2114.ga9a 7.8 MB/s | 680 MB 01:26 2024-04-14T23:54:11.603 INFO:teuthology.orchestra.run.smithi037.stdout:(196/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 21 kB/s | 74 kB 00:03 2024-04-14T23:54:11.608 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:54:11.608 INFO:teuthology.orchestra.run.smithi037.stdout:Total 14 MB/s | 2.2 GB 02:42 2024-04-14T23:54:11.670 INFO:teuthology.orchestra.run.smithi029.stdout:(170/196): re2-20211101-3.el9.x86_64.rpm 433 kB/s | 192 kB 00:00 2024-04-14T23:54:12.146 INFO:teuthology.orchestra.run.smithi029.stdout:(171/196): librados2-19.0.0-2114.ga9a752df.el7. 7.1 MB/s | 3.4 MB 00:00 2024-04-14T23:54:12.205 INFO:teuthology.orchestra.run.smithi029.stdout:(172/196): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-04-14T23:54:12.480 INFO:teuthology.orchestra.run.smithi029.stdout:(173/196): NetworkManager-1.47.4-1.el9.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2024-04-14T23:54:12.564 INFO:teuthology.orchestra.run.smithi029.stdout:(174/196): librbd1-19.0.0-2114.ga9a752df.el7.x8 7.5 MB/s | 3.1 MB 00:00 2024-04-14T23:54:12.623 INFO:teuthology.orchestra.run.smithi029.stdout:(175/196): NetworkManager-team-1.47.4-1.el9.x86 714 kB/s | 42 kB 00:00 2024-04-14T23:54:12.690 INFO:teuthology.orchestra.run.smithi029.stdout:(176/196): NetworkManager-libnm-1.47.4-1.el9.x8 8.7 MB/s | 1.8 MB 00:00 2024-04-14T23:54:12.749 INFO:teuthology.orchestra.run.smithi029.stdout:(177/196): NetworkManager-tui-1.47.4-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-04-14T23:54:12.774 INFO:teuthology.orchestra.run.smithi029.stdout:(178/196): acl-2.3.1-4.el9.x86_64.rpm 849 kB/s | 71 kB 00:00 2024-04-14T23:54:12.800 INFO:teuthology.orchestra.run.smithi029.stdout:(179/196): elfutils-debuginfod-client-0.190-2.e 720 kB/s | 36 kB 00:00 2024-04-14T23:54:12.844 INFO:teuthology.orchestra.run.smithi029.stdout:(180/196): elfutils-libelf-0.190-2.el9.x86_64.r 2.7 MB/s | 192 kB 00:00 2024-04-14T23:54:12.887 INFO:teuthology.orchestra.run.smithi029.stdout:(181/196): elfutils-libs-0.190-2.el9.x86_64.rpm 2.9 MB/s | 256 kB 00:00 2024-04-14T23:54:12.904 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-14T23:54:12.912 INFO:teuthology.orchestra.run.smithi029.stdout:(182/196): libacl-2.3.1-4.el9.x86_64.rpm 342 kB/s | 23 kB 00:00 2024-04-14T23:54:12.946 INFO:teuthology.orchestra.run.smithi029.stdout:(183/196): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-14T23:54:12.972 INFO:teuthology.orchestra.run.smithi029.stdout:(184/196): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-14T23:54:13.005 INFO:teuthology.orchestra.run.smithi029.stdout:(185/196): libmount-2.37.4-18.el9.x86_64.rpm 2.2 MB/s | 136 kB 00:00 2024-04-14T23:54:13.064 INFO:teuthology.orchestra.run.smithi029.stdout:(186/196): libuuid-2.37.4-18.el9.x86_64.rpm 492 kB/s | 29 kB 00:00 2024-04-14T23:54:13.131 INFO:teuthology.orchestra.run.smithi029.stdout:(187/196): libsmartcols-2.37.4-18.el9.x86_64.rp 400 kB/s | 64 kB 00:00 2024-04-14T23:54:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-14T23:54:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-14T23:54:13.274 INFO:teuthology.orchestra.run.smithi029.stdout:(188/196): openssl-3.0.7-27.el9.x86_64.rpm 5.8 MB/s | 1.2 MB 00:00 2024-04-14T23:54:13.441 INFO:teuthology.orchestra.run.smithi029.stdout:(189/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.0 MB/s | 2.2 MB 00:00 2024-04-14T23:54:13.542 INFO:teuthology.orchestra.run.smithi029.stdout:(190/196): util-linux-2.37.4-18.el9.x86_64.rpm 8.5 MB/s | 2.3 MB 00:00 2024-04-14T23:54:13.601 INFO:teuthology.orchestra.run.smithi029.stdout:(191/196): util-linux-user-2.37.4-18.el9.x86_64 532 kB/s | 31 kB 00:00 2024-04-14T23:54:13.668 INFO:teuthology.orchestra.run.smithi029.stdout:(192/196): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2024-04-14T23:54:13.710 INFO:teuthology.orchestra.run.smithi029.stdout:(193/196): util-linux-core-2.37.4-18.el9.x86_64 1.7 MB/s | 465 kB 00:00 2024-04-14T23:54:13.771 INFO:teuthology.orchestra.run.smithi029.stdout:(194/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 74 kB 00:00 2024-04-14T23:54:13.825 INFO:teuthology.orchestra.run.smithi029.stdout:(195/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.9 MB/s | 1.1 MB 00:00 2024-04-14T23:54:24.226 INFO:teuthology.orchestra.run.smithi029.stdout:(196/196): ceph-test-debuginfo-19.0.0-2114.ga9a 9.7 MB/s | 680 MB 01:10 2024-04-14T23:54:24.229 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:54:24.229 INFO:teuthology.orchestra.run.smithi029.stdout:Total 13 MB/s | 2.2 GB 02:51 2024-04-14T23:54:25.527 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-14T23:54:25.839 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-14T23:54:25.839 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-14T23:54:27.857 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-14T23:54:27.858 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-14T23:54:40.523 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-14T23:54:40.523 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-14T23:54:47.952 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-14T23:54:50.654 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-04-14T23:54:50.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_6 2/220 2024-04-14T23:54:50.723 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-04-14T23:54:50.744 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-14T23:54:50.754 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-14T23:54:50.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-04-14T23:54:50.857 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-04-14T23:54:50.890 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-04-14T23:54:50.915 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-04-14T23:54:50.959 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-04-14T23:54:51.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-04-14T23:54:51.367 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/220 2024-04-14T23:54:51.491 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/220 2024-04-14T23:54:51.518 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 12/220 2024-04-14T23:54:51.618 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 12/220 2024-04-14T23:54:51.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 13/220 2024-04-14T23:54:51.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 14/220 2024-04-14T23:54:52.014 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-04-14T23:54:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.14-1.el9.x86_64 16/220 2024-04-14T23:54:52.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/220 2024-04-14T23:54:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/220 2024-04-14T23:54:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 18/220 2024-04-14T23:54:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 18/220 2024-04-14T23:54:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-04-14T23:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-14T23:54:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-14T23:54:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-14T23:54:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-14T23:54:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-04-14T23:54:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-04-14T23:54:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 24/220 2024-04-14T23:54:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 24/220 2024-04-14T23:54:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 25/220 2024-04-14T23:54:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 25/220 2024-04-14T23:54:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 25/220 2024-04-14T23:54:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-04-14T23:54:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-04-14T23:54:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-04-14T23:54:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-04-14T23:54:53.744 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 30/220 2024-04-14T23:54:53.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 31/220 2024-04-14T23:54:53.844 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 32/220 2024-04-14T23:54:53.877 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 33/220 2024-04-14T23:54:53.905 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 34/220 2024-04-14T23:54:53.975 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 35/220 2024-04-14T23:54:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 36/220 2024-04-14T23:54:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 37/220 2024-04-14T23:54:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 38/220 2024-04-14T23:54:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 39/220 2024-04-14T23:54:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 40/220 2024-04-14T23:54:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 41/220 2024-04-14T23:54:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 42/220 2024-04-14T23:54:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-04-14T23:54:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-04-14T23:54:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-04-14T23:54:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-04-14T23:54:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-04-14T23:54:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-04-14T23:54:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-04-14T23:54:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-04-14T23:54:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-14T23:54:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-14T23:54:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 52/220 2024-04-14T23:54:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-04-14T23:54:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 54/220 2024-04-14T23:54:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-04-14T23:54:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-04-14T23:54:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-04-14T23:54:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-04-14T23:54:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-04-14T23:54:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-04-14T23:54:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-04-14T23:54:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-04-14T23:54:56.941 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-04-14T23:54:56.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-04-14T23:54:57.008 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-04-14T23:54:57.055 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-04-14T23:54:57.090 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-04-14T23:54:57.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-04-14T23:54:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-04-14T23:54:57.324 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-04-14T23:54:57.364 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-04-14T23:54:57.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-04-14T23:54:57.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-04-14T23:54:57.542 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-04-14T23:54:57.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 75/220 2024-04-14T23:54:57.618 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-04-14T23:54:57.643 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-04-14T23:54:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-04-14T23:54:57.747 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-04-14T23:54:57.872 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-04-14T23:54:57.909 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-04-14T23:54:57.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 82/220 2024-04-14T23:54:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 83/220 2024-04-14T23:54:58.019 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/220 2024-04-14T23:54:58.059 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/220 2024-04-14T23:54:58.105 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 86/220 2024-04-14T23:54:58.148 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 87/220 2024-04-14T23:54:58.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 88/220 2024-04-14T23:54:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/220 2024-04-14T23:54:58.257 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/220 2024-04-14T23:54:58.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/220 2024-04-14T23:54:58.395 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 92/220 2024-04-14T23:54:58.435 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 93/220 2024-04-14T23:54:58.484 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 94/220 2024-04-14T23:54:58.592 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 95/220 2024-04-14T23:54:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 96/220 2024-04-14T23:54:59.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 97/220 2024-04-14T23:54:59.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 98/220 2024-04-14T23:54:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 99/220 2024-04-14T23:54:59.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 100/220 2024-04-14T23:54:59.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 101/220 2024-04-14T23:55:00.123 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 102/220 2024-04-14T23:55:00.160 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 103/220 2024-04-14T23:55:00.342 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 104/220 2024-04-14T23:55:00.366 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 105/220 2024-04-14T23:55:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 106/220 2024-04-14T23:55:00.625 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-14T23:55:01.126 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 107/220 2024-04-14T23:55:01.241 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 108/220 2024-04-14T23:55:02.526 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 109/220 2024-04-14T23:55:02.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 110/220 2024-04-14T23:55:02.629 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 111/220 2024-04-14T23:55:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 112/220 2024-04-14T23:55:02.992 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/220 2024-04-14T23:55:03.083 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/220 2024-04-14T23:55:03.114 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 114/220 2024-04-14T23:55:03.150 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 115/220 2024-04-14T23:55:03.394 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-04-14T23:55:03.439 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_6 2/220 2024-04-14T23:55:03.483 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-04-14T23:55:03.547 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-14T23:55:03.556 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-14T23:55:03.599 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-04-14T23:55:03.638 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 116/220 2024-04-14T23:55:03.653 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-04-14T23:55:03.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/220 2024-04-14T23:55:03.696 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-04-14T23:55:03.730 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-04-14T23:55:03.741 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/220 2024-04-14T23:55:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 118/220 2024-04-14T23:55:03.778 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-04-14T23:55:04.130 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-04-14T23:55:04.268 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/220 2024-04-14T23:55:04.392 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/220 2024-04-14T23:55:04.428 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 12/220 2024-04-14T23:55:04.521 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 12/220 2024-04-14T23:55:04.550 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 13/220 2024-04-14T23:55:04.608 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 14/220 2024-04-14T23:55:04.804 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-04-14T23:55:04.862 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-13.14-1.el9.x86_64 16/220 2024-04-14T23:55:04.889 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/220 2024-04-14T23:55:04.995 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/220 2024-04-14T23:55:05.025 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 18/220 2024-04-14T23:55:05.091 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 18/220 2024-04-14T23:55:05.131 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-04-14T23:55:05.154 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-14T23:55:05.170 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-14T23:55:05.331 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-14T23:55:05.379 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-14T23:55:05.420 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-04-14T23:55:05.706 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-04-14T23:55:05.819 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 24/220 2024-04-14T23:55:05.880 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 24/220 2024-04-14T23:55:06.022 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 25/220 2024-04-14T23:55:06.076 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 25/220 2024-04-14T23:55:06.216 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/220 2024-04-14T23:55:06.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/220 2024-04-14T23:55:06.677 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 25/220 2024-04-14T23:55:06.823 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/220 2024-04-14T23:55:06.862 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/220 2024-04-14T23:55:06.869 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-04-14T23:55:06.938 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/220 2024-04-14T23:55:06.938 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T23:55:06.938 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T23:55:06.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:06.963 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-04-14T23:55:06.980 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/220 2024-04-14T23:55:06.993 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-04-14T23:55:07.037 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-04-14T23:55:07.112 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 30/220 2024-04-14T23:55:07.154 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 31/220 2024-04-14T23:55:07.198 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 32/220 2024-04-14T23:55:07.247 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 33/220 2024-04-14T23:55:07.293 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-5.4.4-4.el9.x86_64 34/220 2024-04-14T23:55:07.373 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 35/220 2024-04-14T23:55:07.430 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 36/220 2024-04-14T23:55:07.484 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 37/220 2024-04-14T23:55:07.527 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 38/220 2024-04-14T23:55:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 39/220 2024-04-14T23:55:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 40/220 2024-04-14T23:55:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 41/220 2024-04-14T23:55:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 42/220 2024-04-14T23:55:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-04-14T23:55:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-04-14T23:55:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-04-14T23:55:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-04-14T23:55:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-04-14T23:55:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-04-14T23:55:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-04-14T23:55:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-04-14T23:55:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-14T23:55:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-14T23:55:09.019 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 52/220 2024-04-14T23:55:09.073 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-04-14T23:55:09.111 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 54/220 2024-04-14T23:55:09.151 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-04-14T23:55:09.412 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-04-14T23:55:09.626 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-04-14T23:55:09.714 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-04-14T23:55:09.760 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-04-14T23:55:09.893 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-04-14T23:55:09.941 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-04-14T23:55:09.997 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-04-14T23:55:10.074 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-04-14T23:55:10.111 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-04-14T23:55:10.148 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-04-14T23:55:10.197 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-04-14T23:55:10.240 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-04-14T23:55:10.293 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-04-14T23:55:10.360 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-04-14T23:55:10.502 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-04-14T23:55:10.553 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-04-14T23:55:10.592 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-04-14T23:55:10.634 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-04-14T23:55:10.731 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-04-14T23:55:10.770 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 75/220 2024-04-14T23:55:10.810 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-04-14T23:55:10.853 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-04-14T23:55:10.879 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-04-14T23:55:10.968 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-04-14T23:55:11.105 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-04-14T23:55:11.142 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-04-14T23:55:11.179 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 82/220 2024-04-14T23:55:11.215 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 83/220 2024-04-14T23:55:11.255 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/220 2024-04-14T23:55:11.288 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/220 2024-04-14T23:55:11.360 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 86/220 2024-04-14T23:55:11.396 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 87/220 2024-04-14T23:55:11.430 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 88/220 2024-04-14T23:55:11.473 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/220 2024-04-14T23:55:11.507 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/220 2024-04-14T23:55:11.597 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/220 2024-04-14T23:55:11.647 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 92/220 2024-04-14T23:55:11.680 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 93/220 2024-04-14T23:55:11.729 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 94/220 2024-04-14T23:55:11.838 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 95/220 2024-04-14T23:55:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 96/220 2024-04-14T23:55:12.662 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 97/220 2024-04-14T23:55:12.719 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 98/220 2024-04-14T23:55:12.762 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 99/220 2024-04-14T23:55:12.864 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 100/220 2024-04-14T23:55:12.950 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 101/220 2024-04-14T23:55:13.039 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 102/220 2024-04-14T23:55:13.077 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 103/220 2024-04-14T23:55:13.252 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.21-2.el9.x86_64 104/220 2024-04-14T23:55:13.275 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 105/220 2024-04-14T23:55:13.364 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 106/220 2024-04-14T23:55:14.053 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 107/220 2024-04-14T23:55:14.176 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 108/220 2024-04-14T23:55:15.481 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 109/220 2024-04-14T23:55:15.586 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 110/220 2024-04-14T23:55:15.624 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 111/220 2024-04-14T23:55:15.952 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 112/220 2024-04-14T23:55:15.988 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/220 2024-04-14T23:55:16.080 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/220 2024-04-14T23:55:16.111 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 114/220 2024-04-14T23:55:16.148 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 115/220 2024-04-14T23:55:16.635 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 116/220 2024-04-14T23:55:16.670 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/220 2024-04-14T23:55:16.742 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/220 2024-04-14T23:55:16.773 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 118/220 2024-04-14T23:55:19.143 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/220 2024-04-14T23:55:19.184 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/220 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/220 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-04-14T23:55:19.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:19.766 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/220 2024-04-14T23:55:19.817 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/220 2024-04-14T23:55:19.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/220 2024-04-14T23:55:19.889 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/220 2024-04-14T23:55:19.889 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:19.889 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T23:55:19.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:19.906 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/220 2024-04-14T23:55:19.906 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T23:55:19.906 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T23:55:19.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:19.944 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/220 2024-04-14T23:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/220 2024-04-14T23:55:21.453 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/220 2024-04-14T23:55:21.453 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:21.453 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T23:55:21.453 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:55:21.453 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:55:21.454 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:21.687 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/220 2024-04-14T23:55:21.708 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/220 2024-04-14T23:55:21.709 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:21.709 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T23:55:21.709 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:55:21.709 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:55:21.709 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:22.179 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/220 2024-04-14T23:55:22.201 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/220 2024-04-14T23:55:22.201 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:22.201 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T23:55:22.201 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:55:22.201 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:55:22.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:22.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 126/220 2024-04-14T23:55:22.368 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 127/220 2024-04-14T23:55:22.433 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 128/220 2024-04-14T23:55:22.625 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 129/220 2024-04-14T23:55:22.672 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 130/220 2024-04-14T23:55:22.753 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 131/220 2024-04-14T23:55:22.853 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 132/220 2024-04-14T23:55:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 133/220 2024-04-14T23:55:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 134/220 2024-04-14T23:55:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 135/220 2024-04-14T23:55:23.128 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 136/220 2024-04-14T23:55:23.164 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-16.el9.x86_64 137/220 2024-04-14T23:55:23.191 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 138/220 2024-04-14T23:55:23.627 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 139/220 2024-04-14T23:55:23.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 139/220 2024-04-14T23:55:23.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 140/220 2024-04-14T23:55:23.751 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 141/220 2024-04-14T23:55:23.788 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 142/220 2024-04-14T23:55:24.869 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 142/220 2024-04-14T23:55:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 143/220 2024-04-14T23:55:25.920 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 143/220 2024-04-14T23:55:25.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 144/220 2024-04-14T23:55:26.056 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 144/220 2024-04-14T23:55:26.227 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 145/220 2024-04-14T23:55:26.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 146/220 2024-04-14T23:55:26.273 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 146/220 2024-04-14T23:55:26.273 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:26.273 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T23:55:26.273 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:55:26.273 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:55:26.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:26.318 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 147/220 2024-04-14T23:55:26.328 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 147/220 2024-04-14T23:55:26.431 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 148/220 2024-04-14T23:55:31.103 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 149/220 2024-04-14T23:55:31.182 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 150/220 2024-04-14T23:55:32.091 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 151/220 2024-04-14T23:55:32.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 152/220 2024-04-14T23:55:32.147 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 152/220 2024-04-14T23:55:32.147 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:32.147 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T23:55:32.147 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:55:32.147 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:55:32.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:32.192 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 153/220 2024-04-14T23:55:32.213 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 153/220 2024-04-14T23:55:32.213 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:32.213 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T23:55:32.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:32.259 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/220 2024-04-14T23:55:32.281 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/220 2024-04-14T23:55:32.281 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:32.281 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T23:55:32.281 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:55:32.281 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:55:32.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:32.594 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 155/220 2024-04-14T23:55:32.615 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 155/220 2024-04-14T23:55:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T23:55:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:55:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:55:32.616 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:55:32.669 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 156/220 2024-04-14T23:55:32.698 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 157/220 2024-04-14T23:55:32.726 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 158/220 2024-04-14T23:55:32.918 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 159/220 2024-04-14T23:55:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 160/220 2024-04-14T23:55:33.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-04-14T23:55:33.098 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-04-14T23:55:33.141 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-04-14T23:55:33.174 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 164/220 2024-04-14T23:55:33.215 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-04-14T23:55:33.244 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/220 2024-04-14T23:55:33.308 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 167/220 2024-04-14T23:55:33.382 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-04-14T23:55:33.421 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-04-14T23:55:34.071 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-14T23:55:34.126 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-14T23:55:34.145 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-14T23:55:37.727 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/220 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-04-14T23:55:37.728 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:37.890 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/220 2024-04-14T23:55:37.905 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/220 2024-04-14T23:55:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T23:55:37.905 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:39.448 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/220 2024-04-14T23:55:39.473 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/220 2024-04-14T23:55:39.473 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:39.473 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T23:55:39.473 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:55:39.473 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:55:39.474 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:39.707 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/220 2024-04-14T23:55:39.729 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/220 2024-04-14T23:55:39.729 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:39.729 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T23:55:39.730 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:55:39.730 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:55:39.730 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:40.192 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/220 2024-04-14T23:55:40.214 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/220 2024-04-14T23:55:40.214 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:40.214 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T23:55:40.214 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:55:40.214 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:55:40.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:40.326 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.2-8.el9.noarch 126/220 2024-04-14T23:55:40.385 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 127/220 2024-04-14T23:55:40.456 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 128/220 2024-04-14T23:55:40.657 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 129/220 2024-04-14T23:55:40.718 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 130/220 2024-04-14T23:55:40.798 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 131/220 2024-04-14T23:55:40.889 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 132/220 2024-04-14T23:55:41.042 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 133/220 2024-04-14T23:55:41.086 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 134/220 2024-04-14T23:55:41.129 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 135/220 2024-04-14T23:55:41.162 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 136/220 2024-04-14T23:55:41.198 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.6-16.el9.x86_64 137/220 2024-04-14T23:55:41.235 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-15.el9.x86_64 138/220 2024-04-14T23:55:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 171/220 2024-04-14T23:55:41.674 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 139/220 2024-04-14T23:55:41.706 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 139/220 2024-04-14T23:55:41.746 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 140/220 2024-04-14T23:55:41.817 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 141/220 2024-04-14T23:55:41.847 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 142/220 2024-04-14T23:55:42.934 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 142/220 2024-04-14T23:55:42.977 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 143/220 2024-04-14T23:55:43.993 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 143/220 2024-04-14T23:55:44.029 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 144/220 2024-04-14T23:55:44.133 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 144/220 2024-04-14T23:55:44.299 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 145/220 2024-04-14T23:55:44.332 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 146/220 2024-04-14T23:55:44.354 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 146/220 2024-04-14T23:55:44.354 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:44.354 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T23:55:44.354 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:55:44.354 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:55:44.354 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:44.408 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 147/220 2024-04-14T23:55:44.419 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 147/220 2024-04-14T23:55:44.530 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 148/220 2024-04-14T23:55:49.220 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 149/220 2024-04-14T23:55:49.303 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 150/220 2024-04-14T23:55:50.218 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-45.el9.x86_64 151/220 2024-04-14T23:55:50.259 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 152/220 2024-04-14T23:55:50.281 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 152/220 2024-04-14T23:55:50.282 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:50.282 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T23:55:50.282 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:55:50.282 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:55:50.282 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:50.327 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 153/220 2024-04-14T23:55:50.348 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 153/220 2024-04-14T23:55:50.349 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:50.349 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T23:55:50.349 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:50.397 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/220 2024-04-14T23:55:50.418 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/220 2024-04-14T23:55:50.419 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:50.419 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T23:55:50.419 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:55:50.419 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:55:50.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:50.731 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 155/220 2024-04-14T23:55:50.754 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 155/220 2024-04-14T23:55:50.754 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:55:50.754 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T23:55:50.754 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:55:50.754 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:55:50.755 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:55:50.807 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 156/220 2024-04-14T23:55:50.837 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 157/220 2024-04-14T23:55:50.865 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 158/220 2024-04-14T23:55:51.056 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 159/220 2024-04-14T23:55:51.135 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 160/220 2024-04-14T23:55:51.204 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-04-14T23:55:51.271 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-04-14T23:55:51.307 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-04-14T23:55:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 164/220 2024-04-14T23:55:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-04-14T23:55:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/220 2024-04-14T23:55:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 167/220 2024-04-14T23:55:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-04-14T23:55:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-04-14T23:55:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-14T23:55:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-14T23:55:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-14T23:55:59.853 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 171/220 2024-04-14T23:56:26.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-debuginfo-2:19.0.0-2114.ga9a752df.el7. 172/220 2024-04-14T23:56:27.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-debuginfo-2:19.0.0-2114.ga9a752df.el 173/220 2024-04-14T23:56:27.270 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7. 174/220 2024-04-14T23:56:32.466 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 175/220 2024-04-14T23:56:34.924 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 176/220 2024-04-14T23:56:44.911 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-debuginfo-2:19.0.0-2114.ga9a752df.el7. 172/220 2024-04-14T23:56:45.162 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 177/220 2024-04-14T23:56:46.074 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-debuginfo-2:19.0.0-2114.ga9a752df.el 173/220 2024-04-14T23:56:46.654 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7. 174/220 2024-04-14T23:56:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 175/220 2024-04-14T23:56:54.662 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 176/220 2024-04-14T23:57:05.600 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 177/220 2024-04-14T23:57:14.816 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 178/220 2024-04-14T23:57:33.060 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 179/220 2024-04-14T23:57:35.723 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 178/220 2024-04-14T23:57:54.000 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 179/220 2024-04-14T23:58:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-2114.ga9a752df.e 180/220 2024-04-14T23:58:45.522 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-debuginfo-2:19.0.0-2114.ga9a752df.el7. 181/220 2024-04-14T23:58:45.557 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-2114.ga9a752df.el7 182/220 2024-04-14T23:58:50.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-debuginfo-2:19.0.0-2114.ga9a752df 183/220 2024-04-14T23:58:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados2-debuginfo-2:19.0.0-2114.ga9a752df.el7. 184/220 2024-04-14T23:58:56.941 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librbd1-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 185/220 2024-04-14T23:58:57.039 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-2114.ga9a752df 186/220 2024-04-14T23:58:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-debuginfo-2:19.0.0-2114.ga9a752df. 187/220 2024-04-14T23:58:57.230 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-2114.ga9a752df.el 188/220 2024-04-14T23:58:57.304 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-2114.ga9a752df.el 189/220 2024-04-14T23:59:03.205 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 190/220 2024-04-14T23:59:03.660 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-2114.ga9a752df.el7 191/220 2024-04-14T23:59:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 192/220 2024-04-14T23:59:04.910 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-04-14T23:59:05.006 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 194/220 2024-04-14T23:59:05.038 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 195/220 2024-04-14T23:59:05.064 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 196/220 2024-04-14T23:59:05.089 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-04-14T23:59:05.115 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-04-14T23:59:05.141 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-04-14T23:59:05.141 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-14T23:59:05.228 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-14T23:59:05.267 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-04-14T23:59:05.267 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-14T23:59:05.352 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-14T23:59:05.378 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-04-14T23:59:05.411 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-04-14T23:59:05.437 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-04-14T23:59:05.461 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-04-14T23:59:05.510 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-04-14T23:59:05.550 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-04-14T23:59:05.582 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-04-14T23:59:05.608 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-04-14T23:59:05.633 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-04-14T23:59:05.658 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-04-14T23:59:05.684 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-04-14T23:59:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-14T23:59:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-14T23:59:05.878 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-14T23:59:05.878 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-14T23:59:05.953 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-14T23:59:05.977 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-04-14T23:59:06.018 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-04-14T23:59:06.046 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-04-14T23:59:06.070 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-04-14T23:59:06.140 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-14T23:59:06.626 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-2114.ga9a752df.e 180/220 2024-04-14T23:59:07.232 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-debuginfo-2:19.0.0-2114.ga9a752df.el7. 181/220 2024-04-14T23:59:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-2114.ga9a752df.el7 182/220 2024-04-14T23:59:13.481 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-debuginfo-2:19.0.0-2114.ga9a752df 183/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-2114.ga9a752df.el7. 3/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 4/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-2114.ga9a752df.el 5/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_6 6/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 7/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7. 8/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 9/220 2024-04-14T23:59:15.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 11/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 12/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 13/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 14/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 15/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 16/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 17/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 18/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 19/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-2114.ga9a752df.e 20/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 21/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 22/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-2114.ga9a752df.el7. 23/220 2024-04-14T23:59:15.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 24/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 25/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 26/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 27/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-2114.ga9a752df.el7 28/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 29/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 30/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-2114.ga9a752df 31/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-debuginfo-2:19.0.0-2114.ga9a752df.el7. 32/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 33/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 34/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 35/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 36/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 37/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 38/220 2024-04-14T23:59:15.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-2114.ga9a752df 39/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 40/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-2114.ga9a752df. 41/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 42/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-2114.ga9a752df.el 43/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 44/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-2114.ga9a752df.el 45/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 46/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 47/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 48/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-2114.ga9a752df.el7 49/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 50/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 51/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 52/220 2024-04-14T23:59:15.417 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 53/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 54/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 55/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 56/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 57/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 58/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 59/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 60/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 61/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 63/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-16.el9.x86_64 64/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 65/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 66/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 67/220 2024-04-14T23:59:15.418 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 68/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 69/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 70/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 71/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 72/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 73/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 74/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 75/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 76/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 77/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 78/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 79/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 80/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/220 2024-04-14T23:59:15.419 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 82/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 83/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 84/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 85/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 86/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 87/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 88/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 89/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 90/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 91/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.14-1.el9.x86_64 93/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 94/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 95/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 96/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 97/220 2024-04-14T23:59:15.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 98/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 99/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 100/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 101/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 102/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 103/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 104/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 105/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 106/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 107/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 108/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 109/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 110/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 111/220 2024-04-14T23:59:15.421 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 112/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 113/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 115/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 116/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 117/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 118/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 119/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 120/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 121/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 122/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 123/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 124/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 125/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 126/220 2024-04-14T23:59:15.422 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 138/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-04-14T23:59:15.423 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 146/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-04-14T23:59:15.424 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-04-14T23:59:15.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 173/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 175/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 177/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 178/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 179/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 181/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 182/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 183/220 2024-04-14T23:59:15.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 184/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-4.el9.x86_64 185/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-3.el9.x86_64 186/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 187/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 188/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 189/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 190/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 191/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 192/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 193/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 194/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 195/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 196/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 197/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 198/220 2024-04-14T23:59:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 199/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 200/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 201/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 202/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 203/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 204/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 205/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 206/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 207/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 208/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 209/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 210/220 2024-04-14T23:59:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 211/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 212/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 213/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 214/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 215/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 216/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-04-14T23:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T23:59:18.665 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T23:59:18.666 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.667 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.668 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.669 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-16.el9.x86_64 2024-04-14T23:59:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.671 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T23:59:18.672 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T23:59:18.673 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T23:59:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T23:59:18.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T23:59:18.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T23:59:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T23:59:18.678 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T23:59:18.679 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T23:59:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T23:59:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:18.680 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-14T23:59:19.419 DEBUG:teuthology.parallel:result is None 2024-04-14T23:59:20.232 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados2-debuginfo-2:19.0.0-2114.ga9a752df.el7. 184/220 2024-04-14T23:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librbd1-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 185/220 2024-04-14T23:59:20.428 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-2114.ga9a752df 186/220 2024-04-14T23:59:20.567 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-debuginfo-2:19.0.0-2114.ga9a752df. 187/220 2024-04-14T23:59:20.629 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-2114.ga9a752df.el 188/220 2024-04-14T23:59:20.712 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-2114.ga9a752df.el 189/220 2024-04-14T23:59:26.584 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 190/220 2024-04-14T23:59:27.436 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-2114.ga9a752df.el7 191/220 2024-04-14T23:59:28.366 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 192/220 2024-04-14T23:59:28.509 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-04-14T23:59:28.620 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.4-9.el9.x86_64 194/220 2024-04-14T23:59:28.659 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.7.4-5.el9.x86_64 195/220 2024-04-14T23:59:28.693 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 196/220 2024-04-14T23:59:28.726 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-04-14T23:59:28.761 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-04-14T23:59:28.796 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-04-14T23:59:28.796 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-14T23:59:28.902 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-14T23:59:28.940 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-04-14T23:59:28.940 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-14T23:59:29.052 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-14T23:59:29.087 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-04-14T23:59:29.122 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-04-14T23:59:29.156 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-04-14T23:59:29.189 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-04-14T23:59:29.239 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-04-14T23:59:29.292 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-04-14T23:59:29.333 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-04-14T23:59:29.367 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-04-14T23:59:29.393 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-04-14T23:59:29.427 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-04-14T23:59:29.461 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-04-14T23:59:29.468 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-14T23:59:29.468 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-14T23:59:29.658 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-14T23:59:29.706 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-14T23:59:29.758 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-14T23:59:29.791 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-04-14T23:59:29.832 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-04-14T23:59:29.864 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-04-14T23:59:29.894 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-04-14T23:59:29.972 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-14T23:59:49.345 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-2114.ga9a752df.el7. 3/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 4/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-2114.ga9a752df.el 5/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_6 6/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 7/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7. 8/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 9/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/220 2024-04-14T23:59:49.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 11/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 12/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 13/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 14/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 15/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 16/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 17/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 18/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 19/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-2114.ga9a752df.e 20/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 21/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 22/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-2114.ga9a752df.el7. 23/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 24/220 2024-04-14T23:59:49.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 25/220 2024-04-14T23:59:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 26/220 2024-04-14T23:59:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 27/220 2024-04-14T23:59:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-2114.ga9a752df.el7 28/220 2024-04-14T23:59:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 29/220 2024-04-14T23:59:49.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 30/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-2114.ga9a752df 31/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-debuginfo-2:19.0.0-2114.ga9a752df.el7. 32/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 33/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 34/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 35/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 36/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 37/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 38/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-2114.ga9a752df 39/220 2024-04-14T23:59:49.366 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 40/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-2114.ga9a752df. 41/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 42/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-2114.ga9a752df.el 43/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 44/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-2114.ga9a752df.el 45/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 46/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x 47/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 48/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-2114.ga9a752df.el7 49/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 50/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x8 51/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 52/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 53/220 2024-04-14T23:59:49.367 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 54/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 55/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 56/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 57/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 58/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 59/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 60/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 61/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 63/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.6-16.el9.x86_64 64/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 65/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 66/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 67/220 2024-04-14T23:59:49.368 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 68/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 69/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 70/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 71/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 72/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 73/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.2-8.el9.noarch 74/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.7.4-5.el9.x86_64 75/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 76/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 77/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.4-9.el9.x86_64 78/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 79/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 80/220 2024-04-14T23:59:49.369 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 82/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 83/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 84/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 85/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 86/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 87/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 88/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-5.4.4-4.el9.x86_64 89/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 90/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 91/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-13.14-1.el9.x86_64 93/220 2024-04-14T23:59:49.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 94/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 95/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 96/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 97/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 98/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 99/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 100/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 101/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 102/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 103/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 104/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 105/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 106/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 107/220 2024-04-14T23:59:49.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 108/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 109/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 110/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 111/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 112/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 113/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 114/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 115/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 116/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 117/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 118/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 119/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 120/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 121/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 122/220 2024-04-14T23:59:49.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 123/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 124/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 125/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 126/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-04-14T23:59:49.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 138/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 146/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-04-14T23:59:49.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-04-14T23:59:49.375 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 173/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 175/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 177/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 178/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 179/220 2024-04-14T23:59:49.376 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 181/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 182/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 183/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 184/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : acl-2.3.1-4.el9.x86_64 185/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : acl-2.3.1-3.el9.x86_64 186/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 187/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 188/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 189/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 190/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 191/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 192/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 193/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 194/220 2024-04-14T23:59:49.377 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 195/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 196/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 197/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 198/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 199/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 200/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 201/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 202/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 203/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 204/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 205/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 206/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 207/220 2024-04-14T23:59:49.378 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 208/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 209/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 210/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 211/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 212/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 213/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 214/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 215/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 216/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-04-14T23:59:49.379 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-04-14T23:59:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T23:59:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.6-16.el9.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T23:59:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T23:59:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T23:59:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T23:59:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T23:59:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T23:59:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T23:59:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-debuginfo-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T23:59:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T23:59:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:52.498 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-14T23:59:53.414 DEBUG:teuthology.parallel:result is None 2024-04-14T23:59:53.415 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:59:53.630 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T23:59:53.654 INFO:teuthology.orchestra.run.smithi029.stdout:19.0.0-2114.ga9a752df.el7 2024-04-14T23:59:53.655 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-14T23:59:53.655 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-14T23:59:53.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:59:53.877 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T23:59:53.904 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-2114.ga9a752df.el7 2024-04-14T23:59:53.904 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-14T23:59:53.904 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-14T23:59:53.906 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-14T23:59:53.906 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:53.906 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T23:59:53.940 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:53.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T23:59:53.977 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-14T23:59:53.978 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:53.978 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T23:59:54.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T23:59:54.079 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:54.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T23:59:54.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T23:59:54.177 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-14T23:59:54.178 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:54.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T23:59:54.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T23:59:54.273 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:54.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T23:59:54.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T23:59:54.370 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-14T23:59:54.370 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:54.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T23:59:54.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T23:59:54.466 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:54.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T23:59:54.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T23:59:54.563 INFO:teuthology.run_tasks:Running task ceph... 2024-04-14T23:59:54.648 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-14T23:59:54.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-04-14T23:59:54.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-04-14T23:59:54.679 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-14T23:59:54.679 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T23:59:54.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T23:59:54.747 INFO:tasks.ceph:Creating extra log directories... 2024-04-14T23:59:54.748 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T23:59:54.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T23:59:54.822 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-14T23:59:54.823 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-14T23:59:54.823 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-14T23:59:54.823 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:54.823 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T23:59:54.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T23:59:54.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T23:59:55.015 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:55.015 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T23:59:55.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T23:59:55.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T23:59:55.183 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-14T23:59:55.183 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-14T23:59:55.183 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603', 'branch': 'squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7656603', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 840, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'sleep_before_teardown': 0, 'subset': '427/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg1QjYOm/XCwPoI964+rvcDmXRZJoCgq5O6XZklDrKVFZkARNlsIk0PfGQ8Egv9y3LEjQ8qW1HUjH4WohwvuhE=', 'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKoaKdSXSa5MDypAEXZKA09QF0pnbK88cIyQahnI0ihDdIDOOsadRfRxL4WIKmM83/pql8uGT3FmP8TmL3DAg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-14_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-14T23:59:55.184 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T23:59:55.186 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T23:59:55.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T23:59:55.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T23:59:55.299 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:55.299 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T23:59:55.319 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T23:59:55.319 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-04-14T23:59:55.374 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-14 23:59:30.308638511 +0000 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-14 23:50:37.234503977 +0000 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-14 23:50:37.234503977 +0000 2024-04-14T23:59:55.375 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-14 23:50:37.234503977 +0000 2024-04-14T23:59:55.375 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T23:59:55.439 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-14T23:59:55.440 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-14T23:59:55.440 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 8.3664e-05 s, 6.1 MB/s 2024-04-14T23:59:55.441 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T23:59:55.495 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-14 23:59:30.309638494 +0000 2024-04-14T23:59:55.550 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-14 23:50:37.566498245 +0000 2024-04-14T23:59:55.551 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-14 23:50:37.566498245 +0000 2024-04-14T23:59:55.551 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-14 23:50:37.566498245 +0000 2024-04-14T23:59:55.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T23:59:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-14T23:59:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-14T23:59:55.616 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.374e-05 s, 5.5 MB/s 2024-04-14T23:59:55.616 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T23:59:55.672 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-04-14T23:59:55.726 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T23:59:55.726 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:55.726 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-14T23:59:55.726 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:55.726 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:55.726 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-14 23:59:30.309638494 +0000 2024-04-14T23:59:55.727 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-14 23:50:37.914492236 +0000 2024-04-14T23:59:55.727 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-14 23:50:37.914492236 +0000 2024-04-14T23:59:55.727 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-14 23:50:37.914492236 +0000 2024-04-14T23:59:55.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T23:59:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-14T23:59:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-14T23:59:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 7.5487e-05 s, 6.8 MB/s 2024-04-14T23:59:55.793 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T23:59:55.848 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-04-14 23:59:30.309638494 +0000 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-14 23:50:38.243486556 +0000 2024-04-14T23:59:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-14 23:50:38.243486556 +0000 2024-04-14T23:59:55.903 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-04-14 23:50:38.243486556 +0000 2024-04-14T23:59:55.903 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T23:59:55.967 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-04-14T23:59:55.968 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-04-14T23:59:55.968 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.5024e-05 s, 5.4 MB/s 2024-04-14T23:59:55.969 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T23:59:56.023 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:59:56.024 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:56.024 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T23:59:56.042 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T23:59:56.042 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-14 23:59:06.495847256 +0000 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-14 23:50:36.929623607 +0000 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-14 23:50:36.929623607 +0000 2024-04-14T23:59:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-14 23:50:36.929623607 +0000 2024-04-14T23:59:56.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T23:59:56.167 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-14T23:59:56.167 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-14T23:59:56.167 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.0002181 s, 2.3 MB/s 2024-04-14T23:59:56.168 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T23:59:56.226 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-14 23:59:06.496847241 +0000 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-14 23:50:37.271618436 +0000 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-14 23:50:37.271618436 +0000 2024-04-14T23:59:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-14 23:50:37.271618436 +0000 2024-04-14T23:59:56.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T23:59:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-14T23:59:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-14T23:59:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000249199 s, 2.1 MB/s 2024-04-14T23:59:56.352 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T23:59:56.409 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-14 23:59:06.496847241 +0000 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-14 23:50:37.618613189 +0000 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-14 23:50:37.618613189 +0000 2024-04-14T23:59:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-14 23:50:37.618613189 +0000 2024-04-14T23:59:56.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T23:59:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-14T23:59:56.534 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-14T23:59:56.534 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000209522 s, 2.4 MB/s 2024-04-14T23:59:56.535 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T23:59:56.592 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-14 23:59:06.496847241 +0000 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-14 23:50:37.962607988 +0000 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-14 23:50:37.962607988 +0000 2024-04-14T23:59:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-14 23:50:37.962607988 +0000 2024-04-14T23:59:56.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T23:59:56.716 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-14T23:59:56.716 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-14T23:59:56.716 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000193825 s, 2.6 MB/s 2024-04-14T23:59:56.717 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T23:59:56.774 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T23:59:56.774 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T23:59:56.774 INFO:tasks.ceph:Generating config... 2024-04-14T23:59:56.775 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-14T23:59:56.776 INFO:tasks.ceph:[client] debug client = 20 2024-04-14T23:59:56.776 INFO:tasks.ceph:[client] debug ms = 1 2024-04-14T23:59:56.776 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-14T23:59:56.776 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-14T23:59:56.776 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-14T23:59:56.776 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-14T23:59:56.776 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-14T23:59:56.776 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-14T23:59:56.777 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-14T23:59:56.777 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-14T23:59:56.778 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-14T23:59:56.779 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-14T23:59:56.779 INFO:tasks.ceph:Setting up mon.a... 2024-04-14T23:59:56.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-14T23:59:56.836 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-04-14T23:59:56.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-14T23:59:56.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T23:59:56.914 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.37'), ('mon.c', '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]')] 2024-04-14T23:59:56.914 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-14T23:59:56.915 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:56.915 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T23:59:56.969 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.37 --addv c '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:59:57.055 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:59:57.055 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 7c8df2c3-f5a8-486a-b508-c448178a0a97 2024-04-14T23:59:57.055 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-04-14T23:59:57.055 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-04-14T23:59:57.055 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 7c8df2c3-f5a8-486a-b508-c448178a0a97 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-04-14T23:59:57.050691+0000 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-14T23:59:57.050691+0000 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 17 (quincy) 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-04-14T23:59:57.056 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-14T23:59:57.057 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T23:59:57.072 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7c8df2c3-f5a8-486a-b508-c448178a0a97... 2024-04-14T23:59:57.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T23:59:57.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-04-14T23:59:57.162 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.163 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.164 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790]" 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: mds beacon grace = 60 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: mds heartbeat grace = 60 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: osd heartbeat grace = 60 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 7c8df2c3-f5a8-486a-b508-c448178a0a97 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-04-14T23:59:57.165 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug trim objects = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-04-14T23:59:57.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore compression mode = aggressive 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-04-14T23:59:57.167 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 20 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 20 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 10 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: osd fast shutdown = False 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-04-14T23:59:57.168 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:59:57.169 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T23:59:57.170 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: mon down mkfs grace = 300 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd crush smoke test = False 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T23:59:57.171 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.e] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.f] 2024-04-14T23:59:57.172 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds balancer = 20 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: mds valgrind exit = True 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2024-04-14T23:59:57.173 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-04-14T23:59:57.174 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-04-14T23:59:57.175 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-04-14T23:59:57.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.29,172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790]" 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: mds beacon grace = 60 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: mds heartbeat grace = 60 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: osd heartbeat grace = 60 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 7c8df2c3-f5a8-486a-b508-c448178a0a97 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-04-14T23:59:57.177 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.178 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression mode = aggressive 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-14T23:59:57.179 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: osd fast shutdown = False 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-04-14T23:59:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-04-14T23:59:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-04-14T23:59:57.182 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd crush smoke test = False 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-04-14T23:59:57.183 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: mds valgrind exit = True 2024-04-14T23:59:57.184 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2024-04-14T23:59:57.185 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-04-14T23:59:57.185 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-04-14T23:59:57.185 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-04-14T23:59:57.186 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-14T23:59:57.186 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-14T23:59:57.281 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-14T23:59:57.281 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:57.281 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-14T23:59:57.296 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:57.296 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-14T23:59:57.354 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-04-14T23:59:57.354 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:57.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T23:59:57.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T23:59:57.432 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-14T23:59:57.432 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:59:57.487 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-04-14T23:59:57.487 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:57.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T23:59:57.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T23:59:57.532 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-14T23:59:57.533 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:59:57.589 INFO:tasks.ceph:Setting up mon nodes... 2024-04-14T23:59:57.589 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-14T23:59:57.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T23:59:57.644 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T23:59:57.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T23:59:57.715 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T23:59:57.718 INFO:tasks.ceph:Setting up mds nodes... 2024-04-14T23:59:57.718 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T23:59:57.773 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T23:59:57.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-14T23:59:57.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T23:59:57.896 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T23:59:57.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-14T23:59:57.925 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-14T23:59:58.020 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-14T23:59:58.023 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-14T23:59:58.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T23:59:58.113 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T23:59:58.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-14T23:59:58.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T23:59:58.243 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T23:59:58.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-14T23:59:58.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-14T23:59:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-14T23:59:58.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-14T23:59:58.396 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-14T23:59:58.397 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-14T23:59:58.439 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-14T23:59:58.454 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-14T23:59:58.455 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T23:59:58.455 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-14T23:59:58.522 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:59:58.522 INFO:tasks.ceph:role: osd.0 2024-04-14T23:59:58.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-14T23:59:58.522 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T23:59:58.587 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:59:58.587 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:59:58.588 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:59:58.620 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-14T23:59:58.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-14T23:59:58.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-14T23:59:58.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-14T23:59:58.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-14T23:59:58.831 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:59:58.832 INFO:tasks.ceph:role: osd.1 2024-04-14T23:59:58.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-14T23:59:58.832 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:59:58.898 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:59:58.931 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-14T23:59:58.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-14T23:59:58.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-14T23:59:59.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-14T23:59:59.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-14T23:59:59.143 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:59:59.143 INFO:tasks.ceph:role: osd.2 2024-04-14T23:59:59.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-14T23:59:59.143 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:59:59.209 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:59:59.242 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-14T23:59:59.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-14T23:59:59.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-14T23:59:59.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-14T23:59:59.388 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-14T23:59:59.456 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:59:59.457 INFO:tasks.ceph:role: osd.3 2024-04-14T23:59:59.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-14T23:59:59.457 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T23:59:59.523 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:59:59.523 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:59:59.523 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:59:59.523 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:59:59.523 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:59:59.524 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:59:59.524 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:59:59.524 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:59:59.524 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:59:59.524 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:59:59.556 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-04-14T23:59:59.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-04-14T23:59:59.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-14T23:59:59.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-14T23:59:59.699 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:59:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-14T23:59:59.796+0000 7f1b5ee11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-14T23:59:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-14T23:59:59.796+0000 7f1b5ee11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-14T23:59:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-14T23:59:59.796+0000 7f1b5ee11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T23:59:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-14T23:59:59.796+0000 7f1b5ee11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T23:59:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-14T23:59:59.796+0000 7f1b5ee11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T23:59:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-14T23:59:59.797+0000 7f1b5ee11640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-15T00:00:02.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T00:00:02.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:02.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:02.771+0000 7f7bff20c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-15T00:00:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:02.771+0000 7f7bff20c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-15T00:00:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:02.771+0000 7f7bff20c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T00:00:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:02.771+0000 7f7bff20c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T00:00:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:02.771+0000 7f7bff20c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T00:00:02.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:02.772+0000 7f7bff20c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-15T00:00:05.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T00:00:05.676 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:05.763+0000 7fec16328640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-15T00:00:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:05.764+0000 7fec16328640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-15T00:00:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:05.764+0000 7fec16328640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T00:00:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:05.764+0000 7fec16328640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T00:00:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:05.764+0000 7fec16328640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T00:00:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:05.764+0000 7fec16328640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-15T00:00:08.619 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T00:00:08.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:08.736+0000 7f656cc19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-15T00:00:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:08.736+0000 7f656cc19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-15T00:00:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:08.737+0000 7f656cc19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T00:00:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:08.737+0000 7f656cc19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T00:00:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:08.737+0000 7f656cc19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T00:00:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:08.737+0000 7f656cc19640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-15T00:00:11.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T00:00:11.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-15T00:00:11.656 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:00:11.656 INFO:tasks.ceph:role: osd.4 2024-04-15T00:00:11.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T00:00:11.657 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T00:00:11.735 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:00:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:00:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:00:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:00:11.736 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:00:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:00:11.736 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:00:11.736 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:00:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:00:11.736 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:00:12.252 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-15T00:00:12.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-15T00:00:12.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-15T00:00:12.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-15T00:00:12.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-15T00:00:12.465 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:00:12.466 INFO:tasks.ceph:role: osd.5 2024-04-15T00:00:12.466 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T00:00:12.466 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T00:00:12.541 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:00:12.541 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:00:12.541 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:00:12.541 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:00:12.542 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:00:12.542 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:00:12.542 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:00:12.542 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:00:12.542 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:00:12.542 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:00:13.006 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-15T00:00:13.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-15T00:00:13.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-15T00:00:13.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-15T00:00:13.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-15T00:00:13.201 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:00:13.202 INFO:tasks.ceph:role: osd.6 2024-04-15T00:00:13.202 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T00:00:13.202 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T00:00:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:00:13.276 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:00:13.276 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:00:13.276 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:00:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:00:13.276 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:00:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:00:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:00:13.277 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:00:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:00:13.767 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-15T00:00:13.769 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-15T00:00:13.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-15T00:00:13.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-15T00:00:13.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-15T00:00:14.017 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T00:00:14.017 INFO:tasks.ceph:role: osd.7 2024-04-15T00:00:14.017 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T00:00:14.017 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T00:00:14.092 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T00:00:14.602 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-15T00:00:14.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-15T00:00:14.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-15T00:00:14.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-15T00:00:14.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:14.868+0000 7f4b1fe24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-15T00:00:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:14.868+0000 7f4b1fe24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-15T00:00:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:14.868+0000 7f4b1fe24640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T00:00:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:14.868+0000 7f4b1fe24640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T00:00:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:14.868+0000 7f4b1fe24640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T00:00:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:14.869+0000 7f4b1fe24640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-15T00:00:17.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T00:00:17.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:17.847+0000 7f76ec4a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-15T00:00:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:17.847+0000 7f76ec4a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-15T00:00:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:17.847+0000 7f76ec4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T00:00:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:17.847+0000 7f76ec4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T00:00:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:17.847+0000 7f76ec4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T00:00:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:17.848+0000 7f76ec4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-15T00:00:20.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T00:00:20.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:20.819+0000 7f3c159df640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-15T00:00:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:20.819+0000 7f3c159df640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-15T00:00:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:20.819+0000 7f3c159df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T00:00:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:20.819+0000 7f3c159df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T00:00:20.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:20.819+0000 7f3c159df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T00:00:20.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:20.820+0000 7f3c159df640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-15T00:00:23.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-15T00:00:23.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:23.803+0000 7fc69a20e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-15T00:00:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:23.803+0000 7fc69a20e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-15T00:00:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:23.803+0000 7fc69a20e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T00:00:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:23.803+0000 7fc69a20e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T00:00:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:23.803+0000 7fc69a20e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T00:00:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:23.804+0000 7fc69a20e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-15T00:00:25.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:00:25.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:00:26.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-15T00:00:26.696 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-15T00:00:26.696 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:26.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-15T00:00:26.729 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:26.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-15T00:00:26.801 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:26.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-15T00:00:26.872 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:26.872 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-15T00:00:26.942 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:26.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-15T00:00:27.013 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:27.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-15T00:00:27.081 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:27.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-15T00:00:27.150 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:27.151 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-15T00:00:27.220 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-15T00:00:27.251 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-15T00:00:27.322 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-15T00:00:27.393 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-15T00:00:27.462 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-15T00:00:27.533 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-15T00:00:27.603 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-15T00:00:27.672 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:27.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-15T00:00:27.740 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:27.741 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-15T00:00:27.758 INFO:tasks.ceph:Adding keys to all mons... 2024-04-15T00:00:27.759 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T00:00:27.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T00:00:27.827 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9bRxm7uYWJhAASNlvMSqjdbEtifN79bXkwg== 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9bRxmjJjMLRAAzaEyo508PmEPvUuYU9plUQ== 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9bRxmIuQnNRAABX0nr4TkUwhwVP6YSczkcA== 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e] 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD+bRxmAuvwABAAZBMiBJfrH/eUeDTTR+58wQ== 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD/bRxmgJuKLxAAfCss/99UR1ZsiQXPw9WVeg== 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-04-15T00:00:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQACbhxmwcD+LRAAwfeYVCQCcJTn4WrvVHYkdw== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAFbhxmbNqJLRAA9PsGcWy1veOdla0RQ16niQ== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAIbhxmEpj7KxAAtJY+k1Omf9C8fPROs5ISvw== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9bRxm/p1eKhAALZuNhWHzBPK/6vFb/XQw2A== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD+bRxmy3lzBhAAnrYcldYBpWoKbvFXit6anQ== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD+bRxmBHpCDhAAjAcGtulTzwOpLExLDcZg+w== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD+bRxm26qtFRAAwmE7e2/9n1HcxqTf40C18Q== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAObhxmF3vSMxAA/Bj23Yiav780ACyBH2mT3A== 2024-04-15T00:00:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQARbhxmj2KNMhAA1l0L+d3ybyCqpznWB+3qGQ== 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAUbhxmHJXkMBAAFQiWRsJFCJENk29MZ6lfyQ== 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAXbhxmTDzyLxAARdzuXtMGJ+4ToQcQTgYjbg== 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-04-15T00:00:27.830 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD+bRxm/uLwGRAAR7w2/fXSC3wtxlGC7PvS7A== 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD9bRxm7uYWJhAASNlvMSqjdbEtifN79bXkwg== 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD9bRxmjJjMLRAAzaEyo508PmEPvUuYU9plUQ== 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD9bRxmIuQnNRAABX0nr4TkUwhwVP6YSczkcA== 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.e] 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD+bRxmAuvwABAAZBMiBJfrH/eUeDTTR+58wQ== 2024-04-15T00:00:27.832 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD/bRxmgJuKLxAAfCss/99UR1ZsiQXPw9WVeg== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQACbhxmwcD+LRAAwfeYVCQCcJTn4WrvVHYkdw== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAFbhxmbNqJLRAA9PsGcWy1veOdla0RQ16niQ== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAIbhxmEpj7KxAAtJY+k1Omf9C8fPROs5ISvw== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD9bRxm/p1eKhAALZuNhWHzBPK/6vFb/XQw2A== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD+bRxmy3lzBhAAnrYcldYBpWoKbvFXit6anQ== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD+bRxmBHpCDhAAjAcGtulTzwOpLExLDcZg+w== 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.f] 2024-04-15T00:00:27.833 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD+bRxm26qtFRAAwmE7e2/9n1HcxqTf40C18Q== 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAObhxmF3vSMxAA/Bj23Yiav780ACyBH2mT3A== 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQARbhxmj2KNMhAA1l0L+d3ybyCqpznWB+3qGQ== 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAUbhxmHJXkMBAAFQiWRsJFCJENk29MZ6lfyQ== 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAXbhxmTDzyLxAARdzuXtMGJ+4ToQcQTgYjbg== 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-15T00:00:27.834 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD+bRxm/uLwGRAAR7w2/fXSC3wtxlGC7PvS7A== 2024-04-15T00:00:27.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:00:27.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:00:27.929 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:27.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:27.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:27.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:00:28.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T00:00:28.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.482 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T00:00:28.538 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.700 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T00:00:28.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T00:00:28.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T00:00:28.811 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-15T00:00:28.812 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-15T00:00:28.838 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T00:00:28.935 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-15T00:00:28.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-15T00:00:28.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T00:00:29.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-15T00:00:29.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-15T00:00:29.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T00:00:29.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-15T00:00:29.302 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:29.304 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T00:00:29.357 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-15T00:00:29.357 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T00:00:29.357 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-15T00:00:29.357 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-15T00:00:29.359 INFO:tasks.ceph.mon.a:Started 2024-04-15T00:00:29.360 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T00:00:29.360 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-15T00:00:29.360 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-15T00:00:29.399 INFO:tasks.ceph.mon.b:Started 2024-04-15T00:00:29.399 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T00:00:29.399 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-15T00:00:29.400 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-15T00:00:29.402 INFO:tasks.ceph.mon.c:Started 2024-04-15T00:00:29.403 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-15T00:00:29.403 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-15T00:00:29.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-15T00:00:29.405 INFO:tasks.ceph.mgr.y:Started 2024-04-15T00:00:29.406 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-15T00:00:29.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-15T00:00:29.408 INFO:tasks.ceph.mgr.x:Started 2024-04-15T00:00:29.408 INFO:tasks.ceph:Setting crush tunables to default 2024-04-15T00:00:29.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-04-15T00:00:29.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.504+0000 7ff4c5bfa640 1 Processor -- start 2024-04-15T00:00:29.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.504+0000 7ff4c5bfa640 1 -- start start 2024-04-15T00:00:29.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4c5bfa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 0x7ff4c015b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4c5bfa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 0x7ff4c00ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4c5bfa640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c015ba10 con 0x7ff4c00ca470 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4c5bfa640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c0154cc0 con 0x7ff4c00cca40 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4c5bfa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c015c5b0 con 0x7ff4c015ac30 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4beffd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff4c00ca470 legacy=0x7ff4c00cc330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 msgr2=0x7ff4c00ca8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 0x7ff4c00ca8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4bf7fe640 1 -- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 msgr2=0x7ff4c015b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3300/0 2024-04-15T00:00:29.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.505+0000 7ff4bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 0x7ff4c015b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:29.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.706+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 msgr2=0x7ff4c00ca8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:29.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.706+0000 7ff4beffd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff4c00ca470 legacy=0x7ff4c00cc330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-15T00:00:29.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.706+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 0x7ff4c00ca8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:29.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.706+0000 7ff4bf7fe640 1 -- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 msgr2=0x7ff4c015b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3300/0 2024-04-15T00:00:29.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:29.706+0000 7ff4bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 0x7ff4c015b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:30.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.107+0000 7ff4beffd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff4c00ca470 legacy=0x7ff4c00cc330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-15T00:00:30.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.107+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 msgr2=0x7ff4c00ca8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:30.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.107+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 0x7ff4c00ca8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T00:00:30.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.107+0000 7ff4bf7fe640 1 -- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 msgr2=0x7ff4c015b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3300/0 2024-04-15T00:00:30.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.107+0000 7ff4bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 0x7ff4c015b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T00:00:30.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.908+0000 7ff4beffd640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff4c00ca470 legacy=0x7ff4c00cc330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.29:6789/0 2024-04-15T00:00:30.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.908+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 msgr2=0x7ff4c00ca8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:30.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.908+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 0x7ff4c00ca8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T00:00:30.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.908+0000 7ff4bf7fe640 1 -- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 msgr2=0x7ff4c015b010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3300/0 2024-04-15T00:00:30.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:30.908+0000 7ff4bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 0x7ff4c015b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T00:00:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 -- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 msgr2=0x7ff4c015b010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4c015ac30 0x7ff4c015b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 msgr2=0x7ff4c00ca8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c00cca40 0x7ff4c00ca8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 -- >> v1:172.21.15.29:6789/0 conn(0x7ff4c00ca470 legacy=0x7ff4c00cc330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c015bc80 con 0x7ff4a00061b0 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bd7fa640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c0154cc0 con 0x7ff4a0003690 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a00061b0 legacy=0x7ff4a0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.505+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.706+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a00061b0 legacy=0x7ff4a0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.706+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:32.706+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:33.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:33.107+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:33.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:33.107+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a00061b0 legacy=0x7ff4a0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:33.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:33.107+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T00:00:33.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:33.908+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:33.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:33.908+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a00061b0 legacy=0x7ff4a0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:33.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:33.908+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T00:00:35.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a00061b0 legacy=0x7ff4a0008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bffff640 1 -- reap_dead start 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 0x7ff4a000a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c015ba10 con 0x7ff4a0009f50 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c0154cc0 con 0x7ff4a000a3b0 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bd7fa640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c015c5b0 con 0x7ff4a0003690 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a0009f50 legacy=0x7ff4a00085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.505+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:35.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.706+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:35.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.706+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a0009f50 legacy=0x7ff4a00085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:35.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.706+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:35.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.706+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:35.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:35.706+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:36.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.107+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:36.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.107+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T00:00:36.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.107+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a0009f50 legacy=0x7ff4a00085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:36.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.107+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:36.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.107+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T00:00:36.769 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:00:07.282 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:00:36.819 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:00:07.312 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:00:36.819 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:00:07.312 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:00:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.908+0000 7ff4bffff640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.29:3300/0 2024-04-15T00:00:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.908+0000 7ff4bffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T00:00:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.908+0000 7ff4beffd640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a0009f50 legacy=0x7ff4a00085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.37:6789/0 2024-04-15T00:00:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.908+0000 7ff4bf7fe640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.37:3301/0 2024-04-15T00:00:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:36.908+0000 7ff4bf7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T00:00:37.096 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:00:07.609 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:00:37.146 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:00:07.639 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:00:37.149 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:00:07.641 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 -- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 -- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4a000a3b0 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 -- >> v1:172.21.15.37:6789/0 conn(0x7ff4a0009f50 legacy=0x7ff4a00085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c015bc80 con 0x7ff4a000d1f0 2024-04-15T00:00:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.505+0000 7ff4bd7fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c0154cc0 con 0x7ff4a00112b0 2024-04-15T00:00:38.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.597+0000 7ff4bf7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff4a000d1f0 0x7ff4a000d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:41924/0 (socket says 172.21.15.29:41924) 2024-04-15T00:00:38.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.597+0000 7ff4bf7fe640 1 -- 172.21.15.29:0/360303068 learned_addr learned my addr 172.21.15.29:0/360303068 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:00:38.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.747+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.805+0000 7ff4bf7fe640 1 -- 172.21.15.29:0/360303068 >> v1:172.21.15.29:6789/0 conn(0x7ff4a000d1f0 legacy=0x7ff4a000d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-15T00:00:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.805+0000 7ff4bf7fe640 1 -- 172.21.15.29:0/360303068 >> v1:172.21.15.29:6789/0 conn(0x7ff4a000d1f0 legacy=0x7ff4a000d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.805+0000 7ff4bf7fe640 1 --1- 172.21.15.29:0/360303068 >> v1:172.21.15.29:6789/0 conn(0x7ff4a000d1f0 0x7ff4a000d600 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-04-15T00:00:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.915+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.915+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.915+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:38.915+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:39.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.329+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:39.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.332+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:39.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.332+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:39.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.332+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:39.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.332+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.738+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:39.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.855+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:39.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.855+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:39.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.855+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:39.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:39.855+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-15T00:00:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:40.656+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:40.657+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:40.657+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:40.657+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:40.657+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-15T00:00:41.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 msgr2=0x7ff4a00136a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:41.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a00112b0 0x7ff4a00136a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:41.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 -- 172.21.15.29:0/360303068 >> v1:172.21.15.29:6789/0 conn(0x7ff4a000d1f0 legacy=0x7ff4a000d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:41.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 reap_dead start 2024-04-15T00:00:41.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:41.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:41.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 -- 172.21.15.29:0/360303068 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c015ba10 con 0x7ff4a0013be0 2024-04-15T00:00:41.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 -- 172.21.15.29:0/360303068 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c0154cc0 con 0x7ff4a000d600 2024-04-15T00:00:41.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.506+0000 7ff4bd7fa640 1 -- 172.21.15.29:0/360303068 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c015c5b0 con 0x7ff4a0003690 2024-04-15T00:00:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.640+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:41.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.665+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:41.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.666+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-15T00:00:41.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.666+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:41.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.666+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:41.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.666+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.691+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.691+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.691+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:41.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.691+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:00:41.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.867+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:41.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.872+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:41.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.872+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:41.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.872+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:41.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.872+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:41.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.894+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:41.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.895+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-15T00:00:41.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.895+0000 7ff4beffd640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T00:00:41.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.895+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-15T00:00:41.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:41.895+0000 7ff4beffd640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-15T00:00:42.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.028+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949787817 0 0) 0x7ff4c015ba10 con 0x7ff4a0013be0 2024-04-15T00:00:42.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.028+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4ac003520 con 0x7ff4a0013be0 2024-04-15T00:00:42.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.097+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1994306965 0 0) 0x7ff4ac003520 con 0x7ff4a0013be0 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a000a860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4a000a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 msgr2=0x7ff4a0005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 --2- 172.21.15.29:0/360303068 >> v2:172.21.15.37:3300/0 conn(0x7ff4a000d600 0x7ff4a0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a0011690 con 0x7ff4a0013be0 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1744880889 0 0) 0x7ff4a80040e0 con 0x7ff4a0013be0 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 >> v1:172.21.15.29:6789/0 conn(0x7ff4a0013be0 legacy=0x7ff4a0015fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4ac003fe0 0x7ff4ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0154cc0 con 0x7ff4ac003fe0 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015c5b0 con 0x7ff4ac004d40 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac00bbd0 con 0x7ff4a0003690 2024-04-15T00:00:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.098+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:42.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.115+0000 7ff4bf7fe640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:42.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.150+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:42.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.150+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4a0003690 0x7ff4ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.150+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4ac003fe0 msgr2=0x7ff4ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:42.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.150+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4ac003fe0 0x7ff4ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.150+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac003520 con 0x7ff4ac004d40 2024-04-15T00:00:42.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.153+0000 7ff4bffff640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00b0ce0 tx=0x7ff4ac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94b0174716fd46e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:42.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.183+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b803a070 con 0x7ff4ac004d40 2024-04-15T00:00:42.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.240+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b80353b0 con 0x7ff4ac004d40 2024-04-15T00:00:42.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.240+0000 7ff4be7fc640 1 -- 172.21.15.29:0/360303068 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8032070 con 0x7ff4ac004d40 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac004d40 msgr2=0x7ff4ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4c5bfa640 1 --2- 172.21.15.29:0/360303068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4ac004d40 0x7ff4ac0051c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00b0ce0 tx=0x7ff4ac005830 comp rx=0 tx=0).stop 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4bffff640 1 -- 172.21.15.29:0/360303068 reap_dead start 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/360303068 shutdown_connections 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/360303068 >> 172.21.15.29:0/360303068 conn(0x7ff4c00cfaf0 msgr2=0x7ff4c00cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/360303068 shutdown_connections 2024-04-15T00:00:42.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.241+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/360303068 wait complete. 2024-04-15T00:00:42.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.242+0000 7ff4c5bfa640 1 Processor -- start 2024-04-15T00:00:42.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.242+0000 7ff4c5bfa640 1 -- start start 2024-04-15T00:00:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.243+0000 7ff4c5bfa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4c01ef920 0x7ff4c01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.243+0000 7ff4c5bfa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 0x7ff4c00b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.243+0000 7ff4c5bfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c01efd00 0x7ff4c01f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.243+0000 7ff4c5bfa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c00ccec0 con 0x7ff4c00c4850 2024-04-15T00:00:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.243+0000 7ff4c5bfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c015c240 con 0x7ff4c01efd00 2024-04-15T00:00:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.243+0000 7ff4c5bfa640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c00ca8b0 con 0x7ff4c01ef920 2024-04-15T00:00:42.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.246+0000 7ff4beffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 0x7ff4c00b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.247+0000 7ff4beffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 0x7ff4c00b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48810/0 (socket says 172.21.15.29:48810) 2024-04-15T00:00:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.247+0000 7ff4beffd640 1 -- 172.21.15.29:0/12825540 learned_addr learned my addr 172.21.15.29:0/12825540 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.251+0000 7ff4beffd640 1 -- 172.21.15.29:0/12825540 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4c01ef920 msgr2=0x7ff4c01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.251+0000 7ff4beffd640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4c01ef920 0x7ff4c01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.251+0000 7ff4beffd640 1 -- 172.21.15.29:0/12825540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c01efd00 msgr2=0x7ff4c01f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.251+0000 7ff4beffd640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c01efd00 0x7ff4c01f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.251+0000 7ff4beffd640 1 -- 172.21.15.29:0/12825540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c015a590 con 0x7ff4c00c4850 2024-04-15T00:00:42.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.302+0000 7ff4beffd640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 0x7ff4c00b3230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000bdc0 tx=0x7ff4b0006490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:42.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.308+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b001d070 con 0x7ff4c00c4850 2024-04-15T00:00:42.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.308+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b0019440 con 0x7ff4c00c4850 2024-04-15T00:00:42.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.308+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c00b2860 con 0x7ff4c00c4850 2024-04-15T00:00:42.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.308+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0019810 con 0x7ff4c00c4850 2024-04-15T00:00:42.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.308+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c0156a00 con 0x7ff4c00c4850 2024-04-15T00:00:42.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.309+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c004f540 con 0x7ff4c00c4850 2024-04-15T00:00:42.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.483+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4b0020070 con 0x7ff4c00c4850 2024-04-15T00:00:42.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.483+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff4b0022450 con 0x7ff4c00c4850 2024-04-15T00:00:42.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.483+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff4b00183a0 con 0x7ff4c00c4850 2024-04-15T00:00:42.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.565+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff4c00b10a0 con 0x7ff4c00c4850 2024-04-15T00:00:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.666+0000 7ff4b7fff640 1 -- 172.21.15.29:0/12825540 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff4b002c480 con 0x7ff4c00c4850 2024-04-15T00:00:42.672 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-04-15T00:00:42.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 msgr2=0x7ff4c00b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:42.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 0x7ff4c00b3230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000bdc0 tx=0x7ff4b0006490 comp rx=0 tx=0).stop 2024-04-15T00:00:42.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 shutdown_connections 2024-04-15T00:00:42.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c01efd00 0x7ff4c01f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c00c4850 0x7ff4c00b3230 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 --2- 172.21.15.29:0/12825540 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff4c01ef920 0x7ff4c01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:42.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 >> 172.21.15.29:0/12825540 conn(0x7ff4c00cfaf0 msgr2=0x7ff4c00cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:42.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 shutdown_connections 2024-04-15T00:00:42.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:42.667+0000 7ff4c5bfa640 1 -- 172.21.15.29:0/12825540 wait complete. 2024-04-15T00:00:42.684 INFO:tasks.ceph:check_enable_crimson: False 2024-04-15T00:00:42.684 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-15T00:00:42.684 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:42.685 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-15T00:00:42.712 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:42.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-15T00:00:42.771 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:42.765+0000 7ff929211040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T00:00:42.782 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:42.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-15T00:00:42.827 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:42.822+0000 7ff929211040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T00:00:42.836 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:42.830+0000 7fd7dfe2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T00:00:42.849 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:00:42.849 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-15T00:00:42.893 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:42.887+0000 7fd7dfe2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T00:00:42.916 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:42.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-15T00:00:42.943 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:42.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-15T00:00:43.014 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:43.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-15T00:00:43.082 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-15T00:00:43.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-15T00:00:43.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 0bce49bb-205a-47bd-9904-979946c75e11 0 2024-04-15T00:00:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.285+0000 7ff411db4640 1 Processor -- start 2024-04-15T00:00:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.285+0000 7ff411db4640 1 -- start start 2024-04-15T00:00:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.286+0000 7ff411db4640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff40c0c7ce0 0x7ff40c163bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.286+0000 7ff411db4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c0c8110 con 0x7ff40c1415e0 2024-04-15T00:00:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.286+0000 7ff411db4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c158930 con 0x7ff40c0cc860 2024-04-15T00:00:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.286+0000 7ff411db4640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c15c1e0 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.287+0000 7ff40bfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff40c0c7ce0 0x7ff40c163bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.287+0000 7ff40affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff40c0cc860 0x7ff40c0c5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47416/0 (socket says 172.21.15.37:47416) 2024-04-15T00:00:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.287+0000 7ff40affd640 1 -- 172.21.15.37:0/3286021789 learned_addr learned my addr 172.21.15.37:0/3286021789 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:43.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.290+0000 7ff40a7fc640 1 -- 172.21.15.37:0/3286021789 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575394144 0 0) 0x7ff40c158930 con 0x7ff40c0cc860 2024-04-15T00:00:43.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.290+0000 7ff40a7fc640 1 -- 172.21.15.37:0/3286021789 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3f8003520 con 0x7ff40c0cc860 2024-04-15T00:00:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.290+0000 7ff40bfff640 1 -- 172.21.15.37:0/3286021789 >> v1:172.21.15.37:6789/0 conn(0x7ff40c0cc860 legacy=0x7ff40c0c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.290+0000 7ff40bfff640 1 -- 172.21.15.37:0/3286021789 >> v1:172.21.15.29:6789/0 conn(0x7ff40c1415e0 legacy=0x7ff40c158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.290+0000 7ff40bfff640 1 -- 172.21.15.37:0/3286021789 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c0cd480 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.294+0000 7ff40bfff640 1 --2- 172.21.15.37:0/3286021789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c163bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff404009d90 tx=0x7ff40402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2031bd42c26dec7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff40a7fc640 1 -- 172.21.15.37:0/3286021789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404039070 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff40a7fc640 1 -- 172.21.15.37:0/3286021789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40402cd80 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff40a7fc640 1 -- 172.21.15.37:0/3286021789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404034660 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 -- 172.21.15.37:0/3286021789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 msgr2=0x7ff40c163bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 --2- 172.21.15.37:0/3286021789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c163bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff404009d90 tx=0x7ff40402bfd0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 -- 172.21.15.37:0/3286021789 shutdown_connections 2024-04-15T00:00:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 --2- 172.21.15.37:0/3286021789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c163bb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 -- 172.21.15.37:0/3286021789 >> 172.21.15.37:0/3286021789 conn(0x7ff40c06c310 msgr2=0x7ff40c06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 -- 172.21.15.37:0/3286021789 shutdown_connections 2024-04-15T00:00:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.300+0000 7ff411db4640 1 -- 172.21.15.37:0/3286021789 wait complete. 2024-04-15T00:00:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 Processor -- start 2024-04-15T00:00:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 -- start start 2024-04-15T00:00:43.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff40c0cc860 0x7ff40c1f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c1415e0 0x7ff40c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c15be70 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c15bb90 con 0x7ff40c1415e0 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.302+0000 7ff411db4640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff40c06dbe0 con 0x7ff40c0cc860 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.303+0000 7ff40bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c1415e0 0x7ff40c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.303+0000 7ff40affd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff40c0cc860 0x7ff40c1f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.303+0000 7ff40b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.303+0000 7ff40b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c1547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.37:45320/0 (socket says 172.21.15.37:45320) 2024-04-15T00:00:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.303+0000 7ff40b7fe640 1 -- 172.21.15.37:0/2900023191 learned_addr learned my addr 172.21.15.37:0/2900023191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.307+0000 7ff40b7fe640 1 -- 172.21.15.37:0/2900023191 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff40c0cc860 msgr2=0x7ff40c1f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.307+0000 7ff40b7fe640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff40c0cc860 0x7ff40c1f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.307+0000 7ff40b7fe640 1 -- 172.21.15.37:0/2900023191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c1415e0 msgr2=0x7ff40c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.307+0000 7ff40b7fe640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c1415e0 0x7ff40c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.307+0000 7ff40b7fe640 1 -- 172.21.15.37:0/2900023191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c156760 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.309+0000 7ff40b7fe640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c1547c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400c400 tx=0x7ff3f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.312+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40052d0 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.312+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4005490 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.312+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4007260 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.312+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c156a40 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.313+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c13c550 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.314+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c0cd800 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.316+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff3f4007400 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.316+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ff3f4003a40 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.443 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.437+0000 7ff929211040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T00:00:43.500 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.494+0000 7ff929211040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T00:00:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.495+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff40c0cd800 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.502 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.496+0000 7fd7dfe2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T00:00:43.561 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.555+0000 7fd7dfe2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T00:00:43.577 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.571+0000 7ff929211040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T00:00:43.609 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.603+0000 7fd7dfe2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T00:00:43.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.656+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0bce49bb-205a-47bd-9904-979946c75e11", "id": 0} v 0) -- 0x7ff40c141140 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.666 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.660+0000 7fd7dfe2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T00:00:43.666 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.661+0000 7ff929211040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T00:00:43.710 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.705+0000 7ff929211040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T00:00:43.711 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.705+0000 7fd7dfe2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T00:00:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.749+0000 7ff403fff640 1 -- 172.21.15.37:0/2900023191 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0bce49bb-205a-47bd-9904-979946c75e11", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ff40c141140 con 0x7ff40c0c7ce0 2024-04-15T00:00:43.755 INFO:teuthology.orchestra.run.smithi037.stdout:0 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 msgr2=0x7ff40c1547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c1547c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400c400 tx=0x7ff3f400c8c0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 shutdown_connections 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c1415e0 0x7ff40c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff40c0cc860 0x7ff40c1f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 --2- 172.21.15.37:0/2900023191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c0c7ce0 0x7ff40c1547c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 >> 172.21.15.37:0/2900023191 conn(0x7ff40c06c310 msgr2=0x7ff40c06c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 shutdown_connections 2024-04-15T00:00:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.750+0000 7ff411db4640 1 -- 172.21.15.37:0/2900023191 wait complete. 2024-04-15T00:00:43.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new c80833ab-3af5-4b2d-90a3-20dc0982406b 1 2024-04-15T00:00:43.834 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.828+0000 7fd7dfe2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T00:00:43.841 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.836+0000 7ff929211040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T00:00:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.866+0000 7f58ef00f640 1 Processor -- start 2024-04-15T00:00:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.866+0000 7f58ef00f640 1 -- start start 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.867+0000 7f58ef00f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58e815ac30 0x7f58e815b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.867+0000 7f58ef00f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e815ba10 con 0x7f58e80ca470 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.867+0000 7f58ef00f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e815bc80 con 0x7f58e80cca40 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.867+0000 7f58ef00f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f58e8154cc0 con 0x7f58e815ac30 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.867+0000 7f58ecdab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58e815ac30 0x7f58e815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.868+0000 7f58e7fff640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f58e80ca470 0x7f58e80cc330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.37:46062/0 (socket says 172.21.15.37:46062) 2024-04-15T00:00:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.868+0000 7f58e7fff640 1 -- 172.21.15.37:0/3858697485 learned_addr learned my addr 172.21.15.37:0/3858697485 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.870+0000 7f58ecdab640 1 -- 172.21.15.37:0/3858697485 >> v1:172.21.15.37:6789/0 conn(0x7f58e80cca40 legacy=0x7f58e815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.870+0000 7f58ecdab640 1 -- 172.21.15.37:0/3858697485 >> v1:172.21.15.29:6789/0 conn(0x7f58e80ca470 legacy=0x7f58e80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.870+0000 7f58ecdab640 1 -- 172.21.15.37:0/3858697485 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e815bf60 con 0x7f58e815ac30 2024-04-15T00:00:43.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.872+0000 7f58ecdab640 1 --2- 172.21.15.37:0/3858697485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e815ac30 0x7f58e815b010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58e8154e40 tx=0x7f58d002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b199678756550708 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.879+0000 7f58e77fe640 1 -- 172.21.15.37:0/3858697485 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0034070 con 0x7f58e815ac30 2024-04-15T00:00:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.879+0000 7f58e77fe640 1 -- 172.21.15.37:0/3858697485 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d0030610 con 0x7f58e815ac30 2024-04-15T00:00:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.879+0000 7f58e77fe640 1 -- 172.21.15.37:0/3858697485 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d00309e0 con 0x7f58e815ac30 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 -- 172.21.15.37:0/3858697485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e815ac30 msgr2=0x7f58e815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 --2- 172.21.15.37:0/3858697485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e815ac30 0x7f58e815b010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58e8154e40 tx=0x7f58d002b960 comp rx=0 tx=0).stop 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 -- 172.21.15.37:0/3858697485 shutdown_connections 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 --2- 172.21.15.37:0/3858697485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e815ac30 0x7f58e815b010 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 -- 172.21.15.37:0/3858697485 >> 172.21.15.37:0/3858697485 conn(0x7f58e80cfaf0 msgr2=0x7f58e80cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 -- 172.21.15.37:0/3858697485 shutdown_connections 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.880+0000 7f58ef00f640 1 -- 172.21.15.37:0/3858697485 wait complete. 2024-04-15T00:00:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.881+0000 7f58ef00f640 1 Processor -- start 2024-04-15T00:00:43.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.881+0000 7f58ef00f640 1 -- start start 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ef00f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f58e80ca470 0x7f58e8157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ef00f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e80cca40 0x7f58e81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ef00f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 0x7f58e81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ef00f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f58e80ccec0 con 0x7f58e815ac30 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ef00f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58e815c5b0 con 0x7f58e80cca40 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ef00f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f58e815d150 con 0x7f58e80ca470 2024-04-15T00:00:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.882+0000 7f58ed5ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 0x7f58e81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.883+0000 7f58ecdab640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f58e80ca470 0x7f58e8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.883+0000 7f58ed5ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 0x7f58e81561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.37:50888/0 (socket says 172.21.15.37:50888) 2024-04-15T00:00:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.883+0000 7f58ed5ac640 1 -- 172.21.15.37:0/728696033 learned_addr learned my addr 172.21.15.37:0/728696033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.884+0000 7f58e7fff640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e80cca40 0x7f58e81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.886+0000 7f58ed5ac640 1 -- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f58e80ca470 msgr2=0x7f58e8157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.886+0000 7f58ed5ac640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f58e80ca470 0x7f58e8157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.886+0000 7f58ed5ac640 1 -- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e80cca40 msgr2=0x7f58e81550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.886+0000 7f58ed5ac640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e80cca40 0x7f58e81550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.886+0000 7f58ed5ac640 1 -- 172.21.15.37:0/728696033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e80ce2d0 con 0x7f58e815ac30 2024-04-15T00:00:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.889+0000 7f58ed5ac640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 0x7f58e81561a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f58e000c410 tx=0x7f58e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:43.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.893+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0017070 con 0x7f58e815ac30 2024-04-15T00:00:43.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.893+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e00035f0 con 0x7f58e815ac30 2024-04-15T00:00:43.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.893+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0003a20 con 0x7f58e815ac30 2024-04-15T00:00:43.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.893+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e80c8ae0 con 0x7f58e815ac30 2024-04-15T00:00:43.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.893+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e815a3b0 con 0x7f58e815ac30 2024-04-15T00:00:43.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.894+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e815a5f0 con 0x7f58e815ac30 2024-04-15T00:00:43.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.896+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58e001a070 con 0x7f58e815ac30 2024-04-15T00:00:43.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:43.896+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f58e0012400 con 0x7f58e815ac30 2024-04-15T00:00:43.908 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.903+0000 7fd7dfe2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T00:00:43.918 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.912+0000 7ff929211040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T00:00:43.958 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:43.951+0000 7fd7dfe2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T00:00:43.967 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:43.960+0000 7ff929211040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T00:00:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.001+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f58e815a5f0 con 0x7f58e815ac30 2024-04-15T00:00:44.012 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.006+0000 7fd7dfe2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T00:00:44.020 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.015+0000 7ff929211040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T00:00:44.062 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.057+0000 7fd7dfe2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T00:00:44.075 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.069+0000 7ff929211040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T00:00:44.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.081+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c80833ab-3af5-4b2d-90a3-20dc0982406b", "id": 1} v 0) -- 0x7f58e804f540 con 0x7f58e815ac30 2024-04-15T00:00:44.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.142+0000 7f58e57fa640 1 -- 172.21.15.37:0/728696033 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c80833ab-3af5-4b2d-90a3-20dc0982406b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f58e0021020 con 0x7f58e815ac30 2024-04-15T00:00:44.148 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-04-15T00:00:44.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 msgr2=0x7f58e81561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 0x7f58e81561a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f58e000c410 tx=0x7f58e000c8d0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 shutdown_connections 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58e815ac30 0x7f58e81561a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e80cca40 0x7f58e81550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 --2- 172.21.15.37:0/728696033 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f58e80ca470 0x7f58e8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 >> 172.21.15.37:0/728696033 conn(0x7f58e80cfaf0 msgr2=0x7f58e80cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 shutdown_connections 2024-04-15T00:00:44.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.143+0000 7f58ef00f640 1 -- 172.21.15.37:0/728696033 wait complete. 2024-04-15T00:00:44.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new f9d56751-42ec-4f2b-ab02-2b9b29c4255d 2 2024-04-15T00:00:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.258+0000 7f7193e05640 1 Processor -- start 2024-04-15T00:00:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 -- start start 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f718c154660 0x7f718c0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c0ca580 0x7f718c0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718c0cb3a0 0x7f718c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f718c0cc230 con 0x7f718c0cb3a0 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f718c15a3e0 con 0x7f718c154660 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.259+0000 7f7193e05640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f718c15a6a0 con 0x7f718c0ca580 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.260+0000 7f71913a0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c0ca580 0x7f718c0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.260+0000 7f71923a2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718c0cb3a0 0x7f718c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.260+0000 7f7191ba1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f718c154660 0x7f718c0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.260+0000 7f71923a2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718c0cb3a0 0x7f718c15d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.37:50892/0 (socket says 172.21.15.37:50892) 2024-04-15T00:00:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.260+0000 7f7191ba1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f718c154660 0x7f718c0cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36952/0 (socket says 172.21.15.37:36952) 2024-04-15T00:00:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.260+0000 7f71923a2640 1 -- 172.21.15.37:0/4038873949 learned_addr learned my addr 172.21.15.37:0/4038873949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.263+0000 7f71923a2640 1 -- 172.21.15.37:0/4038873949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c0ca580 msgr2=0x7f718c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.263+0000 7f71923a2640 1 --2- 172.21.15.37:0/4038873949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c0ca580 0x7f718c0cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.263+0000 7f71923a2640 1 -- 172.21.15.37:0/4038873949 >> v2:172.21.15.37:3300/0 conn(0x7f718c154660 msgr2=0x7f718c0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.263+0000 7f71923a2640 1 --2- 172.21.15.37:0/4038873949 >> v2:172.21.15.37:3300/0 conn(0x7f718c154660 0x7f718c0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.263+0000 7f71923a2640 1 -- 172.21.15.37:0/4038873949 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718c15a980 con 0x7f718c0cb3a0 2024-04-15T00:00:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.265+0000 7f71923a2640 1 --2- 172.21.15.37:0/4038873949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0cb3a0 0x7f718c15d9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f718c062450 tx=0x7f718402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5e6b83788fcc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:44.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.269+0000 7f7190b9f640 1 -- 172.21.15.37:0/4038873949 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718402ca70 con 0x7f718c0cb3a0 2024-04-15T00:00:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.269+0000 7f7190b9f640 1 -- 172.21.15.37:0/4038873949 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718402cc10 con 0x7f718c0cb3a0 2024-04-15T00:00:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.269+0000 7f7190b9f640 1 -- 172.21.15.37:0/4038873949 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71840343f0 con 0x7f718c0cb3a0 2024-04-15T00:00:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.269+0000 7f7193e05640 1 -- 172.21.15.37:0/4038873949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0cb3a0 msgr2=0x7f718c15d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.269+0000 7f7193e05640 1 --2- 172.21.15.37:0/4038873949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0cb3a0 0x7f718c15d9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f718c062450 tx=0x7f718402bed0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 -- 172.21.15.37:0/4038873949 shutdown_connections 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 --2- 172.21.15.37:0/4038873949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0cb3a0 0x7f718c15d9d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 --2- 172.21.15.37:0/4038873949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c0ca580 0x7f718c0cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 --2- 172.21.15.37:0/4038873949 >> v2:172.21.15.37:3300/0 conn(0x7f718c154660 0x7f718c0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 -- 172.21.15.37:0/4038873949 >> 172.21.15.37:0/4038873949 conn(0x7f718c072b10 msgr2=0x7f718c061c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 -- 172.21.15.37:0/4038873949 shutdown_connections 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.270+0000 7f7193e05640 1 -- 172.21.15.37:0/4038873949 wait complete. 2024-04-15T00:00:44.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.271+0000 7f7193e05640 1 Processor -- start 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.271+0000 7f7193e05640 1 -- start start 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.271+0000 7f7193e05640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0ca580 0x7f718c147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7193e05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 0x7f718c14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7193e05640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c154660 0x7f718c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7193e05640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f718c154a40 con 0x7f718c0ca580 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7193e05640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f718c0cbee0 con 0x7f718c0cb3a0 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7193e05640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f718c15be90 con 0x7f718c154660 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7191ba1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0ca580 0x7f718c147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f71913a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 0x7f718c14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f71923a2640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c154660 0x7f718c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7191ba1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0ca580 0x7f718c147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.37:50900/0 (socket says 172.21.15.37:50900) 2024-04-15T00:00:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f71913a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 0x7f718c14efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36962/0 (socket says 172.21.15.37:36962) 2024-04-15T00:00:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f7191ba1640 1 -- 172.21.15.37:0/585093162 learned_addr learned my addr 172.21.15.37:0/585093162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.272+0000 7f71923a2640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c154660 0x7f718c150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.37:53354/0 (socket says 172.21.15.37:53354) 2024-04-15T00:00:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.276+0000 7f71913a0640 1 -- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c154660 msgr2=0x7f718c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.276+0000 7f71913a0640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c154660 0x7f718c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.276+0000 7f71913a0640 1 -- 172.21.15.37:0/585093162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0ca580 msgr2=0x7f718c147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.276+0000 7f71913a0640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0ca580 0x7f718c147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.276+0000 7f71913a0640 1 -- 172.21.15.37:0/585093162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718c0b4db0 con 0x7f718c0cb3a0 2024-04-15T00:00:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.278+0000 7f71913a0640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 0x7f718c14efa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f718800e8a0 tx=0x7f718800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.282+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188017070 con 0x7f718c0cb3a0 2024-04-15T00:00:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.282+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718800c940 con 0x7f718c0cb3a0 2024-04-15T00:00:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.282+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718c1f0bb0 con 0x7f718c0cb3a0 2024-04-15T00:00:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.282+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718800ccf0 con 0x7f718c0cb3a0 2024-04-15T00:00:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.282+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f718c15da80 con 0x7f718c0cb3a0 2024-04-15T00:00:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.283+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f718c04f540 con 0x7f718c0cb3a0 2024-04-15T00:00:44.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.296+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f718801a070 con 0x7f718c0cb3a0 2024-04-15T00:00:44.461 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.455+0000 7fd7dfe2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T00:00:44.533 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.473+0000 7ff929211040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T00:00:44.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.489+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f7188006860 con 0x7f718c0cb3a0 2024-04-15T00:00:44.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.489+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f718c0b4db0 con 0x7f718c0cb3a0 2024-04-15T00:00:44.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.562+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9d56751-42ec-4f2b-ab02-2b9b29c4255d", "id": 2} v 0) -- 0x7f718c15d580 con 0x7f718c0cb3a0 2024-04-15T00:00:44.602 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.596+0000 7fd7dfe2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T00:00:44.621 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.615+0000 7ff929211040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T00:00:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.671+0000 7f71827fc640 1 -- 172.21.15.37:0/585093162 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9d56751-42ec-4f2b-ab02-2b9b29c4255d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f7188006440 con 0x7f718c0cb3a0 2024-04-15T00:00:44.677 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-04-15T00:00:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 msgr2=0x7f718c14efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 0x7f718c14efa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f718800e8a0 tx=0x7f718800ed60 comp rx=0 tx=0).stop 2024-04-15T00:00:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 shutdown_connections 2024-04-15T00:00:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f718c154660 0x7f718c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f718c0cb3a0 0x7f718c14efa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 --2- 172.21.15.37:0/585093162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f718c0ca580 0x7f718c147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 >> 172.21.15.37:0/585093162 conn(0x7f718c072b10 msgr2=0x7f718c152800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 shutdown_connections 2024-04-15T00:00:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.672+0000 7f7193e05640 1 -- 172.21.15.37:0/585093162 wait complete. 2024-04-15T00:00:44.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new fb8b7734-3e40-4883-b273-c61104c9d16b 3 2024-04-15T00:00:44.727 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.721+0000 7fd7dfe2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T00:00:44.737 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.731+0000 7ff929211040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T00:00:44.774 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.768+0000 7fd7dfe2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T00:00:44.786 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.780+0000 7ff929211040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T00:00:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.783+0000 7f914e836640 1 Processor -- start 2024-04-15T00:00:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.783+0000 7f914e836640 1 -- start start 2024-04-15T00:00:44.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.784+0000 7f914e836640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9148154700 0x7f91480c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.784+0000 7f914e836640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914806f910 con 0x7f91480c96b0 2024-04-15T00:00:44.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.784+0000 7f914e836640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914806fbb0 con 0x7f914815df20 2024-04-15T00:00:44.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.784+0000 7f914e836640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f914815da90 con 0x7f9148154700 2024-04-15T00:00:44.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.784+0000 7f9147fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9148154700 0x7f91480c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.785+0000 7f91477fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f91480c96b0 0x7f91480c8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.37:46068/0 (socket says 172.21.15.37:46068) 2024-04-15T00:00:44.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.785+0000 7f91477fe640 1 -- 172.21.15.37:0/145123513 learned_addr learned my addr 172.21.15.37:0/145123513 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:44.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.787+0000 7f9146ffd640 1 -- 172.21.15.37:0/145123513 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109111826 0 0) 0x7f914806f910 con 0x7f91480c96b0 2024-04-15T00:00:44.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.787+0000 7f9146ffd640 1 -- 172.21.15.37:0/145123513 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9130003520 con 0x7f91480c96b0 2024-04-15T00:00:44.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.787+0000 7f9147fff640 1 -- 172.21.15.37:0/145123513 >> v1:172.21.15.37:6789/0 conn(0x7f914815df20 legacy=0x7f914815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:44.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.787+0000 7f9147fff640 1 -- 172.21.15.37:0/145123513 >> v1:172.21.15.29:6789/0 conn(0x7f91480c96b0 legacy=0x7f91480c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.787+0000 7f9147fff640 1 -- 172.21.15.37:0/145123513 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914806fe50 con 0x7f9148154700 2024-04-15T00:00:44.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.789+0000 7f9147fff640 1 --2- 172.21.15.37:0/145123513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148154700 0x7f91480c9c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f914815dc10 tx=0x7f913c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2acd86438b1e0937 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:44.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.794+0000 7f9146ffd640 1 -- 172.21.15.37:0/145123513 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c034070 con 0x7f9148154700 2024-04-15T00:00:44.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.794+0000 7f9146ffd640 1 -- 172.21.15.37:0/145123513 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c030610 con 0x7f9148154700 2024-04-15T00:00:44.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.794+0000 7f9146ffd640 1 -- 172.21.15.37:0/145123513 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c0309e0 con 0x7f9148154700 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 -- 172.21.15.37:0/145123513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148154700 msgr2=0x7f91480c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 --2- 172.21.15.37:0/145123513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148154700 0x7f91480c9c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f914815dc10 tx=0x7f913c02b960 comp rx=0 tx=0).stop 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 -- 172.21.15.37:0/145123513 shutdown_connections 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 --2- 172.21.15.37:0/145123513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148154700 0x7f91480c9c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 -- 172.21.15.37:0/145123513 >> 172.21.15.37:0/145123513 conn(0x7f9148071370 msgr2=0x7f9148071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 -- 172.21.15.37:0/145123513 shutdown_connections 2024-04-15T00:00:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.795+0000 7f914e836640 1 -- 172.21.15.37:0/145123513 wait complete. 2024-04-15T00:00:44.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.796+0000 7f914e836640 1 Processor -- start 2024-04-15T00:00:44.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.796+0000 7f914e836640 1 -- start start 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914e836640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91480c96b0 0x7f91481e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914e836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9148154700 0x7f91480aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914e836640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914815df20 0x7f91480b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914e836640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f91480703d0 con 0x7f91480c96b0 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914e836640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9148154ae0 con 0x7f914815df20 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914e836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f91480706b0 con 0x7f9148154700 2024-04-15T00:00:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.797+0000 7f914cdd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914815df20 0x7f91480b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.798+0000 7f9147fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91480c96b0 0x7f91481e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.798+0000 7f91477fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9148154700 0x7f91480aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:44.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.798+0000 7f914cdd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914815df20 0x7f91480b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36974/0 (socket says 172.21.15.37:36974) 2024-04-15T00:00:44.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.798+0000 7f914cdd3640 1 -- 172.21.15.37:0/2143171926 learned_addr learned my addr 172.21.15.37:0/2143171926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:44.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.801+0000 7f9147fff640 1 -- 172.21.15.37:0/2143171926 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9148154700 msgr2=0x7f91480aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.801+0000 7f9147fff640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9148154700 0x7f91480aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.801+0000 7f9147fff640 1 -- 172.21.15.37:0/2143171926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914815df20 msgr2=0x7f91480b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:44.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.801+0000 7f9147fff640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914815df20 0x7f91480b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:44.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.801+0000 7f9147fff640 1 -- 172.21.15.37:0/2143171926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9148156ee0 con 0x7f91480c96b0 2024-04-15T00:00:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.803+0000 7f9147fff640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91480c96b0 0x7f91481e6bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f914806fd80 tx=0x7f913c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.807+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c034040 con 0x7f91480c96b0 2024-04-15T00:00:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.807+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c039990 con 0x7f91480c96b0 2024-04-15T00:00:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.807+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9148157180 con 0x7f91480c96b0 2024-04-15T00:00:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.807+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c039da0 con 0x7f91480c96b0 2024-04-15T00:00:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.807+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9148157740 con 0x7f91480c96b0 2024-04-15T00:00:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.808+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914804f540 con 0x7f91480c96b0 2024-04-15T00:00:44.892 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.886+0000 7fd7dfe2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:00:44.906 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:44.901+0000 7ff929211040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:00:44.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.908+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f913c037070 con 0x7f91480c96b0 2024-04-15T00:00:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.913+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f913c04b400 con 0x7f91480c96b0 2024-04-15T00:00:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.913+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f913c0304d0 con 0x7f91480c96b0 2024-04-15T00:00:44.991 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:44.985+0000 7fd7dfe2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T00:00:44.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:44.986+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb8b7734-3e40-4883-b273-c61104c9d16b", "id": 3} v 0) -- 0x7f91480c91c0 con 0x7f91480c96b0 2024-04-15T00:00:45.006 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:45.000+0000 7ff929211040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T00:00:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.020+0000 7f9144ff9640 1 -- 172.21.15.37:0/2143171926 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb8b7734-3e40-4883-b273-c61104c9d16b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f913c055430 con 0x7f91480c96b0 2024-04-15T00:00:45.027 INFO:teuthology.orchestra.run.smithi037.stdout:3 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.021+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91480c96b0 msgr2=0x7f91481e6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.021+0000 7f914e836640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91480c96b0 0x7f91481e6bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f914806fd80 tx=0x7f913c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 shutdown_connections 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914815df20 0x7f91480b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9148154700 0x7f91480aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 --2- 172.21.15.37:0/2143171926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91480c96b0 0x7f91481e6bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 >> 172.21.15.37:0/2143171926 conn(0x7f9148071370 msgr2=0x7f9148071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 shutdown_connections 2024-04-15T00:00:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.022+0000 7f914e836640 1 -- 172.21.15.37:0/2143171926 wait complete. 2024-04-15T00:00:45.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 8133c6c6-e7f3-4ef6-b653-5b76ea43eba6 4 2024-04-15T00:00:45.154 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:45.148+0000 7fd7dfe2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:00:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.153+0000 7f40e57ed640 1 Processor -- start 2024-04-15T00:00:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.153+0000 7f40e57ed640 1 -- start start 2024-04-15T00:00:45.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.153+0000 7f40e57ed640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.153+0000 7f40e57ed640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e015ba10 con 0x7f40e015ac30 2024-04-15T00:00:45.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.153+0000 7f40e57ed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e015b450 con 0x7f40e00cc870 2024-04-15T00:00:45.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.153+0000 7f40e57ed640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f40e0154cc0 con 0x7f40e015b010 2024-04-15T00:00:45.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.154+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.154+0000 7f40deffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f40e015ac30 0x7f40e00ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.37:46074/0 (socket says 172.21.15.37:46074) 2024-04-15T00:00:45.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.154+0000 7f40deffd640 1 -- 172.21.15.37:0/1961685827 learned_addr learned my addr 172.21.15.37:0/1961685827 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.157+0000 7f40de7fc640 1 -- 172.21.15.37:0/1961685827 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560724704 0 0) 0x7f40e015ba10 con 0x7f40e015ac30 2024-04-15T00:00:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.157+0000 7f40de7fc640 1 -- 172.21.15.37:0/1961685827 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40cc003520 con 0x7f40e015ac30 2024-04-15T00:00:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.157+0000 7f40de7fc640 1 -- 172.21.15.37:0/1961685827 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256458730 0 0) 0x7f40e015b450 con 0x7f40e00cc870 2024-04-15T00:00:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.157+0000 7f40d7fff640 1 -- 172.21.15.37:0/1961685827 >> v1:172.21.15.37:6789/0 conn(0x7f40e00cc870 legacy=0x7f40e015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.157+0000 7f40d7fff640 1 -- 172.21.15.37:0/1961685827 >> v1:172.21.15.29:6789/0 conn(0x7f40e015ac30 legacy=0x7f40e00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.157+0000 7f40d7fff640 1 -- 172.21.15.37:0/1961685827 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e015bc80 con 0x7f40e015b010 2024-04-15T00:00:45.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.159+0000 7f40d7fff640 1 --2- 172.21.15.37:0/1961685827 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00cc330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f40c80097d0 tx=0x7f40c802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22bb1d2b4a04165a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.164+0000 7f40de7fc640 1 -- 172.21.15.37:0/1961685827 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8034070 con 0x7f40e015b010 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.164+0000 7f40de7fc640 1 -- 172.21.15.37:0/1961685827 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c8030880 con 0x7f40e015b010 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.164+0000 7f40de7fc640 1 -- 172.21.15.37:0/1961685827 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8030c50 con 0x7f40e015b010 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 -- 172.21.15.37:0/1961685827 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 msgr2=0x7f40e00cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 --2- 172.21.15.37:0/1961685827 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00cc330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f40c80097d0 tx=0x7f40c802b9c0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 -- 172.21.15.37:0/1961685827 shutdown_connections 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 --2- 172.21.15.37:0/1961685827 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00cc330 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 -- 172.21.15.37:0/1961685827 >> 172.21.15.37:0/1961685827 conn(0x7f40e00cfaf0 msgr2=0x7f40e00cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 -- 172.21.15.37:0/1961685827 shutdown_connections 2024-04-15T00:00:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.165+0000 7f40e57ed640 1 -- 172.21.15.37:0/1961685827 wait complete. 2024-04-15T00:00:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.167+0000 7f40e57ed640 1 Processor -- start 2024-04-15T00:00:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.167+0000 7f40e57ed640 1 -- start start 2024-04-15T00:00:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.168+0000 7f40e57ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e00cc870 0x7f40e0153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.168+0000 7f40e57ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 0x7f40e00b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.168+0000 7f40e57ed640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.168+0000 7f40e57ed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f40e015c240 con 0x7f40e015ac30 2024-04-15T00:00:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.168+0000 7f40e57ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40e015c5b0 con 0x7f40e00cc870 2024-04-15T00:00:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.168+0000 7f40e57ed640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f40e00ccec0 con 0x7f40e015b010 2024-04-15T00:00:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.169+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 0x7f40e00b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.169+0000 7f40deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e00cc870 0x7f40e0153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.169+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 0x7f40e00b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.37:50928/0 (socket says 172.21.15.37:50928) 2024-04-15T00:00:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.169+0000 7f40d7fff640 1 -- 172.21.15.37:0/2992999817 learned_addr learned my addr 172.21.15.37:0/2992999817 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.172+0000 7f40d7fff640 1 -- 172.21.15.37:0/2992999817 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 msgr2=0x7f40e00b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.172+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.172+0000 7f40d7fff640 1 -- 172.21.15.37:0/2992999817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e00cc870 msgr2=0x7f40e0153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.172+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e00cc870 0x7f40e0153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.172+0000 7f40d7fff640 1 -- 172.21.15.37:0/2992999817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e00b3df0 con 0x7f40e015ac30 2024-04-15T00:00:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.175+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 0x7f40e00b4fc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f40c802bfd0 tx=0x7f40c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.178+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8034040 con 0x7f40e015ac30 2024-04-15T00:00:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.178+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c803aca0 con 0x7f40e015ac30 2024-04-15T00:00:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.178+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8043630 con 0x7f40e015ac30 2024-04-15T00:00:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.178+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e00b40d0 con 0x7f40e015ac30 2024-04-15T00:00:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.178+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e00b4690 con 0x7f40e015ac30 2024-04-15T00:00:45.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.179+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e004f540 con 0x7f40e015ac30 2024-04-15T00:00:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.181+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f40c8037070 con 0x7f40e015ac30 2024-04-15T00:00:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.181+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f40c8043da0 con 0x7f40e015ac30 2024-04-15T00:00:45.194 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:45.189+0000 7ff929211040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T00:00:45.199 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:45.193+0000 7fd7dfe2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T00:00:45.239 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:45.233+0000 7ff929211040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T00:00:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.285+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f40c8030740 con 0x7f40e015ac30 2024-04-15T00:00:45.361 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:45.355+0000 7fd7dfe2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T00:00:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.359+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8133c6c6-e7f3-4ef6-b653-5b76ea43eba6", "id": 4} v 0) -- 0x7f40e00b10a0 con 0x7f40e015ac30 2024-04-15T00:00:45.403 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:45.397+0000 7ff929211040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T00:00:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.407+0000 7f40d77fe640 1 -- 172.21.15.37:0/2992999817 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8133c6c6-e7f3-4ef6-b653-5b76ea43eba6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f40c80437d0 con 0x7f40e015ac30 2024-04-15T00:00:45.413 INFO:teuthology.orchestra.run.smithi037.stdout:4 2024-04-15T00:00:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 msgr2=0x7f40e00b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 0x7f40e00b4fc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f40c802bfd0 tx=0x7f40c80046c0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 shutdown_connections 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f40e015b010 0x7f40e00b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40e015ac30 0x7f40e00b4fc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 --2- 172.21.15.37:0/2992999817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e00cc870 0x7f40e0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 >> 172.21.15.37:0/2992999817 conn(0x7f40e00cfaf0 msgr2=0x7f40e00ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 shutdown_connections 2024-04-15T00:00:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.408+0000 7f40e57ed640 1 -- 172.21.15.37:0/2992999817 wait complete. 2024-04-15T00:00:45.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 875f80a4-453a-4de0-aeef-59f0f1695696 5 2024-04-15T00:00:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.522+0000 7f7745755640 1 Processor -- start 2024-04-15T00:00:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.522+0000 7f7745755640 1 -- start start 2024-04-15T00:00:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.523+0000 7f7745755640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77400c4790 0x7f77400cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.523+0000 7f7745755640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77400c69f0 con 0x7f7740150f40 2024-04-15T00:00:45.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.523+0000 7f7745755640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77401570f0 con 0x7f77400c72d0 2024-04-15T00:00:45.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.523+0000 7f7745755640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7740157a20 con 0x7f77400c4790 2024-04-15T00:00:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.523+0000 7f773e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77400c4790 0x7f77400cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.523+0000 7f773effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7740150f40 0x7f77400c6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.37:46086/0 (socket says 172.21.15.37:46086) 2024-04-15T00:00:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.524+0000 7f773effd640 1 -- 172.21.15.37:0/671514551 learned_addr learned my addr 172.21.15.37:0/671514551 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.526+0000 7f773dffb640 1 -- 172.21.15.37:0/671514551 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258329752 0 0) 0x7f77400c69f0 con 0x7f7740150f40 2024-04-15T00:00:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.526+0000 7f773dffb640 1 -- 172.21.15.37:0/671514551 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7728003520 con 0x7f7740150f40 2024-04-15T00:00:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.526+0000 7f773e7fc640 1 -- 172.21.15.37:0/671514551 >> v1:172.21.15.37:6789/0 conn(0x7f77400c72d0 legacy=0x7f7740161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.526+0000 7f773e7fc640 1 -- 172.21.15.37:0/671514551 >> v1:172.21.15.29:6789/0 conn(0x7f7740150f40 legacy=0x7f77400c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.526+0000 7f773e7fc640 1 -- 172.21.15.37:0/671514551 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77401573d0 con 0x7f77400c4790 2024-04-15T00:00:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.528+0000 7f773e7fc640 1 --2- 172.21.15.37:0/671514551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f77400cc860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77300097a0 tx=0x7f773002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dfcde14b0bd61e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:45.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.532+0000 7f773dffb640 1 -- 172.21.15.37:0/671514551 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730035020 con 0x7f77400c4790 2024-04-15T00:00:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.532+0000 7f773dffb640 1 -- 172.21.15.37:0/671514551 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7730031830 con 0x7f77400c4790 2024-04-15T00:00:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.532+0000 7f773dffb640 1 -- 172.21.15.37:0/671514551 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730031c00 con 0x7f77400c4790 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 -- 172.21.15.37:0/671514551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 msgr2=0x7f77400cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 --2- 172.21.15.37:0/671514551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f77400cc860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77300097a0 tx=0x7f773002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 -- 172.21.15.37:0/671514551 shutdown_connections 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 --2- 172.21.15.37:0/671514551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f77400cc860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 -- 172.21.15.37:0/671514551 >> 172.21.15.37:0/671514551 conn(0x7f774006c310 msgr2=0x7f774006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 -- 172.21.15.37:0/671514551 shutdown_connections 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.533+0000 7f7745755640 1 -- 172.21.15.37:0/671514551 wait complete. 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.535+0000 7f7745755640 1 Processor -- start 2024-04-15T00:00:45.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.535+0000 7f7745755640 1 -- start start 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.535+0000 7f7745755640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f774014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.535+0000 7f7745755640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77400c72d0 0x7f77400ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f7745755640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7740150f40 0x7f774014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f7745755640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f77400c6cd0 con 0x7f77400c72d0 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f7745755640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77400c4c20 con 0x7f77400c4790 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f7745755640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f774006d070 con 0x7f7740150f40 2024-04-15T00:00:45.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f773effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f774014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f773e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77400c72d0 0x7f77400ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f773f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7740150f40 0x7f774014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f773effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f774014cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37002/0 (socket says 172.21.15.37:37002) 2024-04-15T00:00:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.536+0000 7f773effd640 1 -- 172.21.15.37:0/328154278 learned_addr learned my addr 172.21.15.37:0/328154278 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.540+0000 7f773effd640 1 -- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7740150f40 msgr2=0x7f774014d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.540+0000 7f773effd640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7740150f40 0x7f774014d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.540+0000 7f773effd640 1 -- 172.21.15.37:0/328154278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77400c72d0 msgr2=0x7f77400ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.540+0000 7f773effd640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77400c72d0 0x7f77400ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.540+0000 7f773effd640 1 -- 172.21.15.37:0/328154278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7740141f10 con 0x7f77400c4790 2024-04-15T00:00:45.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.542+0000 7f773effd640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f774014cd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f773400c390 tx=0x7f773400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.547+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734017070 con 0x7f77400c4790 2024-04-15T00:00:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.547+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7734005ce0 con 0x7f77400c4790 2024-04-15T00:00:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.547+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77401edc50 con 0x7f77400c4790 2024-04-15T00:00:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.547+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77340072f0 con 0x7f77400c4790 2024-04-15T00:00:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.547+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77401424b0 con 0x7f77400c4790 2024-04-15T00:00:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.548+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774004f540 con 0x7f77400c4790 2024-04-15T00:00:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.549+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f773401a070 con 0x7f77400c4790 2024-04-15T00:00:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.551+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7734007490 con 0x7f77400c4790 2024-04-15T00:00:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.658+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7734021020 con 0x7f77400c4790 2024-04-15T00:00:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.732+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "875f80a4-453a-4de0-aeef-59f0f1695696", "id": 5} v 0) -- 0x7f7740155f70 con 0x7f77400c4790 2024-04-15T00:00:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.814+0000 7f77277fe640 1 -- 172.21.15.37:0/328154278 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "875f80a4-453a-4de0-aeef-59f0f1695696", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f773401cbc0 con 0x7f77400c4790 2024-04-15T00:00:45.820 INFO:teuthology.orchestra.run.smithi037.stdout:5 2024-04-15T00:00:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 msgr2=0x7f774014cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f774014cd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f773400c390 tx=0x7f773400c850 comp rx=0 tx=0).stop 2024-04-15T00:00:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 shutdown_connections 2024-04-15T00:00:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7740150f40 0x7f774014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77400c72d0 0x7f77400ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 --2- 172.21.15.37:0/328154278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77400c4790 0x7f774014cd40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 >> 172.21.15.37:0/328154278 conn(0x7f774006c310 msgr2=0x7f774014c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:45.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 shutdown_connections 2024-04-15T00:00:45.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.815+0000 7f7745755640 1 -- 172.21.15.37:0/328154278 wait complete. 2024-04-15T00:00:45.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new f2c8c3cb-9774-4266-a63d-5c8d982576a2 6 2024-04-15T00:00:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.927+0000 7f21f8ed5640 1 Processor -- start 2024-04-15T00:00:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.927+0000 7f21f8ed5640 1 -- start start 2024-04-15T00:00:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f8ed5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21f406cf00 0x7f21f40714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f8ed5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f406c310 con 0x7f21f40710f0 2024-04-15T00:00:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f8ed5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f415db30 con 0x7f21f40cab80 2024-04-15T00:00:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f8ed5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f21f415d860 con 0x7f21f406cf00 2024-04-15T00:00:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f2d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21f406cf00 0x7f21f40714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f21f40710f0 0x7f21f40c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.37:46096/0 (socket says 172.21.15.37:46096) 2024-04-15T00:00:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.928+0000 7f21f259c640 1 -- 172.21.15.37:0/3891469139 learned_addr learned my addr 172.21.15.37:0/3891469139 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.931+0000 7f21f2d9d640 1 -- 172.21.15.37:0/3891469139 >> v1:172.21.15.37:6789/0 conn(0x7f21f40cab80 legacy=0x7f21f406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.931+0000 7f21f2d9d640 1 -- 172.21.15.37:0/3891469139 >> v1:172.21.15.29:6789/0 conn(0x7f21f40710f0 legacy=0x7f21f40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.931+0000 7f21f2d9d640 1 -- 172.21.15.37:0/3891469139 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f415ddf0 con 0x7f21f406cf00 2024-04-15T00:00:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.933+0000 7f21f2d9d640 1 --2- 172.21.15.37:0/3891469139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f406cf00 0x7f21f40714d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009d90 tx=0x7f21ec02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333bcc2768c1f1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f1d9b640 1 -- 172.21.15.37:0/3891469139 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec039070 con 0x7f21f406cf00 2024-04-15T00:00:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f1d9b640 1 -- 172.21.15.37:0/3891469139 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec02cc60 con 0x7f21f406cf00 2024-04-15T00:00:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f1d9b640 1 -- 172.21.15.37:0/3891469139 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec034660 con 0x7f21f406cf00 2024-04-15T00:00:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 -- 172.21.15.37:0/3891469139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f406cf00 msgr2=0x7f21f40714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 --2- 172.21.15.37:0/3891469139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f406cf00 0x7f21f40714d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009d90 tx=0x7f21ec02beb0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 -- 172.21.15.37:0/3891469139 shutdown_connections 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 --2- 172.21.15.37:0/3891469139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f406cf00 0x7f21f40714d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 -- 172.21.15.37:0/3891469139 >> 172.21.15.37:0/3891469139 conn(0x7f21f406b620 msgr2=0x7f21f406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 -- 172.21.15.37:0/3891469139 shutdown_connections 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.937+0000 7f21f8ed5640 1 -- 172.21.15.37:0/3891469139 wait complete. 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.939+0000 7f21f8ed5640 1 Processor -- start 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.939+0000 7f21f8ed5640 1 -- start start 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f8ed5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f21f406cf00 0x7f21f414cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f8ed5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f40710f0 0x7f21f414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f8ed5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 0x7f21f41f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f8ed5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f21f415e690 con 0x7f21f40710f0 2024-04-15T00:00:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f8ed5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21f415e3b0 con 0x7f21f40cab80 2024-04-15T00:00:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f8ed5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f21f41545d0 con 0x7f21f406cf00 2024-04-15T00:00:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 0x7f21f41f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21e9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f40710f0 0x7f21f414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f259c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f21f406cf00 0x7f21f414cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 0x7f21f41f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37022/0 (socket says 172.21.15.37:37022) 2024-04-15T00:00:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.940+0000 7f21f2d9d640 1 -- 172.21.15.37:0/2260208523 learned_addr learned my addr 172.21.15.37:0/2260208523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.944+0000 7f21f2d9d640 1 -- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f21f406cf00 msgr2=0x7f21f414cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.944+0000 7f21f2d9d640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f21f406cf00 0x7f21f414cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.944+0000 7f21f2d9d640 1 -- 172.21.15.37:0/2260208523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f40710f0 msgr2=0x7f21f414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.944+0000 7f21f2d9d640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f40710f0 0x7f21f414be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.944+0000 7f21f2d9d640 1 -- 172.21.15.37:0/2260208523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f414c390 con 0x7f21f40cab80 2024-04-15T00:00:45.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.946+0000 7f21f2d9d640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 0x7f21f41f4700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009d90 tx=0x7f21ec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.950+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec044030 con 0x7f21f40cab80 2024-04-15T00:00:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.950+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec02ca60 con 0x7f21f40cab80 2024-04-15T00:00:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.950+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f41f4c40 con 0x7f21f40cab80 2024-04-15T00:00:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.950+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec039040 con 0x7f21f40cab80 2024-04-15T00:00:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.950+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f414d8a0 con 0x7f21f40cab80 2024-04-15T00:00:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.951+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f404f540 con 0x7f21f40cab80 2024-04-15T00:00:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.953+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f21ec047070 con 0x7f21f40cab80 2024-04-15T00:00:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:45.953+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f21ec052ba0 con 0x7f21f40cab80 2024-04-15T00:00:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.069+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f21ec04e070 con 0x7f21f40cab80 2024-04-15T00:00:46.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.148+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f2c8c3cb-9774-4266-a63d-5c8d982576a2", "id": 6} v 0) -- 0x7f21f40cb200 con 0x7f21f40cab80 2024-04-15T00:00:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.210+0000 7f21eb7fe640 1 -- 172.21.15.37:0/2260208523 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2c8c3cb-9774-4266-a63d-5c8d982576a2", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f21ec052da0 con 0x7f21f40cab80 2024-04-15T00:00:46.216 INFO:teuthology.orchestra.run.smithi037.stdout:6 2024-04-15T00:00:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 msgr2=0x7f21f41f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 0x7f21f41f4700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009d90 tx=0x7f21ec004a40 comp rx=0 tx=0).stop 2024-04-15T00:00:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 shutdown_connections 2024-04-15T00:00:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21f40cab80 0x7f21f41f4700 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21f40710f0 0x7f21f414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 --2- 172.21.15.37:0/2260208523 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f21f406cf00 0x7f21f414cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 >> 172.21.15.37:0/2260208523 conn(0x7f21f406b620 msgr2=0x7f21f41588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 shutdown_connections 2024-04-15T00:00:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.211+0000 7f21f8ed5640 1 -- 172.21.15.37:0/2260208523 wait complete. 2024-04-15T00:00:46.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 1eddb587-14c7-42d7-b030-4bcdce6650ae 7 2024-04-15T00:00:46.240 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:46.234+0000 7fd7dfe2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T00:00:46.276 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:46.270+0000 7ff929211040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T00:00:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.324+0000 7f1fc70de640 1 Processor -- start 2024-04-15T00:00:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.324+0000 7f1fc70de640 1 -- start start 2024-04-15T00:00:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc70de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fc01544a0 0x7f1fc015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc70de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00cd3b0 0x7f1fc00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc70de640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc00734f0 con 0x7f1fc00c9400 2024-04-15T00:00:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc70de640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc0072790 con 0x7f1fc01544a0 2024-04-15T00:00:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc70de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc015e830 con 0x7f1fc00cd3b0 2024-04-15T00:00:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc4e7a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1fc01544a0 0x7f1fc015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fbffff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00cd3b0 0x7f1fc00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.325+0000 7f1fc567b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1fc00c9400 0x7f1fc006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57718/0 (socket says 172.21.15.37:57718) 2024-04-15T00:00:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.326+0000 7f1fc567b640 1 -- 172.21.15.37:0/1854359218 learned_addr learned my addr 172.21.15.37:0/1854359218 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-15T00:00:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.328+0000 7f1fbffff640 1 -- 172.21.15.37:0/1854359218 >> v2:172.21.15.29:3300/0 conn(0x7f1fc01544a0 msgr2=0x7f1fc015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.328+0000 7f1fbffff640 1 --2- 172.21.15.37:0/1854359218 >> v2:172.21.15.29:3300/0 conn(0x7f1fc01544a0 0x7f1fc015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.328+0000 7f1fbffff640 1 -- 172.21.15.37:0/1854359218 >> v1:172.21.15.37:6789/0 conn(0x7f1fc00c9400 legacy=0x7f1fc006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.328+0000 7f1fbffff640 1 -- 172.21.15.37:0/1854359218 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc015a400 con 0x7f1fc00cd3b0 2024-04-15T00:00:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.328+0000 7f1fc4e7a640 1 --2- 172.21.15.37:0/1854359218 >> v2:172.21.15.29:3300/0 conn(0x7f1fc01544a0 0x7f1fc015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:00:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.330+0000 7f1fbffff640 1 --2- 172.21.15.37:0/1854359218 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00cd3b0 0x7f1fc00c7370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0097a0 tx=0x7f1fac02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b56528d73339947 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fbf7fe640 1 -- 172.21.15.37:0/1854359218 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac035020 con 0x7f1fc00cd3b0 2024-04-15T00:00:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fbf7fe640 1 -- 172.21.15.37:0/1854359218 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac031830 con 0x7f1fc00cd3b0 2024-04-15T00:00:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fbf7fe640 1 -- 172.21.15.37:0/1854359218 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac031c00 con 0x7f1fc00cd3b0 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 -- 172.21.15.37:0/1854359218 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00cd3b0 msgr2=0x7f1fc00c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 --2- 172.21.15.37:0/1854359218 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00cd3b0 0x7f1fc00c7370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0097a0 tx=0x7f1fac02b8d0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 -- 172.21.15.37:0/1854359218 shutdown_connections 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 --2- 172.21.15.37:0/1854359218 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00cd3b0 0x7f1fc00c7370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 --2- 172.21.15.37:0/1854359218 >> v2:172.21.15.29:3300/0 conn(0x7f1fc01544a0 0x7f1fc015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 -- 172.21.15.37:0/1854359218 >> 172.21.15.37:0/1854359218 conn(0x7f1fc006c310 msgr2=0x7f1fc006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 -- 172.21.15.37:0/1854359218 shutdown_connections 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.336+0000 7f1fc70de640 1 -- 172.21.15.37:0/1854359218 wait complete. 2024-04-15T00:00:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.338+0000 7f1fc70de640 1 Processor -- start 2024-04-15T00:00:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.338+0000 7f1fc70de640 1 -- start start 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc70de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00c9400 0x7f1fc01eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc70de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc00cd3b0 0x7f1fc015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc70de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 0x7f1fc015d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc70de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc015aca0 con 0x7f1fc01544a0 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc70de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc015a9c0 con 0x7f1fc00cd3b0 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc70de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc0073790 con 0x7f1fc00c9400 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc4e7a640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00c9400 0x7f1fc01eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.339+0000 7f1fc567b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 0x7f1fc015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.340+0000 7f1fbffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc00cd3b0 0x7f1fc015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.340+0000 7f1fc567b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 0x7f1fc015d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.37:50966/0 (socket says 172.21.15.37:50966) 2024-04-15T00:00:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.340+0000 7f1fc567b640 1 -- 172.21.15.37:0/151529279 learned_addr learned my addr 172.21.15.37:0/151529279 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-15T00:00:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.343+0000 7f1fc567b640 1 -- 172.21.15.37:0/151529279 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00c9400 msgr2=0x7f1fc01eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.343+0000 7f1fc567b640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00c9400 0x7f1fc01eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.343+0000 7f1fc567b640 1 -- 172.21.15.37:0/151529279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc00cd3b0 msgr2=0x7f1fc015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.343+0000 7f1fc567b640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc00cd3b0 0x7f1fc015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.343+0000 7f1fc567b640 1 -- 172.21.15.37:0/151529279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc015bc10 con 0x7f1fc01544a0 2024-04-15T00:00:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.345+0000 7f1fc567b640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 0x7f1fc015d580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800cbf0 tx=0x7f1fb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:46.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.349+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8017070 con 0x7f1fc01544a0 2024-04-15T00:00:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.349+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb800ad40 con 0x7f1fc01544a0 2024-04-15T00:00:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.349+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc015bef0 con 0x7f1fc01544a0 2024-04-15T00:00:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.349+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8012600 con 0x7f1fc01544a0 2024-04-15T00:00:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.349+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc015c4b0 con 0x7f1fc01544a0 2024-04-15T00:00:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.350+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc004f540 con 0x7f1fc01544a0 2024-04-15T00:00:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.352+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1fb801a070 con 0x7f1fc01544a0 2024-04-15T00:00:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.352+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f1fb80076d0 con 0x7f1fc01544a0 2024-04-15T00:00:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.456+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1fb80078d0 con 0x7f1fc01544a0 2024-04-15T00:00:46.529 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:46.523+0000 7fd7dfe2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T00:00:46.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.529+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1eddb587-14c7-42d7-b030-4bcdce6650ae", "id": 7} v 0) -- 0x7f1fc00c3750 con 0x7f1fc01544a0 2024-04-15T00:00:46.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.562+0000 7f1fbd7fa640 1 -- 172.21.15.37:0/151529279 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1eddb587-14c7-42d7-b030-4bcdce6650ae", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f1fb8007070 con 0x7f1fc01544a0 2024-04-15T00:00:46.568 INFO:teuthology.orchestra.run.smithi037.stdout:7 2024-04-15T00:00:46.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 msgr2=0x7f1fc015d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 0x7f1fc015d580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800cbf0 tx=0x7f1fb800a430 comp rx=0 tx=0).stop 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 shutdown_connections 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc01544a0 0x7f1fc015d580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc00cd3b0 0x7f1fc015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 --2- 172.21.15.37:0/151529279 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1fc00c9400 0x7f1fc01eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 >> 172.21.15.37:0/151529279 conn(0x7f1fc006c310 msgr2=0x7f1fc0072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 shutdown_connections 2024-04-15T00:00:46.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-15T00:00:46.563+0000 7f1fc70de640 1 -- 172.21.15.37:0/151529279 wait complete. 2024-04-15T00:00:46.579 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:46.574+0000 7ff929211040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T00:00:46.580 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-15T00:00:46.581 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-15T00:00:46.583 INFO:tasks.ceph.osd.0:Started 2024-04-15T00:00:46.583 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-15T00:00:46.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-15T00:00:46.586 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:46.577+0000 7fd7dfe2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T00:00:46.588 INFO:tasks.ceph.osd.1:Started 2024-04-15T00:00:46.588 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-15T00:00:46.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-15T00:00:46.590 INFO:tasks.ceph.osd.2:Started 2024-04-15T00:00:46.590 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-15T00:00:46.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-15T00:00:46.593 INFO:tasks.ceph.osd.3:Started 2024-04-15T00:00:46.594 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-15T00:00:46.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-15T00:00:46.596 INFO:tasks.ceph.osd.4:Started 2024-04-15T00:00:46.596 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-15T00:00:46.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-15T00:00:46.598 INFO:tasks.ceph.osd.5:Started 2024-04-15T00:00:46.598 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-15T00:00:46.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-15T00:00:46.600 INFO:tasks.ceph.osd.6:Started 2024-04-15T00:00:46.601 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-15T00:00:46.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-15T00:00:46.603 INFO:tasks.ceph.osd.7:Started 2024-04-15T00:00:46.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:00:46.649 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:46.644+0000 7ff929211040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T00:00:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 Processor -- start 2024-04-15T00:00:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 -- start start 2024-04-15T00:00:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7e41435c0 0x7fd7e406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e40cb0a0 0x7fd7e415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e415dd00 con 0x7fd7e40cac70 2024-04-15T00:00:46.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e415daa0 con 0x7fd7e41435c0 2024-04-15T00:00:46.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.728+0000 7fd7ea236640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e415dfc0 con 0x7fd7e40cb0a0 2024-04-15T00:00:46.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.729+0000 7fd7e3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e40cb0a0 0x7fd7e415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.730+0000 7fd7e3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e40cb0a0 0x7fd7e415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:43770/0 (socket says 172.21.15.29:43770) 2024-04-15T00:00:46.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.730+0000 7fd7e3fff640 1 -- 172.21.15.29:0/1645099311 learned_addr learned my addr 172.21.15.29:0/1645099311 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.732+0000 7fd7e3fff640 1 -- 172.21.15.29:0/1645099311 >> v2:172.21.15.29:3300/0 conn(0x7fd7e41435c0 msgr2=0x7fd7e406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.732+0000 7fd7e3fff640 1 --2- 172.21.15.29:0/1645099311 >> v2:172.21.15.29:3300/0 conn(0x7fd7e41435c0 0x7fd7e406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.732+0000 7fd7e3fff640 1 -- 172.21.15.29:0/1645099311 >> v1:172.21.15.29:6789/0 conn(0x7fd7e40cac70 legacy=0x7fd7e4071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:46.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.732+0000 7fd7e3fff640 1 -- 172.21.15.29:0/1645099311 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e415e2a0 con 0x7fd7e40cb0a0 2024-04-15T00:00:46.738 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-15T00:00:46.733+0000 7fd7dfe2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T00:00:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.734+0000 7fd7e3fff640 1 --2- 172.21.15.29:0/1645099311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e415a9a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40ca8b0 tx=0x7fd7dc02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103a5d738eb1702f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:46.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.736+0000 7fd7e27fc640 1 -- 172.21.15.29:0/1645099311 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02cb20 con 0x7fd7e40cb0a0 2024-04-15T00:00:46.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.738+0000 7fd7e27fc640 1 -- 172.21.15.29:0/1645099311 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02ccc0 con 0x7fd7e40cb0a0 2024-04-15T00:00:46.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.738+0000 7fd7e27fc640 1 -- 172.21.15.29:0/1645099311 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc034610 con 0x7fd7e40cb0a0 2024-04-15T00:00:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 -- 172.21.15.29:0/1645099311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 msgr2=0x7fd7e415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 --2- 172.21.15.29:0/1645099311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e415a9a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40ca8b0 tx=0x7fd7dc02bf80 comp rx=0 tx=0).stop 2024-04-15T00:00:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 -- 172.21.15.29:0/1645099311 shutdown_connections 2024-04-15T00:00:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 --2- 172.21.15.29:0/1645099311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e415a9a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 --2- 172.21.15.29:0/1645099311 >> v2:172.21.15.29:3300/0 conn(0x7fd7e41435c0 0x7fd7e406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 -- 172.21.15.29:0/1645099311 >> 172.21.15.29:0/1645099311 conn(0x7fd7e4070830 msgr2=0x7fd7e406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 -- 172.21.15.29:0/1645099311 shutdown_connections 2024-04-15T00:00:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.739+0000 7fd7ea236640 1 -- 172.21.15.29:0/1645099311 wait complete. 2024-04-15T00:00:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.740+0000 7fd7ea236640 1 Processor -- start 2024-04-15T00:00:46.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 -- start start 2024-04-15T00:00:46.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 0x7fd7e40cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e41f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7e41435c0 0x7fd7e41f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e415a410 con 0x7fd7e40cac70 2024-04-15T00:00:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e415e860 con 0x7fd7e40cb0a0 2024-04-15T00:00:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.741+0000 7fd7ea236640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e4071870 con 0x7fd7e41435c0 2024-04-15T00:00:46.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.742+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 0x7fd7e40cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.742+0000 7fd7e2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e41f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:46.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.742+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 0x7fd7e40cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51782/0 (socket says 172.21.15.29:51782) 2024-04-15T00:00:46.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.742+0000 7fd7e37fe640 1 -- 172.21.15.29:0/805153786 learned_addr learned my addr 172.21.15.29:0/805153786 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:46.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.745+0000 7fd7e37fe640 1 -- 172.21.15.29:0/805153786 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7e41435c0 msgr2=0x7fd7e41f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.745+0000 7fd7e37fe640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7e41435c0 0x7fd7e41f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.745+0000 7fd7e37fe640 1 -- 172.21.15.29:0/805153786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 msgr2=0x7fd7e41f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.745+0000 7fd7e37fe640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e41f0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:46.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.745+0000 7fd7e37fe640 1 -- 172.21.15.29:0/805153786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e40ad8d0 con 0x7fd7e40cac70 2024-04-15T00:00:46.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.748+0000 7fd7e37fe640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 0x7fd7e40cba90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b440 tx=0x7fd7d400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:46.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.751+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4015020 con 0x7fd7e40cac70 2024-04-15T00:00:46.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.751+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d4011890 con 0x7fd7e40cac70 2024-04-15T00:00:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.751+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4011c80 con 0x7fd7e40cac70 2024-04-15T00:00:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.751+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e40adb50 con 0x7fd7e40cac70 2024-04-15T00:00:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.751+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e40ae110 con 0x7fd7e40cac70 2024-04-15T00:00:46.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.752+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e40b3dc0 con 0x7fd7e40cac70 2024-04-15T00:00:46.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.755+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7d4018020 con 0x7fd7e40cac70 2024-04-15T00:00:46.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.755+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd7d40103e0 con 0x7fd7e40cac70 2024-04-15T00:00:46.787 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:46.781+0000 7ff929211040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T00:00:46.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.925+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd7e40b3dc0 con 0x7fd7e40cac70 2024-04-15T00:00:46.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:46.986+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7e40c84f0 con 0x7fd7e40cac70 2024-04-15T00:00:47.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.148+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 2) ==== 45102+0+0 (secure 0 0 0) 0x7fd7d400f050 con 0x7fd7e40cac70 2024-04-15T00:00:47.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.150+0000 7fd7cbfff640 1 -- 172.21.15.29:0/805153786 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd7d401f020 con 0x7fd7e40cac70 2024-04-15T00:00:47.156 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:00:47.156 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:00:46.535961+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:00:47.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 msgr2=0x7fd7e40cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:47.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 0x7fd7e40cba90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b440 tx=0x7fd7d400b900 comp rx=0 tx=0).stop 2024-04-15T00:00:47.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 shutdown_connections 2024-04-15T00:00:47.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7e41435c0 0x7fd7e41f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:47.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40cb0a0 0x7fd7e41f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:47.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 --2- 172.21.15.29:0/805153786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e40cac70 0x7fd7e40cba90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:47.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 >> 172.21.15.29:0/805153786 conn(0x7fd7e4070830 msgr2=0x7fd7e4159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:47.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 shutdown_connections 2024-04-15T00:00:47.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:47.151+0000 7fd7ea236640 1 -- 172.21.15.29:0/805153786 wait complete. 2024-04-15T00:00:47.168 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-15T00:00:47.169 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-15T00:00:47.216 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-15T00:00:47.210+0000 7f2bb53f8640 -1 Falling back to public interface 2024-04-15T00:00:47.227 INFO:tasks.ceph.osd.4.smithi037.stderr:2024-04-15T00:00:47.221+0000 7fe43d50f640 -1 Falling back to public interface 2024-04-15T00:00:47.240 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T00:00:47.234+0000 7f45b5e11640 -1 Falling back to public interface 2024-04-15T00:00:47.240 INFO:tasks.ceph.osd.7.smithi037.stderr:2024-04-15T00:00:47.234+0000 7f3b24615640 -1 Falling back to public interface 2024-04-15T00:00:47.241 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T00:00:47.235+0000 7f45b43fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2024-04-15T00:00:47.245 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-15T00:00:47.239+0000 7fa4a6d06640 -1 Falling back to public interface 2024-04-15T00:00:47.251 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-15T00:00:47.245+0000 7ff3e0d93640 -1 Falling back to public interface 2024-04-15T00:00:47.254 INFO:tasks.ceph.osd.5.smithi037.stderr:2024-04-15T00:00:47.248+0000 7f4331c99640 -1 Falling back to public interface 2024-04-15T00:00:47.254 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-15T00:00:47.248+0000 7f5956201640 -1 Falling back to public interface 2024-04-15T00:00:47.975 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T00:00:48.075 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.069+0000 7f2c4b3f0640 1 Processor -- start 2024-04-15T00:00:48.075 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.069+0000 7f2c4b3f0640 1 -- start start 2024-04-15T00:00:48.076 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.069+0000 7f2c4b3f0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c4415b250 0x7f2c441576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:48.076 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.070+0000 7f2c4b3f0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c44156f50 con 0x7f2c44157c30 2024-04-15T00:00:48.076 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.070+0000 7f2c4b3f0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c440c4210 con 0x7f2c440c6260 2024-04-15T00:00:48.076 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.070+0000 7f2c4b3f0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4414e140 con 0x7f2c4415b250 2024-04-15T00:00:48.077 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.070+0000 7f2c4998d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c440c6260 0x7f2c441618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:33778/0 (socket says 172.21.15.29:33778) 2024-04-15T00:00:48.077 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.070+0000 7f2c4998d640 1 -- 172.21.15.29:0/2737238366 learned_addr learned my addr 172.21.15.29:0/2737238366 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:00:48.253 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.247+0000 7f2c4918c640 1 --2- 172.21.15.29:0/2737238366 >> v2:172.21.15.29:3300/0 conn(0x7f2c4415b250 0x7f2c441576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:48.282 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.276+0000 7f2c4918c640 1 -- 172.21.15.29:0/2737238366 >> v1:172.21.15.37:6789/0 conn(0x7f2c440c6260 legacy=0x7f2c441618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.282 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.276+0000 7f2c4918c640 1 -- 172.21.15.29:0/2737238366 >> v1:172.21.15.29:6789/0 conn(0x7f2c44157c30 legacy=0x7f2c440c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.282 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.276+0000 7f2c4918c640 1 -- 172.21.15.29:0/2737238366 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c440c44f0 con 0x7f2c4415b250 2024-04-15T00:00:48.301 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.295+0000 7f2c4918c640 1 --2- 172.21.15.29:0/2737238366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c4415b250 0x7f2c441576f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097a0 tx=0x7f2c4002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d59c0fa69c5d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:48.339 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.331+0000 7f2c3bfff640 1 -- 172.21.15.29:0/2737238366 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4002f810 con 0x7f2c4415b250 2024-04-15T00:00:48.340 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.331+0000 7f2c3bfff640 1 -- 172.21.15.29:0/2737238366 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4002f9b0 con 0x7f2c4415b250 2024-04-15T00:00:48.340 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.331+0000 7f2c3bfff640 1 -- 172.21.15.29:0/2737238366 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4002fd80 con 0x7f2c4415b250 2024-04-15T00:00:48.340 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/2737238366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c4415b250 msgr2=0x7f2c441576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.340 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/2737238366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c4415b250 0x7f2c441576f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097a0 tx=0x7f2c4002b9f0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.340 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/2737238366 shutdown_connections 2024-04-15T00:00:48.340 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/2737238366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c4415b250 0x7f2c441576f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.341 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/2737238366 >> 172.21.15.29:0/2737238366 conn(0x7f2c4406c310 msgr2=0x7f2c4406c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:48.341 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/2737238366 shutdown_connections 2024-04-15T00:00:48.341 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.332+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/2737238366 wait complete. 2024-04-15T00:00:48.341 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.333+0000 7f2c4b3f0640 1 Processor -- start 2024-04-15T00:00:48.341 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.333+0000 7f2c4b3f0640 1 -- start start 2024-04-15T00:00:48.343 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.334+0000 7f2c4b3f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 0x7f2c441541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:48.343 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.334+0000 7f2c4b3f0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2c44157c30 0x7f2c44158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:48.343 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.334+0000 7f2c4b3f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4415b250 0x7f2c441527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:48.343 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.334+0000 7f2c4b3f0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440c4ab0 con 0x7f2c440c6260 2024-04-15T00:00:48.343 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.334+0000 7f2c4b3f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c441571d0 con 0x7f2c4415b250 2024-04-15T00:00:48.343 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.334+0000 7f2c4b3f0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440c6d80 con 0x7f2c44157c30 2024-04-15T00:00:48.357 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.351+0000 7f2c4918c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 0x7f2c441541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:48.357 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.352+0000 7f2c4918c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 0x7f2c441541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51808/0 (socket says 172.21.15.29:51808) 2024-04-15T00:00:48.357 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.352+0000 7f2c4918c640 1 -- 172.21.15.29:0/3051990247 learned_addr learned my addr 172.21.15.29:0/3051990247 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:48.361 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.355+0000 7f2c4918c640 1 -- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2c44157c30 msgr2=0x7f2c44158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.361 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.355+0000 7f2c4918c640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2c44157c30 0x7f2c44158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.361 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.355+0000 7f2c4918c640 1 -- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4415b250 msgr2=0x7f2c441527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.361 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.355+0000 7f2c4918c640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4415b250 0x7f2c441527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.361 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.355+0000 7f2c4918c640 1 -- 172.21.15.29:0/3051990247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44159580 con 0x7f2c440c6260 2024-04-15T00:00:48.363 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.357+0000 7f2c4918c640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 0x7f2c441541b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c400098c0 tx=0x7f2c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:48.368 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.362+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40037bc0 con 0x7f2c440c6260 2024-04-15T00:00:48.368 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.362+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40047070 con 0x7f2c440c6260 2024-04-15T00:00:48.368 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.362+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40042480 con 0x7f2c440c6260 2024-04-15T00:00:48.368 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.362+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c44159860 con 0x7f2c440c6260 2024-04-15T00:00:48.368 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.362+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c44159e20 con 0x7f2c440c6260 2024-04-15T00:00:48.369 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.364+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4404f540 con 0x7f2c440c6260 2024-04-15T00:00:48.388 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.383+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 3) ==== 89992+0+0 (secure 0 0 0) 0x7f2c40040050 con 0x7f2c440c6260 2024-04-15T00:00:48.389 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.383+0000 7f2c39ffb640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2c2806b830 0x7f2c2806dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:48.389 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.383+0000 7f2c4898b640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2c2806b830 0x7f2c2806dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:48.389 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.384+0000 7f2c4898b640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2c2806b830 0x7f2c2806dcf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2c34000f60 tx=0x7f2c340079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:48.391 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.385+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2c4007a2d0 con 0x7f2c440c6260 2024-04-15T00:00:48.491 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:48.485+0000 7ff8ca424640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-15T00:00:48.554 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T00:00:48.548+0000 7ff8ca424640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-15T00:00:48.662 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.656+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2c40033030 con 0x7f2c440c6260 2024-04-15T00:00:48.851 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.845+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c441575f0 con 0x7f2c440c6260 2024-04-15T00:00:48.866 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.860+0000 7f2c39ffb640 1 -- 172.21.15.29:0/3051990247 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2c4007c930 con 0x7f2c440c6260 2024-04-15T00:00:48.867 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-15T00:00:48.867 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:00:46.535961+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2c2806b830 msgr2=0x7f2c2806dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2c2806b830 0x7f2c2806dcf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2c34000f60 tx=0x7f2c340079d0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 msgr2=0x7f2c441541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 0x7f2c441541b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2c400098c0 tx=0x7f2c400046c0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 shutdown_connections 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2c2806b830 0x7f2c2806dcf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4415b250 0x7f2c441527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2c44157c30 0x7f2c44158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 --2- 172.21.15.29:0/3051990247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c440c6260 0x7f2c441541b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:48.869 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 >> 172.21.15.29:0/3051990247 conn(0x7f2c4406c310 msgr2=0x7f2c4406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:48.870 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 shutdown_connections 2024-04-15T00:00:48.870 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:48.863+0000 7f2c4b3f0640 1 -- 172.21.15.29:0/3051990247 wait complete. 2024-04-15T00:00:48.878 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T00:00:50.661 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-15T00:00:50.655+0000 7f2bb53f8640 -1 osd.0 0 log_to_monitors true 2024-04-15T00:00:50.663 INFO:tasks.ceph.osd.4.smithi037.stderr:2024-04-15T00:00:50.657+0000 7fe43d50f640 -1 osd.4 0 log_to_monitors true 2024-04-15T00:00:50.717 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-15T00:00:50.711+0000 7fa4a6d06640 -1 osd.1 0 log_to_monitors true 2024-04-15T00:00:50.717 INFO:tasks.ceph.osd.7.smithi037.stderr:2024-04-15T00:00:50.711+0000 7f3b24615640 -1 osd.7 0 log_to_monitors true 2024-04-15T00:00:50.748 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T00:00:50.743+0000 7f45b5e11640 -1 osd.6 0 log_to_monitors true 2024-04-15T00:00:50.766 INFO:tasks.ceph.osd.5.smithi037.stderr:2024-04-15T00:00:50.760+0000 7f4331c99640 -1 osd.5 0 log_to_monitors true 2024-04-15T00:00:50.778 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-15T00:00:50.772+0000 7f5956201640 -1 osd.2 0 log_to_monitors true 2024-04-15T00:00:50.778 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-15T00:00:50.773+0000 7ff3e0d93640 -1 osd.3 0 log_to_monitors true 2024-04-15T00:00:52.671 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-15T00:00:52.665+0000 7f2bb17f8640 -1 osd.0 0 waiting for initial osdmap 2024-04-15T00:00:52.728 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-15T00:00:52.722+0000 7f2ba8e80640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:53.057 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T00:00:53.051+0000 7f45b1bf8640 -1 osd.6 0 waiting for initial osdmap 2024-04-15T00:00:53.087 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T00:00:53.082+0000 7f45a9280640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:53.111 INFO:tasks.ceph.osd.7.smithi037.stderr:2024-04-15T00:00:53.104+0000 7f3b1fbf7640 -1 osd.7 0 waiting for initial osdmap 2024-04-15T00:00:53.112 INFO:tasks.ceph.osd.4.smithi037.stderr:2024-04-15T00:00:53.107+0000 7fe4391f7640 -1 osd.4 0 waiting for initial osdmap 2024-04-15T00:00:53.193 INFO:tasks.ceph.osd.7.smithi037.stderr:2024-04-15T00:00:53.188+0000 7f3b17a80640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:53.205 INFO:tasks.ceph.osd.4.smithi037.stderr:2024-04-15T00:00:53.200+0000 7fe431080640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:53.879 INFO:tasks.ceph.osd.5.smithi037.stderr:2024-04-15T00:00:53.874+0000 7f432d9f7640 -1 osd.5 0 waiting for initial osdmap 2024-04-15T00:00:53.952 INFO:tasks.ceph.osd.5.smithi037.stderr:2024-04-15T00:00:53.947+0000 7f4325828640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:54.060 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-15T00:00:54.055+0000 7fa4a29f7640 -1 osd.1 0 waiting for initial osdmap 2024-04-15T00:00:54.093 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-15T00:00:54.086+0000 7f5951df7640 -1 osd.2 0 waiting for initial osdmap 2024-04-15T00:00:54.101 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-15T00:00:54.096+0000 7fa49a880640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:54.109 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-15T00:00:54.103+0000 7f5949c80640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:54.158 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-15T00:00:54.152+0000 7ff3dc9f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-15T00:00:54.182 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-15T00:00:54.176+0000 7ff3d4880640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T00:00:55.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:00:55.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:00:55.685 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T00:00:55.778 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.772+0000 7fe9ec236640 1 Processor -- start 2024-04-15T00:00:55.779 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.773+0000 7fe9ec236640 1 -- start start 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.773+0000 7fe9ec236640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 0x7fe9e415d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.773+0000 7fe9ec236640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe9e415ace0 0x7fe9e40cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.773+0000 7fe9ec236640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e415e800 con 0x7fe9e40d0030 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.773+0000 7fe9ec236640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e415a850 con 0x7fe9e415ace0 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.773+0000 7fe9ec236640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e415d690 con 0x7fe9e415d2b0 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.774+0000 7fe9e97d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe9e415ace0 0x7fe9e40cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.774+0000 7fe9e97d1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe9e415ace0 0x7fe9e40cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51862/0 (socket says 172.21.15.29:51862) 2024-04-15T00:00:55.780 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.774+0000 7fe9e97d1640 1 -- 172.21.15.29:0/2914953543 learned_addr learned my addr 172.21.15.29:0/2914953543 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:55.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.777+0000 7fe9e97d1640 1 -- 172.21.15.29:0/2914953543 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 msgr2=0x7fe9e415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:55.782 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.777+0000 7fe9e97d1640 1 --2- 172.21.15.29:0/2914953543 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 0x7fe9e415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:55.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.777+0000 7fe9e97d1640 1 -- 172.21.15.29:0/2914953543 >> v1:172.21.15.37:6789/0 conn(0x7fe9e40d0030 legacy=0x7fe9e40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:55.783 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.777+0000 7fe9e97d1640 1 -- 172.21.15.29:0/2914953543 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e415df60 con 0x7fe9e415ace0 2024-04-15T00:00:55.784 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.778+0000 7fe9e97d1640 1 --2- 172.21.15.29:0/2914953543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e415ace0 0x7fe9e40cfaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009870 tx=0x7fe9e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28381ec757f96713 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:55.788 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.782+0000 7fe9e8fd0640 1 -- 172.21.15.29:0/2914953543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0034070 con 0x7fe9e415ace0 2024-04-15T00:00:55.788 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.782+0000 7fe9e8fd0640 1 -- 172.21.15.29:0/2914953543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e0030840 con 0x7fe9e415ace0 2024-04-15T00:00:55.788 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.782+0000 7fe9e8fd0640 1 -- 172.21.15.29:0/2914953543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0030c10 con 0x7fe9e415ace0 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 -- 172.21.15.29:0/2914953543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e415ace0 msgr2=0x7fe9e40cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 --2- 172.21.15.29:0/2914953543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e415ace0 0x7fe9e40cfaf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009870 tx=0x7fe9e002b980 comp rx=0 tx=0).stop 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 -- 172.21.15.29:0/2914953543 shutdown_connections 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 --2- 172.21.15.29:0/2914953543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e415ace0 0x7fe9e40cfaf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 --2- 172.21.15.29:0/2914953543 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 0x7fe9e415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 -- 172.21.15.29:0/2914953543 >> 172.21.15.29:0/2914953543 conn(0x7fe9e4072930 msgr2=0x7fe9e4072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:55.789 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 -- 172.21.15.29:0/2914953543 shutdown_connections 2024-04-15T00:00:55.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.783+0000 7fe9ec236640 1 -- 172.21.15.29:0/2914953543 wait complete. 2024-04-15T00:00:55.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.784+0000 7fe9ec236640 1 Processor -- start 2024-04-15T00:00:55.790 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.784+0000 7fe9ec236640 1 -- start start 2024-04-15T00:00:55.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9ec236640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 0x7fe9e40c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:55.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9ec236640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415ace0 0x7fe9e41e3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:55.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9ec236640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 0x7fe9e4157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:55.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9ec236640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e415a4e0 con 0x7fe9e40d0030 2024-04-15T00:00:55.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9ec236640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e415e520 con 0x7fe9e415ace0 2024-04-15T00:00:55.791 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9ec236640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e415b840 con 0x7fe9e415d2b0 2024-04-15T00:00:55.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.785+0000 7fe9e9fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 0x7fe9e40c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:55.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.786+0000 7fe9e9fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 0x7fe9e40c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51872/0 (socket says 172.21.15.29:51872) 2024-04-15T00:00:55.792 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.786+0000 7fe9e9fd2640 1 -- 172.21.15.29:0/3191193818 learned_addr learned my addr 172.21.15.29:0/3191193818 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:55.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.789+0000 7fe9e9fd2640 1 -- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 msgr2=0x7fe9e4157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:55.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.789+0000 7fe9e9fd2640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 0x7fe9e4157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:55.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.789+0000 7fe9e9fd2640 1 -- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415ace0 msgr2=0x7fe9e41e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:55.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.789+0000 7fe9e9fd2640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415ace0 0x7fe9e41e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:55.795 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.789+0000 7fe9e9fd2640 1 -- 172.21.15.29:0/3191193818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e40c8f30 con 0x7fe9e40d0030 2024-04-15T00:00:55.797 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.791+0000 7fe9e9fd2640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 0x7fe9e40c7590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400b500 tx=0x7fe9d400b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:55.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.795+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4014070 con 0x7fe9e40d0030 2024-04-15T00:00:55.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.795+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d4010610 con 0x7fe9e40d0030 2024-04-15T00:00:55.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.795+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e40c9210 con 0x7fe9e40d0030 2024-04-15T00:00:55.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.795+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4010a00 con 0x7fe9e40d0030 2024-04-15T00:00:55.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.795+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e40c97d0 con 0x7fe9e40d0030 2024-04-15T00:00:55.801 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.796+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e40c6e60 con 0x7fe9e40d0030 2024-04-15T00:00:55.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.814+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 90098+0+0 (secure 0 0 0) 0x7fe9d4017070 con 0x7fe9e40d0030 2024-04-15T00:00:55.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.814+0000 7fe9da7fc640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe9c806b930 0x7fe9c806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:55.820 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.815+0000 7fe9e97d1640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe9c806b930 0x7fe9c806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:55.821 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:55.815+0000 7fe9e97d1640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe9c806b930 0x7fe9c806ddf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0036000 tx=0x7fe9e003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:56.091 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.085+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7fe9d4088c20 con 0x7fe9e40d0030 2024-04-15T00:00:56.091 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.085+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe9d40592d0 con 0x7fe9e40d0030 2024-04-15T00:00:56.271 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.265+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9e404f540 con 0x7fe9e40d0030 2024-04-15T00:00:56.307 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.301+0000 7fe9da7fc640 1 -- 172.21.15.29:0/3191193818 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10952 (secure 0 0 0) 0x7fe9d4058bd0 con 0x7fe9e40d0030 2024-04-15T00:00:56.308 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-15T00:00:56.308 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":15,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:00:55.162842+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:00:56.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe9c806b930 msgr2=0x7fe9c806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:56.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe9c806b930 0x7fe9c806ddf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0036000 tx=0x7fe9e003b040 comp rx=0 tx=0).stop 2024-04-15T00:00:56.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 msgr2=0x7fe9e40c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:56.310 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 0x7fe9e40c7590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400b500 tx=0x7fe9d400b9c0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 shutdown_connections 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe9c806b930 0x7fe9c806ddf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9e415d2b0 0x7fe9e4157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415ace0 0x7fe9e41e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 --2- 172.21.15.29:0/3191193818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9e40d0030 0x7fe9e40c7590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 >> 172.21.15.29:0/3191193818 conn(0x7fe9e4072930 msgr2=0x7fe9e4153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 shutdown_connections 2024-04-15T00:00:56.311 INFO:teuthology.misc.health.smithi029.stderr:2024-04-15T00:00:56.304+0000 7fe9ec236640 1 -- 172.21.15.29:0/3191193818 wait complete. 2024-04-15T00:00:56.319 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-15T00:00:56.320 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-15T00:00:56.320 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T00:00:56.320 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-15T00:00:56.320 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-15T00:00:56.323 INFO:tasks.ceph.mds.a:Started 2024-04-15T00:00:56.323 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T00:00:56.323 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-15T00:00:56.323 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-15T00:00:56.325 INFO:tasks.ceph.mds.c:Started 2024-04-15T00:00:56.325 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T00:00:56.325 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-15T00:00:56.325 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-15T00:00:56.327 INFO:tasks.ceph.mds.e:Started 2024-04-15T00:00:56.327 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T00:00:56.328 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-15T00:00:56.328 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-15T00:00:56.330 INFO:tasks.ceph.mds.b:Started 2024-04-15T00:00:56.330 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T00:00:56.330 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-15T00:00:56.330 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-15T00:00:56.333 INFO:tasks.ceph.mds.d:Started 2024-04-15T00:00:56.333 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T00:00:56.333 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-15T00:00:56.333 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-15T00:00:56.335 INFO:tasks.ceph.mds.f:Started 2024-04-15T00:00:56.336 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-15T00:00:56.336 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:00:56.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.463+0000 7fd3ff31e640 1 Processor -- start 2024-04-15T00:00:56.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.463+0000 7fd3ff31e640 1 -- start start 2024-04-15T00:00:56.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.464+0000 7fd3ff31e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3f81509d0 0x7fd3f80c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:56.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.464+0000 7fd3ff31e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f80c8610 con 0x7fd3f806b910 2024-04-15T00:00:56.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.464+0000 7fd3ff31e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f80c88f0 con 0x7fd3f806c650 2024-04-15T00:00:56.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.464+0000 7fd3ff31e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f80c7210 con 0x7fd3f81509d0 2024-04-15T00:00:56.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.469+0000 7fd3fd8bb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd3f806b910 0x7fd3f81610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:33162/0 (socket says 172.21.15.29:33162) 2024-04-15T00:00:56.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.469+0000 7fd3fd8bb640 1 -- 172.21.15.29:0/2220044959 learned_addr learned my addr 172.21.15.29:0/2220044959 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:00:56.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.469+0000 7fd3fd0ba640 1 --2- 172.21.15.29:0/2220044959 >> v2:172.21.15.29:3300/0 conn(0x7fd3f81509d0 0x7fd3f80c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:56.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.472+0000 7fd3fd0ba640 1 -- 172.21.15.29:0/2220044959 >> v1:172.21.15.37:6789/0 conn(0x7fd3f806c650 legacy=0x7fd3f80c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:56.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.472+0000 7fd3fd0ba640 1 -- 172.21.15.29:0/2220044959 >> v1:172.21.15.29:6789/0 conn(0x7fd3f806b910 legacy=0x7fd3f81610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:56.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.472+0000 7fd3fd0ba640 1 -- 172.21.15.29:0/2220044959 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f8156ac0 con 0x7fd3f81509d0 2024-04-15T00:00:56.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.478+0000 7fd3fd0ba640 1 --2- 172.21.15.29:0/2220044959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c7d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400a940 tx=0x7fd3f402ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef52c1ba871d7f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:56.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.481+0000 7fd3effff640 1 -- 172.21.15.29:0/2220044959 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f403a070 con 0x7fd3f81509d0 2024-04-15T00:00:56.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.484+0000 7fd3effff640 1 -- 172.21.15.29:0/2220044959 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f402dbe0 con 0x7fd3f81509d0 2024-04-15T00:00:56.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.484+0000 7fd3effff640 1 -- 172.21.15.29:0/2220044959 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400b040 con 0x7fd3f81509d0 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 -- 172.21.15.29:0/2220044959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 msgr2=0x7fd3f80c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/2220044959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c7d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400a940 tx=0x7fd3f402ce30 comp rx=0 tx=0).stop 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 -- 172.21.15.29:0/2220044959 shutdown_connections 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/2220044959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c7d10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 -- 172.21.15.29:0/2220044959 >> 172.21.15.29:0/2220044959 conn(0x7fd3f80cc100 msgr2=0x7fd3f80cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 -- 172.21.15.29:0/2220044959 shutdown_connections 2024-04-15T00:00:56.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.485+0000 7fd3ff31e640 1 -- 172.21.15.29:0/2220044959 wait complete. 2024-04-15T00:00:56.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.486+0000 7fd3ff31e640 1 Processor -- start 2024-04-15T00:00:56.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 -- start start 2024-04-15T00:00:56.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd3f806b910 0x7fd3f8158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806c650 0x7fd3f81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f806b350 con 0x7fd3f81509d0 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8157080 con 0x7fd3f806c650 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.487+0000 7fd3ff31e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f8156770 con 0x7fd3f806b910 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.488+0000 7fd3fd8bb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:56.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.488+0000 7fd3fd8bb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51884/0 (socket says 172.21.15.29:51884) 2024-04-15T00:00:56.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.488+0000 7fd3fd8bb640 1 -- 172.21.15.29:0/474584844 learned_addr learned my addr 172.21.15.29:0/474584844 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.492+0000 7fd3fd8bb640 1 -- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd3f806b910 msgr2=0x7fd3f8158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.492+0000 7fd3fd8bb640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd3f806b910 0x7fd3f8158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.492+0000 7fd3fd8bb640 1 -- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806c650 msgr2=0x7fd3f81538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.492+0000 7fd3fd8bb640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806c650 0x7fd3f81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.492+0000 7fd3fd8bb640 1 -- 172.21.15.29:0/474584844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f81521c0 con 0x7fd3f81509d0 2024-04-15T00:00:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.495+0000 7fd3fd8bb640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c45e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000caa0 tx=0x7fd3f000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:56.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.499+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0017070 con 0x7fd3f81509d0 2024-04-15T00:00:56.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.499+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f000ab40 con 0x7fd3f81509d0 2024-04-15T00:00:56.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.499+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0012400 con 0x7fd3f81509d0 2024-04-15T00:00:56.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.499+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f81524a0 con 0x7fd3f81509d0 2024-04-15T00:00:56.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.500+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f80c6310 con 0x7fd3f81509d0 2024-04-15T00:00:56.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.501+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f804f540 con 0x7fd3f81509d0 2024-04-15T00:00:56.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.526+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 90098+0+0 (secure 0 0 0) 0x7fd3f001a070 con 0x7fd3f81509d0 2024-04-15T00:00:56.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.526+0000 7fd3edffb640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd3dc06b900 0x7fd3dc06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:56.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.527+0000 7fd3fd0ba640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd3dc06b900 0x7fd3dc06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:56.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.527+0000 7fd3fd0ba640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd3dc06b900 0x7fd3dc06ddc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4037000 tx=0x7fd3f402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.825+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4846+0+0 (secure 0 0 0) 0x7fd3f005f440 con 0x7fd3f81509d0 2024-04-15T00:00:56.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:56.825+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd3f0058ec0 con 0x7fd3f81509d0 2024-04-15T00:00:57.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.086+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3f806c430 con 0x7fd3f81509d0 2024-04-15T00:00:57.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.196+0000 7fd3edffb640 1 -- 172.21.15.29:0/474584844 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12816 (secure 0 0 0) 0x7fd3f005cf60 con 0x7fd3f81509d0 2024-04-15T00:00:57.203 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:00:57.203 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:00:56.185619+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.199+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd3dc06b900 msgr2=0x7fd3dc06ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.199+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd3dc06b900 0x7fd3dc06ddc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4037000 tx=0x7fd3f402f000 comp rx=0 tx=0).stop 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.199+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 msgr2=0x7fd3f80c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.199+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c45e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000caa0 tx=0x7fd3f000cf60 comp rx=0 tx=0).stop 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 shutdown_connections 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd3dc06b900 0x7fd3dc06ddc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3f81509d0 0x7fd3f80c45e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806c650 0x7fd3f81538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 --2- 172.21.15.29:0/474584844 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd3f806b910 0x7fd3f8158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 >> 172.21.15.29:0/474584844 conn(0x7fd3f80cc100 msgr2=0x7fd3f8061c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 shutdown_connections 2024-04-15T00:00:57.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.200+0000 7fd3ff31e640 1 -- 172.21.15.29:0/474584844 wait complete. 2024-04-15T00:00:57.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T00:00:57.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:00:57.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.322+0000 7f35b2a36640 1 Processor -- start 2024-04-15T00:00:57.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.322+0000 7f35b2a36640 1 -- start start 2024-04-15T00:00:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35b2a36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35ac152010 0x7f35ac0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35b2a36640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35ac1523f0 0x7f35ac0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35b2a36640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac0c36a0 0x7f35ac071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35b2a36640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac1584f0 con 0x7f35ac1523f0 2024-04-15T00:00:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35b2a36640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac1587b0 con 0x7f35ac152010 2024-04-15T00:00:57.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35b2a36640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac158a90 con 0x7f35ac0c36a0 2024-04-15T00:00:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.323+0000 7f35abfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35ac152010 0x7f35ac0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.324+0000 7f35b0fd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac0c36a0 0x7f35ac071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.324+0000 7f35abfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35ac152010 0x7f35ac0cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:44182/0 (socket says 172.21.15.29:44182) 2024-04-15T00:00:57.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.324+0000 7f35abfff640 1 -- 172.21.15.29:0/1313686864 learned_addr learned my addr 172.21.15.29:0/1313686864 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:57.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.327+0000 7f35abfff640 1 -- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac0c36a0 msgr2=0x7f35ac071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:57.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.327+0000 7f35abfff640 1 --2- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac0c36a0 0x7f35ac071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.327+0000 7f35abfff640 1 -- 172.21.15.29:0/1313686864 >> v2:172.21.15.29:3300/0 conn(0x7f35ac1523f0 msgr2=0x7f35ac0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:00:57.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.327+0000 7f35abfff640 1 --2- 172.21.15.29:0/1313686864 >> v2:172.21.15.29:3300/0 conn(0x7f35ac1523f0 0x7f35ac0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.327+0000 7f35abfff640 1 -- 172.21.15.29:0/1313686864 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac158d70 con 0x7f35ac152010 2024-04-15T00:00:57.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.330+0000 7f35abfff640 1 --2- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac152010 0x7f35ac0cab90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0c80e0 tx=0x7f359c02b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e5c345ef5896a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.333+0000 7f35aaffd640 1 -- 172.21.15.29:0/1313686864 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c034070 con 0x7f35ac152010 2024-04-15T00:00:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.336+0000 7f35aaffd640 1 -- 172.21.15.29:0/1313686864 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c030880 con 0x7f35ac152010 2024-04-15T00:00:57.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.336+0000 7f35aaffd640 1 -- 172.21.15.29:0/1313686864 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c030c50 con 0x7f35ac152010 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 -- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac152010 msgr2=0x7f35ac0cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 --2- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac152010 0x7f35ac0cab90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0c80e0 tx=0x7f359c02b9c0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 -- 172.21.15.29:0/1313686864 shutdown_connections 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 --2- 172.21.15.29:0/1313686864 >> v2:172.21.15.29:3300/0 conn(0x7f35ac1523f0 0x7f35ac0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 --2- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac0c36a0 0x7f35ac071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 --2- 172.21.15.29:0/1313686864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac152010 0x7f35ac0cab90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 -- 172.21.15.29:0/1313686864 >> 172.21.15.29:0/1313686864 conn(0x7f35ac0707d0 msgr2=0x7f35ac06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 -- 172.21.15.29:0/1313686864 shutdown_connections 2024-04-15T00:00:57.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.337+0000 7f35b2a36640 1 -- 172.21.15.29:0/1313686864 wait complete. 2024-04-15T00:00:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.339+0000 7f35b2a36640 1 Processor -- start 2024-04-15T00:00:57.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.339+0000 7f35b2a36640 1 -- start start 2024-04-15T00:00:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.340+0000 7f35b2a36640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 0x7f35ac156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.340+0000 7f35b2a36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35ac152010 0x7f35ac14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.340+0000 7f35b2a36640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac1523f0 0x7f35ac14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.340+0000 7f35b2a36640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac158140 con 0x7f35ac152010 2024-04-15T00:00:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.340+0000 7f35b2a36640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac15b7d0 con 0x7f35ac0c36a0 2024-04-15T00:00:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.340+0000 7f35b2a36640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac14d9e0 con 0x7f35ac1523f0 2024-04-15T00:00:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.341+0000 7f35abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 0x7f35ac156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.341+0000 7f35b0fd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac1523f0 0x7f35ac14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.341+0000 7f35abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 0x7f35ac156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:44188/0 (socket says 172.21.15.29:44188) 2024-04-15T00:00:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.341+0000 7f35abfff640 1 -- 172.21.15.29:0/4078489639 learned_addr learned my addr 172.21.15.29:0/4078489639 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.346+0000 7f35abfff640 1 -- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac1523f0 msgr2=0x7f35ac14d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.346+0000 7f35abfff640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac1523f0 0x7f35ac14d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.346+0000 7f35abfff640 1 -- 172.21.15.29:0/4078489639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35ac152010 msgr2=0x7f35ac14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.346+0000 7f35abfff640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35ac152010 0x7f35ac14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.346+0000 7f35abfff640 1 -- 172.21.15.29:0/4078489639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac0ce6c0 con 0x7f35ac0c36a0 2024-04-15T00:00:57.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.350+0000 7f35abfff640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 0x7f35ac156790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f359c02ba00 tx=0x7f359c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.356+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c048070 con 0x7f35ac0c36a0 2024-04-15T00:00:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.356+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c030680 con 0x7f35ac0c36a0 2024-04-15T00:00:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.356+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c034040 con 0x7f35ac0c36a0 2024-04-15T00:00:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.356+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac1f17e0 con 0x7f35ac0c36a0 2024-04-15T00:00:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.356+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac1f1da0 con 0x7f35ac0c36a0 2024-04-15T00:00:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.357+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac151820 con 0x7f35ac0c36a0 2024-04-15T00:00:57.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.397+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 90098+0+0 (secure 0 0 0) 0x7f359c04b070 con 0x7f35ac0c36a0 2024-04-15T00:00:57.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.397+0000 7f35a8ff9640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f359806b900 0x7f359806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:57.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.398+0000 7f35ab7fe640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f359806b900 0x7f359806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:57.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.398+0000 7f35ab7fe640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f359806b900 0x7f359806ddc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0c7610 tx=0x7f35a0006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:57.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.837+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4846+0+0 (secure 0 0 0) 0x7f359c030830 con 0x7f35ac0c36a0 2024-04-15T00:00:57.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:57.867+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f35ac151820 con 0x7f35ac0c36a0 2024-04-15T00:00:58.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.106+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35ac04f540 con 0x7f35ac0c36a0 2024-04-15T00:00:58.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.137+0000 7f35a8ff9640 1 -- 172.21.15.29:0/4078489639 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f359c052020 con 0x7f35ac0c36a0 2024-04-15T00:00:58.143 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f359806b900 msgr2=0x7f359806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f359806b900 0x7f359806ddc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0c7610 tx=0x7f35a0006bf0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 msgr2=0x7f35ac156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 0x7f35ac156790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f359c02ba00 tx=0x7f359c004730 comp rx=0 tx=0).stop 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 shutdown_connections 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f359806b900 0x7f359806ddc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f35ac1523f0 0x7f35ac14d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35ac152010 0x7f35ac14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 --2- 172.21.15.29:0/4078489639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac0c36a0 0x7f35ac156790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 >> 172.21.15.29:0/4078489639 conn(0x7f35ac0707d0 msgr2=0x7f35ac150b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:58.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 shutdown_connections 2024-04-15T00:00:58.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.140+0000 7f35b2a36640 1 -- 172.21.15.29:0/4078489639 wait complete. 2024-04-15T00:00:58.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:00:58.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.273+0000 7f2a739ed640 1 Processor -- start 2024-04-15T00:00:58.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.274+0000 7f2a739ed640 1 -- start start 2024-04-15T00:00:58.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.274+0000 7f2a739ed640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a6c1596e0 0x7f2a6c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:58.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.275+0000 7f2a739ed640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6c157fb0 con 0x7f2a6c14ea00 2024-04-15T00:00:58.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.275+0000 7f2a739ed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6c15a070 con 0x7f2a6c0c3550 2024-04-15T00:00:58.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.275+0000 7f2a739ed640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2a6c0c3970 con 0x7f2a6c1596e0 2024-04-15T00:00:58.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.309+0000 7f2a71f8a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a6c1596e0 0x7f2a6c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:58.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.313+0000 7f2a71f8a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a6c1596e0 0x7f2a6c159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35294/0 (socket says 172.21.15.29:35294) 2024-04-15T00:00:58.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.313+0000 7f2a71f8a640 1 -- 172.21.15.29:0/975812546 learned_addr learned my addr 172.21.15.29:0/975812546 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:58.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.322+0000 7f2a71f8a640 1 -- 172.21.15.29:0/975812546 >> v1:172.21.15.37:6789/0 conn(0x7f2a6c0c3550 legacy=0x7f2a6c070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.322+0000 7f2a71f8a640 1 -- 172.21.15.29:0/975812546 >> v1:172.21.15.29:6789/0 conn(0x7f2a6c14ea00 legacy=0x7f2a6c0cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.322+0000 7f2a71f8a640 1 -- 172.21.15.29:0/975812546 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c158230 con 0x7f2a6c1596e0 2024-04-15T00:00:58.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.327+0000 7f2a71f8a640 1 --2- 172.21.15.29:0/975812546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c159b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009e50 tx=0x7f2a6402c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d535b6621dde4984 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:58.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.341+0000 7f2a63fff640 1 -- 172.21.15.29:0/975812546 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6402cc30 con 0x7f2a6c1596e0 2024-04-15T00:00:58.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.341+0000 7f2a63fff640 1 -- 172.21.15.29:0/975812546 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6402cdd0 con 0x7f2a6c1596e0 2024-04-15T00:00:58.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.341+0000 7f2a63fff640 1 -- 172.21.15.29:0/975812546 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64034610 con 0x7f2a6c1596e0 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 -- 172.21.15.29:0/975812546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c1596e0 msgr2=0x7f2a6c159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 --2- 172.21.15.29:0/975812546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c159b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009e50 tx=0x7f2a6402c090 comp rx=0 tx=0).stop 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 -- 172.21.15.29:0/975812546 shutdown_connections 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 --2- 172.21.15.29:0/975812546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c159b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 -- 172.21.15.29:0/975812546 >> 172.21.15.29:0/975812546 conn(0x7f2a6c061e00 msgr2=0x7f2a6c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 -- 172.21.15.29:0/975812546 shutdown_connections 2024-04-15T00:00:58.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.342+0000 7f2a739ed640 1 -- 172.21.15.29:0/975812546 wait complete. 2024-04-15T00:00:58.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.344+0000 7f2a739ed640 1 Processor -- start 2024-04-15T00:00:58.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.344+0000 7f2a739ed640 1 -- start start 2024-04-15T00:00:58.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a739ed640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2a6c0c3550 0x7f2a6c071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:58.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a739ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 0x7f2a6c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:58.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a739ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c06c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:58.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a739ed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c158ad0 con 0x7f2a6c14ea00 2024-04-15T00:00:58.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a739ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1587f0 con 0x7f2a6c1596e0 2024-04-15T00:00:58.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a739ed640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c158db0 con 0x7f2a6c0c3550 2024-04-15T00:00:58.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.345+0000 7f2a70f88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 0x7f2a6c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:58.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.346+0000 7f2a71f8a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:58.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.346+0000 7f2a70f88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 0x7f2a6c06c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35298/0 (socket says 172.21.15.29:35298) 2024-04-15T00:00:58.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.346+0000 7f2a70f88640 1 -- 172.21.15.29:0/3101522745 learned_addr learned my addr 172.21.15.29:0/3101522745 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:00:58.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.349+0000 7f2a70f88640 1 -- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2a6c0c3550 msgr2=0x7f2a6c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.349+0000 7f2a70f88640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2a6c0c3550 0x7f2a6c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.349+0000 7f2a70f88640 1 -- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6c1596e0 msgr2=0x7f2a6c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:58.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.349+0000 7f2a70f88640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c06c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:58.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.349+0000 7f2a70f88640 1 -- 172.21.15.29:0/3101522745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c071ff0 con 0x7f2a6c14ea00 2024-04-15T00:00:58.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.352+0000 7f2a70f88640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 0x7f2a6c06c310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c400 tx=0x7f2a5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.356+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0052d0 con 0x7f2a6c14ea00 2024-04-15T00:00:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.356+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5c005490 con 0x7f2a6c14ea00 2024-04-15T00:00:58.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.356+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c1f0520 con 0x7f2a6c14ea00 2024-04-15T00:00:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.356+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c007260 con 0x7f2a6c14ea00 2024-04-15T00:00:58.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.357+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1f07e0 con 0x7f2a6c14ea00 2024-04-15T00:00:58.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.358+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c04f540 con 0x7f2a6c14ea00 2024-04-15T00:00:58.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.381+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 90098+0+0 (secure 0 0 0) 0x7f2a5c007400 con 0x7f2a6c14ea00 2024-04-15T00:00:58.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.381+0000 7f2a61ffb640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2a5006b900 0x7f2a5006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:00:58.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.381+0000 7f2a71789640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2a5006b900 0x7f2a5006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:00:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.382+0000 7f2a71789640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2a5006b900 0x7f2a5006ddc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a68000f60 tx=0x7f2a680079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:00:58.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.385+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2a5c05f0b0 con 0x7f2a6c14ea00 2024-04-15T00:00:58.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.731+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2a5c058b20 con 0x7f2a6c14ea00 2024-04-15T00:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:58.969+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a6c070c40 con 0x7f2a6c14ea00 2024-04-15T00:00:59.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.004+0000 7f2a61ffb640 1 -- 172.21.15.29:0/3101522745 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f2a5c05cbc0 con 0x7f2a6c14ea00 2024-04-15T00:00:59.011 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:00:59.011 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-15T00:00:59.011 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 1 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2a5006b900 msgr2=0x7f2a5006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2a5006b900 0x7f2a5006ddc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a68000f60 tx=0x7f2a680079b0 comp rx=0 tx=0).stop 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 msgr2=0x7f2a6c06c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 0x7f2a6c06c310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c400 tx=0x7f2a5c00c8c0 comp rx=0 tx=0).stop 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 shutdown_connections 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2a5006b900 0x7f2a5006ddc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a6c1596e0 0x7f2a6c06c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a6c14ea00 0x7f2a6c06c310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 --2- 172.21.15.29:0/3101522745 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2a6c0c3550 0x7f2a6c071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:00:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 >> 172.21.15.29:0/3101522745 conn(0x7f2a6c061e00 msgr2=0x7f2a6c14b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:00:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 shutdown_connections 2024-04-15T00:00:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:00:59.007+0000 7f2a739ed640 1 -- 172.21.15.29:0/3101522745 wait complete. 2024-04-15T00:01:01.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:01.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.131+0000 7fa428076640 1 Processor -- start 2024-04-15T00:01:01.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.132+0000 7fa428076640 1 -- start start 2024-04-15T00:01:01.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.132+0000 7fa428076640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa4200cc910 0x7fa420165d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:01.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.132+0000 7fa428076640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4200cf910 con 0x7fa4200cc530 2024-04-15T00:01:01.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.132+0000 7fa428076640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4200cf350 con 0x7fa42015b110 2024-04-15T00:01:01.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.132+0000 7fa428076640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa4200cf630 con 0x7fa4200cc910 2024-04-15T00:01:01.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.133+0000 7fa425611640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa42015b110 0x7fa4200cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44678/0 (socket says 172.21.15.29:44678) 2024-04-15T00:01:01.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.133+0000 7fa425611640 1 -- 172.21.15.29:0/3295901087 learned_addr learned my addr 172.21.15.29:0/3295901087 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:01.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.133+0000 7fa426613640 1 --2- 172.21.15.29:0/3295901087 >> v2:172.21.15.29:3300/0 conn(0x7fa4200cc910 0x7fa420165d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:01.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.137+0000 7fa424e10640 1 -- 172.21.15.29:0/3295901087 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278301943 0 0) 0x7fa4200cf350 con 0x7fa42015b110 2024-04-15T00:01:01.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.137+0000 7fa424e10640 1 -- 172.21.15.29:0/3295901087 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa40c003520 con 0x7fa42015b110 2024-04-15T00:01:01.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.138+0000 7fa426613640 1 -- 172.21.15.29:0/3295901087 >> v1:172.21.15.37:6789/0 conn(0x7fa42015b110 legacy=0x7fa4200cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.138+0000 7fa426613640 1 -- 172.21.15.29:0/3295901087 >> v1:172.21.15.29:6789/0 conn(0x7fa4200cc530 legacy=0x7fa42006c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.138+0000 7fa426613640 1 -- 172.21.15.29:0/3295901087 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42015a630 con 0x7fa4200cc910 2024-04-15T00:01:01.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.144+0000 7fa426613640 1 --2- 172.21.15.29:0/3295901087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc910 0x7fa420165d40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa418009d90 tx=0x7fa41802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7212f364ac3003b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:01.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.148+0000 7fa424e10640 1 -- 172.21.15.29:0/3295901087 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418039070 con 0x7fa4200cc910 2024-04-15T00:01:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.150+0000 7fa424e10640 1 -- 172.21.15.29:0/3295901087 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41802ccf0 con 0x7fa4200cc910 2024-04-15T00:01:01.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.151+0000 7fa424e10640 1 -- 172.21.15.29:0/3295901087 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418034640 con 0x7fa4200cc910 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.151+0000 7fa428076640 1 -- 172.21.15.29:0/3295901087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc910 msgr2=0x7fa420165d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.151+0000 7fa428076640 1 --2- 172.21.15.29:0/3295901087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc910 0x7fa420165d40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa418009d90 tx=0x7fa41802bf40 comp rx=0 tx=0).stop 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.152+0000 7fa428076640 1 -- 172.21.15.29:0/3295901087 shutdown_connections 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.152+0000 7fa428076640 1 --2- 172.21.15.29:0/3295901087 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc910 0x7fa420165d40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.152+0000 7fa428076640 1 -- 172.21.15.29:0/3295901087 >> 172.21.15.29:0/3295901087 conn(0x7fa4200cfb20 msgr2=0x7fa4200cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.152+0000 7fa428076640 1 -- 172.21.15.29:0/3295901087 shutdown_connections 2024-04-15T00:01:01.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.152+0000 7fa428076640 1 -- 172.21.15.29:0/3295901087 wait complete. 2024-04-15T00:01:01.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.154+0000 7fa428076640 1 Processor -- start 2024-04-15T00:01:01.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.154+0000 7fa428076640 1 -- start start 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa428076640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 0x7fa4200b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa428076640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4200cc910 0x7fa4201f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa428076640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa42015b110 0x7fa42006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa428076640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200ce700 con 0x7fa4200cc530 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa428076640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa42015abf0 con 0x7fa4200cc910 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa428076640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200ccd20 con 0x7fa42015b110 2024-04-15T00:01:01.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.155+0000 7fa425e12640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 0x7fa4200b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.156+0000 7fa425611640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4200cc910 0x7fa4201f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.156+0000 7fa425e12640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 0x7fa4200b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35316/0 (socket says 172.21.15.29:35316) 2024-04-15T00:01:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.156+0000 7fa425e12640 1 -- 172.21.15.29:0/735439534 learned_addr learned my addr 172.21.15.29:0/735439534 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:01.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.156+0000 7fa426613640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa42015b110 0x7fa42006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.160+0000 7fa425e12640 1 -- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa42015b110 msgr2=0x7fa42006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.160+0000 7fa425e12640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa42015b110 0x7fa42006ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.160+0000 7fa425e12640 1 -- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4200cc910 msgr2=0x7fa4201f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.160+0000 7fa425e12640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4200cc910 0x7fa4201f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.160+0000 7fa425e12640 1 -- 172.21.15.29:0/735439534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201f4420 con 0x7fa4200cc530 2024-04-15T00:01:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.163+0000 7fa425e12640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 0x7fa4200b15e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c3f0 tx=0x7fa41c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.168+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0052d0 con 0x7fa4200cc530 2024-04-15T00:01:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.168+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c005490 con 0x7fa4200cc530 2024-04-15T00:01:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.168+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4200b1c70 con 0x7fa4200cc530 2024-04-15T00:01:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.168+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c007260 con 0x7fa4200cc530 2024-04-15T00:01:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.168+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4200b2230 con 0x7fa4200cc530 2024-04-15T00:01:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.169+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42004f540 con 0x7fa4200cc530 2024-04-15T00:01:01.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.454+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa41c007400 con 0x7fa4200cc530 2024-04-15T00:01:01.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.455+0000 7fa4167fc640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa40406b9c0 0x7fa40406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:01.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.455+0000 7fa425611640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa40406b9c0 0x7fa40406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:01.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.455+0000 7fa425611640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa40406b9c0 0x7fa40406de80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4200c32c0 tx=0x7fa410007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.483+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa41c05ecb0 con 0x7fa4200cc530 2024-04-15T00:01:01.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.483+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa41c058720 con 0x7fa4200cc530 2024-04-15T00:01:01.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.841+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa42006e000 con 0x7fa4200cc530 2024-04-15T00:01:01.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.851+0000 7fa4167fc640 1 -- 172.21.15.29:0/735439534 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fa41c05c7c0 con 0x7fa4200cc530 2024-04-15T00:01:01.857 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:01.857 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-15T00:01:01.858 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 1 2024-04-15T00:01:01.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa40406b9c0 msgr2=0x7fa40406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa40406b9c0 0x7fa40406de80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4200c32c0 tx=0x7fa410007d30 comp rx=0 tx=0).stop 2024-04-15T00:01:01.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 msgr2=0x7fa4200b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 0x7fa4200b15e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c3f0 tx=0x7fa41c00c8b0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 shutdown_connections 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa40406b9c0 0x7fa40406de80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa42015b110 0x7fa42006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4200cc910 0x7fa4201f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 --2- 172.21.15.29:0/735439534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4200cc530 0x7fa4200b15e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:01.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 >> 172.21.15.29:0/735439534 conn(0x7fa4200cfb20 msgr2=0x7fa420152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:01.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 shutdown_connections 2024-04-15T00:01:01.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:01.854+0000 7fa428076640 1 -- 172.21.15.29:0/735439534 wait complete. 2024-04-15T00:01:03.097 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-15T00:01:03.142 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2024-04-15T00:01:03.152 INFO:tasks.ceph.mds.e.smithi029.stdout:starting mds.e at 2024-04-15T00:01:03.168 INFO:tasks.ceph.mds.f.smithi037.stdout:starting mds.f at 2024-04-15T00:01:03.260 INFO:tasks.ceph.mds.b.smithi037.stdout:starting mds.b at 2024-04-15T00:01:03.280 INFO:tasks.ceph.mds.d.smithi037.stdout:starting mds.d at 2024-04-15T00:01:03.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:03.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.973+0000 7f1882e2d640 1 Processor -- start 2024-04-15T00:01:03.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.973+0000 7f1882e2d640 1 -- start start 2024-04-15T00:01:03.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.974+0000 7f1882e2d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:03.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.974+0000 7f1882e2d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f187c15b110 0x7f187c06c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:03.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.974+0000 7f1882e2d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c06c960 con 0x7f187c0cdff0 2024-04-15T00:01:03.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.974+0000 7f1882e2d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f187c0cf910 con 0x7f187c15b110 2024-04-15T00:01:03.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.974+0000 7f1882e2d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f187c0cf350 con 0x7f187c0cc530 2024-04-15T00:01:03.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.975+0000 7f18813ca640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f187c0cdff0 0x7f187c15da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44718/0 (socket says 172.21.15.29:44718) 2024-04-15T00:01:03.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.975+0000 7f18813ca640 1 -- 172.21.15.29:0/1304139270 learned_addr learned my addr 172.21.15.29:0/1304139270 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:03.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.975+0000 7f1880bc9640 1 --2- 172.21.15.29:0/1304139270 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:03.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.979+0000 7f1880bc9640 1 -- 172.21.15.29:0/1304139270 >> v2:172.21.15.29:3300/0 conn(0x7f187c15b110 msgr2=0x7f187c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:03.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.979+0000 7f1880bc9640 1 --2- 172.21.15.29:0/1304139270 >> v2:172.21.15.29:3300/0 conn(0x7f187c15b110 0x7f187c06c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:03.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.979+0000 7f1880bc9640 1 -- 172.21.15.29:0/1304139270 >> v1:172.21.15.37:6789/0 conn(0x7f187c0cdff0 legacy=0x7f187c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:03.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.979+0000 7f1880bc9640 1 -- 172.21.15.29:0/1304139270 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c0cf630 con 0x7f187c0cc530 2024-04-15T00:01:03.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.981+0000 7f1880bc9640 1 --2- 172.21.15.29:0/1304139270 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c0cc910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18700097a0 tx=0x7f187002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d542f916ead83e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:03.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f187b7fe640 1 -- 172.21.15.29:0/1304139270 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870035020 con 0x7f187c0cc530 2024-04-15T00:01:03.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f187b7fe640 1 -- 172.21.15.29:0/1304139270 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870031830 con 0x7f187c0cc530 2024-04-15T00:01:03.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f187b7fe640 1 -- 172.21.15.29:0/1304139270 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870031c00 con 0x7f187c0cc530 2024-04-15T00:01:03.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 -- 172.21.15.29:0/1304139270 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 msgr2=0x7f187c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:03.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 --2- 172.21.15.29:0/1304139270 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c0cc910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18700097a0 tx=0x7f187002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:03.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 -- 172.21.15.29:0/1304139270 shutdown_connections 2024-04-15T00:01:03.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 --2- 172.21.15.29:0/1304139270 >> v2:172.21.15.29:3300/0 conn(0x7f187c15b110 0x7f187c06c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:03.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 --2- 172.21.15.29:0/1304139270 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c0cc910 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:03.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 -- 172.21.15.29:0/1304139270 >> 172.21.15.29:0/1304139270 conn(0x7f187c0cfb20 msgr2=0x7f187c0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:03.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 -- 172.21.15.29:0/1304139270 shutdown_connections 2024-04-15T00:01:03.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.985+0000 7f1882e2d640 1 -- 172.21.15.29:0/1304139270 wait complete. 2024-04-15T00:01:03.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.986+0000 7f1882e2d640 1 Processor -- start 2024-04-15T00:01:03.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.986+0000 7f1882e2d640 1 -- start start 2024-04-15T00:01:03.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.987+0000 7f1882e2d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c1f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:03.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.987+0000 7f1882e2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f187c0cdff0 0x7f187c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.987+0000 7f1882e2d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f187c15b110 0x7f187c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.987+0000 7f1882e2d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f187c15abf0 con 0x7f187c15b110 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.987+0000 7f1882e2d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f187c15a910 con 0x7f187c0cdff0 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.987+0000 7f1882e2d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f187c0cebc0 con 0x7f187c0cc530 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.988+0000 7f187bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f187c0cdff0 0x7f187c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.988+0000 7f1880bc9640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c1f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.988+0000 7f187bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f187c0cdff0 0x7f187c0b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:44268/0 (socket says 172.21.15.29:44268) 2024-04-15T00:01:03.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.988+0000 7f187bfff640 1 -- 172.21.15.29:0/13546717 learned_addr learned my addr 172.21.15.29:0/13546717 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:03.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.992+0000 7f1880bc9640 1 -- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f187c0cdff0 msgr2=0x7f187c0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:03.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.992+0000 7f1880bc9640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f187c0cdff0 0x7f187c0b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:03.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.992+0000 7f1880bc9640 1 -- 172.21.15.29:0/13546717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f187c15b110 msgr2=0x7f187c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:03.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.992+0000 7f1880bc9640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f187c15b110 0x7f187c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:03.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.992+0000 7f1880bc9640 1 -- 172.21.15.29:0/13546717 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c1569b0 con 0x7f187c0cc530 2024-04-15T00:01:03.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.994+0000 7f1880bc9640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c1f0e80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1870033000 tx=0x7f18700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:04.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.998+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870031e60 con 0x7f187c0cc530 2024-04-15T00:01:04.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.998+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187003ac80 con 0x7f187c0cc530 2024-04-15T00:01:04.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.998+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187c156c50 con 0x7f187c0cc530 2024-04-15T00:01:04.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.998+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870035040 con 0x7f187c0cc530 2024-04-15T00:01:04.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.998+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f187c157210 con 0x7f187c0cc530 2024-04-15T00:01:04.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:03.999+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f187c1532f0 con 0x7f187c0cc530 2024-04-15T00:01:04.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.295+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1870038020 con 0x7f187c0cc530 2024-04-15T00:01:04.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.296+0000 7f18797fa640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f186006ba10 0x7f186006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:04.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.296+0000 7f187bfff640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f186006ba10 0x7f186006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:04.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.296+0000 7f187bfff640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f186006ba10 0x7f186006ded0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f187c0cba10 tx=0x7f1868006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:04.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.299+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f18700814e0 con 0x7f187c0cc530 2024-04-15T00:01:04.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.313+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f187c1532f0 con 0x7f187c0cc530 2024-04-15T00:01:04.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.537+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f187c04f540 con 0x7f187c0cc530 2024-04-15T00:01:04.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.561+0000 7f18797fa640 1 -- 172.21.15.29:0/13546717 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f1870031800 con 0x7f187c0cc530 2024-04-15T00:01:04.569 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:04.569 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-15T00:01:04.570 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-04-15T00:01:04.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f186006ba10 msgr2=0x7f186006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:04.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f186006ba10 0x7f186006ded0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f187c0cba10 tx=0x7f1868006f90 comp rx=0 tx=0).stop 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 msgr2=0x7f187c1f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c1f0e80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1870033000 tx=0x7f18700046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 shutdown_connections 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f186006ba10 0x7f186006ded0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f187c15b110 0x7f187c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f187c0cdff0 0x7f187c0b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 --2- 172.21.15.29:0/13546717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f187c0cc530 0x7f187c1f0e80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 >> 172.21.15.29:0/13546717 conn(0x7f187c0cfb20 msgr2=0x7f187c14fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 shutdown_connections 2024-04-15T00:01:04.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:04.563+0000 7f1882e2d640 1 -- 172.21.15.29:0/13546717 wait complete. 2024-04-15T00:01:06.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:06.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.688+0000 7fbac398c640 1 Processor -- start 2024-04-15T00:01:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.688+0000 7fbac398c640 1 -- start start 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.689+0000 7fbac398c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbabc151f70 0x7fbabc0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.689+0000 7fbac398c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbabc15b700 con 0x7fbabc070a10 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.689+0000 7fbac398c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbabc15b9a0 con 0x7fbabc0ce400 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.689+0000 7fbac398c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbabc15bc80 con 0x7fbabc151f70 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.690+0000 7fbac1728640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbabc151f70 0x7fbabc0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.690+0000 7fbac1f29640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbabc0ce400 0x7fbabc1597f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44436/0 (socket says 172.21.15.29:44436) 2024-04-15T00:01:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.690+0000 7fbac1f29640 1 -- 172.21.15.29:0/1650491650 learned_addr learned my addr 172.21.15.29:0/1650491650 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.693+0000 7fbabbfff640 1 -- 172.21.15.29:0/1650491650 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857423340 0 0) 0x7fbabc15b9a0 con 0x7fbabc0ce400 2024-04-15T00:01:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.693+0000 7fbabbfff640 1 -- 172.21.15.29:0/1650491650 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaa4003520 con 0x7fbabc0ce400 2024-04-15T00:01:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.693+0000 7fbac1728640 1 -- 172.21.15.29:0/1650491650 >> v1:172.21.15.37:6789/0 conn(0x7fbabc0ce400 legacy=0x7fbabc1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.693+0000 7fbac1728640 1 -- 172.21.15.29:0/1650491650 >> v1:172.21.15.29:6789/0 conn(0x7fbabc070a10 legacy=0x7fbabc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:06.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.693+0000 7fbac1728640 1 -- 172.21.15.29:0/1650491650 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc15bf60 con 0x7fbabc151f70 2024-04-15T00:01:06.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.698+0000 7fbac1728640 1 --2- 172.21.15.29:0/1650491650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc0704d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbab40097d0 tx=0x7fbab402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ebc73f1b1e997d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:06.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.702+0000 7fbabbfff640 1 -- 172.21.15.29:0/1650491650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4034070 con 0x7fbabc151f70 2024-04-15T00:01:06.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.702+0000 7fbabbfff640 1 -- 172.21.15.29:0/1650491650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab4030610 con 0x7fbabc151f70 2024-04-15T00:01:06.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.702+0000 7fbabbfff640 1 -- 172.21.15.29:0/1650491650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40309e0 con 0x7fbabc151f70 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.702+0000 7fbac398c640 1 -- 172.21.15.29:0/1650491650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 msgr2=0x7fbabc0704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.702+0000 7fbac398c640 1 --2- 172.21.15.29:0/1650491650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc0704d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbab40097d0 tx=0x7fbab402b960 comp rx=0 tx=0).stop 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.703+0000 7fbac398c640 1 -- 172.21.15.29:0/1650491650 shutdown_connections 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.703+0000 7fbac398c640 1 --2- 172.21.15.29:0/1650491650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc0704d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.703+0000 7fbac398c640 1 -- 172.21.15.29:0/1650491650 >> 172.21.15.29:0/1650491650 conn(0x7fbabc061e00 msgr2=0x7fbabc062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.703+0000 7fbac398c640 1 -- 172.21.15.29:0/1650491650 shutdown_connections 2024-04-15T00:01:06.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.703+0000 7fbac398c640 1 -- 172.21.15.29:0/1650491650 wait complete. 2024-04-15T00:01:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.704+0000 7fbac398c640 1 Processor -- start 2024-04-15T00:01:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.704+0000 7fbac398c640 1 -- start start 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac398c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbabc070a10 0x7fbabc14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac398c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbabc0ce400 0x7fbabc1e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac398c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc06c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac398c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc1524d0 con 0x7fbabc151f70 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac398c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc152350 con 0x7fbabc0ce400 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac398c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbabc158d60 con 0x7fbabc070a10 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.705+0000 7fbac1f29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:06.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.706+0000 7fbac0f27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbabc0ce400 0x7fbabc1e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:06.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.706+0000 7fbac1728640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbabc070a10 0x7fbabc14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:06.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.706+0000 7fbac1f29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc06c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36072/0 (socket says 172.21.15.29:36072) 2024-04-15T00:01:06.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.706+0000 7fbac1f29640 1 -- 172.21.15.29:0/907115981 learned_addr learned my addr 172.21.15.29:0/907115981 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.709+0000 7fbac1f29640 1 -- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbabc070a10 msgr2=0x7fbabc14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.709+0000 7fbac1f29640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbabc070a10 0x7fbabc14c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.709+0000 7fbac1f29640 1 -- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbabc0ce400 msgr2=0x7fbabc1e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.710+0000 7fbac1f29640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbabc0ce400 0x7fbabc1e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.710+0000 7fbac1f29640 1 -- 172.21.15.29:0/907115981 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc14c750 con 0x7fbabc151f70 2024-04-15T00:01:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.712+0000 7fbac1f29640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc06c310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00cb70 tx=0x7fbaac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.715+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac017070 con 0x7fbabc151f70 2024-04-15T00:01:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.716+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaac00ace0 con 0x7fbabc151f70 2024-04-15T00:01:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.716+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbabc06db90 con 0x7fbabc151f70 2024-04-15T00:01:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.716+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac012620 con 0x7fbabc151f70 2024-04-15T00:01:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.716+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbabc06e110 con 0x7fbabc151f70 2024-04-15T00:01:06.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.717+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbabc04f540 con 0x7fbabc151f70 2024-04-15T00:01:06.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.984+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbaac01a070 con 0x7fbabc151f70 2024-04-15T00:01:06.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.984+0000 7fbab9ffb640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbaa806b9e0 0x7fbaa806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:06.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.985+0000 7fbac1728640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbaa806b9e0 0x7fbaa806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:06.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.985+0000 7fbac1728640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbaa806b9e0 0x7fbaa806dea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbab4036000 tx=0x7fbab403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.997+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fbaac05f5e0 con 0x7fbabc151f70 2024-04-15T00:01:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:06.998+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbaac021020 con 0x7fbabc151f70 2024-04-15T00:01:07.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.230+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbabc0c8530 con 0x7fbabc151f70 2024-04-15T00:01:07.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.246+0000 7fbab9ffb640 1 -- 172.21.15.29:0/907115981 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5512 (secure 0 0 0) 0x7fbaac059050 con 0x7fbabc151f70 2024-04-15T00:01:07.252 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:07.253 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-15T00:01:07.253 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2024-04-15T00:01:07.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbaa806b9e0 msgr2=0x7fbaa806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbaa806b9e0 0x7fbaa806dea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbab4036000 tx=0x7fbab403b040 comp rx=0 tx=0).stop 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 msgr2=0x7fbabc06c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc06c310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00cb70 tx=0x7fbaac00a430 comp rx=0 tx=0).stop 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 shutdown_connections 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbaa806b9e0 0x7fbaa806dea0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbabc151f70 0x7fbabc06c310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbabc0ce400 0x7fbabc1e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 --2- 172.21.15.29:0/907115981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbabc070a10 0x7fbabc14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 >> 172.21.15.29:0/907115981 conn(0x7fbabc061e00 msgr2=0x7fbabc074340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 shutdown_connections 2024-04-15T00:01:07.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.248+0000 7fbac398c640 1 -- 172.21.15.29:0/907115981 wait complete. 2024-04-15T00:01:07.265 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:07.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.362+0000 7fe037355640 1 Processor -- start 2024-04-15T00:01:07.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.362+0000 7fe037355640 1 -- start start 2024-04-15T00:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.363+0000 7fe037355640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe030157bf0 0x7fe03015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.363+0000 7fe037355640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0300c7660 0x7fe0300c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.363+0000 7fe037355640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0300c6e50 con 0x7fe0300c6250 2024-04-15T00:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.363+0000 7fe037355640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe0300c3ff0 con 0x7fe0300c7660 2024-04-15T00:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.363+0000 7fe037355640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe03015a630 con 0x7fe030157bf0 2024-04-15T00:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.364+0000 7fe0348f0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0300c7660 0x7fe0300c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.364+0000 7fe0348f0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0300c7660 0x7fe0300c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36086/0 (socket says 172.21.15.29:36086) 2024-04-15T00:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.364+0000 7fe0348f0640 1 -- 172.21.15.29:0/2995746285 learned_addr learned my addr 172.21.15.29:0/2995746285 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.367+0000 7fe0348f0640 1 -- 172.21.15.29:0/2995746285 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe030157bf0 msgr2=0x7fe03015ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.367+0000 7fe0348f0640 1 --2- 172.21.15.29:0/2995746285 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe030157bf0 0x7fe03015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.367+0000 7fe0348f0640 1 -- 172.21.15.29:0/2995746285 >> v1:172.21.15.29:6789/0 conn(0x7fe0300c6250 legacy=0x7fe030070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.367+0000 7fe0348f0640 1 -- 172.21.15.29:0/2995746285 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe030157fd0 con 0x7fe0300c7660 2024-04-15T00:01:07.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.369+0000 7fe0348f0640 1 --2- 172.21.15.29:0/2995746285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0300c7660 0x7fe0300c7aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe020009870 tx=0x7fe02002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448d3bc396699ded server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:07.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe027fff640 1 -- 172.21.15.29:0/2995746285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02002f840 con 0x7fe0300c7660 2024-04-15T00:01:07.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe027fff640 1 -- 172.21.15.29:0/2995746285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02002f9e0 con 0x7fe0300c7660 2024-04-15T00:01:07.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe027fff640 1 -- 172.21.15.29:0/2995746285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02002fdb0 con 0x7fe0300c7660 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 -- 172.21.15.29:0/2995746285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0300c7660 msgr2=0x7fe0300c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 --2- 172.21.15.29:0/2995746285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0300c7660 0x7fe0300c7aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe020009870 tx=0x7fe02002ba20 comp rx=0 tx=0).stop 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 -- 172.21.15.29:0/2995746285 shutdown_connections 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 --2- 172.21.15.29:0/2995746285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0300c7660 0x7fe0300c7aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 --2- 172.21.15.29:0/2995746285 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe030157bf0 0x7fe03015ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 -- 172.21.15.29:0/2995746285 >> 172.21.15.29:0/2995746285 conn(0x7fe03006c310 msgr2=0x7fe03006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.378+0000 7fe037355640 1 -- 172.21.15.29:0/2995746285 shutdown_connections 2024-04-15T00:01:07.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.379+0000 7fe037355640 1 -- 172.21.15.29:0/2995746285 wait complete. 2024-04-15T00:01:07.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 Processor -- start 2024-04-15T00:01:07.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 -- start start 2024-04-15T00:01:07.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0300c6250 0x7fe0301451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:07.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0300c7660 0x7fe030150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:07.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 0x7fe0300cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe0300c4870 con 0x7fe030157bf0 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0300c4590 con 0x7fe0300c7660 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.380+0000 7fe037355640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe0300c4b50 con 0x7fe0300c6250 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.381+0000 7fe0358f2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 0x7fe0300cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.381+0000 7fe0358f2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 0x7fe0300cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36088/0 (socket says 172.21.15.29:36088) 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.381+0000 7fe0358f2640 1 -- 172.21.15.29:0/1819254220 learned_addr learned my addr 172.21.15.29:0/1819254220 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.381+0000 7fe0350f1640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0300c6250 0x7fe0301451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:07.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.381+0000 7fe0348f0640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0300c7660 0x7fe030150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:07.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.385+0000 7fe0358f2640 1 -- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0300c6250 msgr2=0x7fe0301451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.385+0000 7fe0358f2640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0300c6250 0x7fe0301451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.385+0000 7fe0358f2640 1 -- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0300c7660 msgr2=0x7fe030150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.385+0000 7fe0358f2640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0300c7660 0x7fe030150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.385+0000 7fe0358f2640 1 -- 172.21.15.29:0/1819254220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe030149dd0 con 0x7fe030157bf0 2024-04-15T00:01:07.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.387+0000 7fe0358f2640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 0x7fe0300cacc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c6b0 tx=0x7fe02800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:07.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.390+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028003b70 con 0x7fe030157bf0 2024-04-15T00:01:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.390+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe028003d10 con 0x7fe030157bf0 2024-04-15T00:01:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.390+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0280052f0 con 0x7fe030157bf0 2024-04-15T00:01:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.390+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0301f14a0 con 0x7fe030157bf0 2024-04-15T00:01:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.391+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03014a350 con 0x7fe030157bf0 2024-04-15T00:01:07.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.392+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03004f540 con 0x7fe030157bf0 2024-04-15T00:01:07.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.411+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe028005490 con 0x7fe030157bf0 2024-04-15T00:01:07.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.411+0000 7fe025ffb640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe01406b9e0 0x7fe01406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:07.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.411+0000 7fe0350f1640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe01406b9e0 0x7fe01406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:07.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.412+0000 7fe0350f1640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe01406b9e0 0x7fe01406dea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009990 tx=0x7fe02c009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:07.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.414+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe0280614c0 con 0x7fe030157bf0 2024-04-15T00:01:07.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.675+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe028016020 con 0x7fe030157bf0 2024-04-15T00:01:07.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.859+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0300c7440 con 0x7fe030157bf0 2024-04-15T00:01:07.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.886+0000 7fe025ffb640 1 -- 172.21.15.29:0/1819254220 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12812 (secure 0 0 0) 0x7fe02805af30 con 0x7fe030157bf0 2024-04-15T00:01:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:07.892 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:00:58.738014+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe01406b9e0 msgr2=0x7fe01406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe01406b9e0 0x7fe01406dea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009990 tx=0x7fe02c009110 comp rx=0 tx=0).stop 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 msgr2=0x7fe0300cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 0x7fe0300cacc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c6b0 tx=0x7fe02800cab0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 shutdown_connections 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe01406b9e0 0x7fe01406dea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe030157bf0 0x7fe0300cacc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0300c7660 0x7fe030150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 --2- 172.21.15.29:0/1819254220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0300c6250 0x7fe0301451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 >> 172.21.15.29:0/1819254220 conn(0x7fe03006c310 msgr2=0x7fe030155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 shutdown_connections 2024-04-15T00:01:07.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:07.888+0000 7fe037355640 1 -- 172.21.15.29:0/1819254220 wait complete. 2024-04-15T00:01:07.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T00:01:07.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:01:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.004+0000 7f130b2b0640 1 Processor -- start 2024-04-15T00:01:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.004+0000 7f130b2b0640 1 -- start start 2024-04-15T00:01:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130b2b0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13040cd890 0x7f13040cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130b2b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13040c9d40 0x7f130415e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130b2b0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130415e850 con 0x7f130415a940 2024-04-15T00:01:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130b2b0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f13040c9920 con 0x7f13040cd890 2024-04-15T00:01:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130b2b0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f13040c8d90 con 0x7f13040c9d40 2024-04-15T00:01:08.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130904c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13040cd890 0x7f13040cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.005+0000 7f130884b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13040c9d40 0x7f130415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.006+0000 7f130904c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f13040cd890 0x7f13040cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36100/0 (socket says 172.21.15.29:36100) 2024-04-15T00:01:08.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.006+0000 7f130904c640 1 -- 172.21.15.29:0/1227805538 learned_addr learned my addr 172.21.15.29:0/1227805538 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.008+0000 7f130904c640 1 -- 172.21.15.29:0/1227805538 >> v2:172.21.15.37:3300/0 conn(0x7f13040c9d40 msgr2=0x7f130415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.008+0000 7f130904c640 1 --2- 172.21.15.29:0/1227805538 >> v2:172.21.15.37:3300/0 conn(0x7f13040c9d40 0x7f130415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.008+0000 7f130904c640 1 -- 172.21.15.29:0/1227805538 >> v1:172.21.15.29:6789/0 conn(0x7f130415a940 legacy=0x7f1304071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.008+0000 7f130904c640 1 -- 172.21.15.29:0/1227805538 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13040c9640 con 0x7f13040cd890 2024-04-15T00:01:08.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.011+0000 7f130904c640 1 --2- 172.21.15.29:0/1227805538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13040cd890 0x7f13040cdc70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f130406ee90 tx=0x7f130002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec0ada53c8ea602 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.017+0000 7f12fbfff640 1 -- 172.21.15.29:0/1227805538 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1300035020 con 0x7f13040cd890 2024-04-15T00:01:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.017+0000 7f12fbfff640 1 -- 172.21.15.29:0/1227805538 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1300031870 con 0x7f13040cd890 2024-04-15T00:01:08.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.017+0000 7f12fbfff640 1 -- 172.21.15.29:0/1227805538 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1300031c40 con 0x7f13040cd890 2024-04-15T00:01:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 -- 172.21.15.29:0/1227805538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13040cd890 msgr2=0x7f13040cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1227805538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13040cd890 0x7f13040cdc70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f130406ee90 tx=0x7f130002b910 comp rx=0 tx=0).stop 2024-04-15T00:01:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 -- 172.21.15.29:0/1227805538 shutdown_connections 2024-04-15T00:01:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1227805538 >> v2:172.21.15.37:3300/0 conn(0x7f13040c9d40 0x7f130415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1227805538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f13040cd890 0x7f13040cdc70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 -- 172.21.15.29:0/1227805538 >> 172.21.15.29:0/1227805538 conn(0x7f1304061c20 msgr2=0x7f1304062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 -- 172.21.15.29:0/1227805538 shutdown_connections 2024-04-15T00:01:08.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.018+0000 7f130b2b0640 1 -- 172.21.15.29:0/1227805538 wait complete. 2024-04-15T00:01:08.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.019+0000 7f130b2b0640 1 Processor -- start 2024-04-15T00:01:08.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.019+0000 7f130b2b0640 1 -- start start 2024-04-15T00:01:08.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130b2b0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f13040c9d40 0x7f13041465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130b2b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040cd890 0x7f13040cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130b2b0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 0x7f13040ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130b2b0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f130415a420 con 0x7f130415a940 2024-04-15T00:01:08.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130b2b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13040c8ab0 con 0x7f13040cd890 2024-04-15T00:01:08.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130b2b0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1304154910 con 0x7f13040c9d40 2024-04-15T00:01:08.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.020+0000 7f130984d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 0x7f13040ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.021+0000 7f130984d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 0x7f13040ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36108/0 (socket says 172.21.15.29:36108) 2024-04-15T00:01:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.021+0000 7f130984d640 1 -- 172.21.15.29:0/1716389792 learned_addr learned my addr 172.21.15.29:0/1716389792 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.021+0000 7f130884b640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040cd890 0x7f13040cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.021+0000 7f130904c640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f13040c9d40 0x7f13041465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.024+0000 7f130984d640 1 -- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f13040c9d40 msgr2=0x7f13041465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.024+0000 7f130984d640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f13040c9d40 0x7f13041465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.024+0000 7f130984d640 1 -- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040cd890 msgr2=0x7f13040cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.024+0000 7f130984d640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040cd890 0x7f13040cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.024+0000 7f130984d640 1 -- 172.21.15.29:0/1716389792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13041f4e80 con 0x7f130415a940 2024-04-15T00:01:08.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.026+0000 7f130984d640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 0x7f13040ccdb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c6e0 tx=0x7f12fc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:08.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.030+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc003b70 con 0x7f130415a940 2024-04-15T00:01:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.030+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12fc003d30 con 0x7f130415a940 2024-04-15T00:01:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.030+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13041e4270 con 0x7f130415a940 2024-04-15T00:01:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.030+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc005310 con 0x7f130415a940 2024-04-15T00:01:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.030+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13041e47f0 con 0x7f130415a940 2024-04-15T00:01:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.032+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130404f540 con 0x7f130415a940 2024-04-15T00:01:08.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.299+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f12fc0054b0 con 0x7f130415a940 2024-04-15T00:01:08.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.299+0000 7f12f9ffb640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f12e806ba10 0x7f12e806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.300+0000 7f130904c640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f12e806ba10 0x7f12e806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.300+0000 7f130904c640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f12e806ba10 0x7f12e806ded0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1300036000 tx=0x7f130003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.315+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f12fc05fbb0 con 0x7f130415a940 2024-04-15T00:01:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.315+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f12fc059620 con 0x7f130415a940 2024-04-15T00:01:08.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.502+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f13040b39c0 con 0x7f130415a940 2024-04-15T00:01:08.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.524+0000 7f12f9ffb640 1 -- 172.21.15.29:0/1716389792 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f12fc05d6c0 con 0x7f130415a940 2024-04-15T00:01:08.530 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T00:01:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f12e806ba10 msgr2=0x7f12e806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f12e806ba10 0x7f12e806ded0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1300036000 tx=0x7f130003c040 comp rx=0 tx=0).stop 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 msgr2=0x7f13040ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 0x7f13040ccdb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c6e0 tx=0x7f12fc00cba0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 shutdown_connections 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f12e806ba10 0x7f12e806ded0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130415a940 0x7f13040ccdb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040cd890 0x7f13040cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 --2- 172.21.15.29:0/1716389792 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f13040c9d40 0x7f13041465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 >> 172.21.15.29:0/1716389792 conn(0x7f1304061c20 msgr2=0x7f13041474d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 shutdown_connections 2024-04-15T00:01:08.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.526+0000 7f130b2b0640 1 -- 172.21.15.29:0/1716389792 wait complete. 2024-04-15T00:01:08.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-15T00:01:08.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.638+0000 7f4f2b755640 1 Processor -- start 2024-04-15T00:01:08.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.638+0000 7f4f2b755640 1 -- start start 2024-04-15T00:01:08.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f2b755640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f2406b470 0x7f4f2415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f2b755640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f2406b850 0x7f4f240c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f2b755640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f24070ce0 0x7f4f240c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f2b755640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2415b380 con 0x7f4f2406b470 2024-04-15T00:01:08.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f2b755640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2415d940 con 0x7f4f2406b850 2024-04-15T00:01:08.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f2b755640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4f24073230 con 0x7f4f24070ce0 2024-04-15T00:01:08.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.639+0000 7f4f294f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f2406b470 0x7f4f2415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.640+0000 7f4f29cf2640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f24070ce0 0x7f4f240c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.640+0000 7f4f28cf0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f2406b850 0x7f4f240c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.640+0000 7f4f294f1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f2406b470 0x7f4f2415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36110/0 (socket says 172.21.15.29:36110) 2024-04-15T00:01:08.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.640+0000 7f4f294f1640 1 -- 172.21.15.29:0/2023452347 learned_addr learned my addr 172.21.15.29:0/2023452347 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.642+0000 7f4f294f1640 1 -- 172.21.15.29:0/2023452347 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f24070ce0 msgr2=0x7f4f240c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.642+0000 7f4f294f1640 1 --2- 172.21.15.29:0/2023452347 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f24070ce0 0x7f4f240c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.642+0000 7f4f294f1640 1 -- 172.21.15.29:0/2023452347 >> v2:172.21.15.37:3300/0 conn(0x7f4f2406b850 msgr2=0x7f4f240c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.642+0000 7f4f294f1640 1 --2- 172.21.15.29:0/2023452347 >> v2:172.21.15.37:3300/0 conn(0x7f4f2406b850 0x7f4f240c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.642+0000 7f4f294f1640 1 -- 172.21.15.29:0/2023452347 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2415dbc0 con 0x7f4f2406b470 2024-04-15T00:01:08.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.644+0000 7f4f294f1640 1 --2- 172.21.15.29:0/2023452347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f2415ae40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f240ca810 tx=0x7f4f2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea64fcc0ee8b955b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:08.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.648+0000 7f4f1bfff640 1 -- 172.21.15.29:0/2023452347 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20035020 con 0x7f4f2406b470 2024-04-15T00:01:08.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.648+0000 7f4f1bfff640 1 -- 172.21.15.29:0/2023452347 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f20031870 con 0x7f4f2406b470 2024-04-15T00:01:08.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.648+0000 7f4f1bfff640 1 -- 172.21.15.29:0/2023452347 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20031c40 con 0x7f4f2406b470 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 -- 172.21.15.29:0/2023452347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 msgr2=0x7f4f2415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2023452347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f2415ae40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f240ca810 tx=0x7f4f2002b910 comp rx=0 tx=0).stop 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 -- 172.21.15.29:0/2023452347 shutdown_connections 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2023452347 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f24070ce0 0x7f4f240c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2023452347 >> v2:172.21.15.37:3300/0 conn(0x7f4f2406b850 0x7f4f240c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2023452347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f2415ae40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 -- 172.21.15.29:0/2023452347 >> 172.21.15.29:0/2023452347 conn(0x7f4f2406c310 msgr2=0x7f4f2406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 -- 172.21.15.29:0/2023452347 shutdown_connections 2024-04-15T00:01:08.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.649+0000 7f4f2b755640 1 -- 172.21.15.29:0/2023452347 wait complete. 2024-04-15T00:01:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.650+0000 7f4f2b755640 1 Processor -- start 2024-04-15T00:01:08.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.650+0000 7f4f2b755640 1 -- start start 2024-04-15T00:01:08.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f2b755640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f241efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f2b755640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f2406b850 0x7f4f241f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f2b755640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f24070ce0 0x7f4f2415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f2b755640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2415e460 con 0x7f4f2406b470 2024-04-15T00:01:08.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f2b755640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2415e180 con 0x7f4f24070ce0 2024-04-15T00:01:08.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f2b755640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4f24072df0 con 0x7f4f2406b850 2024-04-15T00:01:08.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f294f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f241efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f29cf2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f24070ce0 0x7f4f2415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.651+0000 7f4f28cf0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f2406b850 0x7f4f241f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.652+0000 7f4f294f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f241efd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36114/0 (socket says 172.21.15.29:36114) 2024-04-15T00:01:08.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.652+0000 7f4f294f1640 1 -- 172.21.15.29:0/2721186798 learned_addr learned my addr 172.21.15.29:0/2721186798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.655+0000 7f4f294f1640 1 -- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f2406b850 msgr2=0x7f4f241f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.655+0000 7f4f294f1640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f2406b850 0x7f4f241f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.655+0000 7f4f294f1640 1 -- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f24070ce0 msgr2=0x7f4f2415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.655+0000 7f4f294f1640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f24070ce0 0x7f4f2415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:08.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.655+0000 7f4f294f1640 1 -- 172.21.15.29:0/2721186798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2415c240 con 0x7f4f2406b470 2024-04-15T00:01:08.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.657+0000 7f4f294f1640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f241efd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4f20000c00 tx=0x7f4f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:08.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.661+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20035040 con 0x7f4f2406b470 2024-04-15T00:01:08.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.661+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f20030d00 con 0x7f4f2406b470 2024-04-15T00:01:08.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.661+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200456c0 con 0x7f4f2406b470 2024-04-15T00:01:08.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.661+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f240c36e0 con 0x7f4f2406b470 2024-04-15T00:01:08.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.661+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f240c3ca0 con 0x7f4f2406b470 2024-04-15T00:01:08.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.662+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f240c80d0 con 0x7f4f2406b470 2024-04-15T00:01:08.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.681+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4f20038020 con 0x7f4f2406b470 2024-04-15T00:01:08.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.681+0000 7f4f19ffb640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4f0806b9e0 0x7f4f0806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:08.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.681+0000 7f4f28cf0640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4f0806b9e0 0x7f4f0806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:08.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.682+0000 7f4f28cf0640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4f0806b9e0 0x7f4f0806dea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f240c76e0 tx=0x7f4f14009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:08.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.685+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4f20081990 con 0x7f4f2406b470 2024-04-15T00:01:08.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:08.944+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4f240c80d0 con 0x7f4f2406b470 2024-04-15T00:01:09.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.141+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4f2404f540 con 0x7f4f2406b470 2024-04-15T00:01:09.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.147+0000 7f4f19ffb640 1 -- 172.21.15.29:0/2721186798 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f4f20054080 con 0x7f4f2406b470 2024-04-15T00:01:09.153 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:09.153 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-04-15T00:01:09.154 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-15T00:01:09.154 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-04-15T00:01:09.154 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-04-15T00:01:09.154 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-15T00:01:09.154 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-04-15T00:01:09.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4f0806b9e0 msgr2=0x7f4f0806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4f0806b9e0 0x7f4f0806dea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f240c76e0 tx=0x7f4f14009190 comp rx=0 tx=0).stop 2024-04-15T00:01:09.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 msgr2=0x7f4f241efd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f241efd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4f20000c00 tx=0x7f4f200046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 shutdown_connections 2024-04-15T00:01:09.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4f0806b9e0 0x7f4f0806dea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f24070ce0 0x7f4f2415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4f2406b850 0x7f4f241f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 --2- 172.21.15.29:0/2721186798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f2406b470 0x7f4f241efd10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 >> 172.21.15.29:0/2721186798 conn(0x7f4f2406c310 msgr2=0x7f4f240c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:09.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 shutdown_connections 2024-04-15T00:01:09.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.150+0000 7f4f2b755640 1 -- 172.21.15.29:0/2721186798 wait complete. 2024-04-15T00:01:09.167 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-15T00:01:09.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-15T00:01:09.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.267+0000 7f8958ede640 1 Processor -- start 2024-04-15T00:01:09.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.267+0000 7f8958ede640 1 -- start start 2024-04-15T00:01:09.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.268+0000 7f8958ede640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89540cdf40 0x7f89540cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:09.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.268+0000 7f8958ede640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895415be90 con 0x7f89541547c0 2024-04-15T00:01:09.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.268+0000 7f8958ede640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89540ce4a0 con 0x7f89540ca570 2024-04-15T00:01:09.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.268+0000 7f8958ede640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f89540cf390 con 0x7f89540cdf40 2024-04-15T00:01:09.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.268+0000 7f895259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f89541547c0 0x7f895415ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43510/0 (socket says 172.21.15.29:43510) 2024-04-15T00:01:09.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.268+0000 7f895259c640 1 -- 172.21.15.29:0/479466334 learned_addr learned my addr 172.21.15.29:0/479466334 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:09.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.269+0000 7f8952d9d640 1 --2- 172.21.15.29:0/479466334 >> v2:172.21.15.37:3300/0 conn(0x7f89540cdf40 0x7f89540cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:09.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.271+0000 7f895159a640 1 -- 172.21.15.29:0/479466334 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17952386 0 0) 0x7f895415be90 con 0x7f89541547c0 2024-04-15T00:01:09.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.271+0000 7f895159a640 1 -- 172.21.15.29:0/479466334 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8940003520 con 0x7f89541547c0 2024-04-15T00:01:09.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.273+0000 7f8952d9d640 1 -- 172.21.15.29:0/479466334 >> v1:172.21.15.37:6789/0 conn(0x7f89540ca570 legacy=0x7f895415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.273+0000 7f8952d9d640 1 -- 172.21.15.29:0/479466334 >> v1:172.21.15.29:6789/0 conn(0x7f89541547c0 legacy=0x7f895415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.273+0000 7f8952d9d640 1 -- 172.21.15.29:0/479466334 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89540ce780 con 0x7f89540cdf40 2024-04-15T00:01:09.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.277+0000 7f8952d9d640 1 --2- 172.21.15.29:0/479466334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540cdf40 0x7f89540cc490 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8944009d90 tx=0x7f894402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ca2421f2ef4296 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:09.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.282+0000 7f895159a640 1 -- 172.21.15.29:0/479466334 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944039070 con 0x7f89540cdf40 2024-04-15T00:01:09.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.282+0000 7f895159a640 1 -- 172.21.15.29:0/479466334 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894402cd80 con 0x7f89540cdf40 2024-04-15T00:01:09.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.282+0000 7f895159a640 1 -- 172.21.15.29:0/479466334 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944034660 con 0x7f89540cdf40 2024-04-15T00:01:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 -- 172.21.15.29:0/479466334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540cdf40 msgr2=0x7f89540cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 --2- 172.21.15.29:0/479466334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540cdf40 0x7f89540cc490 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8944009d90 tx=0x7f894402bfd0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 -- 172.21.15.29:0/479466334 shutdown_connections 2024-04-15T00:01:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 --2- 172.21.15.29:0/479466334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540cdf40 0x7f89540cc490 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 -- 172.21.15.29:0/479466334 >> 172.21.15.29:0/479466334 conn(0x7f8954062250 msgr2=0x7f89540cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 -- 172.21.15.29:0/479466334 shutdown_connections 2024-04-15T00:01:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.283+0000 7f8958ede640 1 -- 172.21.15.29:0/479466334 wait complete. 2024-04-15T00:01:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.284+0000 7f8958ede640 1 Processor -- start 2024-04-15T00:01:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.284+0000 7f8958ede640 1 -- start start 2024-04-15T00:01:09.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.285+0000 7f8958ede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540ca570 0x7f8954148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:09.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.285+0000 7f8958ede640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f89540cdf40 0x7f89540b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.285+0000 7f8958ede640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 0x7f89540af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.285+0000 7f8958ede640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f89540cf020 con 0x7f89541547c0 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.285+0000 7f8958ede640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89540ced40 con 0x7f89540ca570 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.285+0000 7f8958ede640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f89540cf820 con 0x7f89540cdf40 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.286+0000 7f8952d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 0x7f89540af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.286+0000 7f8952d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 0x7f89540af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36128/0 (socket says 172.21.15.29:36128) 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.286+0000 7f8952d9d640 1 -- 172.21.15.29:0/488956680 learned_addr learned my addr 172.21.15.29:0/488956680 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.286+0000 7f8951d9b640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f89540cdf40 0x7f89540b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:09.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.286+0000 7f895259c640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540ca570 0x7f8954148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.290+0000 7f8952d9d640 1 -- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f89540cdf40 msgr2=0x7f89540b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.290+0000 7f8952d9d640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f89540cdf40 0x7f89540b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.290+0000 7f8952d9d640 1 -- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540ca570 msgr2=0x7f8954148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.290+0000 7f8952d9d640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540ca570 0x7f8954148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.290+0000 7f8952d9d640 1 -- 172.21.15.29:0/488956680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8954152470 con 0x7f89541547c0 2024-04-15T00:01:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.292+0000 7f8952d9d640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 0x7f89540af570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8944009eb0 tx=0x7f8944004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.296+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944044020 con 0x7f89541547c0 2024-04-15T00:01:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.296+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894403f470 con 0x7f89541547c0 2024-04-15T00:01:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.296+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8954153510 con 0x7f89541547c0 2024-04-15T00:01:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.296+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944039040 con 0x7f89541547c0 2024-04-15T00:01:09.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.296+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8954152190 con 0x7f89541547c0 2024-04-15T00:01:09.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.297+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895404f540 con 0x7f89541547c0 2024-04-15T00:01:09.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.567+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8944047020 con 0x7f89541547c0 2024-04-15T00:01:09.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.568+0000 7f894affd640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f893406ba10 0x7f893406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:09.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.568+0000 7f895259c640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f893406ba10 0x7f893406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:09.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.569+0000 7f895259c640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f893406ba10 0x7f893406ded0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f894c005880 tx=0x7f894c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:09.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.583+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8944082110 con 0x7f89541547c0 2024-04-15T00:01:09.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.583+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f894404e030 con 0x7f89541547c0 2024-04-15T00:01:09.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:09.771+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f895415b160 con 0x7f89541547c0 2024-04-15T00:01:10.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.878+0000 7f894affd640 1 -- 172.21.15.29:0/488956680 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f894407bb80 con 0x7f89541547c0 2024-04-15T00:01:10.884 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-04-15T00:01:10.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f893406ba10 msgr2=0x7f893406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:10.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f893406ba10 0x7f893406ded0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f894c005880 tx=0x7f894c009040 comp rx=0 tx=0).stop 2024-04-15T00:01:10.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 msgr2=0x7f89540af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 0x7f89540af570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8944009eb0 tx=0x7f8944004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 shutdown_connections 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f893406ba10 0x7f893406ded0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89541547c0 0x7f89540af570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f89540cdf40 0x7f89540b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 --2- 172.21.15.29:0/488956680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89540ca570 0x7f8954148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 >> 172.21.15.29:0/488956680 conn(0x7f8954062250 msgr2=0x7f89541493a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 shutdown_connections 2024-04-15T00:01:10.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:10.880+0000 7f8958ede640 1 -- 172.21.15.29:0/488956680 wait complete. 2024-04-15T00:01:10.897 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-15T00:01:11.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.003+0000 7f609e8d5640 1 Processor -- start 2024-04-15T00:01:11.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.003+0000 7f609e8d5640 1 -- start start 2024-04-15T00:01:11.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.004+0000 7f609e8d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60980c2c50 0x7f60980c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:11.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.004+0000 7f609e8d5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609815a190 con 0x7f60980c82f0 2024-04-15T00:01:11.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.004+0000 7f609e8d5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609806d090 con 0x7f6098154580 2024-04-15T00:01:11.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.004+0000 7f609e8d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f609815a4e0 con 0x7f60980c2c50 2024-04-15T00:01:11.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.004+0000 7f60977fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f60980c82f0 0x7f6098070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43524/0 (socket says 172.21.15.29:43524) 2024-04-15T00:01:11.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.004+0000 7f60977fe640 1 -- 172.21.15.29:0/3592427179 learned_addr learned my addr 172.21.15.29:0/3592427179 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:11.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.005+0000 7f609ce72640 1 --2- 172.21.15.29:0/3592427179 >> v2:172.21.15.37:3300/0 conn(0x7f60980c2c50 0x7f60980c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.007+0000 7f6096ffd640 1 -- 172.21.15.29:0/3592427179 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29096978 0 0) 0x7f609815a190 con 0x7f60980c82f0 2024-04-15T00:01:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.007+0000 7f6096ffd640 1 -- 172.21.15.29:0/3592427179 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6084003520 con 0x7f60980c82f0 2024-04-15T00:01:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.008+0000 7f609ce72640 1 -- 172.21.15.29:0/3592427179 >> v1:172.21.15.37:6789/0 conn(0x7f6098154580 legacy=0x7f609815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.008+0000 7f609ce72640 1 -- 172.21.15.29:0/3592427179 >> v1:172.21.15.29:6789/0 conn(0x7f60980c82f0 legacy=0x7f6098070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.008+0000 7f609ce72640 1 -- 172.21.15.29:0/3592427179 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980c87e0 con 0x7f60980c2c50 2024-04-15T00:01:11.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.012+0000 7f609ce72640 1 --2- 172.21.15.29:0/3592427179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60980c2c50 0x7f60980c9de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f609002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85ea577fa0bab1e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:11.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f6096ffd640 1 -- 172.21.15.29:0/3592427179 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090039070 con 0x7f60980c2c50 2024-04-15T00:01:11.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f6096ffd640 1 -- 172.21.15.29:0/3592427179 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609002cc60 con 0x7f60980c2c50 2024-04-15T00:01:11.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f6096ffd640 1 -- 172.21.15.29:0/3592427179 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090034660 con 0x7f60980c2c50 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f609e8d5640 1 -- 172.21.15.29:0/3592427179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60980c2c50 msgr2=0x7f60980c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3592427179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60980c2c50 0x7f60980c9de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f609002beb0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f609e8d5640 1 -- 172.21.15.29:0/3592427179 shutdown_connections 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3592427179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60980c2c50 0x7f60980c9de0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.016+0000 7f609e8d5640 1 -- 172.21.15.29:0/3592427179 >> 172.21.15.29:0/3592427179 conn(0x7f60980ca3f0 msgr2=0x7f60980ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.017+0000 7f609e8d5640 1 -- 172.21.15.29:0/3592427179 shutdown_connections 2024-04-15T00:01:11.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.017+0000 7f609e8d5640 1 -- 172.21.15.29:0/3592427179 wait complete. 2024-04-15T00:01:11.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.018+0000 7f609e8d5640 1 Processor -- start 2024-04-15T00:01:11.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.018+0000 7f609e8d5640 1 -- start start 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.018+0000 7f609e8d5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f60980c2c50 0x7f6098150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f609e8d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 0x7f609814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f609e8d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6098154580 0x7f6098149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f609e8d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f60980c9080 con 0x7f60980c82f0 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f609e8d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f60980c8da0 con 0x7f6098154580 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f609e8d5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f609815b080 con 0x7f60980c2c50 2024-04-15T00:01:11.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f60977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 0x7f609814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:11.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f6097fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f60980c2c50 0x7f6098150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:11.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f609ce72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6098154580 0x7f6098149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:11.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f60977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 0x7f609814f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36140/0 (socket says 172.21.15.29:36140) 2024-04-15T00:01:11.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.019+0000 7f60977fe640 1 -- 172.21.15.29:0/3685961281 learned_addr learned my addr 172.21.15.29:0/3685961281 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:11.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.023+0000 7f60977fe640 1 -- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f60980c2c50 msgr2=0x7f6098150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.023+0000 7f60977fe640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f60980c2c50 0x7f6098150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.023+0000 7f60977fe640 1 -- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6098154580 msgr2=0x7f6098149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.023+0000 7f60977fe640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6098154580 0x7f6098149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.023+0000 7f60977fe640 1 -- 172.21.15.29:0/3685961281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609814e130 con 0x7f60980c82f0 2024-04-15T00:01:11.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.025+0000 7f60977fe640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 0x7f609814f1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f608000c500 tx=0x7f608000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.029+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080017070 con 0x7f60980c82f0 2024-04-15T00:01:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.029+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6080005ce0 con 0x7f60980c82f0 2024-04-15T00:01:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.029+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609814e410 con 0x7f60980c82f0 2024-04-15T00:01:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.029+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080007330 con 0x7f60980c82f0 2024-04-15T00:01:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.029+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609814e9d0 con 0x7f60980c82f0 2024-04-15T00:01:11.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.030+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609804f540 con 0x7f60980c82f0 2024-04-15T00:01:11.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.049+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f608001a070 con 0x7f60980c82f0 2024-04-15T00:01:11.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.050+0000 7f6094ff9640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f607806b990 0x7f607806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:11.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.050+0000 7f6097fff640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f607806b990 0x7f607806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:11.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.051+0000 7f6097fff640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f607806b990 0x7f607806de50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6088000f60 tx=0x7f6088009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:11.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.052+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f60800567c0 con 0x7f60980c82f0 2024-04-15T00:01:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.309+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6080021020 con 0x7f60980c82f0 2024-04-15T00:01:11.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.495+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f60980c4740 con 0x7f60980c82f0 2024-04-15T00:01:11.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.932+0000 7f6094ff9640 1 -- 172.21.15.29:0/3685961281 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f6080058720 con 0x7f60980c82f0 2024-04-15T00:01:11.938 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-04-15T00:01:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f607806b990 msgr2=0x7f607806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f607806b990 0x7f607806de50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6088000f60 tx=0x7f6088009040 comp rx=0 tx=0).stop 2024-04-15T00:01:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 msgr2=0x7f609814f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 0x7f609814f1d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f608000c500 tx=0x7f608000c9c0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 shutdown_connections 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f607806b990 0x7f607806de50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6098154580 0x7f6098149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60980c82f0 0x7f609814f1d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 --2- 172.21.15.29:0/3685961281 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f60980c2c50 0x7f6098150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 >> 172.21.15.29:0/3685961281 conn(0x7f60980ca3f0 msgr2=0x7f60981525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 shutdown_connections 2024-04-15T00:01:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:11.934+0000 7f609e8d5640 1 -- 172.21.15.29:0/3685961281 wait complete. 2024-04-15T00:01:11.951 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-15T00:01:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.059+0000 7f045ea08640 1 Processor -- start 2024-04-15T00:01:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.059+0000 7f045ea08640 1 -- start start 2024-04-15T00:01:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.060+0000 7f045ea08640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f045815ac30 0x7f045815b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.060+0000 7f045ea08640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 0x7f04580ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.060+0000 7f045ea08640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045815ba10 con 0x7f04580ca470 2024-04-15T00:01:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.060+0000 7f045ea08640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0458154cc0 con 0x7f045815ac30 2024-04-15T00:01:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.060+0000 7f045ea08640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f045815c5b0 con 0x7f04580cca40 2024-04-15T00:01:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.061+0000 7f045cfa5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 0x7f04580ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.061+0000 7f045cfa5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 0x7f04580ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:42036/0 (socket says 172.21.15.29:42036) 2024-04-15T00:01:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.061+0000 7f045cfa5640 1 -- 172.21.15.29:0/3684885129 learned_addr learned my addr 172.21.15.29:0/3684885129 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.064+0000 7f045cfa5640 1 -- 172.21.15.29:0/3684885129 >> v2:172.21.15.37:3300/0 conn(0x7f045815ac30 msgr2=0x7f045815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.064+0000 7f045cfa5640 1 --2- 172.21.15.29:0/3684885129 >> v2:172.21.15.37:3300/0 conn(0x7f045815ac30 0x7f045815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.064+0000 7f045cfa5640 1 -- 172.21.15.29:0/3684885129 >> v1:172.21.15.37:6789/0 conn(0x7f04580ca470 legacy=0x7f04580cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.064+0000 7f045cfa5640 1 -- 172.21.15.29:0/3684885129 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045815bc80 con 0x7f04580cca40 2024-04-15T00:01:12.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.066+0000 7f045cfa5640 1 --2- 172.21.15.29:0/3684885129 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 0x7f04580ca8b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0450009e50 tx=0x7f045002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b408f4c99fdca49b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.070+0000 7f0456ffd640 1 -- 172.21.15.29:0/3684885129 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045002cb00 con 0x7f04580cca40 2024-04-15T00:01:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.070+0000 7f0456ffd640 1 -- 172.21.15.29:0/3684885129 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045002cca0 con 0x7f04580cca40 2024-04-15T00:01:12.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.070+0000 7f0456ffd640 1 -- 172.21.15.29:0/3684885129 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450034610 con 0x7f04580cca40 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 -- 172.21.15.29:0/3684885129 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 msgr2=0x7f04580ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 --2- 172.21.15.29:0/3684885129 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 0x7f04580ca8b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0450009e50 tx=0x7f045002bf60 comp rx=0 tx=0).stop 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 -- 172.21.15.29:0/3684885129 shutdown_connections 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 --2- 172.21.15.29:0/3684885129 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580cca40 0x7f04580ca8b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 --2- 172.21.15.29:0/3684885129 >> v2:172.21.15.37:3300/0 conn(0x7f045815ac30 0x7f045815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 -- 172.21.15.29:0/3684885129 >> 172.21.15.29:0/3684885129 conn(0x7f04580cfaf0 msgr2=0x7f04580cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 -- 172.21.15.29:0/3684885129 shutdown_connections 2024-04-15T00:01:12.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.071+0000 7f045ea08640 1 -- 172.21.15.29:0/3684885129 wait complete. 2024-04-15T00:01:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.072+0000 7f045ea08640 1 Processor -- start 2024-04-15T00:01:12.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.072+0000 7f045ea08640 1 -- start start 2024-04-15T00:01:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.073+0000 7f045ea08640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 0x7f04580cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.073+0000 7f045ea08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04580cca40 0x7f04580c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.073+0000 7f045ea08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045815ac30 0x7f04581538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.073+0000 7f045ea08640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f04580ccec0 con 0x7f04580cca40 2024-04-15T00:01:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.073+0000 7f045ea08640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f045815c240 con 0x7f045815ac30 2024-04-15T00:01:12.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.073+0000 7f045ea08640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f045815ca40 con 0x7f04580ca470 2024-04-15T00:01:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.074+0000 7f0457fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 0x7f04580cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.074+0000 7f0457fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 0x7f04580cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:42046/0 (socket says 172.21.15.29:42046) 2024-04-15T00:01:12.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.074+0000 7f0457fff640 1 -- 172.21.15.29:0/2420880414 learned_addr learned my addr 172.21.15.29:0/2420880414 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:12.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.077+0000 7f04577fe640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04580cca40 0x7f04580c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:12.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.078+0000 7f0457fff640 1 -- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045815ac30 msgr2=0x7f04581538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:12.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.078+0000 7f0457fff640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045815ac30 0x7f04581538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:12.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.078+0000 7f0457fff640 1 -- 172.21.15.29:0/2420880414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04580cca40 msgr2=0x7f04580c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:12.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.078+0000 7f0457fff640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04580cca40 0x7f04580c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:12.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.078+0000 7f0457fff640 1 -- 172.21.15.29:0/2420880414 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04580c6f00 con 0x7f04580ca470 2024-04-15T00:01:12.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.089+0000 7f0457fff640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 0x7f04580cddf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f044c00b440 tx=0x7f044c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:12.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.093+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c011830 con 0x7f04580ca470 2024-04-15T00:01:12.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.094+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c016070 con 0x7f04580ca470 2024-04-15T00:01:12.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.094+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04580c71e0 con 0x7f04580ca470 2024-04-15T00:01:12.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.094+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c011c10 con 0x7f04580ca470 2024-04-15T00:01:12.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.094+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04580c77a0 con 0x7f04580ca470 2024-04-15T00:01:12.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.095+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045804f540 con 0x7f04580ca470 2024-04-15T00:01:12.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.372+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f044c01b460 con 0x7f04580ca470 2024-04-15T00:01:12.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.372+0000 7f0454ff9640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f044406b9c0 0x7f044406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:12.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.373+0000 7f04577fe640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f044406b9c0 0x7f044406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:12.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.373+0000 7f04577fe640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f044406b9c0 0x7f044406de80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0448007fd0 tx=0x7f0448009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:12.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.375+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f044c057550 con 0x7f04580ca470 2024-04-15T00:01:12.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.385+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f044c059bb0 con 0x7f04580ca470 2024-04-15T00:01:12.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:12.605+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f04580b10a0 con 0x7f04580ca470 2024-04-15T00:01:13.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.383+0000 7f0454ff9640 1 -- 172.21.15.29:0/2420880414 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f044c0594b0 con 0x7f04580ca470 2024-04-15T00:01:13.390 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-04-15T00:01:13.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f044406b9c0 msgr2=0x7f044406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:13.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f044406b9c0 0x7f044406de80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0448007fd0 tx=0x7f0448009040 comp rx=0 tx=0).stop 2024-04-15T00:01:13.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 msgr2=0x7f04580cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:13.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 0x7f04580cddf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f044c00b440 tx=0x7f044c00b900 comp rx=0 tx=0).stop 2024-04-15T00:01:13.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 shutdown_connections 2024-04-15T00:01:13.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f044406b9c0 0x7f044406de80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f045815ac30 0x7f04581538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04580cca40 0x7f04580c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 --2- 172.21.15.29:0/2420880414 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f04580ca470 0x7f04580cddf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 >> 172.21.15.29:0/2420880414 conn(0x7f04580cfaf0 msgr2=0x7f045815ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:13.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 shutdown_connections 2024-04-15T00:01:13.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.386+0000 7f045ea08640 1 -- 172.21.15.29:0/2420880414 wait complete. 2024-04-15T00:01:13.403 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-15T00:01:13.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-15T00:01:13.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 Processor -- start 2024-04-15T00:01:13.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 -- start start 2024-04-15T00:01:13.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7b20152460 0x7f7b20158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:13.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b200ca050 0x7f7b2015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:13.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b20152840 con 0x7f7b200c87b0 2024-04-15T00:01:13.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f7b20158780 con 0x7f7b20152460 2024-04-15T00:01:13.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.507+0000 7f7b26511640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7b20158a60 con 0x7f7b200ca050 2024-04-15T00:01:13.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.508+0000 7f7b1f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b200ca050 0x7f7b2015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:13.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.508+0000 7f7b1f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b200ca050 0x7f7b2015bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:40154/0 (socket says 172.21.15.29:40154) 2024-04-15T00:01:13.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.508+0000 7f7b1f7fe640 1 -- 172.21.15.29:0/3216648169 learned_addr learned my addr 172.21.15.29:0/3216648169 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:13.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.510+0000 7f7b1ffff640 1 --2- 172.21.15.29:0/3216648169 >> v2:172.21.15.29:3300/0 conn(0x7f7b20152460 0x7f7b20158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:13.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.511+0000 7f7b1f7fe640 1 -- 172.21.15.29:0/3216648169 >> v2:172.21.15.29:3300/0 conn(0x7f7b20152460 msgr2=0x7f7b20158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:13.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.511+0000 7f7b1f7fe640 1 --2- 172.21.15.29:0/3216648169 >> v2:172.21.15.29:3300/0 conn(0x7f7b20152460 0x7f7b20158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.511+0000 7f7b1f7fe640 1 -- 172.21.15.29:0/3216648169 >> v1:172.21.15.29:6789/0 conn(0x7f7b200c87b0 legacy=0x7f7b200c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:13.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.511+0000 7f7b1f7fe640 1 -- 172.21.15.29:0/3216648169 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b20158d40 con 0x7f7b200ca050 2024-04-15T00:01:13.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.515+0000 7f7b1f7fe640 1 --2- 172.21.15.29:0/3216648169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200ca050 0x7f7b2015bfd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b20071310 tx=0x7f7b1402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eadda2f54e9ce8a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:13.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.523+0000 7f7b1effd640 1 -- 172.21.15.29:0/3216648169 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402d040 con 0x7f7b200ca050 2024-04-15T00:01:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.525+0000 7f7b1effd640 1 -- 172.21.15.29:0/3216648169 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14004230 con 0x7f7b200ca050 2024-04-15T00:01:13.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.525+0000 7f7b1effd640 1 -- 172.21.15.29:0/3216648169 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14003610 con 0x7f7b200ca050 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.525+0000 7f7b26511640 1 -- 172.21.15.29:0/3216648169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200ca050 msgr2=0x7f7b2015bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.525+0000 7f7b26511640 1 --2- 172.21.15.29:0/3216648169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200ca050 0x7f7b2015bfd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b20071310 tx=0x7f7b1402b8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.526+0000 7f7b26511640 1 -- 172.21.15.29:0/3216648169 shutdown_connections 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.526+0000 7f7b26511640 1 --2- 172.21.15.29:0/3216648169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200ca050 0x7f7b2015bfd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.526+0000 7f7b26511640 1 --2- 172.21.15.29:0/3216648169 >> v2:172.21.15.29:3300/0 conn(0x7f7b20152460 0x7f7b20158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.526+0000 7f7b26511640 1 -- 172.21.15.29:0/3216648169 >> 172.21.15.29:0/3216648169 conn(0x7f7b20061c20 msgr2=0x7f7b20062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.526+0000 7f7b26511640 1 -- 172.21.15.29:0/3216648169 shutdown_connections 2024-04-15T00:01:13.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.526+0000 7f7b26511640 1 -- 172.21.15.29:0/3216648169 wait complete. 2024-04-15T00:01:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.527+0000 7f7b26511640 1 Processor -- start 2024-04-15T00:01:13.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.527+0000 7f7b26511640 1 -- start start 2024-04-15T00:01:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b26511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200c87b0 0x7f7b201f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b26511640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7b200ca050 0x7f7b201ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b26511640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 0x7f7b2014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b26511640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7b200c2e30 con 0x7f7b20152460 2024-04-15T00:01:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b26511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2015bab0 con 0x7f7b200c87b0 2024-04-15T00:01:13.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b26511640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f7b20159020 con 0x7f7b200ca050 2024-04-15T00:01:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b24aae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 0x7f7b2014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200c87b0 0x7f7b201f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b1f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7b200ca050 0x7f7b201ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b24aae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 0x7f7b2014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36174/0 (socket says 172.21.15.29:36174) 2024-04-15T00:01:13.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.528+0000 7f7b24aae640 1 -- 172.21.15.29:0/2442093383 learned_addr learned my addr 172.21.15.29:0/2442093383 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:13.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.532+0000 7f7b24aae640 1 -- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7b200ca050 msgr2=0x7f7b201ee470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:13.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.532+0000 7f7b24aae640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7b200ca050 0x7f7b201ee470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.532+0000 7f7b24aae640 1 -- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200c87b0 msgr2=0x7f7b201f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:13.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.532+0000 7f7b24aae640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200c87b0 0x7f7b201f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:13.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.532+0000 7f7b24aae640 1 -- 172.21.15.29:0/2442093383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b201ee9b0 con 0x7f7b20152460 2024-04-15T00:01:13.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.534+0000 7f7b24aae640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 0x7f7b2014f2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c7b0 tx=0x7f7b1800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:13.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.538+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18017070 con 0x7f7b20152460 2024-04-15T00:01:13.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.538+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18003da0 con 0x7f7b20152460 2024-04-15T00:01:13.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.538+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b201e1370 con 0x7f7b20152460 2024-04-15T00:01:13.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.538+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b180052b0 con 0x7f7b20152460 2024-04-15T00:01:13.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.538+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b201e1930 con 0x7f7b20152460 2024-04-15T00:01:13.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.539+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2004f540 con 0x7f7b20152460 2024-04-15T00:01:13.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.818+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7b1801a070 con 0x7f7b20152460 2024-04-15T00:01:13.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.819+0000 7f7b1cff9640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7b0c06b990 0x7f7b0c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:13.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.819+0000 7f7b1ffff640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7b0c06b990 0x7f7b0c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:13.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.819+0000 7f7b1ffff640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7b0c06b990 0x7f7b0c06de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000aa20 tx=0x7f7b10008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:13.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.846+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7b18056900 con 0x7f7b20152460 2024-04-15T00:01:13.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:13.846+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7b18021020 con 0x7f7b20152460 2024-04-15T00:01:14.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:14.066+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7b200c92f0 con 0x7f7b20152460 2024-04-15T00:01:15.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.094+0000 7f7b1cff9640 1 -- 172.21.15.29:0/2442093383 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f7b18058860 con 0x7f7b20152460 2024-04-15T00:01:15.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7b0c06b990 msgr2=0x7f7b0c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7b0c06b990 0x7f7b0c06de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000aa20 tx=0x7f7b10008040 comp rx=0 tx=0).stop 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 msgr2=0x7f7b2014f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 0x7f7b2014f2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c7b0 tx=0x7f7b1800cc70 comp rx=0 tx=0).stop 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 shutdown_connections 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7b0c06b990 0x7f7b0c06de50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b20152460 0x7f7b2014f2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7b200ca050 0x7f7b201ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 --2- 172.21.15.29:0/2442093383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b200c87b0 0x7f7b201f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 >> 172.21.15.29:0/2442093383 conn(0x7f7b20061c20 msgr2=0x7f7b20062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 shutdown_connections 2024-04-15T00:01:15.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.096+0000 7f7b26511640 1 -- 172.21.15.29:0/2442093383 wait complete. 2024-04-15T00:01:15.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-15T00:01:15.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.225+0000 7f1d89836640 1 Processor -- start 2024-04-15T00:01:15.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.225+0000 7f1d89836640 1 -- start start 2024-04-15T00:01:15.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.226+0000 7f1d89836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 0x7f1d840ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.226+0000 7f1d89836640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d8415e470 0x7f1d8415d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.226+0000 7f1d89836640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d8415deb0 0x7f1d840ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.226+0000 7f1d89836640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1d840cc370 con 0x7f1d8415e470 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.226+0000 7f1d89836640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1d84154b40 con 0x7f1d8415deb0 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.226+0000 7f1d89836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1d840ce630 con 0x7f1d84154760 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.227+0000 7f1d82ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 0x7f1d840ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.227+0000 7f1d837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d8415deb0 0x7f1d840ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.227+0000 7f1d837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d8415deb0 0x7f1d840ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:40158/0 (socket says 172.21.15.29:40158) 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.227+0000 7f1d82ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 0x7f1d840ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:42052/0 (socket says 172.21.15.29:42052) 2024-04-15T00:01:15.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.227+0000 7f1d837fe640 1 -- 172.21.15.29:0/449166287 learned_addr learned my addr 172.21.15.29:0/449166287 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:15.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.230+0000 7f1d837fe640 1 -- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 msgr2=0x7f1d840ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:15.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.230+0000 7f1d837fe640 1 --2- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 0x7f1d840ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.230+0000 7f1d837fe640 1 -- 172.21.15.29:0/449166287 >> v2:172.21.15.29:3300/0 conn(0x7f1d8415e470 msgr2=0x7f1d8415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:15.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.230+0000 7f1d837fe640 1 --2- 172.21.15.29:0/449166287 >> v2:172.21.15.29:3300/0 conn(0x7f1d8415e470 0x7f1d8415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.230+0000 7f1d837fe640 1 -- 172.21.15.29:0/449166287 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d840ce910 con 0x7f1d8415deb0 2024-04-15T00:01:15.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.230+0000 7f1d82ffd640 1 --2- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 0x7f1d840ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:15.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.232+0000 7f1d837fe640 1 --2- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415deb0 0x7f1d840ccb00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d8406bd60 tx=0x7f1d7c02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e38ecc0dda593c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:15.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.237+0000 7f1d81ffb640 1 -- 172.21.15.29:0/449166287 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c02ca70 con 0x7f1d8415deb0 2024-04-15T00:01:15.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.237+0000 7f1d81ffb640 1 -- 172.21.15.29:0/449166287 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c02cc10 con 0x7f1d8415deb0 2024-04-15T00:01:15.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.237+0000 7f1d81ffb640 1 -- 172.21.15.29:0/449166287 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0343f0 con 0x7f1d8415deb0 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 -- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415deb0 msgr2=0x7f1d840ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 --2- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415deb0 0x7f1d840ccb00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d8406bd60 tx=0x7f1d7c02bed0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 -- 172.21.15.29:0/449166287 shutdown_connections 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 --2- 172.21.15.29:0/449166287 >> v2:172.21.15.29:3300/0 conn(0x7f1d8415e470 0x7f1d8415d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 --2- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415deb0 0x7f1d840ccb00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 --2- 172.21.15.29:0/449166287 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d84154760 0x7f1d840ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 -- 172.21.15.29:0/449166287 >> 172.21.15.29:0/449166287 conn(0x7f1d84061c20 msgr2=0x7f1d84062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 -- 172.21.15.29:0/449166287 shutdown_connections 2024-04-15T00:01:15.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.238+0000 7f1d89836640 1 -- 172.21.15.29:0/449166287 wait complete. 2024-04-15T00:01:15.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.239+0000 7f1d89836640 1 Processor -- start 2024-04-15T00:01:15.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.239+0000 7f1d89836640 1 -- start start 2024-04-15T00:01:15.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.240+0000 7f1d89836640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d84154760 0x7f1d8414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.240+0000 7f1d89836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d8415deb0 0x7f1d8414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.240+0000 7f1d89836640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 0x7f1d841f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.240+0000 7f1d89836640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1d840ceed0 con 0x7f1d84154760 2024-04-15T00:01:15.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.240+0000 7f1d89836640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d840cc5e0 con 0x7f1d8415e470 2024-04-15T00:01:15.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.240+0000 7f1d89836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1d840cac10 con 0x7f1d8415deb0 2024-04-15T00:01:15.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.241+0000 7f1d837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 0x7f1d841f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:15.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.241+0000 7f1d827fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d8415deb0 0x7f1d8414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:15.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.241+0000 7f1d837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 0x7f1d841f0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:40160/0 (socket says 172.21.15.29:40160) 2024-04-15T00:01:15.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.241+0000 7f1d837fe640 1 -- 172.21.15.29:0/397096742 learned_addr learned my addr 172.21.15.29:0/397096742 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:15.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.244+0000 7f1d837fe640 1 -- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d8415deb0 msgr2=0x7f1d8414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:15.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.244+0000 7f1d837fe640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d8415deb0 0x7f1d8414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.244+0000 7f1d837fe640 1 -- 172.21.15.29:0/397096742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d84154760 msgr2=0x7f1d8414d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:15.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.244+0000 7f1d837fe640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d84154760 0x7f1d8414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:15.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.244+0000 7f1d837fe640 1 -- 172.21.15.29:0/397096742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d841f0e90 con 0x7f1d8415e470 2024-04-15T00:01:15.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.247+0000 7f1d837fe640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 0x7f1d841f0950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c02c4e0 tx=0x7f1d7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:15.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.250+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c043020 con 0x7f1d8415e470 2024-04-15T00:01:15.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.250+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c03e450 con 0x7f1d8415e470 2024-04-15T00:01:15.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.250+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d841551a0 con 0x7f1d8415e470 2024-04-15T00:01:15.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.250+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c009510 con 0x7f1d8415e470 2024-04-15T00:01:15.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.250+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8414caa0 con 0x7f1d8415e470 2024-04-15T00:01:15.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.251+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8404f540 con 0x7f1d8415e470 2024-04-15T00:01:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.533+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1d7c046020 con 0x7f1d8415e470 2024-04-15T00:01:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.533+0000 7f1d6bfff640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1d7006b9e0 0x7f1d7006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.534+0000 7f1d82ffd640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1d7006b9e0 0x7f1d7006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.534+0000 7f1d82ffd640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1d7006b9e0 0x7f1d7006dea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006e80 tx=0x7f1d78006dd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.537+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7f1d7c079dd0 con 0x7f1d8415e470 2024-04-15T00:01:15.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.549+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1d7c04d020 con 0x7f1d8415e470 2024-04-15T00:01:15.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:15.733+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1d8406dc80 con 0x7f1d8415e470 2024-04-15T00:01:17.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.945+0000 7f1d6bfff640 1 -- 172.21.15.29:0/397096742 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7f1d841f0e90 con 0x7f1d8415e470 2024-04-15T00:01:17.951 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1d7006b9e0 msgr2=0x7f1d7006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1d7006b9e0 0x7f1d7006dea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006e80 tx=0x7f1d78006dd0 comp rx=0 tx=0).stop 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 msgr2=0x7f1d841f0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 0x7f1d841f0950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c02c4e0 tx=0x7f1d7c004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 shutdown_connections 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1d7006b9e0 0x7f1d7006dea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d8415e470 0x7f1d841f0950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d8415deb0 0x7f1d8414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 --2- 172.21.15.29:0/397096742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d84154760 0x7f1d8414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:17.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.947+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 >> 172.21.15.29:0/397096742 conn(0x7f1d84061c20 msgr2=0x7f1d84062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.948+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 shutdown_connections 2024-04-15T00:01:17.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:17.948+0000 7f1d89836640 1 -- 172.21.15.29:0/397096742 wait complete. 2024-04-15T00:01:17.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-15T00:01:18.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.063+0000 7fe1ea381640 1 Processor -- start 2024-04-15T00:01:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.063+0000 7fe1ea381640 1 -- start start 2024-04-15T00:01:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.064+0000 7fe1ea381640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1e40ca570 0x7fe1e415b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.064+0000 7fe1ea381640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1e40cdf40 0x7fe1e40cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.064+0000 7fe1ea381640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e40ce4a0 con 0x7fe1e41547c0 2024-04-15T00:01:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.064+0000 7fe1ea381640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e40cf390 con 0x7fe1e40cdf40 2024-04-15T00:01:18.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.064+0000 7fe1ea381640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e40ce780 con 0x7fe1e40ca570 2024-04-15T00:01:18.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.065+0000 7fe1e891e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1e40cdf40 0x7fe1e40cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.065+0000 7fe1e37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1e40ca570 0x7fe1e415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.065+0000 7fe1e891e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe1e40cdf40 0x7fe1e40cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48234/0 (socket says 172.21.15.29:48234) 2024-04-15T00:01:18.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.065+0000 7fe1e891e640 1 -- 172.21.15.29:0/1288681989 learned_addr learned my addr 172.21.15.29:0/1288681989 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.067+0000 7fe1e891e640 1 -- 172.21.15.29:0/1288681989 >> v2:172.21.15.37:3300/0 conn(0x7fe1e40ca570 msgr2=0x7fe1e415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.067+0000 7fe1e891e640 1 --2- 172.21.15.29:0/1288681989 >> v2:172.21.15.37:3300/0 conn(0x7fe1e40ca570 0x7fe1e415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.067+0000 7fe1e891e640 1 -- 172.21.15.29:0/1288681989 >> v1:172.21.15.37:6789/0 conn(0x7fe1e41547c0 legacy=0x7fe1e415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:18.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.067+0000 7fe1e891e640 1 -- 172.21.15.29:0/1288681989 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e40cea60 con 0x7fe1e40cdf40 2024-04-15T00:01:18.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.069+0000 7fe1e891e640 1 --2- 172.21.15.29:0/1288681989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40cdf40 0x7fe1e40cc490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1e415d7e0 tx=0x7fe1dc02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d18ec7b4a6b898 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:18.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.073+0000 7fe1e2ffd640 1 -- 172.21.15.29:0/1288681989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc02cbb0 con 0x7fe1e40cdf40 2024-04-15T00:01:18.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.073+0000 7fe1e2ffd640 1 -- 172.21.15.29:0/1288681989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc02cd50 con 0x7fe1e40cdf40 2024-04-15T00:01:18.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.073+0000 7fe1e2ffd640 1 -- 172.21.15.29:0/1288681989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc034610 con 0x7fe1e40cdf40 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 -- 172.21.15.29:0/1288681989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40cdf40 msgr2=0x7fe1e40cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 --2- 172.21.15.29:0/1288681989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40cdf40 0x7fe1e40cc490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1e415d7e0 tx=0x7fe1dc02c010 comp rx=0 tx=0).stop 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 -- 172.21.15.29:0/1288681989 shutdown_connections 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 --2- 172.21.15.29:0/1288681989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40cdf40 0x7fe1e40cc490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 --2- 172.21.15.29:0/1288681989 >> v2:172.21.15.37:3300/0 conn(0x7fe1e40ca570 0x7fe1e415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 -- 172.21.15.29:0/1288681989 >> 172.21.15.29:0/1288681989 conn(0x7fe1e4062250 msgr2=0x7fe1e40cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 -- 172.21.15.29:0/1288681989 shutdown_connections 2024-04-15T00:01:18.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.074+0000 7fe1ea381640 1 -- 172.21.15.29:0/1288681989 wait complete. 2024-04-15T00:01:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.075+0000 7fe1ea381640 1 Processor -- start 2024-04-15T00:01:18.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.075+0000 7fe1ea381640 1 -- start start 2024-04-15T00:01:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1ea381640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 0x7fe1e415d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1ea381640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1e40cdf40 0x7fe1e41e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1ea381640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e41547c0 0x7fe1e414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1ea381640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40cf820 con 0x7fe1e40ca570 2024-04-15T00:01:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1ea381640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40cf020 con 0x7fe1e41547c0 2024-04-15T00:01:18.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1ea381640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e415bcc0 con 0x7fe1e40cdf40 2024-04-15T00:01:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1e3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 0x7fe1e415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.076+0000 7fe1e891e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e41547c0 0x7fe1e414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.077+0000 7fe1e3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 0x7fe1e415d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48238/0 (socket says 172.21.15.29:48238) 2024-04-15T00:01:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.077+0000 7fe1e3fff640 1 -- 172.21.15.29:0/3757400490 learned_addr learned my addr 172.21.15.29:0/3757400490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:18.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.077+0000 7fe1e37fe640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1e40cdf40 0x7fe1e41e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.080+0000 7fe1e3fff640 1 -- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1e40cdf40 msgr2=0x7fe1e41e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.080+0000 7fe1e3fff640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1e40cdf40 0x7fe1e41e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.080+0000 7fe1e3fff640 1 -- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e41547c0 msgr2=0x7fe1e414dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.080+0000 7fe1e3fff640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e41547c0 0x7fe1e414dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.080+0000 7fe1e3fff640 1 -- 172.21.15.29:0/3757400490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e40b20a0 con 0x7fe1e40ca570 2024-04-15T00:01:18.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.082+0000 7fe1e3fff640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 0x7fe1e415d160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c3c0 tx=0x7fe1d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:18.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.086+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40052d0 con 0x7fe1e40ca570 2024-04-15T00:01:18.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.086+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d4005490 con 0x7fe1e40ca570 2024-04-15T00:01:18.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.086+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e415d6a0 con 0x7fe1e40ca570 2024-04-15T00:01:18.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.086+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4007260 con 0x7fe1e40ca570 2024-04-15T00:01:18.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.086+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e40c6990 con 0x7fe1e40ca570 2024-04-15T00:01:18.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.087+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e404f540 con 0x7fe1e40ca570 2024-04-15T00:01:18.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.351+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe1d4007400 con 0x7fe1e40ca570 2024-04-15T00:01:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.352+0000 7fe1e0ff9640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1d006b9c0 0x7fe1d006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.352+0000 7fe1e37fe640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1d006b9c0 0x7fe1d006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.352+0000 7fe1e37fe640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1d006b9c0 0x7fe1d006de80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1e415a210 tx=0x7fe1d8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.365+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fe1d4056b70 con 0x7fe1e40ca570 2024-04-15T00:01:18.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.365+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1d4058ad0 con 0x7fe1e40ca570 2024-04-15T00:01:18.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.546+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe1e40b5a90 con 0x7fe1e40ca570 2024-04-15T00:01:18.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.851+0000 7fe1e0ff9640 1 -- 172.21.15.29:0/3757400490 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fe1d405cb70 con 0x7fe1e40ca570 2024-04-15T00:01:18.857 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1d006b9c0 msgr2=0x7fe1d006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1d006b9c0 0x7fe1d006de80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1e415a210 tx=0x7fe1d8009190 comp rx=0 tx=0).stop 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 msgr2=0x7fe1e415d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 0x7fe1e415d160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c3c0 tx=0x7fe1d400c880 comp rx=0 tx=0).stop 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 shutdown_connections 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1d006b9c0 0x7fe1d006de80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e41547c0 0x7fe1e414dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1e40cdf40 0x7fe1e41e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 --2- 172.21.15.29:0/3757400490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1e40ca570 0x7fe1e415d160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 >> 172.21.15.29:0/3757400490 conn(0x7fe1e4062250 msgr2=0x7fe1e40cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:18.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 shutdown_connections 2024-04-15T00:01:18.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.853+0000 7fe1ea381640 1 -- 172.21.15.29:0/3757400490 wait complete. 2024-04-15T00:01:18.869 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-15T00:01:18.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.984+0000 7f1590408640 1 Processor -- start 2024-04-15T00:01:18.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.984+0000 7f1590408640 1 -- start start 2024-04-15T00:01:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.986+0000 7f1590408640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1588158910 0x7f158815e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.986+0000 7f1590408640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f15880c2650 0x7f15880c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.986+0000 7f1590408640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 0x7f15880cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.986+0000 7f1590408640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f15880c79a0 con 0x7f15880c2650 2024-04-15T00:01:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.986+0000 7f1590408640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1588162030 con 0x7f1588158910 2024-04-15T00:01:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.986+0000 7f1590408640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f158815ec70 con 0x7f15881624c0 2024-04-15T00:01:18.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.988+0000 7f158e9a5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 0x7f15880cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:18.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.988+0000 7f158e9a5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 0x7f15880cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:33982/0 (socket says 172.21.15.29:33982) 2024-04-15T00:01:18.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.988+0000 7f158e9a5640 1 -- 172.21.15.29:0/637857778 learned_addr learned my addr 172.21.15.29:0/637857778 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.991+0000 7f158e9a5640 1 -- 172.21.15.29:0/637857778 >> v2:172.21.15.37:3300/0 conn(0x7f1588158910 msgr2=0x7f158815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.991+0000 7f158e9a5640 1 --2- 172.21.15.29:0/637857778 >> v2:172.21.15.37:3300/0 conn(0x7f1588158910 0x7f158815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.991+0000 7f158e9a5640 1 -- 172.21.15.29:0/637857778 >> v2:172.21.15.29:3300/0 conn(0x7f15880c2650 msgr2=0x7f15880c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.991+0000 7f158e9a5640 1 --2- 172.21.15.29:0/637857778 >> v2:172.21.15.29:3300/0 conn(0x7f15880c2650 0x7f15880c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.991+0000 7f158e9a5640 1 -- 172.21.15.29:0/637857778 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158815ef50 con 0x7f15881624c0 2024-04-15T00:01:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.993+0000 7f158e9a5640 1 --2- 172.21.15.29:0/637857778 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 0x7f15880cb710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f15880c9320 tx=0x7f158002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97ce56607804cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:19.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.997+0000 7f158d1a2640 1 -- 172.21.15.29:0/637857778 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580035020 con 0x7f15881624c0 2024-04-15T00:01:19.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.997+0000 7f158d1a2640 1 -- 172.21.15.29:0/637857778 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580031870 con 0x7f15881624c0 2024-04-15T00:01:19.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.997+0000 7f158d1a2640 1 -- 172.21.15.29:0/637857778 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580031c40 con 0x7f15881624c0 2024-04-15T00:01:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 -- 172.21.15.29:0/637857778 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 msgr2=0x7f15880cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 --2- 172.21.15.29:0/637857778 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 0x7f15880cb710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f15880c9320 tx=0x7f158002b910 comp rx=0 tx=0).stop 2024-04-15T00:01:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 -- 172.21.15.29:0/637857778 shutdown_connections 2024-04-15T00:01:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 --2- 172.21.15.29:0/637857778 >> v2:172.21.15.29:3300/0 conn(0x7f15880c2650 0x7f15880c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 --2- 172.21.15.29:0/637857778 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f15881624c0 0x7f15880cb710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 --2- 172.21.15.29:0/637857778 >> v2:172.21.15.37:3300/0 conn(0x7f1588158910 0x7f158815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 -- 172.21.15.29:0/637857778 >> 172.21.15.29:0/637857778 conn(0x7f158806f100 msgr2=0x7f158806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 -- 172.21.15.29:0/637857778 shutdown_connections 2024-04-15T00:01:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.998+0000 7f1590408640 1 -- 172.21.15.29:0/637857778 wait complete. 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.999+0000 7f1590408640 1 Processor -- start 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:18.999+0000 7f1590408640 1 -- start start 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f1590408640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15880c2650 0x7f15881f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f1590408640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 0x7f15881f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f1590408640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15881624c0 0x7f15880c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f1590408640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1588161cc0 con 0x7f15881624c0 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f1590408640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f158815f510 con 0x7f15880c2650 2024-04-15T00:01:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f1590408640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1588158cf0 con 0x7f1588158910 2024-04-15T00:01:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.000+0000 7f158d9a3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 0x7f15881f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.001+0000 7f158d9a3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 0x7f15881f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:33996/0 (socket says 172.21.15.29:33996) 2024-04-15T00:01:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.001+0000 7f158d9a3640 1 -- 172.21.15.29:0/2848993645 learned_addr learned my addr 172.21.15.29:0/2848993645 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.001+0000 7f158e9a5640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15881624c0 0x7f15880c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:19.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.004+0000 7f158d9a3640 1 -- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15880c2650 msgr2=0x7f15881f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:19.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.004+0000 7f158d9a3640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15880c2650 0x7f15881f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:19.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.004+0000 7f158d9a3640 1 -- 172.21.15.29:0/2848993645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15881624c0 msgr2=0x7f15880c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:19.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.004+0000 7f158d9a3640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15881624c0 0x7f15880c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:19.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.004+0000 7f158d9a3640 1 -- 172.21.15.29:0/2848993645 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15881f4a10 con 0x7f1588158910 2024-04-15T00:01:19.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.007+0000 7f158d9a3640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 0x7f15881f8460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f158400b9f0 tx=0x7f158400beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:19.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.011+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584019070 con 0x7f1588158910 2024-04-15T00:01:19.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.011+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158400cbd0 con 0x7f1588158910 2024-04-15T00:01:19.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.011+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584014440 con 0x7f1588158910 2024-04-15T00:01:19.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.011+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15881f89a0 con 0x7f1588158910 2024-04-15T00:01:19.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.011+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15881f4f60 con 0x7f1588158910 2024-04-15T00:01:19.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.012+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158804f540 con 0x7f1588158910 2024-04-15T00:01:19.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.045+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f158401c070 con 0x7f1588158910 2024-04-15T00:01:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.046+0000 7f157effd640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f156c06b9c0 0x7f156c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.046+0000 7f158e1a4640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f156c06b9c0 0x7f156c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.046+0000 7f158e1a4640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f156c06b9c0 0x7f156c06de80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1578009710 tx=0x7f1578006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:19.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.053+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f15840572b0 con 0x7f1588158910 2024-04-15T00:01:19.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.364+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1584023070 con 0x7f1588158910 2024-04-15T00:01:19.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:19.589+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f15880c7240 con 0x7f1588158910 2024-04-15T00:01:20.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.229+0000 7f157effd640 1 -- 172.21.15.29:0/2848993645 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f1584059210 con 0x7f1588158910 2024-04-15T00:01:20.235 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f156c06b9c0 msgr2=0x7f156c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f156c06b9c0 0x7f156c06de80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1578009710 tx=0x7f1578006c90 comp rx=0 tx=0).stop 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 msgr2=0x7f15881f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 0x7f15881f8460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f158400b9f0 tx=0x7f158400beb0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 shutdown_connections 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f156c06b9c0 0x7f156c06de80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15881624c0 0x7f15880c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1588158910 0x7f15881f8460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 --2- 172.21.15.29:0/2848993645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15880c2650 0x7f15881f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 >> 172.21.15.29:0/2848993645 conn(0x7f158806f100 msgr2=0x7f15880c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 shutdown_connections 2024-04-15T00:01:20.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.231+0000 7f1590408640 1 -- 172.21.15.29:0/2848993645 wait complete. 2024-04-15T00:01:20.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:20.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 Processor -- start 2024-04-15T00:01:20.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 -- start start 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63340cc530 0x7f63340cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f633415b110 0x7f633406c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633406c960 con 0x7f63340cdff0 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f63340cf910 con 0x7f63340cc530 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.344+0000 7f633a8b7640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f63340cf350 con 0x7f633415b110 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.345+0000 7f6338e54640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f63340cdff0 0x7f633415da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45308/0 (socket says 172.21.15.29:45308) 2024-04-15T00:01:20.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.345+0000 7f6338e54640 1 -- 172.21.15.29:0/1243374796 learned_addr learned my addr 172.21.15.29:0/1243374796 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.345+0000 7f63337fe640 1 --2- 172.21.15.29:0/1243374796 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f633415b110 0x7f633406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:20.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.345+0000 7f6333fff640 1 --2- 172.21.15.29:0/1243374796 >> v2:172.21.15.37:3300/0 conn(0x7f63340cc530 0x7f63340cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.348+0000 7f6332ffd640 1 -- 172.21.15.29:0/1243374796 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274355414 0 0) 0x7f633406c960 con 0x7f63340cdff0 2024-04-15T00:01:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.348+0000 7f6332ffd640 1 -- 172.21.15.29:0/1243374796 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f631c003520 con 0x7f63340cdff0 2024-04-15T00:01:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.348+0000 7f63337fe640 1 -- 172.21.15.29:0/1243374796 >> v2:172.21.15.37:3300/0 conn(0x7f63340cc530 msgr2=0x7f63340cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.348+0000 7f63337fe640 1 --2- 172.21.15.29:0/1243374796 >> v2:172.21.15.37:3300/0 conn(0x7f63340cc530 0x7f63340cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.348+0000 7f63337fe640 1 -- 172.21.15.29:0/1243374796 >> v1:172.21.15.29:6789/0 conn(0x7f63340cdff0 legacy=0x7f633415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.348+0000 7f63337fe640 1 -- 172.21.15.29:0/1243374796 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63340cf630 con 0x7f633415b110 2024-04-15T00:01:20.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.350+0000 7f63337fe640 1 --2- 172.21.15.29:0/1243374796 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f633415b110 0x7f633406c420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63280097a0 tx=0x7f632802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ada04d3b38bc57 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:20.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.354+0000 7f6332ffd640 1 -- 172.21.15.29:0/1243374796 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328035020 con 0x7f633415b110 2024-04-15T00:01:20.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.354+0000 7f6332ffd640 1 -- 172.21.15.29:0/1243374796 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328031830 con 0x7f633415b110 2024-04-15T00:01:20.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.354+0000 7f6332ffd640 1 -- 172.21.15.29:0/1243374796 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328031c00 con 0x7f633415b110 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 -- 172.21.15.29:0/1243374796 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f633415b110 msgr2=0x7f633406c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1243374796 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f633415b110 0x7f633406c420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63280097a0 tx=0x7f632802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 -- 172.21.15.29:0/1243374796 shutdown_connections 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1243374796 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f633415b110 0x7f633406c420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1243374796 >> v2:172.21.15.37:3300/0 conn(0x7f63340cc530 0x7f63340cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 -- 172.21.15.29:0/1243374796 >> 172.21.15.29:0/1243374796 conn(0x7f63340cfb20 msgr2=0x7f63340cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 -- 172.21.15.29:0/1243374796 shutdown_connections 2024-04-15T00:01:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.355+0000 7f633a8b7640 1 -- 172.21.15.29:0/1243374796 wait complete. 2024-04-15T00:01:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.356+0000 7f633a8b7640 1 Processor -- start 2024-04-15T00:01:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.356+0000 7f633a8b7640 1 -- start start 2024-04-15T00:01:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f633a8b7640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f63340cc530 0x7f6334159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f633a8b7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 0x7f6334159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f633a8b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f633415b110 0x7f633415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f633a8b7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f633415abf0 con 0x7f63340cdff0 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f633a8b7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f633415a910 con 0x7f633415b110 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f633a8b7640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f63340cebc0 con 0x7f63340cc530 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f63337fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 0x7f6334159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f6333fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f63340cc530 0x7f6334159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.357+0000 7f6338e54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f633415b110 0x7f633415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.358+0000 7f63337fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 0x7f6334159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48272/0 (socket says 172.21.15.29:48272) 2024-04-15T00:01:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.358+0000 7f63337fe640 1 -- 172.21.15.29:0/1781451647 learned_addr learned my addr 172.21.15.29:0/1781451647 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.361+0000 7f63337fe640 1 -- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f63340cc530 msgr2=0x7f6334159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.361+0000 7f63337fe640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f63340cc530 0x7f6334159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.361+0000 7f63337fe640 1 -- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f633415b110 msgr2=0x7f633415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.361+0000 7f63337fe640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f633415b110 0x7f633415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.361+0000 7f63337fe640 1 -- 172.21.15.29:0/1781451647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63340c6920 con 0x7f63340cdff0 2024-04-15T00:01:20.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.363+0000 7f63337fe640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 0x7f6334159f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6328000c00 tx=0x7f63280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.367+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328040070 con 0x7f63340cdff0 2024-04-15T00:01:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.367+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632803a910 con 0x7f63340cdff0 2024-04-15T00:01:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.367+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328035040 con 0x7f63340cdff0 2024-04-15T00:01:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.367+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633414a6a0 con 0x7f63340cdff0 2024-04-15T00:01:20.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.367+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633414ac60 con 0x7f63340cdff0 2024-04-15T00:01:20.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.368+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633414aea0 con 0x7f63340cdff0 2024-04-15T00:01:20.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.635+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f632804b060 con 0x7f63340cdff0 2024-04-15T00:01:20.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.635+0000 7f6330ff9640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f632006b9e0 0x7f632006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.636+0000 7f6333fff640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f632006b9e0 0x7f632006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:20.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.636+0000 7f6333fff640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f632006b9e0 0x7f632006dea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6324009b40 tx=0x7f6324009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:20.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.649+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6328045df0 con 0x7f63340cdff0 2024-04-15T00:01:20.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.649+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f633414aea0 con 0x7f63340cdff0 2024-04-15T00:01:20.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.885+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f633404f540 con 0x7f63340cdff0 2024-04-15T00:01:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.907+0000 7f6330ff9640 1 -- 172.21.15.29:0/1781451647 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6825 (secure 0 0 0) 0x7f6328031800 con 0x7f63340cdff0 2024-04-15T00:01:20.913 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:20.914 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:19.613085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-15T00:01:20.914 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-04-15T00:01:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f632006b9e0 msgr2=0x7f632006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f632006b9e0 0x7f632006dea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6324009b40 tx=0x7f6324009190 comp rx=0 tx=0).stop 2024-04-15T00:01:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 msgr2=0x7f6334159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 0x7f6334159f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6328000c00 tx=0x7f63280046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 shutdown_connections 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f632006b9e0 0x7f632006dea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f633415b110 0x7f633415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63340cdff0 0x7f6334159f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 --2- 172.21.15.29:0/1781451647 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f63340cc530 0x7f6334159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 >> 172.21.15.29:0/1781451647 conn(0x7f63340cfb20 msgr2=0x7f63340ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 shutdown_connections 2024-04-15T00:01:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:20.909+0000 7f633a8b7640 1 -- 172.21.15.29:0/1781451647 wait complete. 2024-04-15T00:01:20.926 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.022+0000 7f95be1e0640 1 Processor -- start 2024-04-15T00:01:21.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.022+0000 7f95be1e0640 1 -- start start 2024-04-15T00:01:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95be1e0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95b80c4930 0x7f95b80c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95be1e0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f95b8072cd0 0x7f95b80c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95be1e0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b80c5870 con 0x7f95b81511a0 2024-04-15T00:01:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95be1e0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f95b80c5b50 con 0x7f95b8072cd0 2024-04-15T00:01:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95be1e0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f95b80c2cf0 con 0x7f95b80c4930 2024-04-15T00:01:21.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95b7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f95b8072cd0 0x7f95b80c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.023+0000 7f95b6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95b80c4930 0x7f95b80c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.024+0000 7f95b77fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f95b81511a0 0x7f95b80c4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45318/0 (socket says 172.21.15.29:45318) 2024-04-15T00:01:21.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.024+0000 7f95b77fe640 1 -- 172.21.15.29:0/2275269149 learned_addr learned my addr 172.21.15.29:0/2275269149 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:21.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.026+0000 7f95b6ffd640 1 -- 172.21.15.29:0/2275269149 >> v2:172.21.15.29:3300/0 conn(0x7f95b8072cd0 msgr2=0x7f95b80c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:21.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.026+0000 7f95b6ffd640 1 --2- 172.21.15.29:0/2275269149 >> v2:172.21.15.29:3300/0 conn(0x7f95b8072cd0 0x7f95b80c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.026+0000 7f95b6ffd640 1 -- 172.21.15.29:0/2275269149 >> v1:172.21.15.29:6789/0 conn(0x7f95b81511a0 legacy=0x7f95b80c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.026+0000 7f95b6ffd640 1 -- 172.21.15.29:0/2275269149 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b80c2fd0 con 0x7f95b80c4930 2024-04-15T00:01:21.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.028+0000 7f95b6ffd640 1 --2- 172.21.15.29:0/2275269149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b80c4930 0x7f95b80c81e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95b80c4340 tx=0x7f95ac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef19d935d7a33301 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.032+0000 7f95b67fc640 1 -- 172.21.15.29:0/2275269149 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac035020 con 0x7f95b80c4930 2024-04-15T00:01:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.032+0000 7f95b67fc640 1 -- 172.21.15.29:0/2275269149 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac031830 con 0x7f95b80c4930 2024-04-15T00:01:21.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.032+0000 7f95b67fc640 1 -- 172.21.15.29:0/2275269149 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac031c00 con 0x7f95b80c4930 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 -- 172.21.15.29:0/2275269149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b80c4930 msgr2=0x7f95b80c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 --2- 172.21.15.29:0/2275269149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b80c4930 0x7f95b80c81e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95b80c4340 tx=0x7f95ac02b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 -- 172.21.15.29:0/2275269149 shutdown_connections 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 --2- 172.21.15.29:0/2275269149 >> v2:172.21.15.29:3300/0 conn(0x7f95b8072cd0 0x7f95b80c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 --2- 172.21.15.29:0/2275269149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b80c4930 0x7f95b80c81e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 -- 172.21.15.29:0/2275269149 >> 172.21.15.29:0/2275269149 conn(0x7f95b806fca0 msgr2=0x7f95b806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 -- 172.21.15.29:0/2275269149 shutdown_connections 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.033+0000 7f95be1e0640 1 -- 172.21.15.29:0/2275269149 wait complete. 2024-04-15T00:01:21.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.034+0000 7f95be1e0640 1 Processor -- start 2024-04-15T00:01:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 -- start start 2024-04-15T00:01:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f95b8072cd0 0x7f95b814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 0x7f95b80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b81511a0 0x7f95b81e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8151580 con 0x7f95b80c4930 2024-04-15T00:01:21.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95b80c3590 con 0x7f95b81511a0 2024-04-15T00:01:21.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.035+0000 7f95be1e0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f95b8151700 con 0x7f95b8072cd0 2024-04-15T00:01:21.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.036+0000 7f95b6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 0x7f95b80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.036+0000 7f95b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b81511a0 0x7f95b81e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.036+0000 7f95b77fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f95b8072cd0 0x7f95b814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.036+0000 7f95b6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 0x7f95b80c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48282/0 (socket says 172.21.15.29:48282) 2024-04-15T00:01:21.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.036+0000 7f95b6ffd640 1 -- 172.21.15.29:0/1786898717 learned_addr learned my addr 172.21.15.29:0/1786898717 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.040+0000 7f95b6ffd640 1 -- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f95b8072cd0 msgr2=0x7f95b814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.040+0000 7f95b6ffd640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f95b8072cd0 0x7f95b814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.040+0000 7f95b6ffd640 1 -- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b81511a0 msgr2=0x7f95b81e1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.040+0000 7f95b6ffd640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b81511a0 0x7f95b81e1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.040+0000 7f95b6ffd640 1 -- 172.21.15.29:0/1786898717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b8142f90 con 0x7f95b80c4930 2024-04-15T00:01:21.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.042+0000 7f95b6ffd640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 0x7f95b80c75e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009880 tx=0x7f95ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.046+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac035040 con 0x7f95b80c4930 2024-04-15T00:01:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.046+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac03b900 con 0x7f95b80c4930 2024-04-15T00:01:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.046+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b814ef20 con 0x7f95b80c4930 2024-04-15T00:01:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.046+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac03bcf0 con 0x7f95b80c4930 2024-04-15T00:01:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.046+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b814f7e0 con 0x7f95b80c4930 2024-04-15T00:01:21.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.047+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b806d480 con 0x7f95b80c4930 2024-04-15T00:01:21.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.065+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f95ac038020 con 0x7f95b80c4930 2024-04-15T00:01:21.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.066+0000 7f959ffff640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f95a406b9e0 0x7f95a406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.066+0000 7f95b77fe640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f95a406b9e0 0x7f95a406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.067+0000 7f95b77fe640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f95a406b9e0 0x7f95a406dea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95b8143260 tx=0x7f95a8007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:21.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.069+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f95ac079150 con 0x7f95b80c4930 2024-04-15T00:01:21.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.330+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f95b806d480 con 0x7f95b80c4930 2024-04-15T00:01:21.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.513+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95b804f540 con 0x7f95b80c4930 2024-04-15T00:01:21.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.563+0000 7f959ffff640 1 -- 172.21.15.29:0/1786898717 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7f95ac07b0b0 con 0x7f95b80c4930 2024-04-15T00:01:21.570 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:21.570 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f95a406b9e0 msgr2=0x7f95a406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f95a406b9e0 0x7f95a406dea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95b8143260 tx=0x7f95a8007e80 comp rx=0 tx=0).stop 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 msgr2=0x7f95b80c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 0x7f95b80c75e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009880 tx=0x7f95ac0046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 shutdown_connections 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f95a406b9e0 0x7f95a406dea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b81511a0 0x7f95b81e1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b80c4930 0x7f95b80c75e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 --2- 172.21.15.29:0/1786898717 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f95b8072cd0 0x7f95b814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.565+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 >> 172.21.15.29:0/1786898717 conn(0x7f95b806fca0 msgr2=0x7f95b806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:21.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.566+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 shutdown_connections 2024-04-15T00:01:21.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.566+0000 7f95be1e0640 1 -- 172.21.15.29:0/1786898717 wait complete. 2024-04-15T00:01:21.584 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:21.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.679+0000 7fd7d94d5640 1 Processor -- start 2024-04-15T00:01:21.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.679+0000 7fd7d94d5640 1 -- start start 2024-04-15T00:01:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.679+0000 7fd7d94d5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d4070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.680+0000 7fd7d94d5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d415a430 con 0x7fd7d4154070 2024-04-15T00:01:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.680+0000 7fd7d94d5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d415a6d0 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.680+0000 7fd7d94d5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d40707b0 con 0x7fd7d40cded0 2024-04-15T00:01:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.680+0000 7fd7d37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd7d4154070 0x7fd7d415baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45324/0 (socket says 172.21.15.29:45324) 2024-04-15T00:01:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.680+0000 7fd7d37fe640 1 -- 172.21.15.29:0/3057176634 learned_addr learned my addr 172.21.15.29:0/3057176634 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.680+0000 7fd7d2ffd640 1 --2- 172.21.15.29:0/3057176634 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d4070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.682+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943084200 0 0) 0x7fd7d415a6d0 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.683+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7c0003520 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.683+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659590834 0 0) 0x7fd7d415a430 con 0x7fd7d4154070 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.683+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d415a6d0 con 0x7fd7d4154070 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.683+0000 7fd7d2ffd640 1 -- 172.21.15.29:0/3057176634 >> v1:172.21.15.37:6789/0 conn(0x7fd7d40ce2b0 legacy=0x7fd7d415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.683+0000 7fd7d2ffd640 1 -- 172.21.15.29:0/3057176634 >> v1:172.21.15.29:6789/0 conn(0x7fd7d4154070 legacy=0x7fd7d415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.683+0000 7fd7d2ffd640 1 -- 172.21.15.29:0/3057176634 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d415a9b0 con 0x7fd7d40cded0 2024-04-15T00:01:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.685+0000 7fd7d2ffd640 1 --2- 172.21.15.29:0/3057176634 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d4070a10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40097d0 tx=0x7fd7c402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34642ed868ef0d1f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4035020 con 0x7fd7d40cded0 2024-04-15T00:01:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c4031890 con 0x7fd7d40cded0 2024-04-15T00:01:21.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d27fc640 1 -- 172.21.15.29:0/3057176634 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4031c60 con 0x7fd7d40cded0 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 -- 172.21.15.29:0/3057176634 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 msgr2=0x7fd7d4070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/3057176634 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d4070a10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40097d0 tx=0x7fd7c402b930 comp rx=0 tx=0).stop 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 -- 172.21.15.29:0/3057176634 shutdown_connections 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/3057176634 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d4070a10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 -- 172.21.15.29:0/3057176634 >> 172.21.15.29:0/3057176634 conn(0x7fd7d4061e00 msgr2=0x7fd7d4062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 -- 172.21.15.29:0/3057176634 shutdown_connections 2024-04-15T00:01:21.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.690+0000 7fd7d94d5640 1 -- 172.21.15.29:0/3057176634 wait complete. 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.691+0000 7fd7d94d5640 1 Processor -- start 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.691+0000 7fd7d94d5640 1 -- start start 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.692+0000 7fd7d94d5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d41517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.692+0000 7fd7d94d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 0x7fd7d40cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.692+0000 7fd7d94d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d4154070 0x7fd7d40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.692+0000 7fd7d94d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d415c1b0 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.692+0000 7fd7d94d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d415af70 con 0x7fd7d4154070 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.692+0000 7fd7d94d5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d415c330 con 0x7fd7d40cded0 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.693+0000 7fd7cbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 0x7fd7d40cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.693+0000 7fd7d2ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d41517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.693+0000 7fd7d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d4154070 0x7fd7d40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.693+0000 7fd7cbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 0x7fd7d40cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48294/0 (socket says 172.21.15.29:48294) 2024-04-15T00:01:21.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.693+0000 7fd7cbfff640 1 -- 172.21.15.29:0/2114506797 learned_addr learned my addr 172.21.15.29:0/2114506797 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.696+0000 7fd7cbfff640 1 -- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 msgr2=0x7fd7d41517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.696+0000 7fd7cbfff640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d41517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.696+0000 7fd7cbfff640 1 -- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d4154070 msgr2=0x7fd7d40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.696+0000 7fd7cbfff640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d4154070 0x7fd7d40ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:21.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.696+0000 7fd7cbfff640 1 -- 172.21.15.29:0/2114506797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d41525b0 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.699+0000 7fd7cbfff640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 0x7fd7d40cad50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c430 tx=0x7fd7bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.702+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc017070 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.702+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0052d0 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.702+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc003810 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.702+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d41f4080 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.702+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d41522d0 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.703+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d404f540 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.968+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd7bc01a070 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.968+0000 7fd7cb7fe640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd7b406b990 0x7fd7b406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.969+0000 7fd7d2ffd640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd7b406b990 0x7fd7b406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.969+0000 7fd7d2ffd640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd7b406b990 0x7fd7b406de50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4036000 tx=0x7fd7c4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.983+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd7bc056650 con 0x7fd7d40ce2b0 2024-04-15T00:01:21.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:21.983+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd7bc021020 con 0x7fd7d40ce2b0 2024-04-15T00:01:22.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.166+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7d40721f0 con 0x7fd7d40ce2b0 2024-04-15T00:01:22.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.207+0000 7fd7cb7fe640 1 -- 172.21.15.29:0/2114506797 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7fd7bc0585b0 con 0x7fd7d40ce2b0 2024-04-15T00:01:22.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:22.214 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd7b406b990 msgr2=0x7fd7b406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd7b406b990 0x7fd7b406de50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4036000 tx=0x7fd7c4008030 comp rx=0 tx=0).stop 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 msgr2=0x7fd7d40cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 0x7fd7d40cad50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c430 tx=0x7fd7bc00c8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 shutdown_connections 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd7b406b990 0x7fd7b406de50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7d4154070 0x7fd7d40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7d40ce2b0 0x7fd7d40cad50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 --2- 172.21.15.29:0/2114506797 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd7d40cded0 0x7fd7d41517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 >> 172.21.15.29:0/2114506797 conn(0x7fd7d4061e00 msgr2=0x7fd7d406ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 shutdown_connections 2024-04-15T00:01:22.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.209+0000 7fd7d94d5640 1 -- 172.21.15.29:0/2114506797 wait complete. 2024-04-15T00:01:22.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.339+0000 7f32cdede640 1 Processor -- start 2024-04-15T00:01:22.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.339+0000 7f32cdede640 1 -- start start 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.339+0000 7f32cdede640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32c8154580 0x7f32c80cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.339+0000 7f32cdede640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c8154960 con 0x7f32c80ce210 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.339+0000 7f32cdede640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c815a580 con 0x7f32c815c370 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.339+0000 7f32cdede640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f32c815a860 con 0x7f32c8154580 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.340+0000 7f32c6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f32c80ce210 0x7f32c815bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45340/0 (socket says 172.21.15.29:45340) 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.340+0000 7f32c6ffd640 1 -- 172.21.15.29:0/2927603824 learned_addr learned my addr 172.21.15.29:0/2927603824 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:22.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.340+0000 7f32c77fe640 1 --2- 172.21.15.29:0/2927603824 >> v2:172.21.15.37:3300/0 conn(0x7f32c8154580 0x7f32c80cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.343+0000 7f32c67fc640 1 -- 172.21.15.29:0/2927603824 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783808977 0 0) 0x7f32bc001110 con 0x7f32c80ce210 2024-04-15T00:01:22.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.343+0000 7f32c67fc640 1 -- 172.21.15.29:0/2927603824 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32b0003520 con 0x7f32c80ce210 2024-04-15T00:01:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.344+0000 7f32c77fe640 1 -- 172.21.15.29:0/2927603824 >> v1:172.21.15.37:6789/0 conn(0x7f32c815c370 legacy=0x7f32c8070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.344+0000 7f32c77fe640 1 -- 172.21.15.29:0/2927603824 >> v1:172.21.15.29:6789/0 conn(0x7f32c80ce210 legacy=0x7f32c815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.344+0000 7f32c77fe640 1 -- 172.21.15.29:0/2927603824 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c815ab40 con 0x7f32c8154580 2024-04-15T00:01:22.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.350+0000 7f32c77fe640 1 --2- 172.21.15.29:0/2927603824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c8154580 0x7f32c80cdcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32b80097a0 tx=0x7f32b802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78e7caf9903020 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:22.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.354+0000 7f32c67fc640 1 -- 172.21.15.29:0/2927603824 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8034070 con 0x7f32c8154580 2024-04-15T00:01:22.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.354+0000 7f32c67fc640 1 -- 172.21.15.29:0/2927603824 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b8030610 con 0x7f32c8154580 2024-04-15T00:01:22.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.354+0000 7f32c67fc640 1 -- 172.21.15.29:0/2927603824 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80309e0 con 0x7f32c8154580 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 -- 172.21.15.29:0/2927603824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c8154580 msgr2=0x7f32c80cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 --2- 172.21.15.29:0/2927603824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c8154580 0x7f32c80cdcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32b80097a0 tx=0x7f32b802b960 comp rx=0 tx=0).stop 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 -- 172.21.15.29:0/2927603824 shutdown_connections 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 --2- 172.21.15.29:0/2927603824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c8154580 0x7f32c80cdcd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 -- 172.21.15.29:0/2927603824 >> 172.21.15.29:0/2927603824 conn(0x7f32c8061e00 msgr2=0x7f32c8062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 -- 172.21.15.29:0/2927603824 shutdown_connections 2024-04-15T00:01:22.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.355+0000 7f32cdede640 1 -- 172.21.15.29:0/2927603824 wait complete. 2024-04-15T00:01:22.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.356+0000 7f32cdede640 1 Processor -- start 2024-04-15T00:01:22.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.356+0000 7f32cdede640 1 -- start start 2024-04-15T00:01:22.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32cdede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c80ce210 0x7f32c81f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:22.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32cdede640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 0x7f32c80cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:22.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32cdede640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f32c815c370 0x7f32c815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:22.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32cdede640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f32c815b740 con 0x7f32c8154580 2024-04-15T00:01:22.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32cdede640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32c815b100 con 0x7f32c80ce210 2024-04-15T00:01:22.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32cdede640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f32c815a250 con 0x7f32c815c370 2024-04-15T00:01:22.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.357+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 0x7f32c80cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:22.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.358+0000 7f32c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c80ce210 0x7f32c81f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:22.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.358+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 0x7f32c80cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48306/0 (socket says 172.21.15.29:48306) 2024-04-15T00:01:22.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.358+0000 7f32c6ffd640 1 -- 172.21.15.29:0/195509392 learned_addr learned my addr 172.21.15.29:0/195509392 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:22.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.358+0000 7f32c7fff640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f32c815c370 0x7f32c815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:22.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.361+0000 7f32c6ffd640 1 -- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f32c815c370 msgr2=0x7f32c815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.361+0000 7f32c6ffd640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f32c815c370 0x7f32c815dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.361+0000 7f32c6ffd640 1 -- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c80ce210 msgr2=0x7f32c81f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.361+0000 7f32c6ffd640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c80ce210 0x7f32c81f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.361+0000 7f32c6ffd640 1 -- 172.21.15.29:0/195509392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c80cd1e0 con 0x7f32c8154580 2024-04-15T00:01:22.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.369+0000 7f32c6ffd640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 0x7f32c80cbf60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c760 tx=0x7f32bc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:22.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.375+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc017070 con 0x7f32c8154580 2024-04-15T00:01:22.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.375+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc005ab0 con 0x7f32c8154580 2024-04-15T00:01:22.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.375+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc007070 con 0x7f32c8154580 2024-04-15T00:01:22.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.375+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c80c7e30 con 0x7f32c8154580 2024-04-15T00:01:22.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.375+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c80cc770 con 0x7f32c8154580 2024-04-15T00:01:22.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.376+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c804f540 con 0x7f32c8154580 2024-04-15T00:01:22.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.646+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f32bc01a070 con 0x7f32c8154580 2024-04-15T00:01:22.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.647+0000 7f32affff640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f32b406b9e0 0x7f32b406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:22.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.647+0000 7f32c77fe640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f32b406b9e0 0x7f32b406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:22.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.648+0000 7f32c77fe640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f32b406b9e0 0x7f32b406dea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32b8036000 tx=0x7f32b803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:22.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.662+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f32bc056640 con 0x7f32c8154580 2024-04-15T00:01:22.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.662+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f32bc021020 con 0x7f32c8154580 2024-04-15T00:01:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.890+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32c814e600 con 0x7f32c8154580 2024-04-15T00:01:22.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.903+0000 7f32affff640 1 -- 172.21.15.29:0/195509392 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6825 (secure 0 0 0) 0x7f32c8154960 con 0x7f32c8154580 2024-04-15T00:01:22.910 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:22.910 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:19.613085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-04-15T00:01:22.910 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-04-15T00:01:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f32b406b9e0 msgr2=0x7f32b406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f32b406b9e0 0x7f32b406dea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32b8036000 tx=0x7f32b803b040 comp rx=0 tx=0).stop 2024-04-15T00:01:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 msgr2=0x7f32c80cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 0x7f32c80cbf60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c760 tx=0x7f32bc00cc20 comp rx=0 tx=0).stop 2024-04-15T00:01:22.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 shutdown_connections 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f32b406b9e0 0x7f32b406dea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f32c815c370 0x7f32c815dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32c8154580 0x7f32c80cbf60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 --2- 172.21.15.29:0/195509392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32c80ce210 0x7f32c81f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 >> 172.21.15.29:0/195509392 conn(0x7f32c8061e00 msgr2=0x7f32c80caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 shutdown_connections 2024-04-15T00:01:22.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:22.906+0000 7f32cdede640 1 -- 172.21.15.29:0/195509392 wait complete. 2024-04-15T00:01:22.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:23.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.018+0000 7fe4d59aa640 1 Processor -- start 2024-04-15T00:01:23.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.018+0000 7fe4d59aa640 1 -- start start 2024-04-15T00:01:23.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.019+0000 7fe4d59aa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4d014ea00 0x7fe4d00c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:23.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.019+0000 7fe4d59aa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4d00ce1e0 0x7fe4d01596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:23.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.019+0000 7fe4d59aa640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d0157fb0 con 0x7fe4d00cddc0 2024-04-15T00:01:23.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.019+0000 7fe4d59aa640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d00ce630 con 0x7fe4d014ea00 2024-04-15T00:01:23.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.019+0000 7fe4d59aa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d0158230 con 0x7fe4d00ce1e0 2024-04-15T00:01:23.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.020+0000 7fe4ceffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4d014ea00 0x7fe4d00c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:23.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.020+0000 7fe4cf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4d00ce1e0 0x7fe4d01596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:23.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.020+0000 7fe4cf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4d00ce1e0 0x7fe4d01596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:54654/0 (socket says 172.21.15.29:54654) 2024-04-15T00:01:23.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.020+0000 7fe4cf7fe640 1 -- 172.21.15.29:0/2363601356 learned_addr learned my addr 172.21.15.29:0/2363601356 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:23.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.023+0000 7fe4cf7fe640 1 -- 172.21.15.29:0/2363601356 >> v2:172.21.15.29:3300/0 conn(0x7fe4d014ea00 msgr2=0x7fe4d00c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:23.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.023+0000 7fe4cf7fe640 1 --2- 172.21.15.29:0/2363601356 >> v2:172.21.15.29:3300/0 conn(0x7fe4d014ea00 0x7fe4d00c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.023+0000 7fe4cf7fe640 1 -- 172.21.15.29:0/2363601356 >> v1:172.21.15.29:6789/0 conn(0x7fe4d00cddc0 legacy=0x7fe4d0070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:23.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.023+0000 7fe4cf7fe640 1 -- 172.21.15.29:0/2363601356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d0158510 con 0x7fe4d00ce1e0 2024-04-15T00:01:23.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.025+0000 7fe4cf7fe640 1 --2- 172.21.15.29:0/2363601356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00ce1e0 0x7fe4d01596e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00c8530 tx=0x7fe4c002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618c955723105c74 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4cdffb640 1 -- 172.21.15.29:0/2363601356 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c002cbb0 con 0x7fe4d00ce1e0 2024-04-15T00:01:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4cdffb640 1 -- 172.21.15.29:0/2363601356 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c002cd50 con 0x7fe4d00ce1e0 2024-04-15T00:01:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4cdffb640 1 -- 172.21.15.29:0/2363601356 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0034610 con 0x7fe4d00ce1e0 2024-04-15T00:01:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4d59aa640 1 -- 172.21.15.29:0/2363601356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00ce1e0 msgr2=0x7fe4d01596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/2363601356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00ce1e0 0x7fe4d01596e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00c8530 tx=0x7fe4c002c010 comp rx=0 tx=0).stop 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4d59aa640 1 -- 172.21.15.29:0/2363601356 shutdown_connections 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/2363601356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00ce1e0 0x7fe4d01596e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/2363601356 >> v2:172.21.15.29:3300/0 conn(0x7fe4d014ea00 0x7fe4d00c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.029+0000 7fe4d59aa640 1 -- 172.21.15.29:0/2363601356 >> 172.21.15.29:0/2363601356 conn(0x7fe4d0061e00 msgr2=0x7fe4d0062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.030+0000 7fe4d59aa640 1 -- 172.21.15.29:0/2363601356 shutdown_connections 2024-04-15T00:01:23.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.030+0000 7fe4d59aa640 1 -- 172.21.15.29:0/2363601356 wait complete. 2024-04-15T00:01:23.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.031+0000 7fe4d59aa640 1 Processor -- start 2024-04-15T00:01:23.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.031+0000 7fe4d59aa640 1 -- start start 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4d59aa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 0x7fe4d014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4d59aa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe4d00ce1e0 0x7fe4d01ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4d59aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d014ea00 0x7fe4d01eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4d59aa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0158db0 con 0x7fe4d00cddc0 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4d59aa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0158ad0 con 0x7fe4d014ea00 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4d59aa640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d014ede0 con 0x7fe4d00ce1e0 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4ceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 0x7fe4d014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:23.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4ceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 0x7fe4d014db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48332/0 (socket says 172.21.15.29:48332) 2024-04-15T00:01:23.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4ceffd640 1 -- 172.21.15.29:0/1208008780 learned_addr learned my addr 172.21.15.29:0/1208008780 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:23.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4cf7fe640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d014ea00 0x7fe4d01eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:23.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.032+0000 7fe4ce7fc640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe4d00ce1e0 0x7fe4d01ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:23.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.036+0000 7fe4ceffd640 1 -- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe4d00ce1e0 msgr2=0x7fe4d01ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:23.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.036+0000 7fe4ceffd640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe4d00ce1e0 0x7fe4d01ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.036+0000 7fe4ceffd640 1 -- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d014ea00 msgr2=0x7fe4d01eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:23.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.036+0000 7fe4ceffd640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d014ea00 0x7fe4d01eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.036+0000 7fe4ceffd640 1 -- 172.21.15.29:0/1208008780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d00b2760 con 0x7fe4d00cddc0 2024-04-15T00:01:23.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.038+0000 7fe4ceffd640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 0x7fe4d014db60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e8a0 tx=0x7fe4c800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:23.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.042+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8017070 con 0x7fe4d00cddc0 2024-04-15T00:01:23.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.042+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c800c940 con 0x7fe4d00cddc0 2024-04-15T00:01:23.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.042+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800cd30 con 0x7fe4d00cddc0 2024-04-15T00:01:23.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.042+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d00b2a00 con 0x7fe4d00cddc0 2024-04-15T00:01:23.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.042+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d00c6920 con 0x7fe4d00cddc0 2024-04-15T00:01:23.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.043+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d004f540 con 0x7fe4d00cddc0 2024-04-15T00:01:23.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.062+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe4c801a070 con 0x7fe4d00cddc0 2024-04-15T00:01:23.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.063+0000 7fe4b7fff640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe4bc06b9e0 0x7fe4bc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:23.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.063+0000 7fe4ce7fc640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe4bc06b9e0 0x7fe4bc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:23.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.064+0000 7fe4ce7fc640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe4bc06b9e0 0x7fe4bc06dea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe4d015a2c0 tx=0x7fe4c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:23.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.321+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe4c80574e0 con 0x7fe4d00cddc0 2024-04-15T00:01:23.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.321+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe4c8059440 con 0x7fe4d00cddc0 2024-04-15T00:01:23.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.509+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4d00c8560 con 0x7fe4d00cddc0 2024-04-15T00:01:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.549+0000 7fe4b7fff640 1 -- 172.21.15.29:0/1208008780 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7fe4c805d4e0 con 0x7fe4d00cddc0 2024-04-15T00:01:23.556 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:23.556 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe4bc06b9e0 msgr2=0x7fe4bc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe4bc06b9e0 0x7fe4bc06dea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe4d015a2c0 tx=0x7fe4c4009040 comp rx=0 tx=0).stop 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 msgr2=0x7fe4d014db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 0x7fe4d014db60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e8a0 tx=0x7fe4c800ed60 comp rx=0 tx=0).stop 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 shutdown_connections 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe4bc06b9e0 0x7fe4bc06dea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d014ea00 0x7fe4d01eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe4d00ce1e0 0x7fe4d01ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 --2- 172.21.15.29:0/1208008780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4d00cddc0 0x7fe4d014db60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.551+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 >> 172.21.15.29:0/1208008780 conn(0x7fe4d0061e00 msgr2=0x7fe4d015a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.552+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 shutdown_connections 2024-04-15T00:01:23.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:23.552+0000 7fe4d59aa640 1 -- 172.21.15.29:0/1208008780 wait complete. 2024-04-15T00:01:24.173 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T00:01:12.657999+0000', 'modified': '2024-04-15T00:01:19.613085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6835/4290142859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 4290142859}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 4290142859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4275, 'qdb_cluster': [4275]} 2024-04-15T00:01:24.173 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T00:01:24.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-15T00:01:24.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.273+0000 7f8c1618c640 1 Processor -- start 2024-04-15T00:01:24.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.273+0000 7f8c1618c640 1 -- start start 2024-04-15T00:01:24.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.274+0000 7f8c1618c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100ce1f0 0x7f8c1015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.274+0000 7f8c1618c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c100b0570 con 0x7f8c10154750 2024-04-15T00:01:24.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.274+0000 7f8c1618c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c100b0850 con 0x7f8c100cf610 2024-04-15T00:01:24.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.274+0000 7f8c1618c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f8c100cea10 con 0x7f8c100ce1f0 2024-04-15T00:01:24.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.275+0000 7f8c0f7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8c10154750 0x7f8c100d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45362/0 (socket says 172.21.15.29:45362) 2024-04-15T00:01:24.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.275+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/801551603 learned_addr learned my addr 172.21.15.29:0/801551603 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:24.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.275+0000 7f8c0effd640 1 --2- 172.21.15.29:0/801551603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100ce1f0 0x7f8c1015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.277+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359485949 0 0) 0x7f8c100b0570 con 0x7f8c10154750 2024-04-15T00:01:24.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.277+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bf8003520 con 0x7f8c10154750 2024-04-15T00:01:24.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.278+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796787562 0 0) 0x7f8c100b0850 con 0x7f8c100cf610 2024-04-15T00:01:24.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.278+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c100b0570 con 0x7f8c100cf610 2024-04-15T00:01:24.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.278+0000 7f8c0effd640 1 -- 172.21.15.29:0/801551603 >> v1:172.21.15.37:6789/0 conn(0x7f8c100cf610 legacy=0x7f8c10164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.278+0000 7f8c0effd640 1 -- 172.21.15.29:0/801551603 >> v1:172.21.15.29:6789/0 conn(0x7f8c10154750 legacy=0x7f8c100d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.278+0000 7f8c0effd640 1 -- 172.21.15.29:0/801551603 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c100ca630 con 0x7f8c100ce1f0 2024-04-15T00:01:24.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.281+0000 7f8c0effd640 1 --2- 172.21.15.29:0/801551603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100ce1f0 0x7f8c1015a230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c040097d0 tx=0x7f8c0402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa9693797d1dd62 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.285+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04035020 con 0x7f8c100ce1f0 2024-04-15T00:01:24.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.285+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c04031890 con 0x7f8c100ce1f0 2024-04-15T00:01:24.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.285+0000 7f8c0e7fc640 1 -- 172.21.15.29:0/801551603 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04031c60 con 0x7f8c100ce1f0 2024-04-15T00:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 -- 172.21.15.29:0/801551603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100ce1f0 msgr2=0x7f8c1015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 --2- 172.21.15.29:0/801551603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100ce1f0 0x7f8c1015a230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c040097d0 tx=0x7f8c0402b930 comp rx=0 tx=0).stop 2024-04-15T00:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 -- 172.21.15.29:0/801551603 shutdown_connections 2024-04-15T00:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 --2- 172.21.15.29:0/801551603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100ce1f0 0x7f8c1015a230 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 -- 172.21.15.29:0/801551603 >> 172.21.15.29:0/801551603 conn(0x7f8c10062070 msgr2=0x7f8c10062480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 -- 172.21.15.29:0/801551603 shutdown_connections 2024-04-15T00:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.286+0000 7f8c1618c640 1 -- 172.21.15.29:0/801551603 wait complete. 2024-04-15T00:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.287+0000 7f8c1618c640 1 Processor -- start 2024-04-15T00:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.287+0000 7f8c1618c640 1 -- start start 2024-04-15T00:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.288+0000 7f8c1618c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 0x7f8c1015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.288+0000 7f8c1618c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100cf610 0x7f8c1015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.288+0000 7f8c1618c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c10154750 0x7f8c101e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.288+0000 7f8c1618c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8c100b1230 con 0x7f8c100ce1f0 2024-04-15T00:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.288+0000 7f8c1618c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c100ce6b0 con 0x7f8c10154750 2024-04-15T00:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.288+0000 7f8c1618c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f8c100b13b0 con 0x7f8c100cf610 2024-04-15T00:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.289+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 0x7f8c1015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.289+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 0x7f8c1015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48336/0 (socket says 172.21.15.29:48336) 2024-04-15T00:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.289+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/897414475 learned_addr learned my addr 172.21.15.29:0/897414475 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.289+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c10154750 0x7f8c101e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.289+0000 7f8c0effd640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100cf610 0x7f8c1015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.292+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100cf610 msgr2=0x7f8c1015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.292+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100cf610 0x7f8c1015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.292+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c10154750 msgr2=0x7f8c101e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.292+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c10154750 0x7f8c101e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.292+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/897414475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c101f0350 con 0x7f8c100ce1f0 2024-04-15T00:01:24.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.295+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 0x7f8c1015bdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c410 tx=0x7f8c0000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.298+0000 7f8bf7fff640 1 -- 172.21.15.29:0/897414475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00017070 con 0x7f8c100ce1f0 2024-04-15T00:01:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.298+0000 7f8bf7fff640 1 -- 172.21.15.29:0/897414475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00005ce0 con 0x7f8c100ce1f0 2024-04-15T00:01:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.298+0000 7f8bf7fff640 1 -- 172.21.15.29:0/897414475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c000072d0 con 0x7f8c100ce1f0 2024-04-15T00:01:24.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.298+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c101f0630 con 0x7f8c100ce1f0 2024-04-15T00:01:24.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.298+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c101f0bf0 con 0x7f8c100ce1f0 2024-04-15T00:01:24.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.301+0000 7f8c18f6f740 1 Processor -- start 2024-04-15T00:01:24.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.301+0000 7f8c18f6f740 1 -- start start 2024-04-15T00:01:24.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.302+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833ade0f0 0x558833ade4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.302+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833adea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.302+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833adcb50 0x558833b1d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.302+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558833a41f80 con 0x558833ade0f0 2024-04-15T00:01:24.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.302+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5588339ea9a0 con 0x558833b27f70 2024-04-15T00:01:24.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.302+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x558833a3df30 con 0x558833adcb50 2024-04-15T00:01:24.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.303+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833adea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.303+0000 7f8c0effd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833adcb50 0x558833b1d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.303+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833adea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:54674/0 (socket says 172.21.15.29:54674) 2024-04-15T00:01:24.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.303+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/1220986112 learned_addr learned my addr 172.21.15.29:0/1220986112 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:24.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.305+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833adcb50 msgr2=0x558833b1d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.305+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833adcb50 0x558833b1d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.305+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/1220986112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833ade0f0 msgr2=0x558833ade4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.305+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833ade0f0 0x558833ade4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.305+0000 7f8c0f7fe640 1 -- 172.21.15.29:0/1220986112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558833a0b480 con 0x558833b27f70 2024-04-15T00:01:24.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.308+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833adea10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c00011000 tx=0x7f8c0000f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e32526e3ac6ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.312+0000 7f8bf57fa640 1 -- 172.21.15.29:0/1220986112 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00021060 con 0x558833b27f70 2024-04-15T00:01:24.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.312+0000 7f8bf57fa640 1 -- 172.21.15.29:0/1220986112 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0002c070 con 0x558833b27f70 2024-04-15T00:01:24.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.312+0000 7f8bf57fa640 1 -- 172.21.15.29:0/1220986112 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00027a40 con 0x558833b27f70 2024-04-15T00:01:24.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.312+0000 7f8c18f6f740 1 -- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 msgr2=0x558833adea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.312+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833adea10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c00011000 tx=0x7f8c0000f000 comp rx=0 tx=0).stop 2024-04-15T00:01:24.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 -- 172.21.15.29:0/1220986112 shutdown_connections 2024-04-15T00:01:24.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833adcb50 0x558833b1d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833adea10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/1220986112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833ade0f0 0x558833ade4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 -- 172.21.15.29:0/1220986112 >> 172.21.15.29:0/1220986112 conn(0x558833ada860 msgr2=0x558833add1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 -- 172.21.15.29:0/1220986112 shutdown_connections 2024-04-15T00:01:24.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 -- 172.21.15.29:0/1220986112 wait complete. 2024-04-15T00:01:24.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 -- start start 2024-04-15T00:01:24.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.313+0000 7f8c18f6f740 1 Processor -- start 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b1bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b01640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833afab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558833b03650 con 0x558833b27f70 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5588339fdf40 con 0x558833afc570 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x558833adba10 con 0x558833ade0f0 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.314+0000 7f8c18f6f740 10 client.0 _ll_register_callbacks cb 0x5588339f89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.315+0000 7f8c0ffff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b1bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.315+0000 7f8c0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833afab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.315+0000 7f8c0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833afab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:54684/0 (socket says 172.21.15.29:54684) 2024-04-15T00:01:24.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.315+0000 7f8c0effd640 1 -- 172.21.15.29:0/2189980188 learned_addr learned my addr 172.21.15.29:0/2189980188 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:24.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.318+0000 7f8c0effd640 1 -- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 msgr2=0x558833b1bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.318+0000 7f8c0effd640 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b1bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.318+0000 7f8c0effd640 1 -- 172.21.15.29:0/2189980188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 msgr2=0x558833b01640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.318+0000 7f8c0effd640 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b01640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.318+0000 7f8c0effd640 1 -- 172.21.15.29:0/2189980188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588337562d0 con 0x558833afc570 2024-04-15T00:01:24.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.319+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b1bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:24.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.319+0000 7f8bf7fff640 1 -- 172.21.15.29:0/897414475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8c0001a070 con 0x7f8c100ce1f0 2024-04-15T00:01:24.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.320+0000 7f8bf7fff640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f8bfc06b950 0x7f8bfc06de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.320+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f8bfc06b950 0x7f8bfc06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.321+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f8bfc06b950 0x7f8bfc06de10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c08001530 tx=0x7f8c08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.321+0000 7f8c0effd640 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833afab60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098c0 tx=0x7f8c0402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73abcea95a6c3864 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.321+0000 7f8bee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-15T00:01:24.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.323+0000 7f8bf7fff640 1 -- 172.21.15.29:0/897414475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8c0005a990 con 0x7f8c100ce1f0 2024-04-15T00:01:24.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.325+0000 7f8bee7fc640 1 -- 172.21.15.29:0/2189980188 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04035040 con 0x558833afc570 2024-04-15T00:01:24.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.325+0000 7f8bee7fc640 1 -- 172.21.15.29:0/2189980188 <== mon.1 v2:172.21.15.37:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8c0403b840 con 0x558833afc570 2024-04-15T00:01:24.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.325+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c0002c070 con 0x558833afc570 2024-04-15T00:01:24.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.327+0000 7f8bee7fc640 1 -- 172.21.15.29:0/2189980188 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f8c04052050 con 0x558833afc570 2024-04-15T00:01:24.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.327+0000 7f8c18f6f740 10 client.4363 fetch_fsmap learned FSMap version 7 2024-04-15T00:01:24.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.327+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5588338206b0 con 0x558833afc570 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8bee7fc640 1 -- 172.21.15.29:0/2189980188 <== mon.1 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0002c070 con 0x558833afc570 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8bee7fc640 1 -- 172.21.15.29:0/2189980188 <== mon.1 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f8c04055020 con 0x558833afc570 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8c18f6f740 10 client.4363 fetch_fsmap finished waiting for FSMap version 7 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8c18f6f740 10 client.4363 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8c18f6f740 20 client.4363 populate_metadata read hostname 'smithi029' 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b3bd30 0x558833b3e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8c18f6f740 4 client.4363 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:01:24.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.332+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 --> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558833a4f4c0 con 0x558833b3bd30 2024-04-15T00:01:24.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.341+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b3bd30 0x558833b3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.432+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b3bd30 0x558833b3e120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f653ecf626882fea server_cookie=4d5a5fd11b28fb5b in_seq=0 out_seq=0 2024-04-15T00:01:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.432+0000 7f8bee7fc640 10 client.4363 ms_handle_connect on v2:172.21.15.37:6834/4290142859 2024-04-15T00:01:24.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8bee7fc640 1 -- 172.21.15.29:0/2189980188 <== mds.0 v2:172.21.15.37:6834/4290142859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558833a4f4c0 con 0x558833b3bd30 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8bee7fc640 10 client.4363 handle_command_reply: tid=0 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 client.4363 shutdown 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 msgr2=0x558833afab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833afab60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098c0 tx=0x7f8c0402e000 comp rx=0 tx=0).stop 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 shutdown_connections 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b3bd30 0x558833b3e120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833afab60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8bee7fc640 0 client.4363 ms_handle_reset on v2:172.21.15.37:6834/4290142859 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b01640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/2189980188 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b1bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 >> 172.21.15.29:0/2189980188 conn(0x558833adcb50 msgr2=0x558833ade4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 shutdown_connections 2024-04-15T00:01:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 1 -- 172.21.15.29:0/2189980188 wait complete. 2024-04-15T00:01:24.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.560+0000 7f8c18f6f740 20 client.4363 trim_cache size 0 max 16384 2024-04-15T00:01:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.578+0000 7f8c18f6f740 1 Processor -- start 2024-04-15T00:01:24.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.578+0000 7f8c18f6f740 1 -- start start 2024-04-15T00:01:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.579+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b41150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.579+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 0x558833b41690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.579+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833afc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.579+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8c101fc470 con 0x558833afc570 2024-04-15T00:01:24.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.579+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c101fcac0 con 0x558833b27f70 2024-04-15T00:01:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.579+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x558833b01bd0 con 0x558833ade0f0 2024-04-15T00:01:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.580+0000 7f8c0effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 0x558833b41690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.580+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b41150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.580+0000 7f8c0ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833afc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.580+0000 7f8c0effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 0x558833b41690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48368/0 (socket says 172.21.15.29:48368) 2024-04-15T00:01:24.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.580+0000 7f8c0effd640 1 -- 172.21.15.29:0/617752609 learned_addr learned my addr 172.21.15.29:0/617752609 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.582+0000 7f8c0effd640 1 -- 172.21.15.29:0/617752609 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 msgr2=0x558833b41150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.582+0000 7f8c0effd640 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b41150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.582+0000 7f8c0effd640 1 -- 172.21.15.29:0/617752609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 msgr2=0x558833afc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.582+0000 7f8c0effd640 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833afc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.582+0000 7f8c0effd640 1 -- 172.21.15.29:0/617752609 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558833b19300 con 0x558833afc570 2024-04-15T00:01:24.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.584+0000 7f8c0effd640 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 0x558833b41690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009770 tx=0x7f8c04031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d93b557c27ee3d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.586+0000 7f8bf4ff9640 1 -- 172.21.15.29:0/617752609 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04000e60 con 0x558833afc570 2024-04-15T00:01:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8bf4ff9640 1 -- 172.21.15.29:0/617752609 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0404a070 con 0x558833afc570 2024-04-15T00:01:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8bf4ff9640 1 -- 172.21.15.29:0/617752609 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04035040 con 0x558833afc570 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 -- 172.21.15.29:0/617752609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 msgr2=0x558833b41690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 0x558833b41690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009770 tx=0x7f8c04031000 comp rx=0 tx=0).stop 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 -- 172.21.15.29:0/617752609 shutdown_connections 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833b27f70 0x558833afc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833afc570 0x558833b41690 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/617752609 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833b41150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 -- 172.21.15.29:0/617752609 >> 172.21.15.29:0/617752609 conn(0x558833adcb50 msgr2=0x558833b078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 -- 172.21.15.29:0/617752609 shutdown_connections 2024-04-15T00:01:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.588+0000 7f8c18f6f740 1 -- 172.21.15.29:0/617752609 wait complete. 2024-04-15T00:01:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.589+0000 7f8c18f6f740 1 -- start start 2024-04-15T00:01:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.589+0000 7f8c18f6f740 1 Processor -- start 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833aecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833b99420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b99960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558833afd490 con 0x558833b27f70 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558833b19e10 con 0x558833afc570 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x558833af6910 con 0x558833ade0f0 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.590+0000 7f8c18f6f740 10 client.0 _ll_register_callbacks cb 0x7f8c04009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.591+0000 7f8c0ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b99960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.591+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833aecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.591+0000 7f8c0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833b99420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.591+0000 7f8c0ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b99960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48370/0 (socket says 172.21.15.29:48370) 2024-04-15T00:01:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.591+0000 7f8c0ffff640 1 -- 172.21.15.29:0/820855814 learned_addr learned my addr 172.21.15.29:0/820855814 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.594+0000 7f8c0ffff640 1 -- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 msgr2=0x558833aecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.594+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833aecd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.594+0000 7f8c0ffff640 1 -- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 msgr2=0x558833b99420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.594+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833b99420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.594+0000 7f8c0ffff640 1 -- 172.21.15.29:0/820855814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558833ada3f0 con 0x558833b27f70 2024-04-15T00:01:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.596+0000 7f8c0ffff640 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b99960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c08015e40 tx=0x7f8c080016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c425db2a2af89 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.596+0000 7f8bee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-15T00:01:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.600+0000 7f8bee7fc640 1 -- 172.21.15.29:0/820855814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08019040 con 0x558833b27f70 2024-04-15T00:01:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.600+0000 7f8bee7fc640 1 -- 172.21.15.29:0/820855814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8c08014b30 con 0x558833b27f70 2024-04-15T00:01:24.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.600+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c0404a070 con 0x558833b27f70 2024-04-15T00:01:24.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.602+0000 7f8bee7fc640 1 -- 172.21.15.29:0/820855814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f8c08032050 con 0x558833b27f70 2024-04-15T00:01:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.602+0000 7f8c18f6f740 10 client.4380 fetch_fsmap learned FSMap version 7 2024-04-15T00:01:24.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.602+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x558833ade670 con 0x558833b27f70 2024-04-15T00:01:24.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.603+0000 7f8bee7fc640 1 -- 172.21.15.29:0/820855814 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0404a070 con 0x558833b27f70 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.607+0000 7f8bee7fc640 1 -- 172.21.15.29:0/820855814 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f8c08035020 con 0x558833b27f70 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c18f6f740 10 client.4380 fetch_fsmap finished waiting for FSMap version 7 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c18f6f740 10 client.4380 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c18f6f740 20 client.4380 populate_metadata read hostname 'smithi029' 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b00970 0x558833ba5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c18f6f740 4 client.4380 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:01:24.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 --> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] -- command(tid 0: {"prefix": "status"}) -- 0x558833a49810 con 0x558833b00970 2024-04-15T00:01:24.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.608+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b00970 0x558833ba5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.611+0000 7f8c0f7fe640 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b00970 0x558833ba5830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=361ea62053df61b5 server_cookie=a444c55e2ce2dcdc in_seq=0 out_seq=0 2024-04-15T00:01:24.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.611+0000 7f8bee7fc640 10 client.4380 ms_handle_connect on v2:172.21.15.37:6834/4290142859 2024-04-15T00:01:24.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8bee7fc640 1 -- 172.21.15.29:0/820855814 <== mds.0 v2:172.21.15.37:6834/4290142859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x558833a49810 con 0x558833b00970 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8bee7fc640 10 client.4380 handle_command_reply: tid=0 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 client.4380 shutdown 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 msgr2=0x558833b99960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b99960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c08015e40 tx=0x7f8c080016d0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 shutdown_connections 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x558833b00970 0x558833ba5830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558833b27f70 0x558833b99960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558833afc570 0x558833b99420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8bee7fc640 0 client.4380 ms_handle_reset on v2:172.21.15.37:6834/4290142859 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 --2- 172.21.15.29:0/820855814 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558833ade0f0 0x558833aecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 >> 172.21.15.29:0/820855814 conn(0x558833adcb50 msgr2=0x558833add390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 shutdown_connections 2024-04-15T00:01:24.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 1 -- 172.21.15.29:0/820855814 wait complete. 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c18f6f740 20 client.4380 trim_cache size 0 max 16384 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "7c8df2c3-f5a8-486a-b508-c448178a0a97", 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4275, 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-15T00:01:24.638 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-15T00:01:24.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 11.22221974, 2024-04-15T00:01:24.639 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 7, 2024-04-15T00:01:24.639 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 27, 2024-04-15T00:01:24.639 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 27, 2024-04-15T00:01:24.639 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 21.398216525999999 2024-04-15T00:01:24.639 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f8bfc06b950 msgr2=0x7f8bfc06de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.630+0000 7f8c1618c640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f8bfc06b950 0x7f8bfc06de10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c08001530 tx=0x7f8c08009040 comp rx=0 tx=0).stop 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 msgr2=0x7f8c1015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 0x7f8c1015bdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c410 tx=0x7f8c0000c8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 shutdown_connections 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f8bfc06b950 0x7f8bfc06de10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c10154750 0x7f8c101e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f8c100cf610 0x7f8c1015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 --2- 172.21.15.29:0/897414475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c100ce1f0 0x7f8c1015bdc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 >> 172.21.15.29:0/897414475 conn(0x7f8c10062070 msgr2=0x7f8c10152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 shutdown_connections 2024-04-15T00:01:24.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.631+0000 7f8c1618c640 1 -- 172.21.15.29:0/897414475 wait complete. 2024-04-15T00:01:24.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T00:01:24.647 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:24.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T00:01:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.743+0000 7f27c318c640 1 Processor -- start 2024-04-15T00:01:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.743+0000 7f27c318c640 1 -- start start 2024-04-15T00:01:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c318c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc15a530 0x7f27bc0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c318c640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc0ce030 con 0x7f27bc0caad0 2024-04-15T00:01:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c318c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc15a950 con 0x7f27bc0cca40 2024-04-15T00:01:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c318c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc154cf0 con 0x7f27bc15a530 2024-04-15T00:01:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c0f28640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f27bc0caad0 0x7f27bc0cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:45374/0 (socket says 172.21.15.29:45374) 2024-04-15T00:01:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c1729640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27bc0cca40 0x7f27bc0cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:60364/0 (socket says 172.21.15.29:60364) 2024-04-15T00:01:24.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.744+0000 7f27c0f28640 1 -- 172.21.15.29:0/2541967080 learned_addr learned my addr 172.21.15.29:0/2541967080 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.747+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212716675 0 0) 0x7f27bc15a950 con 0x7f27bc0cca40 2024-04-15T00:01:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.747+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27ac003520 con 0x7f27bc0cca40 2024-04-15T00:01:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.747+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89960987 0 0) 0x7f27bc0ce030 con 0x7f27bc0caad0 2024-04-15T00:01:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.747+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27bc15a950 con 0x7f27bc0caad0 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.1 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850996642 0 0) 0x7f27ac003520 con 0x7f27bc0cca40 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc15a530 msgr2=0x7f27bc0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc15a530 0x7f27bc0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 >> v1:172.21.15.29:6789/0 conn(0x7f27bc0caad0 legacy=0x7f27bc0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc15abe0 con 0x7f27bc0cca40 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.1 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1744880889 0 0) 0x7f27b40019f0 con 0x7f27bc0cca40 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 >> v1:172.21.15.37:6789/0 conn(0x7f27bc0cca40 legacy=0x7f27bc0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27ac003b40 0x7f27ac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc15a530 0x7f27ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ac004e60 0x7f27ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc154cf0 con 0x7f27ac003b40 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac005510 con 0x7f27ac004e60 2024-04-15T00:01:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.750+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac00bf00 con 0x7f27bc15a530 2024-04-15T00:01:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.752+0000 7f27c0f28640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27ac003b40 0x7f27ac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.752+0000 7f27c1729640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ac004e60 0x7f27ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.756+0000 7f27c1729640 1 -- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc15a530 msgr2=0x7f27ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.756+0000 7f27c1729640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc15a530 0x7f27ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.756+0000 7f27c1729640 1 -- 172.21.15.29:0/2541967080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27ac003b40 msgr2=0x7f27ac003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.756+0000 7f27c1729640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27ac003b40 0x7f27ac003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.756+0000 7f27c1729640 1 -- 172.21.15.29:0/2541967080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac003520 con 0x7f27ac004e60 2024-04-15T00:01:24.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.758+0000 7f27c1729640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ac004e60 0x7f27ac00b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f27b400c4c0 tx=0x7f27ac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d8c477bf322d675 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b400c0e0 con 0x7f27ac004e60 2024-04-15T00:01:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b4030070 con 0x7f27ac004e60 2024-04-15T00:01:24.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27bb7fe640 1 -- 172.21.15.29:0/2541967080 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b402ca80 con 0x7f27ac004e60 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27c318c640 1 -- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ac004e60 msgr2=0x7f27ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27c318c640 1 --2- 172.21.15.29:0/2541967080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ac004e60 0x7f27ac00b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f27b400c4c0 tx=0x7f27ac005830 comp rx=0 tx=0).stop 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27c1729640 1 -- 172.21.15.29:0/2541967080 reap_dead start 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27c318c640 1 -- 172.21.15.29:0/2541967080 shutdown_connections 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27c318c640 1 -- 172.21.15.29:0/2541967080 >> 172.21.15.29:0/2541967080 conn(0x7f27bc0cfb20 msgr2=0x7f27bc0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.762+0000 7f27c318c640 1 -- 172.21.15.29:0/2541967080 shutdown_connections 2024-04-15T00:01:24.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.763+0000 7f27c318c640 1 -- 172.21.15.29:0/2541967080 wait complete. 2024-04-15T00:01:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.764+0000 7f27c318c640 1 Processor -- start 2024-04-15T00:01:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.764+0000 7f27c318c640 1 -- start start 2024-04-15T00:01:24.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27c318c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27bc0c3ab0 0x7f27bc14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27c318c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 0x7f27bc14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27c318c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc0c3e90 0x7f27bc1f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27c318c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc15b1a0 con 0x7f27bc0c3ab0 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27c318c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc15b480 con 0x7f27bc0b1710 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27c318c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc0ce3d0 con 0x7f27bc0c3e90 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.765+0000 7f27bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 0x7f27bc14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.766+0000 7f27bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 0x7f27bc14c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:54712/0 (socket says 172.21.15.29:54712) 2024-04-15T00:01:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.766+0000 7f27bbfff640 1 -- 172.21.15.29:0/340350330 learned_addr learned my addr 172.21.15.29:0/340350330 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:24.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.766+0000 7f27c1729640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc0c3e90 0x7f27bc1f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.769+0000 7f27bbfff640 1 -- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc0c3e90 msgr2=0x7f27bc1f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.769+0000 7f27bbfff640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc0c3e90 0x7f27bc1f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.769+0000 7f27bbfff640 1 -- 172.21.15.29:0/340350330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27bc0c3ab0 msgr2=0x7f27bc14c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.769+0000 7f27bbfff640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27bc0c3ab0 0x7f27bc14c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:24.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.769+0000 7f27bbfff640 1 -- 172.21.15.29:0/340350330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc0c4f40 con 0x7f27bc0b1710 2024-04-15T00:01:24.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.771+0000 7f27bbfff640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 0x7f27bc14c6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27a800b450 tx=0x7f27a800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.775+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8015020 con 0x7f27bc0b1710 2024-04-15T00:01:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.775+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8011890 con 0x7f27bc0b1710 2024-04-15T00:01:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.775+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8011c60 con 0x7f27bc0b1710 2024-04-15T00:01:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.775+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc0c5220 con 0x7f27bc0b1710 2024-04-15T00:01:24.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.775+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc0c57e0 con 0x7f27bc0b1710 2024-04-15T00:01:24.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.776+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27bc0cc830 con 0x7f27bc0b1710 2024-04-15T00:01:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.795+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f27a8018020 con 0x7f27bc0b1710 2024-04-15T00:01:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.795+0000 7f27b97fa640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f27a006ba10 0x7f27a006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:24.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.796+0000 7f27c0f28640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f27a006ba10 0x7f27a006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:24.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.796+0000 7f27c0f28640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f27a006ba10 0x7f27a006ded0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27b0007a90 tx=0x7f27b0007a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:24.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:24.799+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f27a8011e00 con 0x7f27bc0b1710 2024-04-15T00:01:25.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.087+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f27bc0cc830 con 0x7f27bc0b1710 2024-04-15T00:01:25.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:01:25.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:01:25.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.306+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27bc0cb5c0 con 0x7f27bc0b1710 2024-04-15T00:01:25.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.313+0000 7f27b97fa640 1 -- 172.21.15.29:0/340350330 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f27bc0cb5c0 con 0x7f27bc0b1710 2024-04-15T00:01:25.320 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T00:01:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f27a006ba10 msgr2=0x7f27a006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f27a006ba10 0x7f27a006ded0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27b0007a90 tx=0x7f27b0007a20 comp rx=0 tx=0).stop 2024-04-15T00:01:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 msgr2=0x7f27bc14c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:25.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 0x7f27bc14c6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27a800b450 tx=0x7f27a800b910 comp rx=0 tx=0).stop 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 shutdown_connections 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f27a006ba10 0x7f27a006ded0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f27bc0c3e90 0x7f27bc1f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27bc0b1710 0x7f27bc14c6a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 --2- 172.21.15.29:0/340350330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f27bc0c3ab0 0x7f27bc14c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.315+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 >> 172.21.15.29:0/340350330 conn(0x7f27bc0cfb20 msgr2=0x7f27bc0c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.316+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 shutdown_connections 2024-04-15T00:01:25.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25.316+0000 7f27c318c640 1 -- 172.21.15.29:0/340350330 wait complete. 2024-04-15T00:01:25.332 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-15T00:01:25.332 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T00:01:25.333 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-15T00:01:25.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:25.333 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-04-15T00:01:25.412 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T00:01:25.412 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T00:01:25.412 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T00:01:25.412 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:01:25.412 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-04-15T00:01:25.412 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42268sec preferred_lft 42268sec 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link noprefixroute 2024-04-15T00:01:25.413 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:01:25.414 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:01:25.414 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-04-15T00:01:25.414 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-04-15T00:01:25.415 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T00:01:25.415 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:01:25.415 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:01:25.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-04-15T00:01:25.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-04-15T00:01:25.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-04-15T00:01:25.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T00:01:25.416 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:01:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:01:25.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:25.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:25.611 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T00:01:25.638 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-04-15T00:01:25.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:25.640 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-04-15T00:01:25.713 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-04-15T00:01:25.713 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T00:01:25.714 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-15T00:01:25.714 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-15T00:01:25.714 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T00:01:25.714 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:01:25.714 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:01:25.714 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-15T00:01:25.714 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-15T00:01:25.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-15T00:01:25.715 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:01:25.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:01:25.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:25.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:25.998 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-15T00:01:26.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:26.012 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-04-15T00:01:26.067 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:01:26.067 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:01:26.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:26.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-15T00:01:26.067 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:01:26.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:01:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:26.190 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-15T00:01:26.190 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:01:26.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:01:26.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:26.334 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:01:26.335 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:01:26.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-04-15T00:01:26.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T00:01:26.335 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:01:26.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:01:26.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:26.417 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-15T00:01:26.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:01:26.417 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:26.431 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-15T00:01:26.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:01:26.432 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:26.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:01:26.554 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:01:26.609 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:01:26.609 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:01:26.610 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:01:26.611 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:26.612 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:26.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:26.612 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:01:26.664 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T00:01:26.664 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-15T00:01:26.707 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:01:26.733 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:01:26.789 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:01:26.789 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:01:26.789 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:01:26.789 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:01:26.790 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:26.791 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:26.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:26.792 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:01:26.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2024-04-15T00:01:26.797+0000 7f8636a3b480 -1 init, newargv = 0x5586cc2a6210 newargc=15 2024-04-15T00:01:26.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[42628]: starting ceph client 2024-04-15T00:01:27.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[42628]: starting fuse 2024-04-15T00:01:27.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:01:27.949 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:01:28.005 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:01:28.005 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:01:28.005 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:01:28.005 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:01:28.006 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:01:28.007 INFO:teuthology.orchestra.run.smithi029.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:28.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:28.008 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:01:28.065 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-04-15T00:01:28.065 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-15T00:01:28.065 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-04-15T00:01:28.065 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-04-15T00:01:28.065 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-04-15T00:01:28.066 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2024-04-15T00:01:28.067 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-04-15T00:01:28.191 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.42628.asok 2024-04-15T00:01:28.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:28.202 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42628.asok 2024-04-15T00:01:28.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:28.202 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42628.asok status 2024-04-15T00:01:28.341 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:01:28.341 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "a9a752df26c63acad72e1b3569fd79a515ca0765", 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.0.0-2114-ga9a752df (a9a752df26c63acad72e1b3569fd79a515ca0765) squid (dev)", 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "42628", 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-04-15T00:01:28.342 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4389, 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4389 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2988828209 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-15T00:01:28.343 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2988828209 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4389 192.168.0.1:0/2988828209", 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/2988828209", 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 7, 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 27, 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-04-15T00:01:28.344 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-04-15T00:01:28.345 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:01:28.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:28.350 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-04-15T00:01:28.350 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:28.376 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-04-15T00:01:28.376 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:28.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:28.376 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:28.525 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-15T00:01:28.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-15T00:01:28.794 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2024-04-15T00:01:28.795 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-15T00:01:28.795 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:28.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:01:28.801 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:01:28.801 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:01:28.818 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:28.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.954+0000 7f2b73f75640 1 Processor -- start 2024-04-15T00:01:28.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.954+0000 7f2b73f75640 1 -- start start 2024-04-15T00:01:28.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.955+0000 7f2b73f75640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b6c1436b0 0x7f2b6c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:28.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.955+0000 7f2b73f75640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:28.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.955+0000 7f2b73f75640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6c15e7f0 con 0x7f2b6c070950 2024-04-15T00:01:28.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.955+0000 7f2b73f75640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6c143a90 con 0x7f2b6c1436b0 2024-04-15T00:01:28.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.955+0000 7f2b73f75640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c15a5a0 con 0x7f2b6c070530 2024-04-15T00:01:28.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.956+0000 7f2b71d11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b6c1436b0 0x7f2b6c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:28.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.956+0000 7f2b71510640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:28.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.956+0000 7f2b71d11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b6c1436b0 0x7f2b6c15e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47112/0 (socket says 172.21.15.29:47112) 2024-04-15T00:01:28.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.956+0000 7f2b71d11640 1 -- 172.21.15.29:0/949618695 learned_addr learned my addr 172.21.15.29:0/949618695 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:28.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.958+0000 7f2b71510640 1 -- 172.21.15.29:0/949618695 >> v2:172.21.15.37:3300/0 conn(0x7f2b6c1436b0 msgr2=0x7f2b6c15e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:28.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.958+0000 7f2b71510640 1 --2- 172.21.15.29:0/949618695 >> v2:172.21.15.37:3300/0 conn(0x7f2b6c1436b0 0x7f2b6c15e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:28.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.958+0000 7f2b71510640 1 -- 172.21.15.29:0/949618695 >> v1:172.21.15.37:6789/0 conn(0x7f2b6c070950 legacy=0x7f2b6c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:28.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.958+0000 7f2b71510640 1 -- 172.21.15.29:0/949618695 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c15a880 con 0x7f2b6c070530 2024-04-15T00:01:28.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.961+0000 7f2b71510640 1 --2- 172.21.15.29:0/949618695 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c0cdbc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097a0 tx=0x7f2b5c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=630ae5b4b4b37183 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:28.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.966+0000 7f2b70d0f640 1 -- 172.21.15.29:0/949618695 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c034070 con 0x7f2b6c070530 2024-04-15T00:01:28.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.966+0000 7f2b70d0f640 1 -- 172.21.15.29:0/949618695 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c030610 con 0x7f2b6c070530 2024-04-15T00:01:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.966+0000 7f2b70d0f640 1 -- 172.21.15.29:0/949618695 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0309e0 con 0x7f2b6c070530 2024-04-15T00:01:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 -- 172.21.15.29:0/949618695 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 msgr2=0x7f2b6c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 --2- 172.21.15.29:0/949618695 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c0cdbc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097a0 tx=0x7f2b5c02b960 comp rx=0 tx=0).stop 2024-04-15T00:01:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 -- 172.21.15.29:0/949618695 shutdown_connections 2024-04-15T00:01:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 --2- 172.21.15.29:0/949618695 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c0cdbc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:28.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 --2- 172.21.15.29:0/949618695 >> v2:172.21.15.37:3300/0 conn(0x7f2b6c1436b0 0x7f2b6c15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 -- 172.21.15.29:0/949618695 >> 172.21.15.29:0/949618695 conn(0x7f2b6c061e00 msgr2=0x7f2b6c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 -- 172.21.15.29:0/949618695 shutdown_connections 2024-04-15T00:01:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.967+0000 7f2b73f75640 1 -- 172.21.15.29:0/949618695 wait complete. 2024-04-15T00:01:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.968+0000 7f2b73f75640 1 Processor -- start 2024-04-15T00:01:28.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.968+0000 7f2b73f75640 1 -- start start 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b73f75640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c1f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b73f75640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 0x7f2b6c13a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b73f75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c1436b0 0x7f2b6c0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b73f75640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c15a2b0 con 0x7f2b6c070950 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b73f75640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c15ae40 con 0x7f2b6c1436b0 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b73f75640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c15c060 con 0x7f2b6c070530 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b71510640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 0x7f2b6c13a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b71510640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 0x7f2b6c13a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52448/0 (socket says 172.21.15.29:52448) 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b71510640 1 -- 172.21.15.29:0/375880090 learned_addr learned my addr 172.21.15.29:0/375880090 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b72512640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c1436b0 0x7f2b6c0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.969+0000 7f2b71d11640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c1f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.973+0000 7f2b71510640 1 -- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 msgr2=0x7f2b6c1f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.973+0000 7f2b71510640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c1f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:28.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.973+0000 7f2b71510640 1 -- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c1436b0 msgr2=0x7f2b6c0ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:28.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.973+0000 7f2b71510640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c1436b0 0x7f2b6c0ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:28.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.973+0000 7f2b71510640 1 -- 172.21.15.29:0/375880090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c13ae10 con 0x7f2b6c070950 2024-04-15T00:01:28.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.975+0000 7f2b71510640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 0x7f2b6c13a8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c02bf70 tx=0x7f2b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.979+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c034040 con 0x7f2b6c070950 2024-04-15T00:01:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.979+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c030410 con 0x7f2b6c070950 2024-04-15T00:01:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.979+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c039c30 con 0x7f2b6c070950 2024-04-15T00:01:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.979+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c0cc300 con 0x7f2b6c070950 2024-04-15T00:01:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.979+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c0cc020 con 0x7f2b6c070950 2024-04-15T00:01:28.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.980+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6c0cbac0 con 0x7f2b6c070950 2024-04-15T00:01:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.999+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2b5c037070 con 0x7f2b6c070950 2024-04-15T00:01:29.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:28.999+0000 7f2b627fc640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2b5006ba10 0x7f2b5006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.000+0000 7f2b71d11640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2b5006ba10 0x7f2b5006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:29.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.000+0000 7f2b71d11640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2b5006ba10 0x7f2b5006ded0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009b30 tx=0x7f2b68009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:29.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.002+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2b5c0305c0 con 0x7f2b6c070950 2024-04-15T00:01:29.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.266+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2b6c0cbac0 con 0x7f2b6c070950 2024-04-15T00:01:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.454+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b6c04f540 con 0x7f2b6c070950 2024-04-15T00:01:29.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.547+0000 7f2b627fc640 1 -- 172.21.15.29:0/375880090 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7f2b5c07b8b0 con 0x7f2b6c070950 2024-04-15T00:01:29.555 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:29.555 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2b5006ba10 msgr2=0x7f2b5006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2b5006ba10 0x7f2b5006ded0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009b30 tx=0x7f2b68009240 comp rx=0 tx=0).stop 2024-04-15T00:01:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 msgr2=0x7f2b6c13a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 0x7f2b6c13a8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c02bf70 tx=0x7f2b5c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 shutdown_connections 2024-04-15T00:01:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2b5006ba10 0x7f2b5006ded0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c1436b0 0x7f2b6c0ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b6c070950 0x7f2b6c13a8d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 --2- 172.21.15.29:0/375880090 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b6c070530 0x7f2b6c1f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 >> 172.21.15.29:0/375880090 conn(0x7f2b6c061e00 msgr2=0x7f2b6c0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 shutdown_connections 2024-04-15T00:01:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.550+0000 7f2b73f75640 1 -- 172.21.15.29:0/375880090 wait complete. 2024-04-15T00:01:29.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:01:09.779176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:01:11.503018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:01:16.720777+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:01:29.567 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:01:29.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.666+0000 7fdeaaab0640 1 Processor -- start 2024-04-15T00:01:29.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.666+0000 7fdeaaab0640 1 -- start start 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fdeaaab0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea40c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fdeaaab0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea40c37e0 con 0x7fdea40c7810 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fdeaaab0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea40c51d0 con 0x7fdea4151440 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fdeaaab0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fdea40c4f80 con 0x7fdea40c8bf0 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fdea904d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdea40c7810 0x7fdea40cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49378/0 (socket says 172.21.15.29:49378) 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fdea904d640 1 -- 172.21.15.29:0/3070553286 learned_addr learned my addr 172.21.15.29:0/3070553286 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:29.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.667+0000 7fde9bfff640 1 --2- 172.21.15.29:0/3070553286 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea40c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:29.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291681106 0 0) 0x7fdea40c37e0 con 0x7fdea40c7810 2024-04-15T00:01:29.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde8c003520 con 0x7fdea40c7810 2024-04-15T00:01:29.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089029758 0 0) 0x7fdea40c51d0 con 0x7fdea4151440 2024-04-15T00:01:29.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdea40c37e0 con 0x7fdea4151440 2024-04-15T00:01:29.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9bfff640 1 -- 172.21.15.29:0/3070553286 >> v1:172.21.15.37:6789/0 conn(0x7fdea4151440 legacy=0x7fdea40c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9bfff640 1 -- 172.21.15.29:0/3070553286 >> v1:172.21.15.29:6789/0 conn(0x7fdea40c7810 legacy=0x7fdea40cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.670+0000 7fde9bfff640 1 -- 172.21.15.29:0/3070553286 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea40c54b0 con 0x7fdea40c8bf0 2024-04-15T00:01:29.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.672+0000 7fde9bfff640 1 --2- 172.21.15.29:0/3070553286 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea40c72d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde940097d0 tx=0x7fde9402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f71501812f2e62 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:29.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.676+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94035020 con 0x7fdea40c8bf0 2024-04-15T00:01:29.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.676+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde94031890 con 0x7fdea40c8bf0 2024-04-15T00:01:29.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.676+0000 7fde9b7fe640 1 -- 172.21.15.29:0/3070553286 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94031c60 con 0x7fdea40c8bf0 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.676+0000 7fdeaaab0640 1 -- 172.21.15.29:0/3070553286 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 msgr2=0x7fdea40c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.676+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/3070553286 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea40c72d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde940097d0 tx=0x7fde9402b930 comp rx=0 tx=0).stop 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.677+0000 7fdeaaab0640 1 -- 172.21.15.29:0/3070553286 shutdown_connections 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.677+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/3070553286 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea40c72d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.677+0000 7fdeaaab0640 1 -- 172.21.15.29:0/3070553286 >> 172.21.15.29:0/3070553286 conn(0x7fdea406f100 msgr2=0x7fdea406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.677+0000 7fdeaaab0640 1 -- 172.21.15.29:0/3070553286 shutdown_connections 2024-04-15T00:01:29.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.677+0000 7fdeaaab0640 1 -- 172.21.15.29:0/3070553286 wait complete. 2024-04-15T00:01:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.678+0000 7fdeaaab0640 1 Processor -- start 2024-04-15T00:01:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.678+0000 7fdeaaab0640 1 -- start start 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.678+0000 7fdeaaab0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 0x7fdea4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.678+0000 7fdeaaab0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea413fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdeaaab0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdea4151440 0x7fdea4143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdeaaab0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdea40c3550 con 0x7fdea40c7810 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdeaaab0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdea40c33d0 con 0x7fdea4151440 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdeaaab0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fdea40cbf20 con 0x7fdea40c8bf0 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdea884c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 0x7fdea4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:29.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea413fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdea904d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdea4151440 0x7fdea4143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdea884c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 0x7fdea4151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52452/0 (socket says 172.21.15.29:52452) 2024-04-15T00:01:29.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.679+0000 7fdea884c640 1 -- 172.21.15.29:0/4070260749 learned_addr learned my addr 172.21.15.29:0/4070260749 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:29.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.683+0000 7fdea884c640 1 -- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 msgr2=0x7fdea413fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.683+0000 7fdea884c640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea413fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.683+0000 7fdea884c640 1 -- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdea4151440 msgr2=0x7fdea4143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:29.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.683+0000 7fdea884c640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdea4151440 0x7fdea4143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:29.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.683+0000 7fdea884c640 1 -- 172.21.15.29:0/4070260749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea413f590 con 0x7fdea40c7810 2024-04-15T00:01:29.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.685+0000 7fdea884c640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 0x7fdea4151950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdea000c430 tx=0x7fdea000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:29.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.689+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0017070 con 0x7fdea40c7810 2024-04-15T00:01:29.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.689+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea00052f0 con 0x7fdea40c7810 2024-04-15T00:01:29.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.689+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0003830 con 0x7fdea40c7810 2024-04-15T00:01:29.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.689+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea4153400 con 0x7fdea40c7810 2024-04-15T00:01:29.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.689+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea41539c0 con 0x7fdea40c7810 2024-04-15T00:01:29.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.690+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea404f540 con 0x7fdea40c7810 2024-04-15T00:01:29.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.709+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdea001a070 con 0x7fdea40c7810 2024-04-15T00:01:29.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.709+0000 7fde997fa640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fde9006b9e0 0x7fde9006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:29.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.709+0000 7fde9bfff640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fde9006b9e0 0x7fde9006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:29.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.710+0000 7fde9bfff640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fde9006b9e0 0x7fde9006dea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde94036000 tx=0x7fde94008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:29.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.711+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdea0013e10 con 0x7fdea40c7810 2024-04-15T00:01:29.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:29.969+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdea0021020 con 0x7fdea40c7810 2024-04-15T00:01:30.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.153+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdea4153c00 con 0x7fdea40c7810 2024-04-15T00:01:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.158+0000 7fde997fa640 1 -- 172.21.15.29:0/4070260749 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fdea0058590 con 0x7fdea40c7810 2024-04-15T00:01:30.164 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T00:01:30.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fde9006b9e0 msgr2=0x7fde9006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fde9006b9e0 0x7fde9006dea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde94036000 tx=0x7fde94008030 comp rx=0 tx=0).stop 2024-04-15T00:01:30.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 msgr2=0x7fdea4151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 0x7fdea4151950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdea000c430 tx=0x7fdea000c8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 shutdown_connections 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fde9006b9e0 0x7fde9006dea0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdea4151440 0x7fdea4143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdea40c8bf0 0x7fdea413fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 --2- 172.21.15.29:0/4070260749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea40c7810 0x7fdea4151950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 >> 172.21.15.29:0/4070260749 conn(0x7fdea406f100 msgr2=0x7fdea4147330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 shutdown_connections 2024-04-15T00:01:30.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.161+0000 7fdeaaab0640 1 -- 172.21.15.29:0/4070260749 wait complete. 2024-04-15T00:01:30.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:01:30.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.276+0000 7f270755e640 1 Processor -- start 2024-04-15T00:01:30.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.276+0000 7f270755e640 1 -- start start 2024-04-15T00:01:30.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f270755e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f27000c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f270755e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2700070d30 con 0x7f2700072630 2024-04-15T00:01:30.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f270755e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27000c9e70 con 0x7f27000c3650 2024-04-15T00:01:30.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f270755e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2700071010 con 0x7f2700152420 2024-04-15T00:01:30.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f2705afb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2700072630 0x7f27000c5e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49394/0 (socket says 172.21.15.29:49394) 2024-04-15T00:01:30.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f2705afb640 1 -- 172.21.15.29:0/3762047892 learned_addr learned my addr 172.21.15.29:0/3762047892 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:30.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.277+0000 7f27052fa640 1 --2- 172.21.15.29:0/3762047892 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f27000c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.280+0000 7f26f7fff640 1 -- 172.21.15.29:0/3762047892 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636363911 0 0) 0x7f2700070d30 con 0x7f2700072630 2024-04-15T00:01:30.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.280+0000 7f26f7fff640 1 -- 172.21.15.29:0/3762047892 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26ec003520 con 0x7f2700072630 2024-04-15T00:01:30.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.280+0000 7f26f7fff640 1 -- 172.21.15.29:0/3762047892 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829773144 0 0) 0x7f27000c9e70 con 0x7f27000c3650 2024-04-15T00:01:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.280+0000 7f27052fa640 1 -- 172.21.15.29:0/3762047892 >> v1:172.21.15.37:6789/0 conn(0x7f27000c3650 legacy=0x7f2700157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.280+0000 7f27052fa640 1 -- 172.21.15.29:0/3762047892 >> v1:172.21.15.29:6789/0 conn(0x7f2700072630 legacy=0x7f27000c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.280+0000 7f27052fa640 1 -- 172.21.15.29:0/3762047892 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000ca150 con 0x7f2700152420 2024-04-15T00:01:30.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.283+0000 7f27052fa640 1 --2- 172.21.15.29:0/3762047892 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f27000c30e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2700071190 tx=0x7f26fc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b76f7e0c13bd5cd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.287+0000 7f26f7fff640 1 -- 172.21.15.29:0/3762047892 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc035020 con 0x7f2700152420 2024-04-15T00:01:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.287+0000 7f26f7fff640 1 -- 172.21.15.29:0/3762047892 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26fc031890 con 0x7f2700152420 2024-04-15T00:01:30.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.287+0000 7f26f7fff640 1 -- 172.21.15.29:0/3762047892 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc031c60 con 0x7f2700152420 2024-04-15T00:01:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.287+0000 7f270755e640 1 -- 172.21.15.29:0/3762047892 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 msgr2=0x7f27000c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.287+0000 7f270755e640 1 --2- 172.21.15.29:0/3762047892 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f27000c30e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2700071190 tx=0x7f26fc02b930 comp rx=0 tx=0).stop 2024-04-15T00:01:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.288+0000 7f270755e640 1 -- 172.21.15.29:0/3762047892 shutdown_connections 2024-04-15T00:01:30.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.288+0000 7f270755e640 1 --2- 172.21.15.29:0/3762047892 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f27000c30e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.288+0000 7f270755e640 1 -- 172.21.15.29:0/3762047892 >> 172.21.15.29:0/3762047892 conn(0x7f270006c310 msgr2=0x7f270006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:30.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.288+0000 7f270755e640 1 -- 172.21.15.29:0/3762047892 shutdown_connections 2024-04-15T00:01:30.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.288+0000 7f270755e640 1 -- 172.21.15.29:0/3762047892 wait complete. 2024-04-15T00:01:30.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.289+0000 7f270755e640 1 Processor -- start 2024-04-15T00:01:30.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.289+0000 7f270755e640 1 -- start start 2024-04-15T00:01:30.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f270755e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 0x7f27001434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f270755e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27000c3650 0x7f27001ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f270755e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f2700142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f270755e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f27000c6580 con 0x7f2700072630 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f270755e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27000c74e0 con 0x7f27000c3650 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f270755e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f27000c6700 con 0x7f2700152420 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f27052fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 0x7f27001434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f2704af9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27000c3650 0x7f27001ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f2705afb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f2700142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f27052fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 0x7f27001434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52456/0 (socket says 172.21.15.29:52456) 2024-04-15T00:01:30.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.290+0000 7f27052fa640 1 -- 172.21.15.29:0/2226070643 learned_addr learned my addr 172.21.15.29:0/2226070643 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.294+0000 7f27052fa640 1 -- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 msgr2=0x7f2700142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.294+0000 7f27052fa640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f2700142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.294+0000 7f27052fa640 1 -- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27000c3650 msgr2=0x7f27001ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.294+0000 7f27052fa640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27000c3650 0x7f27001ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.294+0000 7f27052fa640 1 -- 172.21.15.29:0/2226070643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2700141ee0 con 0x7f2700072630 2024-04-15T00:01:30.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.296+0000 7f27052fa640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 0x7f27001434e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f26fc034040 tx=0x7f26fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.300+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc040070 con 0x7f2700072630 2024-04-15T00:01:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.300+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26fc030ca0 con 0x7f2700072630 2024-04-15T00:01:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.300+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc035040 con 0x7f2700072630 2024-04-15T00:01:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.300+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001421c0 con 0x7f2700072630 2024-04-15T00:01:30.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.300+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001f10b0 con 0x7f2700072630 2024-04-15T00:01:30.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.301+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270004f540 con 0x7f2700072630 2024-04-15T00:01:30.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.569+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f26fc04b060 con 0x7f2700072630 2024-04-15T00:01:30.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.569+0000 7f26f5ffb640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f26e406b990 0x7f26e406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.569+0000 7f2704af9640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f26e406b990 0x7f26e406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.570+0000 7f2704af9640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f26e406b990 0x7f26e406de50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f270014d6c0 tx=0x7f26f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:30.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.584+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f26fc045df0 con 0x7f2700072630 2024-04-15T00:01:30.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.585+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f26fc0aae20 con 0x7f2700072630 2024-04-15T00:01:30.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.773+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f27000705a0 con 0x7f2700072630 2024-04-15T00:01:30.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.790+0000 7f26f5ffb640 1 -- 172.21.15.29:0/2226070643 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f26fc02d040 con 0x7f2700072630 2024-04-15T00:01:30.797 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:30.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f26e406b990 msgr2=0x7f26e406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f26e406b990 0x7f26e406de50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f270014d6c0 tx=0x7f26f0009040 comp rx=0 tx=0).stop 2024-04-15T00:01:30.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 msgr2=0x7f27001434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 0x7f27001434e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f26fc034040 tx=0x7f26fc0046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 shutdown_connections 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f26e406b990 0x7f26e406de50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2700152420 0x7f2700142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27000c3650 0x7f27001ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 --2- 172.21.15.29:0/2226070643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2700072630 0x7f27001434e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 >> 172.21.15.29:0/2226070643 conn(0x7f270006c310 msgr2=0x7f270014c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 shutdown_connections 2024-04-15T00:01:30.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.793+0000 7f270755e640 1 -- 172.21.15.29:0/2226070643 wait complete. 2024-04-15T00:01:30.809 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:01:30.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.909+0000 7fb8360b0640 1 Processor -- start 2024-04-15T00:01:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.909+0000 7fb8360b0640 1 -- start start 2024-04-15T00:01:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.910+0000 7fb8360b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb83015ac30 0x7fb83015b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.910+0000 7fb8360b0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8300ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.910+0000 7fb8360b0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83015ba10 con 0x7fb8300cc330 2024-04-15T00:01:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.910+0000 7fb8360b0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb830154cc0 con 0x7fb83015ac30 2024-04-15T00:01:30.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.910+0000 7fb8360b0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb83015c5b0 con 0x7fb8300ca470 2024-04-15T00:01:30.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.911+0000 7fb82f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb83015ac30 0x7fb83015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.911+0000 7fb82effd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8300ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.911+0000 7fb82f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb83015ac30 0x7fb83015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47146/0 (socket says 172.21.15.29:47146) 2024-04-15T00:01:30.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.911+0000 7fb82f7fe640 1 -- 172.21.15.29:0/510064170 learned_addr learned my addr 172.21.15.29:0/510064170 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:30.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.914+0000 7fb82effd640 1 -- 172.21.15.29:0/510064170 >> v2:172.21.15.37:3300/0 conn(0x7fb83015ac30 msgr2=0x7fb83015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:30.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.914+0000 7fb82effd640 1 --2- 172.21.15.29:0/510064170 >> v2:172.21.15.37:3300/0 conn(0x7fb83015ac30 0x7fb83015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.915+0000 7fb82effd640 1 -- 172.21.15.29:0/510064170 >> v1:172.21.15.37:6789/0 conn(0x7fb8300cc330 legacy=0x7fb83015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.915+0000 7fb82effd640 1 -- 172.21.15.29:0/510064170 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83015bc80 con 0x7fb8300ca470 2024-04-15T00:01:30.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.917+0000 7fb82effd640 1 --2- 172.21.15.29:0/510064170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8300ca8b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097a0 tx=0x7fb82402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34618e489002f37c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.921+0000 7fb82e7fc640 1 -- 172.21.15.29:0/510064170 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824034070 con 0x7fb8300ca470 2024-04-15T00:01:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.921+0000 7fb82e7fc640 1 -- 172.21.15.29:0/510064170 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb824030610 con 0x7fb8300ca470 2024-04-15T00:01:30.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.921+0000 7fb82e7fc640 1 -- 172.21.15.29:0/510064170 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8240309e0 con 0x7fb8300ca470 2024-04-15T00:01:30.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 -- 172.21.15.29:0/510064170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 msgr2=0x7fb8300ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 --2- 172.21.15.29:0/510064170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8300ca8b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097a0 tx=0x7fb82402b960 comp rx=0 tx=0).stop 2024-04-15T00:01:30.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 -- 172.21.15.29:0/510064170 shutdown_connections 2024-04-15T00:01:30.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 --2- 172.21.15.29:0/510064170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8300ca8b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 --2- 172.21.15.29:0/510064170 >> v2:172.21.15.37:3300/0 conn(0x7fb83015ac30 0x7fb83015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 -- 172.21.15.29:0/510064170 >> 172.21.15.29:0/510064170 conn(0x7fb8300cfaf0 msgr2=0x7fb8300cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:30.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 -- 172.21.15.29:0/510064170 shutdown_connections 2024-04-15T00:01:30.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.922+0000 7fb8360b0640 1 -- 172.21.15.29:0/510064170 wait complete. 2024-04-15T00:01:30.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.923+0000 7fb8360b0640 1 Processor -- start 2024-04-15T00:01:30.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.923+0000 7fb8360b0640 1 -- start start 2024-04-15T00:01:30.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.924+0000 7fb8360b0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8301569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.924+0000 7fb8360b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8300cc330 0x7fb8301e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.924+0000 7fb8360b0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb83015ac30 0x7fb8300c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.924+0000 7fb8360b0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300ccec0 con 0x7fb83015ac30 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.924+0000 7fb8360b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb83015c240 con 0x7fb8300cc330 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.924+0000 7fb8360b0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb83015d150 con 0x7fb8300ca470 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.925+0000 7fb82f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8301569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.925+0000 7fb82effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8300cc330 0x7fb8301e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.925+0000 7fb82effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8300cc330 0x7fb8301e6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47150/0 (socket says 172.21.15.29:47150) 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.925+0000 7fb82f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8301569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:47390/0 (socket says 172.21.15.29:47390) 2024-04-15T00:01:30.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.925+0000 7fb82effd640 1 -- 172.21.15.29:0/2055010822 learned_addr learned my addr 172.21.15.29:0/2055010822 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:30.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.926+0000 7fb82ffff640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb83015ac30 0x7fb8300c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.929+0000 7fb82f7fe640 1 -- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8300cc330 msgr2=0x7fb8301e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.929+0000 7fb82f7fe640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8300cc330 0x7fb8301e6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.929+0000 7fb82f7fe640 1 -- 172.21.15.29:0/2055010822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb83015ac30 msgr2=0x7fb8300c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.929+0000 7fb82f7fe640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb83015ac30 0x7fb8300c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:30.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.929+0000 7fb82f7fe640 1 -- 172.21.15.29:0/2055010822 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb830156ee0 con 0x7fb8300ca470 2024-04-15T00:01:30.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.931+0000 7fb82f7fe640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8301569a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e8a0 tx=0x7fb82000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:30.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.935+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820017070 con 0x7fb8300ca470 2024-04-15T00:01:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.935+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82000c940 con 0x7fb8300ca470 2024-04-15T00:01:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.935+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8301f0a20 con 0x7fb8300ca470 2024-04-15T00:01:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.935+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820009e60 con 0x7fb8300ca470 2024-04-15T00:01:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.935+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb830157ae0 con 0x7fb8300ca470 2024-04-15T00:01:30.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:30.936+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8301565e0 con 0x7fb8300ca470 2024-04-15T00:01:31.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.213+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb82001a070 con 0x7fb8300ca470 2024-04-15T00:01:31.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.213+0000 7fb817fff640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb81c06b9e0 0x7fb81c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.214+0000 7fb82effd640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb81c06b9e0 0x7fb81c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.214+0000 7fb82effd640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb81c06b9e0 0x7fb81c06dea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb82402b9a0 tx=0x7fb82403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:31.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.216+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb8200573b0 con 0x7fb8300ca470 2024-04-15T00:01:31.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.227+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb820059310 con 0x7fb8300ca470 2024-04-15T00:01:31.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.407+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb83004f540 con 0x7fb8300ca470 2024-04-15T00:01:31.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.433+0000 7fb817fff640 1 -- 172.21.15.29:0/2055010822 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb82005d3b0 con 0x7fb8300ca470 2024-04-15T00:01:31.439 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-15T00:01:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb81c06b9e0 msgr2=0x7fb81c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb81c06b9e0 0x7fb81c06dea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb82402b9a0 tx=0x7fb82403b040 comp rx=0 tx=0).stop 2024-04-15T00:01:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 msgr2=0x7fb8301569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8301569a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e8a0 tx=0x7fb82000ed60 comp rx=0 tx=0).stop 2024-04-15T00:01:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 shutdown_connections 2024-04-15T00:01:31.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb81c06b9e0 0x7fb81c06dea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb83015ac30 0x7fb8300c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8300cc330 0x7fb8301e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 --2- 172.21.15.29:0/2055010822 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb8300ca470 0x7fb8301569a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 >> 172.21.15.29:0/2055010822 conn(0x7fb8300cfaf0 msgr2=0x7fb8300cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:31.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 shutdown_connections 2024-04-15T00:01:31.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.435+0000 7fb8360b0640 1 -- 172.21.15.29:0/2055010822 wait complete. 2024-04-15T00:01:31.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:01:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.551+0000 7f4aeb895640 1 Processor -- start 2024-04-15T00:01:31.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.551+0000 7f4aeb895640 1 -- start start 2024-04-15T00:01:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4aeb895640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ae4151440 0x7f4ae40c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4aeb895640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae40c3200 0x7f4ae40cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4aeb895640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae40c37e0 con 0x7f4ae40c8bf0 2024-04-15T00:01:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4aeb895640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae40c4f80 con 0x7f4ae4151440 2024-04-15T00:01:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4aeb895640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae40c51d0 con 0x7f4ae40c3200 2024-04-15T00:01:31.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4ae8e30640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4ae40c8bf0 0x7f4ae40c72d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49406/0 (socket says 172.21.15.29:49406) 2024-04-15T00:01:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4ae8e30640 1 -- 172.21.15.29:0/3235994181 learned_addr learned my addr 172.21.15.29:0/3235994181 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4ae9e32640 1 --2- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae40c3200 0x7f4ae40cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.552+0000 7f4ae9631640 1 --2- 172.21.15.29:0/3235994181 >> v2:172.21.15.37:3300/0 conn(0x7f4ae4151440 0x7f4ae40c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.555+0000 7f4adbfff640 1 -- 172.21.15.29:0/3235994181 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723276754 0 0) 0x7f4ae40c37e0 con 0x7f4ae40c8bf0 2024-04-15T00:01:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.555+0000 7f4adbfff640 1 -- 172.21.15.29:0/3235994181 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ad0005730 con 0x7f4ae40c8bf0 2024-04-15T00:01:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.555+0000 7f4ae9631640 1 -- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae40c3200 msgr2=0x7f4ae40cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.555+0000 7f4ae9631640 1 --2- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae40c3200 0x7f4ae40cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.555+0000 7f4ae9631640 1 -- 172.21.15.29:0/3235994181 >> v1:172.21.15.29:6789/0 conn(0x7f4ae40c8bf0 legacy=0x7f4ae40c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.555+0000 7f4ae9631640 1 -- 172.21.15.29:0/3235994181 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae40c54b0 con 0x7f4ae4151440 2024-04-15T00:01:31.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.557+0000 7f4ae9631640 1 --2- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4151440 0x7f4ae40c2cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097a0 tx=0x7f4ae002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bcc145517660fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.562+0000 7f4adbfff640 1 -- 172.21.15.29:0/3235994181 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0035020 con 0x7f4ae4151440 2024-04-15T00:01:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.562+0000 7f4adbfff640 1 -- 172.21.15.29:0/3235994181 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae0031830 con 0x7f4ae4151440 2024-04-15T00:01:31.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.562+0000 7f4adbfff640 1 -- 172.21.15.29:0/3235994181 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0031c00 con 0x7f4ae4151440 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 -- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4151440 msgr2=0x7f4ae40c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 --2- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4151440 0x7f4ae40c2cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097a0 tx=0x7f4ae002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 -- 172.21.15.29:0/3235994181 shutdown_connections 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 --2- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae40c3200 0x7f4ae40cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 --2- 172.21.15.29:0/3235994181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4151440 0x7f4ae40c2cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 -- 172.21.15.29:0/3235994181 >> 172.21.15.29:0/3235994181 conn(0x7f4ae406f100 msgr2=0x7f4ae406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 -- 172.21.15.29:0/3235994181 shutdown_connections 2024-04-15T00:01:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.563+0000 7f4aeb895640 1 -- 172.21.15.29:0/3235994181 wait complete. 2024-04-15T00:01:31.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 Processor -- start 2024-04-15T00:01:31.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 -- start start 2024-04-15T00:01:31.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 0x7f4ae4146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae40c8bf0 0x7f4ae4144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae4151440 0x7f4ae41ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae40c7b60 con 0x7f4ae40c3200 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae40c79e0 con 0x7f4ae40c8bf0 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.565+0000 7f4aeb895640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae40cbd50 con 0x7f4ae4151440 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.566+0000 7f4ae9631640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 0x7f4ae4146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.566+0000 7f4ae9631640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 0x7f4ae4146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52476/0 (socket says 172.21.15.29:52476) 2024-04-15T00:01:31.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.566+0000 7f4ae9631640 1 -- 172.21.15.29:0/380712692 learned_addr learned my addr 172.21.15.29:0/380712692 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:31.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.566+0000 7f4ae9e32640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae4151440 0x7f4ae41ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.568+0000 7f4ae8e30640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae40c8bf0 0x7f4ae4144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.570+0000 7f4ae9631640 1 -- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae4151440 msgr2=0x7f4ae41ec3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:31.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.570+0000 7f4ae9631640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae4151440 0x7f4ae41ec3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.570+0000 7f4ae9631640 1 -- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae40c8bf0 msgr2=0x7f4ae4144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:31.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.570+0000 7f4ae9631640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae40c8bf0 0x7f4ae4144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:31.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.570+0000 7f4ae9631640 1 -- 172.21.15.29:0/380712692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae40729c0 con 0x7f4ae40c3200 2024-04-15T00:01:31.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.572+0000 7f4ae9631640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 0x7f4ae4146d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0034040 tx=0x7f4ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.575+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0040070 con 0x7f4ae40c3200 2024-04-15T00:01:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.575+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae003a910 con 0x7f4ae40c3200 2024-04-15T00:01:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.575+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0035040 con 0x7f4ae40c3200 2024-04-15T00:01:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.576+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae41e1e90 con 0x7f4ae40c3200 2024-04-15T00:01:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.576+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae4146280 con 0x7f4ae40c3200 2024-04-15T00:01:31.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.577+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae404f540 con 0x7f4ae40c3200 2024-04-15T00:01:31.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.596+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4ae0038020 con 0x7f4ae40c3200 2024-04-15T00:01:31.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.596+0000 7f4ad9ffb640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4ac806b9e0 0x7f4ac806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:31.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.596+0000 7f4ae8e30640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4ac806b9e0 0x7f4ac806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:31.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.597+0000 7f4ae8e30640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4ac806b9e0 0x7f4ac806dea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40725f0 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:31.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.599+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4ae0045e00 con 0x7f4ae40c3200 2024-04-15T00:01:31.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:31.856+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4ae007a9e0 con 0x7f4ae40c3200 2024-04-15T00:01:32.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.039+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4ae414ea40 con 0x7f4ae40c3200 2024-04-15T00:01:32.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.044+0000 7f4ad9ffb640 1 -- 172.21.15.29:0/380712692 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f4ae007ea80 con 0x7f4ae40c3200 2024-04-15T00:01:32.050 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4ac806b9e0 msgr2=0x7f4ac806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4ac806b9e0 0x7f4ac806dea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40725f0 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2024-04-15T00:01:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 msgr2=0x7f4ae4146d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 0x7f4ae4146d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0034040 tx=0x7f4ae00046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 shutdown_connections 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4ac806b9e0 0x7f4ac806dea0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4ae4151440 0x7f4ae41ec3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae40c8bf0 0x7f4ae4144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 --2- 172.21.15.29:0/380712692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ae40c3200 0x7f4ae4146d60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 >> 172.21.15.29:0/380712692 conn(0x7f4ae406f100 msgr2=0x7f4ae40c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 shutdown_connections 2024-04-15T00:01:32.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.047+0000 7f4aeb895640 1 -- 172.21.15.29:0/380712692 wait complete. 2024-04-15T00:01:32.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T00:01:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.161+0000 7f6f39436640 1 Processor -- start 2024-04-15T00:01:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.161+0000 7f6f39436640 1 -- start start 2024-04-15T00:01:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.162+0000 7f6f39436640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f340ca570 0x7f6f3415b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.162+0000 7f6f39436640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f340cdf40 0x7f6f340cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.162+0000 7f6f39436640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f340ce4a0 con 0x7f6f341547c0 2024-04-15T00:01:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.162+0000 7f6f39436640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f6f340cf390 con 0x7f6f340ca570 2024-04-15T00:01:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.162+0000 7f6f39436640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6f340ce780 con 0x7f6f340cdf40 2024-04-15T00:01:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.163+0000 7f6f337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f340cdf40 0x7f6f340cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.163+0000 7f6f327fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f340ca570 0x7f6f3415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.163+0000 7f6f32ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f341547c0 0x7f6f3415ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49416/0 (socket says 172.21.15.29:49416) 2024-04-15T00:01:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.163+0000 7f6f32ffd640 1 -- 172.21.15.29:0/3210955796 learned_addr learned my addr 172.21.15.29:0/3210955796 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:32.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.166+0000 7f6f337fe640 1 -- 172.21.15.29:0/3210955796 >> v2:172.21.15.29:3300/0 conn(0x7f6f340ca570 msgr2=0x7f6f3415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:32.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.166+0000 7f6f337fe640 1 --2- 172.21.15.29:0/3210955796 >> v2:172.21.15.29:3300/0 conn(0x7f6f340ca570 0x7f6f3415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.166+0000 7f6f337fe640 1 -- 172.21.15.29:0/3210955796 >> v1:172.21.15.29:6789/0 conn(0x7f6f341547c0 legacy=0x7f6f3415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.166+0000 7f6f337fe640 1 -- 172.21.15.29:0/3210955796 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f340cea60 con 0x7f6f340cdf40 2024-04-15T00:01:32.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.167+0000 7f6f337fe640 1 --2- 172.21.15.29:0/3210955796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340cc490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f34157f20 tx=0x7f6f2c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=561da2480e9d1fbe server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:32.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.171+0000 7f6f31ffb640 1 -- 172.21.15.29:0/3210955796 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c039070 con 0x7f6f340cdf40 2024-04-15T00:01:32.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.171+0000 7f6f31ffb640 1 -- 172.21.15.29:0/3210955796 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2c02cd00 con 0x7f6f340cdf40 2024-04-15T00:01:32.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.171+0000 7f6f31ffb640 1 -- 172.21.15.29:0/3210955796 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c034660 con 0x7f6f340cdf40 2024-04-15T00:01:32.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 -- 172.21.15.29:0/3210955796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 msgr2=0x7f6f340cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 --2- 172.21.15.29:0/3210955796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340cc490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f34157f20 tx=0x7f6f2c02bf50 comp rx=0 tx=0).stop 2024-04-15T00:01:32.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 -- 172.21.15.29:0/3210955796 shutdown_connections 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 --2- 172.21.15.29:0/3210955796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340cc490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 --2- 172.21.15.29:0/3210955796 >> v2:172.21.15.29:3300/0 conn(0x7f6f340ca570 0x7f6f3415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 -- 172.21.15.29:0/3210955796 >> 172.21.15.29:0/3210955796 conn(0x7f6f34062250 msgr2=0x7f6f340cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 -- 172.21.15.29:0/3210955796 shutdown_connections 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.172+0000 7f6f39436640 1 -- 172.21.15.29:0/3210955796 wait complete. 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.173+0000 7f6f39436640 1 Processor -- start 2024-04-15T00:01:32.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.173+0000 7f6f39436640 1 -- start start 2024-04-15T00:01:32.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.174+0000 7f6f39436640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 0x7f6f34159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.174+0000 7f6f39436640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.174+0000 7f6f39436640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6f341547c0 0x7f6f340c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.174+0000 7f6f39436640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6f340cf820 con 0x7f6f340ca570 2024-04-15T00:01:32.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.174+0000 7f6f39436640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f340cf020 con 0x7f6f340cdf40 2024-04-15T00:01:32.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.174+0000 7f6f39436640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3415bcc0 con 0x7f6f341547c0 2024-04-15T00:01:32.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.175+0000 7f6f32ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 0x7f6f34159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.175+0000 7f6f337fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6f341547c0 0x7f6f340c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.175+0000 7f6f32ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 0x7f6f34159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52492/0 (socket says 172.21.15.29:52492) 2024-04-15T00:01:32.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.175+0000 7f6f32ffd640 1 -- 172.21.15.29:0/22356548 learned_addr learned my addr 172.21.15.29:0/22356548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:32.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.175+0000 7f6f327fc640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.178+0000 7f6f32ffd640 1 -- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6f341547c0 msgr2=0x7f6f340c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.178+0000 7f6f32ffd640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6f341547c0 0x7f6f340c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.178+0000 7f6f32ffd640 1 -- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 msgr2=0x7f6f340c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.178+0000 7f6f32ffd640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.178+0000 7f6f32ffd640 1 -- 172.21.15.29:0/22356548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f34157fc0 con 0x7f6f340ca570 2024-04-15T00:01:32.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.180+0000 7f6f32ffd640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 0x7f6f34159a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c3c0 tx=0x7f6f2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:32.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.184+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24017070 con 0x7f6f340ca570 2024-04-15T00:01:32.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.184+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f24005ce0 con 0x7f6f340ca570 2024-04-15T00:01:32.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.184+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f240072f0 con 0x7f6f340ca570 2024-04-15T00:01:32.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.184+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f341f3990 con 0x7f6f340ca570 2024-04-15T00:01:32.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.184+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f341f3f50 con 0x7f6f340ca570 2024-04-15T00:01:32.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.185+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f34075840 con 0x7f6f340ca570 2024-04-15T00:01:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.449+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6f2401a070 con 0x7f6f340ca570 2024-04-15T00:01:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.449+0000 7f6f1b7fe640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6f2006b9e0 0x7f6f2006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.450+0000 7f6f327fc640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6f2006b9e0 0x7f6f2006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.450+0000 7f6f327fc640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6f2006b9e0 0x7f6f2006dea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f34153a90 tx=0x7f6f28009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:32.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.463+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6f240566c0 con 0x7f6f340ca570 2024-04-15T00:01:32.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.463+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6f34075840 con 0x7f6f340ca570 2024-04-15T00:01:32.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.658+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6f3404f540 con 0x7f6f340ca570 2024-04-15T00:01:32.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.663+0000 7f6f1b7fe640 1 -- 172.21.15.29:0/22356548 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6f24021020 con 0x7f6f340ca570 2024-04-15T00:01:32.669 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-15T00:01:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6f2006b9e0 msgr2=0x7f6f2006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6f2006b9e0 0x7f6f2006dea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f34153a90 tx=0x7f6f28009190 comp rx=0 tx=0).stop 2024-04-15T00:01:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 msgr2=0x7f6f34159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 0x7f6f34159a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c3c0 tx=0x7f6f2400c880 comp rx=0 tx=0).stop 2024-04-15T00:01:32.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 shutdown_connections 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6f2006b9e0 0x7f6f2006dea0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6f341547c0 0x7f6f340c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f340cdf40 0x7f6f340c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 --2- 172.21.15.29:0/22356548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f340ca570 0x7f6f34159a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 >> 172.21.15.29:0/22356548 conn(0x7f6f34062250 msgr2=0x7f6f3414dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 shutdown_connections 2024-04-15T00:01:32.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.665+0000 7f6f39436640 1 -- 172.21.15.29:0/22356548 wait complete. 2024-04-15T00:01:32.682 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:01:32.682 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T00:01:32.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 Processor -- start 2024-04-15T00:01:32.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 -- start start 2024-04-15T00:01:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc668143740 0x7fc6680caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc66815d8a0 0x7fc66806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc66806ccf0 con 0x7fc66815dca0 2024-04-15T00:01:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc66815a2d0 con 0x7fc668143740 2024-04-15T00:01:32.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.833+0000 7fc66e71e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc66806cf90 con 0x7fc66815d8a0 2024-04-15T00:01:32.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.834+0000 7fc667fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc668143740 0x7fc6680caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.834+0000 7fc667fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc668143740 0x7fc6680caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52506/0 (socket says 172.21.15.29:52506) 2024-04-15T00:01:32.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.834+0000 7fc667fff640 1 -- 172.21.15.29:0/3745689840 learned_addr learned my addr 172.21.15.29:0/3745689840 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:32.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.834+0000 7fc6677fe640 1 --2- 172.21.15.29:0/3745689840 >> v2:172.21.15.37:3300/0 conn(0x7fc66815d8a0 0x7fc66806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.836+0000 7fc667fff640 1 -- 172.21.15.29:0/3745689840 >> v2:172.21.15.37:3300/0 conn(0x7fc66815d8a0 msgr2=0x7fc66806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:32.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.836+0000 7fc667fff640 1 --2- 172.21.15.29:0/3745689840 >> v2:172.21.15.37:3300/0 conn(0x7fc66815d8a0 0x7fc66806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.836+0000 7fc667fff640 1 -- 172.21.15.29:0/3745689840 >> v1:172.21.15.37:6789/0 conn(0x7fc66815dca0 legacy=0x7fc668071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.836+0000 7fc667fff640 1 -- 172.21.15.29:0/3745689840 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66815a590 con 0x7fc668143740 2024-04-15T00:01:32.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.838+0000 7fc667fff640 1 --2- 172.21.15.29:0/3745689840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc668143740 0x7fc6680caee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc658009870 tx=0x7fc65802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923cf549f72626f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:32.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.842+0000 7fc666ffd640 1 -- 172.21.15.29:0/3745689840 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658035020 con 0x7fc668143740 2024-04-15T00:01:32.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.842+0000 7fc666ffd640 1 -- 172.21.15.29:0/3745689840 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc658031870 con 0x7fc668143740 2024-04-15T00:01:32.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.842+0000 7fc666ffd640 1 -- 172.21.15.29:0/3745689840 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658031c40 con 0x7fc668143740 2024-04-15T00:01:32.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 -- 172.21.15.29:0/3745689840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc668143740 msgr2=0x7fc6680caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 --2- 172.21.15.29:0/3745689840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc668143740 0x7fc6680caee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc658009870 tx=0x7fc65802b910 comp rx=0 tx=0).stop 2024-04-15T00:01:32.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 -- 172.21.15.29:0/3745689840 shutdown_connections 2024-04-15T00:01:32.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 --2- 172.21.15.29:0/3745689840 >> v2:172.21.15.37:3300/0 conn(0x7fc66815d8a0 0x7fc66806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 --2- 172.21.15.29:0/3745689840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc668143740 0x7fc6680caee0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 -- 172.21.15.29:0/3745689840 >> 172.21.15.29:0/3745689840 conn(0x7fc668070830 msgr2=0x7fc66806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:32.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 -- 172.21.15.29:0/3745689840 shutdown_connections 2024-04-15T00:01:32.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.843+0000 7fc66e71e640 1 -- 172.21.15.29:0/3745689840 wait complete. 2024-04-15T00:01:32.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.844+0000 7fc66e71e640 1 Processor -- start 2024-04-15T00:01:32.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.844+0000 7fc66e71e640 1 -- start start 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66e71e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc668143740 0x7fc6680c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66e71e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66815d8a0 0x7fc6681f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66e71e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 0x7fc668152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66e71e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc668071870 con 0x7fc6681e5980 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66e71e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc66815ab50 con 0x7fc66815d8a0 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66e71e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc6680719f0 con 0x7fc668143740 2024-04-15T00:01:32.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.845+0000 7fc66ccbb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 0x7fc668152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.846+0000 7fc66ccbb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 0x7fc668152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52510/0 (socket says 172.21.15.29:52510) 2024-04-15T00:01:32.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.846+0000 7fc66ccbb640 1 -- 172.21.15.29:0/801958812 learned_addr learned my addr 172.21.15.29:0/801958812 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:32.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.846+0000 7fc6677fe640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66815d8a0 0x7fc6681f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.846+0000 7fc667fff640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc668143740 0x7fc6680c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.849+0000 7fc66ccbb640 1 -- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc668143740 msgr2=0x7fc6680c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.849+0000 7fc66ccbb640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc668143740 0x7fc6680c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.849+0000 7fc66ccbb640 1 -- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66815d8a0 msgr2=0x7fc6681f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:32.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.849+0000 7fc66ccbb640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66815d8a0 0x7fc6681f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:32.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.849+0000 7fc66ccbb640 1 -- 172.21.15.29:0/801958812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6681f12e0 con 0x7fc6681e5980 2024-04-15T00:01:32.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.851+0000 7fc66ccbb640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 0x7fc668152610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c730 tx=0x7fc66000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.855+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660003b90 con 0x7fc6681e5980 2024-04-15T00:01:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.855+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc660003d30 con 0x7fc6681e5980 2024-04-15T00:01:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.855+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6680c7ad0 con 0x7fc6681e5980 2024-04-15T00:01:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.855+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660005310 con 0x7fc6681e5980 2024-04-15T00:01:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.855+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6681f3d60 con 0x7fc6681e5980 2024-04-15T00:01:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.856+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66804f540 con 0x7fc6681e5980 2024-04-15T00:01:32.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.875+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc6600056c0 con 0x7fc6681e5980 2024-04-15T00:01:32.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.876+0000 7fc664ff9640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc65406b9e0 0x7fc65406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:32.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.876+0000 7fc667fff640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc65406b9e0 0x7fc65406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:32.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.877+0000 7fc667fff640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc65406b9e0 0x7fc65406dea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc658036000 tx=0x7fc65803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:32.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:32.878+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc6600578a0 con 0x7fc6681e5980 2024-04-15T00:01:33.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.136+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc660059800 con 0x7fc6681e5980 2024-04-15T00:01:33.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.334+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6680c8e20 con 0x7fc6681e5980 2024-04-15T00:01:33.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.381+0000 7fc664ff9640 1 -- 172.21.15.29:0/801958812 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7fc66005d8a0 con 0x7fc6681e5980 2024-04-15T00:01:33.388 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.383+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc65406b9e0 msgr2=0x7fc65406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.383+0000 7fc66e71e640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc65406b9e0 0x7fc65406dea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc658036000 tx=0x7fc65803c040 comp rx=0 tx=0).stop 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.383+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 msgr2=0x7fc668152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.383+0000 7fc66e71e640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 0x7fc668152610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c730 tx=0x7fc66000cbf0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 shutdown_connections 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc65406b9e0 0x7fc65406dea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6681e5980 0x7fc668152610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66815d8a0 0x7fc6681f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 --2- 172.21.15.29:0/801958812 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc668143740 0x7fc6680c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 >> 172.21.15.29:0/801958812 conn(0x7fc668070830 msgr2=0x7fc6680746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:33.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 shutdown_connections 2024-04-15T00:01:33.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.384+0000 7fc66e71e640 1 -- 172.21.15.29:0/801958812 wait complete. 2024-04-15T00:01:33.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:01:09.779176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:01:11.503018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:01:16.720777+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:01:33.402 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:01:33.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.500+0000 7f3e6dd1e640 1 Processor -- start 2024-04-15T00:01:33.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.501+0000 7f3e6dd1e640 1 -- start start 2024-04-15T00:01:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.501+0000 7f3e6dd1e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e680c1b40 0x7f3e680c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.501+0000 7f3e6dd1e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e6815b590 0x7f3e6815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.501+0000 7f3e6dd1e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e68158f50 con 0x7f3e68071510 2024-04-15T00:01:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.501+0000 7f3e6dd1e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3e68072310 con 0x7f3e680c1b40 2024-04-15T00:01:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.501+0000 7f3e6dd1e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3e680c1f20 con 0x7f3e6815b590 2024-04-15T00:01:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.502+0000 7f3e677fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e680c1b40 0x7f3e680c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.502+0000 7f3e677fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e680c1b40 0x7f3e680c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52520/0 (socket says 172.21.15.29:52520) 2024-04-15T00:01:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.502+0000 7f3e677fe640 1 -- 172.21.15.29:0/2293752980 learned_addr learned my addr 172.21.15.29:0/2293752980 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.502+0000 7f3e66ffd640 1 --2- 172.21.15.29:0/2293752980 >> v2:172.21.15.37:3300/0 conn(0x7f3e6815b590 0x7f3e6815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:33.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.505+0000 7f3e677fe640 1 -- 172.21.15.29:0/2293752980 >> v2:172.21.15.37:3300/0 conn(0x7f3e6815b590 msgr2=0x7f3e6815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:33.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.505+0000 7f3e677fe640 1 --2- 172.21.15.29:0/2293752980 >> v2:172.21.15.37:3300/0 conn(0x7f3e6815b590 0x7f3e6815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.505+0000 7f3e677fe640 1 -- 172.21.15.29:0/2293752980 >> v1:172.21.15.37:6789/0 conn(0x7f3e68071510 legacy=0x7f3e680c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:33.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.505+0000 7f3e677fe640 1 -- 172.21.15.29:0/2293752980 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e68072030 con 0x7f3e680c1b40 2024-04-15T00:01:33.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.507+0000 7f3e677fe640 1 --2- 172.21.15.29:0/2293752980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e680c1b40 0x7f3e680c8d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e6806fcb0 tx=0x7f3e5802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab7d9486d58ed1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:33.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.510+0000 7f3e667fc640 1 -- 172.21.15.29:0/2293752980 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58035020 con 0x7f3e680c1b40 2024-04-15T00:01:33.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e667fc640 1 -- 172.21.15.29:0/2293752980 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e58031870 con 0x7f3e680c1b40 2024-04-15T00:01:33.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e667fc640 1 -- 172.21.15.29:0/2293752980 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58031c40 con 0x7f3e680c1b40 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/2293752980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e680c1b40 msgr2=0x7f3e680c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/2293752980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e680c1b40 0x7f3e680c8d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e6806fcb0 tx=0x7f3e5802b910 comp rx=0 tx=0).stop 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/2293752980 shutdown_connections 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/2293752980 >> v2:172.21.15.37:3300/0 conn(0x7f3e6815b590 0x7f3e6815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/2293752980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e680c1b40 0x7f3e680c8d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/2293752980 >> 172.21.15.29:0/2293752980 conn(0x7f3e6806f100 msgr2=0x7f3e6806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/2293752980 shutdown_connections 2024-04-15T00:01:33.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.511+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/2293752980 wait complete. 2024-04-15T00:01:33.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 Processor -- start 2024-04-15T00:01:33.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 -- start start 2024-04-15T00:01:33.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e68071510 0x7f3e680c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:33.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3e680c1b40 0x7f3e68157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:33.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 0x7f3e68149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:33.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3e68158750 con 0x7f3e6815b590 2024-04-15T00:01:33.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e68158470 con 0x7f3e68071510 2024-04-15T00:01:33.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.513+0000 7f3e6dd1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f3e68158a30 con 0x7f3e680c1b40 2024-04-15T00:01:33.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.514+0000 7f3e67fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 0x7f3e68149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:33.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.514+0000 7f3e66ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3e680c1b40 0x7f3e68157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:33.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.514+0000 7f3e67fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 0x7f3e68149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52528/0 (socket says 172.21.15.29:52528) 2024-04-15T00:01:33.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.514+0000 7f3e67fff640 1 -- 172.21.15.29:0/1954732168 learned_addr learned my addr 172.21.15.29:0/1954732168 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:33.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.514+0000 7f3e677fe640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e68071510 0x7f3e680c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:33.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.518+0000 7f3e67fff640 1 -- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3e680c1b40 msgr2=0x7f3e68157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:33.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.518+0000 7f3e67fff640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3e680c1b40 0x7f3e68157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.518+0000 7f3e67fff640 1 -- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e68071510 msgr2=0x7f3e680c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:33.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.518+0000 7f3e67fff640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e68071510 0x7f3e680c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:33.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.518+0000 7f3e67fff640 1 -- 172.21.15.29:0/1954732168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e68155fe0 con 0x7f3e6815b590 2024-04-15T00:01:33.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.520+0000 7f3e67fff640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 0x7f3e68149650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c780 tx=0x7f3e6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.524+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60004b60 con 0x7f3e6815b590 2024-04-15T00:01:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.524+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e60004d00 con 0x7f3e6815b590 2024-04-15T00:01:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.524+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000aa30 con 0x7f3e6815b590 2024-04-15T00:01:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.524+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e681562c0 con 0x7f3e6815b590 2024-04-15T00:01:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.524+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e68148f50 con 0x7f3e6815b590 2024-04-15T00:01:33.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.525+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6804f540 con 0x7f3e6815b590 2024-04-15T00:01:33.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.543+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3e6000abd0 con 0x7f3e6815b590 2024-04-15T00:01:33.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.544+0000 7f3e4ffff640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3e5406b9e0 0x7f3e5406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:33.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.544+0000 7f3e677fe640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3e5406b9e0 0x7f3e5406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:33.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.545+0000 7f3e677fe640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3e5406b9e0 0x7f3e5406dea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e58036000 tx=0x7f3e5803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:33.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.803+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3e6001cdf0 con 0x7f3e6815b590 2024-04-15T00:01:33.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.803+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3e60020070 con 0x7f3e6815b590 2024-04-15T00:01:33.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.987+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e68149120 con 0x7f3e6815b590 2024-04-15T00:01:33.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.993+0000 7f3e4ffff640 1 -- 172.21.15.29:0/1954732168 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3e600596e0 con 0x7f3e6815b590 2024-04-15T00:01:33.999 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T00:01:34.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3e5406b9e0 msgr2=0x7f3e5406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3e5406b9e0 0x7f3e5406dea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e58036000 tx=0x7f3e5803c040 comp rx=0 tx=0).stop 2024-04-15T00:01:34.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 msgr2=0x7f3e68149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 0x7f3e68149650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c780 tx=0x7f3e6000cc40 comp rx=0 tx=0).stop 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 shutdown_connections 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3e5406b9e0 0x7f3e5406dea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e6815b590 0x7f3e68149650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3e680c1b40 0x7f3e68157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 --2- 172.21.15.29:0/1954732168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e68071510 0x7f3e680c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 >> 172.21.15.29:0/1954732168 conn(0x7f3e6806f100 msgr2=0x7f3e6815a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 shutdown_connections 2024-04-15T00:01:34.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:33.996+0000 7f3e6dd1e640 1 -- 172.21.15.29:0/1954732168 wait complete. 2024-04-15T00:01:34.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:01:34.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.112+0000 7fed6736a640 1 Processor -- start 2024-04-15T00:01:34.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.112+0000 7fed6736a640 1 -- start start 2024-04-15T00:01:34.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.113+0000 7fed6736a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed600cd890 0x7fed600cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.113+0000 7fed6736a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed600c8d90 con 0x7fed600c9d40 2024-04-15T00:01:34.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.113+0000 7fed6736a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed600c9640 con 0x7fed6015a940 2024-04-15T00:01:34.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.113+0000 7fed6736a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fed600c9920 con 0x7fed600cd890 2024-04-15T00:01:34.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.114+0000 7fed64905640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fed600c9d40 0x7fed6015e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49428/0 (socket says 172.21.15.29:49428) 2024-04-15T00:01:34.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.114+0000 7fed64905640 1 -- 172.21.15.29:0/1787255763 learned_addr learned my addr 172.21.15.29:0/1787255763 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:34.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.114+0000 7fed65106640 1 --2- 172.21.15.29:0/1787255763 >> v2:172.21.15.37:3300/0 conn(0x7fed600cd890 0x7fed600cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.116+0000 7fed5ffff640 1 -- 172.21.15.29:0/1787255763 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133702112 0 0) 0x7fed600c8d90 con 0x7fed600c9d40 2024-04-15T00:01:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.116+0000 7fed5ffff640 1 -- 172.21.15.29:0/1787255763 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed48003520 con 0x7fed600c9d40 2024-04-15T00:01:34.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.118+0000 7fed65106640 1 -- 172.21.15.29:0/1787255763 >> v1:172.21.15.37:6789/0 conn(0x7fed6015a940 legacy=0x7fed60164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.118+0000 7fed65106640 1 -- 172.21.15.29:0/1787255763 >> v1:172.21.15.29:6789/0 conn(0x7fed600c9d40 legacy=0x7fed6015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.118+0000 7fed65106640 1 -- 172.21.15.29:0/1787255763 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed600c87d0 con 0x7fed600cd890 2024-04-15T00:01:34.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.121+0000 7fed65106640 1 --2- 172.21.15.29:0/1787255763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed600cdc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed58009d90 tx=0x7fed5802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc922179499a549 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed5ffff640 1 -- 172.21.15.29:0/1787255763 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58039070 con 0x7fed600cd890 2024-04-15T00:01:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed5ffff640 1 -- 172.21.15.29:0/1787255763 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5802cc60 con 0x7fed600cd890 2024-04-15T00:01:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed5ffff640 1 -- 172.21.15.29:0/1787255763 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58034660 con 0x7fed600cd890 2024-04-15T00:01:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 -- 172.21.15.29:0/1787255763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 msgr2=0x7fed600cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 --2- 172.21.15.29:0/1787255763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed600cdc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed58009d90 tx=0x7fed5802beb0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 -- 172.21.15.29:0/1787255763 shutdown_connections 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 --2- 172.21.15.29:0/1787255763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed600cdc70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 -- 172.21.15.29:0/1787255763 >> 172.21.15.29:0/1787255763 conn(0x7fed60061c20 msgr2=0x7fed60062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 -- 172.21.15.29:0/1787255763 shutdown_connections 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.126+0000 7fed6736a640 1 -- 172.21.15.29:0/1787255763 wait complete. 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.127+0000 7fed6736a640 1 Processor -- start 2024-04-15T00:01:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 -- start start 2024-04-15T00:01:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 0x7fed60140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed60145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fed6015a940 0x7fed60145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fed60154910 con 0x7fed600c9d40 2024-04-15T00:01:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed6015a420 con 0x7fed600cd890 2024-04-15T00:01:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.128+0000 7fed6736a640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fed601475e0 con 0x7fed6015a940 2024-04-15T00:01:34.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.129+0000 7fed65106640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 0x7fed60140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.129+0000 7fed65106640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 0x7fed60140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52540/0 (socket says 172.21.15.29:52540) 2024-04-15T00:01:34.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.129+0000 7fed65106640 1 -- 172.21.15.29:0/194329509 learned_addr learned my addr 172.21.15.29:0/194329509 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:34.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.129+0000 7fed64905640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed60145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.129+0000 7fed65907640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fed6015a940 0x7fed60145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.132+0000 7fed65106640 1 -- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fed6015a940 msgr2=0x7fed60145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.132+0000 7fed65106640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fed6015a940 0x7fed60145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.132+0000 7fed65106640 1 -- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 msgr2=0x7fed60145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.132+0000 7fed65106640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed60145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.132+0000 7fed65106640 1 -- 172.21.15.29:0/194329509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6015e5d0 con 0x7fed600c9d40 2024-04-15T00:01:34.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.135+0000 7fed65106640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 0x7fed60140430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed58009eb0 tx=0x7fed58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:34.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.138+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58044030 con 0x7fed600c9d40 2024-04-15T00:01:34.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.138+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5802ca60 con 0x7fed600c9d40 2024-04-15T00:01:34.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.138+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58039040 con 0x7fed600c9d40 2024-04-15T00:01:34.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.138+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed600cc4c0 con 0x7fed600c9d40 2024-04-15T00:01:34.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.139+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed60145160 con 0x7fed600c9d40 2024-04-15T00:01:34.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.139+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6004f540 con 0x7fed600c9d40 2024-04-15T00:01:34.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.408+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fed58047070 con 0x7fed600c9d40 2024-04-15T00:01:34.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.408+0000 7fed5dffb640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fed4c06b9e0 0x7fed4c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.409+0000 7fed64905640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fed4c06b9e0 0x7fed4c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.409+0000 7fed64905640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fed4c06b9e0 0x7fed4c06dea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed601e5640 tx=0x7fed54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:34.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.421+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fed5802cc10 con 0x7fed600c9d40 2024-04-15T00:01:34.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.421+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fed5804e070 con 0x7fed600c9d40 2024-04-15T00:01:34.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.607+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed60154130 con 0x7fed600c9d40 2024-04-15T00:01:34.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.612+0000 7fed5dffb640 1 -- 172.21.15.29:0/194329509 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fed5807bb30 con 0x7fed600c9d40 2024-04-15T00:01:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fed4c06b9e0 msgr2=0x7fed4c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fed4c06b9e0 0x7fed4c06dea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed601e5640 tx=0x7fed54009040 comp rx=0 tx=0).stop 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 msgr2=0x7fed60140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 0x7fed60140430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed58009eb0 tx=0x7fed58004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 shutdown_connections 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fed4c06b9e0 0x7fed4c06dea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fed6015a940 0x7fed60145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed600cd890 0x7fed60145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 --2- 172.21.15.29:0/194329509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fed600c9d40 0x7fed60140430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 >> 172.21.15.29:0/194329509 conn(0x7fed60061c20 msgr2=0x7fed60152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 shutdown_connections 2024-04-15T00:01:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.614+0000 7fed6736a640 1 -- 172.21.15.29:0/194329509 wait complete. 2024-04-15T00:01:34.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:01:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.729+0000 7f853335d640 1 Processor -- start 2024-04-15T00:01:34.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.729+0000 7f853335d640 1 -- start start 2024-04-15T00:01:34.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.730+0000 7f853335d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.730+0000 7f853335d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f852c0c2c50 0x7f852c070410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.730+0000 7f853335d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f852c15a190 con 0x7f852c0c82f0 2024-04-15T00:01:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.730+0000 7f853335d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f852c15a4e0 con 0x7f852c0c2c50 2024-04-15T00:01:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.730+0000 7f853335d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f852c06d090 con 0x7f852c154580 2024-04-15T00:01:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.731+0000 7f85310f9640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.731+0000 7f85318fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f852c0c2c50 0x7f852c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.731+0000 7f85308f8640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f852c0c82f0 0x7f852c15a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49432/0 (socket says 172.21.15.29:49432) 2024-04-15T00:01:34.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.731+0000 7f85308f8640 1 -- 172.21.15.29:0/3506319991 learned_addr learned my addr 172.21.15.29:0/3506319991 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:34.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.733+0000 7f85310f9640 1 -- 172.21.15.29:0/3506319991 >> v2:172.21.15.29:3300/0 conn(0x7f852c0c2c50 msgr2=0x7f852c070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.733+0000 7f85310f9640 1 --2- 172.21.15.29:0/3506319991 >> v2:172.21.15.29:3300/0 conn(0x7f852c0c2c50 0x7f852c070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.733+0000 7f85310f9640 1 -- 172.21.15.29:0/3506319991 >> v1:172.21.15.29:6789/0 conn(0x7f852c0c82f0 legacy=0x7f852c15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.733+0000 7f85310f9640 1 -- 172.21.15.29:0/3506319991 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c0c87e0 con 0x7f852c154580 2024-04-15T00:01:34.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.736+0000 7f85310f9640 1 --2- 172.21.15.29:0/3506319991 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c0c9de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1735d68fc25c0f16 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f852bfff640 1 -- 172.21.15.29:0/3506319991 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524035020 con 0x7f852c154580 2024-04-15T00:01:34.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f852bfff640 1 -- 172.21.15.29:0/3506319991 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8524031830 con 0x7f852c154580 2024-04-15T00:01:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f852bfff640 1 -- 172.21.15.29:0/3506319991 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524031c00 con 0x7f852c154580 2024-04-15T00:01:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f853335d640 1 -- 172.21.15.29:0/3506319991 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 msgr2=0x7f852c0c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f853335d640 1 --2- 172.21.15.29:0/3506319991 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c0c9de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f853335d640 1 -- 172.21.15.29:0/3506319991 shutdown_connections 2024-04-15T00:01:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f853335d640 1 --2- 172.21.15.29:0/3506319991 >> v2:172.21.15.29:3300/0 conn(0x7f852c0c2c50 0x7f852c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f853335d640 1 --2- 172.21.15.29:0/3506319991 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c0c9de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.740+0000 7f853335d640 1 -- 172.21.15.29:0/3506319991 >> 172.21.15.29:0/3506319991 conn(0x7f852c0ca3f0 msgr2=0x7f852c0ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:34.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.741+0000 7f853335d640 1 -- 172.21.15.29:0/3506319991 shutdown_connections 2024-04-15T00:01:34.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.741+0000 7f853335d640 1 -- 172.21.15.29:0/3506319991 wait complete. 2024-04-15T00:01:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 Processor -- start 2024-04-15T00:01:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 -- start start 2024-04-15T00:01:34.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 0x7f852c1f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f852c0c82f0 0x7f852c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f852c0c9080 con 0x7f852c0c2c50 2024-04-15T00:01:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f852c0c8da0 con 0x7f852c0c82f0 2024-04-15T00:01:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.742+0000 7f853335d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f852c15b080 con 0x7f852c154580 2024-04-15T00:01:34.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.743+0000 7f85310f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 0x7f852c1f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.743+0000 7f85318fa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.743+0000 7f85308f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f852c0c82f0 0x7f852c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.743+0000 7f85310f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 0x7f852c1f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52562/0 (socket says 172.21.15.29:52562) 2024-04-15T00:01:34.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.743+0000 7f85310f9640 1 -- 172.21.15.29:0/2163010739 learned_addr learned my addr 172.21.15.29:0/2163010739 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:34.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.747+0000 7f85310f9640 1 -- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 msgr2=0x7f852c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.747+0000 7f85310f9640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.747+0000 7f85310f9640 1 -- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f852c0c82f0 msgr2=0x7f852c1532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:34.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.747+0000 7f85310f9640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f852c0c82f0 0x7f852c1532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:34.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.747+0000 7f85310f9640 1 -- 172.21.15.29:0/2163010739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c151f50 con 0x7f852c0c2c50 2024-04-15T00:01:34.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.749+0000 7f85310f9640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 0x7f852c1f00e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8524000c00 tx=0x7f85240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.753+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524040070 con 0x7f852c0c2c50 2024-04-15T00:01:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.753+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852403a850 con 0x7f852c0c2c50 2024-04-15T00:01:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.753+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524035040 con 0x7f852c0c2c50 2024-04-15T00:01:34.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.753+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c152230 con 0x7f852c0c2c50 2024-04-15T00:01:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.753+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c1527f0 con 0x7f852c0c2c50 2024-04-15T00:01:34.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.754+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852c04f540 con 0x7f852c0c2c50 2024-04-15T00:01:34.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.774+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f852404b060 con 0x7f852c0c2c50 2024-04-15T00:01:34.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.774+0000 7f8529ffb640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f851806b990 0x7f851806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:34.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.775+0000 7f85308f8640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f851806b990 0x7f851806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:34.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:34.775+0000 7f85308f8640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f851806b990 0x7f851806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f852c0c3ee0 tx=0x7f8520009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:35.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.033+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8524045df0 con 0x7f852c0c2c50 2024-04-15T00:01:35.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.033+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8524031800 con 0x7f852c0c2c50 2024-04-15T00:01:35.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.233+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f852c0c9440 con 0x7f852c0c2c50 2024-04-15T00:01:35.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.243+0000 7f8529ffb640 1 -- 172.21.15.29:0/2163010739 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f852407aab0 con 0x7f852c0c2c50 2024-04-15T00:01:35.249 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-15T00:01:35.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f851806b990 msgr2=0x7f851806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f851806b990 0x7f851806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f852c0c3ee0 tx=0x7f8520009040 comp rx=0 tx=0).stop 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 msgr2=0x7f852c1f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 0x7f852c1f00e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8524000c00 tx=0x7f85240046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 shutdown_connections 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f851806b990 0x7f851806de50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f852c154580 0x7f852c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f852c0c82f0 0x7f852c1532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 --2- 172.21.15.29:0/2163010739 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f852c0c2c50 0x7f852c1f00e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 >> 172.21.15.29:0/2163010739 conn(0x7f852c0ca3f0 msgr2=0x7f852c0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 shutdown_connections 2024-04-15T00:01:35.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.245+0000 7f853335d640 1 -- 172.21.15.29:0/2163010739 wait complete. 2024-04-15T00:01:35.262 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:01:35.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.361+0000 7f262e2c8640 1 Processor -- start 2024-04-15T00:01:35.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.361+0000 7f262e2c8640 1 -- start start 2024-04-15T00:01:35.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.362+0000 7f262e2c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2628154620 0x7f26280cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.362+0000 7f262e2c8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280ce600 con 0x7f262815afd0 2024-04-15T00:01:35.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.362+0000 7f262e2c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280ce8e0 con 0x7f2628154a00 2024-04-15T00:01:35.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.362+0000 7f262e2c8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f262815ab40 con 0x7f2628154620 2024-04-15T00:01:35.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.363+0000 7f262c865640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f262815afd0 0x7f26280ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:49436/0 (socket says 172.21.15.29:49436) 2024-04-15T00:01:35.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.363+0000 7f262c865640 1 -- 172.21.15.29:0/3459994209 learned_addr learned my addr 172.21.15.29:0/3459994209 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:35.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.363+0000 7f2627fff640 1 --2- 172.21.15.29:0/3459994209 >> v2:172.21.15.37:3300/0 conn(0x7f2628154620 0x7f26280cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.365+0000 7f2626ffd640 1 -- 172.21.15.29:0/3459994209 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390067328 0 0) 0x7f26280ce600 con 0x7f262815afd0 2024-04-15T00:01:35.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.365+0000 7f2626ffd640 1 -- 172.21.15.29:0/3459994209 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614003520 con 0x7f262815afd0 2024-04-15T00:01:35.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.367+0000 7f2627fff640 1 -- 172.21.15.29:0/3459994209 >> v1:172.21.15.37:6789/0 conn(0x7f2628154a00 legacy=0x7f26280cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.367+0000 7f2627fff640 1 -- 172.21.15.29:0/3459994209 >> v1:172.21.15.29:6789/0 conn(0x7f262815afd0 legacy=0x7f26280ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.367+0000 7f2627fff640 1 -- 172.21.15.29:0/3459994209 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26280cebc0 con 0x7f2628154620 2024-04-15T00:01:35.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.369+0000 7f2627fff640 1 --2- 172.21.15.29:0/3459994209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2628154620 0x7f26280cdfe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f262815acc0 tx=0x7f261002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb25ffd12b0e40e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:35.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f2626ffd640 1 -- 172.21.15.29:0/3459994209 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610034070 con 0x7f2628154620 2024-04-15T00:01:35.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f2626ffd640 1 -- 172.21.15.29:0/3459994209 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610030610 con 0x7f2628154620 2024-04-15T00:01:35.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f2626ffd640 1 -- 172.21.15.29:0/3459994209 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26100309e0 con 0x7f2628154620 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 -- 172.21.15.29:0/3459994209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2628154620 msgr2=0x7f26280cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 --2- 172.21.15.29:0/3459994209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2628154620 0x7f26280cdfe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f262815acc0 tx=0x7f261002b960 comp rx=0 tx=0).stop 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 -- 172.21.15.29:0/3459994209 shutdown_connections 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 --2- 172.21.15.29:0/3459994209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2628154620 0x7f26280cdfe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 -- 172.21.15.29:0/3459994209 >> 172.21.15.29:0/3459994209 conn(0x7f26280cfb10 msgr2=0x7f26280cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 -- 172.21.15.29:0/3459994209 shutdown_connections 2024-04-15T00:01:35.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.376+0000 7f262e2c8640 1 -- 172.21.15.29:0/3459994209 wait complete. 2024-04-15T00:01:35.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 Processor -- start 2024-04-15T00:01:35.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 -- start start 2024-04-15T00:01:35.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 0x7f26281f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262815afd0 0x7f2628155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2628156320 0x7f2628157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f26280cf610 con 0x7f2628154620 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f262815a480 con 0x7f262815afd0 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.378+0000 7f262e2c8640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f26280cf790 con 0x7f2628156320 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.379+0000 7f2627fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 0x7f26281f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.379+0000 7f2627fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 0x7f26281f07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52566/0 (socket says 172.21.15.29:52566) 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.379+0000 7f2627fff640 1 -- 172.21.15.29:0/1707586397 learned_addr learned my addr 172.21.15.29:0/1707586397 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.379+0000 7f26277fe640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262815afd0 0x7f2628155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.379+0000 7f262c865640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2628156320 0x7f2628157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.383+0000 7f2627fff640 1 -- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2628156320 msgr2=0x7f2628157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.383+0000 7f2627fff640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2628156320 0x7f2628157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.383+0000 7f2627fff640 1 -- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262815afd0 msgr2=0x7f2628155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.383+0000 7f2627fff640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262815afd0 0x7f2628155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.383+0000 7f2627fff640 1 -- 172.21.15.29:0/1707586397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26281567b0 con 0x7f2628154620 2024-04-15T00:01:35.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.385+0000 7f2627fff640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 0x7f26281f07c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2610000c00 tx=0x7f26100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.387+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610034040 con 0x7f2628154620 2024-04-15T00:01:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.387+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2628155900 con 0x7f2628154620 2024-04-15T00:01:35.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.387+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26280c2ed0 con 0x7f2628154620 2024-04-15T00:01:35.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.388+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262804f540 con 0x7f2628154620 2024-04-15T00:01:35.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.656+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610030410 con 0x7f2628154620 2024-04-15T00:01:35.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.656+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610039a10 con 0x7f2628154620 2024-04-15T00:01:35.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.657+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2610037070 con 0x7f2628154620 2024-04-15T00:01:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.657+0000 7f2624ff9640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f260806b990 0x7f260806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.657+0000 7f26277fe640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f260806b990 0x7f260806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.658+0000 7f26277fe640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f260806b990 0x7f260806de50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2618001780 tx=0x7f2618009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:35.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.670+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f26100797e0 con 0x7f2628154620 2024-04-15T00:01:35.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.670+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f261007b740 con 0x7f2628154620 2024-04-15T00:01:35.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.856+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f26280c9e20 con 0x7f2628154620 2024-04-15T00:01:35.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.861+0000 7f2624ff9640 1 -- 172.21.15.29:0/1707586397 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f261007f7e0 con 0x7f2628154620 2024-04-15T00:01:35.867 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:35.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f260806b990 msgr2=0x7f260806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f260806b990 0x7f260806de50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2618001780 tx=0x7f2618009040 comp rx=0 tx=0).stop 2024-04-15T00:01:35.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 msgr2=0x7f26281f07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 0x7f26281f07c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2610000c00 tx=0x7f26100046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 shutdown_connections 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f260806b990 0x7f260806de50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2628156320 0x7f2628157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f262815afd0 0x7f2628155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 --2- 172.21.15.29:0/1707586397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2628154620 0x7f26281f07c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 >> 172.21.15.29:0/1707586397 conn(0x7f26280cfb10 msgr2=0x7f26280ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 shutdown_connections 2024-04-15T00:01:35.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.863+0000 7f262e2c8640 1 -- 172.21.15.29:0/1707586397 wait complete. 2024-04-15T00:01:35.880 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T00:01:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.978+0000 7f0acbff0640 1 Processor -- start 2024-04-15T00:01:35.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.978+0000 7f0acbff0640 1 -- start start 2024-04-15T00:01:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0acbff0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ac4150db0 0x7f0ac4156850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0acbff0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ac40c7ee0 0x7f0ac40c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0acbff0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac40c4d60 con 0x7f0ac4073240 2024-04-15T00:01:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0acbff0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac4156d90 con 0x7f0ac40c7ee0 2024-04-15T00:01:35.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0acbff0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac40c5040 con 0x7f0ac4150db0 2024-04-15T00:01:35.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0ac958b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ac40c7ee0 0x7f0ac40c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.979+0000 7f0ac9d8c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ac4150db0 0x7f0ac4156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.980+0000 7f0ac958b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ac40c7ee0 0x7f0ac40c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52576/0 (socket says 172.21.15.29:52576) 2024-04-15T00:01:35.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.980+0000 7f0ac958b640 1 -- 172.21.15.29:0/2553390219 learned_addr learned my addr 172.21.15.29:0/2553390219 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.982+0000 7f0ac958b640 1 -- 172.21.15.29:0/2553390219 >> v2:172.21.15.37:3300/0 conn(0x7f0ac4150db0 msgr2=0x7f0ac4156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.982+0000 7f0ac958b640 1 --2- 172.21.15.29:0/2553390219 >> v2:172.21.15.37:3300/0 conn(0x7f0ac4150db0 0x7f0ac4156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.982+0000 7f0ac958b640 1 -- 172.21.15.29:0/2553390219 >> v1:172.21.15.37:6789/0 conn(0x7f0ac4073240 legacy=0x7f0ac40c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:35.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.982+0000 7f0ac958b640 1 -- 172.21.15.29:0/2553390219 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac40c5320 con 0x7f0ac40c7ee0 2024-04-15T00:01:35.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.984+0000 7f0ac958b640 1 --2- 172.21.15.29:0/2553390219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac40c2dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4070120 tx=0x7f0ab402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbcf255dea3715c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.988+0000 7f0ac8d8a640 1 -- 172.21.15.29:0/2553390219 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4034070 con 0x7f0ac40c7ee0 2024-04-15T00:01:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.988+0000 7f0ac8d8a640 1 -- 172.21.15.29:0/2553390219 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab4030860 con 0x7f0ac40c7ee0 2024-04-15T00:01:35.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.988+0000 7f0ac8d8a640 1 -- 172.21.15.29:0/2553390219 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4030c30 con 0x7f0ac40c7ee0 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 -- 172.21.15.29:0/2553390219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 msgr2=0x7f0ac40c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 --2- 172.21.15.29:0/2553390219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac40c2dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4070120 tx=0x7f0ab402b9a0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 -- 172.21.15.29:0/2553390219 shutdown_connections 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 --2- 172.21.15.29:0/2553390219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac40c2dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 --2- 172.21.15.29:0/2553390219 >> v2:172.21.15.37:3300/0 conn(0x7f0ac4150db0 0x7f0ac4156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 -- 172.21.15.29:0/2553390219 >> 172.21.15.29:0/2553390219 conn(0x7f0ac406f140 msgr2=0x7f0ac406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 -- 172.21.15.29:0/2553390219 shutdown_connections 2024-04-15T00:01:35.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.989+0000 7f0acbff0640 1 -- 172.21.15.29:0/2553390219 wait complete. 2024-04-15T00:01:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.990+0000 7f0acbff0640 1 Processor -- start 2024-04-15T00:01:35.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 -- start start 2024-04-15T00:01:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4073240 0x7f0ac41f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac4149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0ac4150db0 0x7f0ac4156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac40c3300 con 0x7f0ac40c7ee0 2024-04-15T00:01:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac4072d20 con 0x7f0ac4073240 2024-04-15T00:01:35.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.991+0000 7f0acbff0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac4140370 con 0x7f0ac4150db0 2024-04-15T00:01:35.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.992+0000 7f0ac958b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac4149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.992+0000 7f0ac9d8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4073240 0x7f0ac41f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:35.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.992+0000 7f0ac958b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac4149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52590/0 (socket says 172.21.15.29:52590) 2024-04-15T00:01:35.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.992+0000 7f0ac958b640 1 -- 172.21.15.29:0/3616816419 learned_addr learned my addr 172.21.15.29:0/3616816419 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:35.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.992+0000 7f0aca58d640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0ac4150db0 0x7f0ac4156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.995+0000 7f0ac958b640 1 -- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0ac4150db0 msgr2=0x7f0ac4156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.995+0000 7f0ac958b640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0ac4150db0 0x7f0ac4156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.995+0000 7f0ac958b640 1 -- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4073240 msgr2=0x7f0ac41f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.995+0000 7f0ac958b640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4073240 0x7f0ac41f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.995+0000 7f0ac958b640 1 -- 172.21.15.29:0/3616816419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac4164740 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:35.998+0000 7f0ac958b640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac4149630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ab402b9e0 tx=0x7f0ab4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.001+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4048070 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.001+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab4030660 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.001+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac4164460 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.001+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4034040 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.002+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac4163e70 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.003+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac404f540 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.022+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0ab404b070 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.023+0000 7f0aba7fc640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0aa806b9e0 0x7f0aa806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.023+0000 7f0ac9d8c640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0aa806b9e0 0x7f0aa806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.024+0000 7f0ac9d8c640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0aa806b9e0 0x7f0aa806dea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009aa0 tx=0x7f0ac0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:36.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.281+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0ab4030810 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.281+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0ab4052020 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.474+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ac40c7cc0 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.478+0000 7f0aba7fc640 1 -- 172.21.15.29:0/3616816419 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f0ab407b5c0 con 0x7f0ac40c7ee0 2024-04-15T00:01:36.484 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0aa806b9e0 msgr2=0x7f0aa806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0aa806b9e0 0x7f0aa806dea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009aa0 tx=0x7f0ac0009190 comp rx=0 tx=0).stop 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 msgr2=0x7f0ac4149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac4149630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ab402b9e0 tx=0x7f0ab4004730 comp rx=0 tx=0).stop 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 shutdown_connections 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0aa806b9e0 0x7f0aa806dea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0ac4150db0 0x7f0ac4156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ac40c7ee0 0x7f0ac4149630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 --2- 172.21.15.29:0/3616816419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4073240 0x7f0ac41f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 >> 172.21.15.29:0/3616816419 conn(0x7f0ac406f140 msgr2=0x7f0ac41406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 shutdown_connections 2024-04-15T00:01:36.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.480+0000 7f0acbff0640 1 -- 172.21.15.29:0/3616816419 wait complete. 2024-04-15T00:01:36.497 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-04-15T00:01:36.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:36.497 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-15T00:01:36.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[42628]: fuse finished with error 0 and tester_r 0 2024-04-15T00:01:36.524 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T00:01:36.593 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T00:01:36.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:01:36.593 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-15T00:01:36.615 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.751+0000 7fd38242d640 1 Processor -- start 2024-04-15T00:01:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.751+0000 7fd38242d640 1 -- start start 2024-04-15T00:01:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.752+0000 7fd38242d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0cdc80 0x7fd37c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.752+0000 7fd38242d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c15d9a0 con 0x7fd37c0ce060 2024-04-15T00:01:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.752+0000 7fd38242d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c15dc80 con 0x7fd37c0c2ec0 2024-04-15T00:01:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.752+0000 7fd38242d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c15e5b0 con 0x7fd37c0cdc80 2024-04-15T00:01:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.752+0000 7fd37b7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd37c0ce060 0x7fd37c070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54620/0 (socket says 172.21.15.29:54620) 2024-04-15T00:01:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.752+0000 7fd37b7fe640 1 -- 172.21.15.29:0/1648397775 learned_addr learned my addr 172.21.15.29:0/1648397775 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.755+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364213836 0 0) 0x7fd37c15d9a0 con 0x7fd37c0ce060 2024-04-15T00:01:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.755+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd364003520 con 0x7fd37c0ce060 2024-04-15T00:01:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.756+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359839291 0 0) 0x7fd37c15dc80 con 0x7fd37c0c2ec0 2024-04-15T00:01:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.756+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd37c15d9a0 con 0x7fd37c0c2ec0 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.758+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3703384225 0 0) 0x7fd364003520 con 0x7fd37c0ce060 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.758+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0cdc80 msgr2=0x7fd37c15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.758+0000 7fd37affd640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0cdc80 0x7fd37c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.758+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 >> v1:172.21.15.37:6789/0 conn(0x7fd37c0c2ec0 legacy=0x7fd37c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.758+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c15df60 con 0x7fd37c0ce060 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.758+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1744880889 0 0) 0x7fd36c001670 con 0x7fd37c0ce060 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 >> v1:172.21.15.29:6789/0 conn(0x7fd37c0ce060 legacy=0x7fd37c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd364003b70 0x7fd364003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0cdc80 0x7fd36400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd3640054f0 con 0x7fd364003b70 2024-04-15T00:01:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400bf00 con 0x7fd364004800 2024-04-15T00:01:36.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.759+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd36400c080 con 0x7fd37c0cdc80 2024-04-15T00:01:36.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.760+0000 7fd37bfff640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd364003b70 0x7fd364003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.762+0000 7fd37b7fe640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.764+0000 7fd37bfff640 1 -- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0cdc80 msgr2=0x7fd36400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:36.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.764+0000 7fd37bfff640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0cdc80 0x7fd36400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.764+0000 7fd37bfff640 1 -- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd364004800 msgr2=0x7fd364004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:36.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.764+0000 7fd37bfff640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd364004800 0x7fd364004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.764+0000 7fd37bfff640 1 -- 172.21.15.29:0/1648397775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd364003520 con 0x7fd364003b70 2024-04-15T00:01:36.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.766+0000 7fd37bfff640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd364003b70 0x7fd364003f70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd370009860 tx=0x7fd364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f165360591ea37d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:36.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.770+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370037070 con 0x7fd364003b70 2024-04-15T00:01:36.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.770+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370032620 con 0x7fd364003b70 2024-04-15T00:01:36.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.770+0000 7fd37affd640 1 -- 172.21.15.29:0/1648397775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370009460 con 0x7fd364003b70 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd38242d640 1 -- 172.21.15.29:0/1648397775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd364003b70 msgr2=0x7fd364003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd38242d640 1 --2- 172.21.15.29:0/1648397775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd364003b70 0x7fd364003f70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd370009860 tx=0x7fd364005830 comp rx=0 tx=0).stop 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd3809ca640 1 -- 172.21.15.29:0/1648397775 reap_dead start 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd38242d640 1 -- 172.21.15.29:0/1648397775 shutdown_connections 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd38242d640 1 -- 172.21.15.29:0/1648397775 >> 172.21.15.29:0/1648397775 conn(0x7fd37c061e00 msgr2=0x7fd37c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd38242d640 1 -- 172.21.15.29:0/1648397775 shutdown_connections 2024-04-15T00:01:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.771+0000 7fd38242d640 1 -- 172.21.15.29:0/1648397775 wait complete. 2024-04-15T00:01:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.772+0000 7fd38242d640 1 Processor -- start 2024-04-15T00:01:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.772+0000 7fd38242d640 1 -- start start 2024-04-15T00:01:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.773+0000 7fd38242d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd37c15a220 0x7fd37c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.773+0000 7fd38242d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.773+0000 7fd38242d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd37c0c9300 0x7fd37c1f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.773+0000 7fd38242d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c0ce4a0 con 0x7fd37c15a220 2024-04-15T00:01:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.773+0000 7fd38242d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c15d750 con 0x7fd37c0c9300 2024-04-15T00:01:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.773+0000 7fd38242d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c070b80 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.774+0000 7fd37b7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.774+0000 7fd3809ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd37c0c9300 0x7fd37c1f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.774+0000 7fd3809ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd37c0c9300 0x7fd37c1f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:58514/0 (socket says 172.21.15.29:58514) 2024-04-15T00:01:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.774+0000 7fd3809ca640 1 -- 172.21.15.29:0/1326360907 learned_addr learned my addr 172.21.15.29:0/1326360907 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.778+0000 7fd37b7fe640 1 -- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd37c0c9300 msgr2=0x7fd37c1f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.778+0000 7fd37b7fe640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd37c0c9300 0x7fd37c1f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.778+0000 7fd37b7fe640 1 -- 172.21.15.29:0/1326360907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd37c15a220 msgr2=0x7fd37c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.778+0000 7fd37b7fe640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd37c15a220 0x7fd37c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.778+0000 7fd37b7fe640 1 -- 172.21.15.29:0/1326360907 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c15af00 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.781+0000 7fd37b7fe640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c15c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd36c004840 tx=0x7fd36c0074f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.785+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00f6d0 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.785+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c018070 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.785+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00fab0 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.785+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c15b570 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.785+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c0ca6e0 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.786+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37c0ca230 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.807+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd36c00fc50 con 0x7fd37c0c8eb0 2024-04-15T00:01:36.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.807+0000 7fd378ff9640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd36806b9e0 0x7fd36806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:36.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.808+0000 7fd37bfff640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd36806b9e0 0x7fd36806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:36.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:36.808+0000 7fd37bfff640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd36806b9e0 0x7fd36806dea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd370034000 tx=0x7fd37002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:37.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.070+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd36c057880 con 0x7fd37c0c8eb0 2024-04-15T00:01:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.081+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd36c059ee0 con 0x7fd37c0c8eb0 2024-04-15T00:01:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.269+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd37c04f540 con 0x7fd37c0c8eb0 2024-04-15T00:01:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.415+0000 7fd378ff9640 1 -- 172.21.15.29:0/1326360907 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7fd36c0597e0 con 0x7fd37c0c8eb0 2024-04-15T00:01:37.422 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:37.422 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:37.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd36806b9e0 msgr2=0x7fd36806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd36806b9e0 0x7fd36806dea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd370034000 tx=0x7fd37002f000 comp rx=0 tx=0).stop 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0c8eb0 msgr2=0x7fd37c15c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c15c2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd36c004840 tx=0x7fd36c0074f0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 shutdown_connections 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd36806b9e0 0x7fd36806dea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd37c0c9300 0x7fd37c1f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c15c2c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 --2- 172.21.15.29:0/1326360907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd37c15a220 0x7fd37c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 >> 172.21.15.29:0/1326360907 conn(0x7fd37c061e00 msgr2=0x7fd37c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 shutdown_connections 2024-04-15T00:01:37.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.417+0000 7fd38242d640 1 -- 172.21.15.29:0/1326360907 wait complete. 2024-04-15T00:01:37.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.531+0000 7fe0420a6640 1 Processor -- start 2024-04-15T00:01:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.531+0000 7fe0420a6640 1 -- start start 2024-04-15T00:01:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.532+0000 7fe0420a6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe03c15da50 0x7fe03c0cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.532+0000 7fe0420a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c06cb60 con 0x7fe03c06c670 2024-04-15T00:01:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.532+0000 7fe0420a6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c0cae60 con 0x7fe03c0cd950 2024-04-15T00:01:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.532+0000 7fe0420a6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c0cc160 con 0x7fe03c15da50 2024-04-15T00:01:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.533+0000 7fe03b7fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe03c15da50 0x7fe03c0cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.533+0000 7fe03bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe03c0cd950 0x7fe03c164d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:43222/0 (socket says 172.21.15.29:43222) 2024-04-15T00:01:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.533+0000 7fe03bfff640 1 -- 172.21.15.29:0/188572764 learned_addr learned my addr 172.21.15.29:0/188572764 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:37.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.535+0000 7fe03a7fc640 1 -- 172.21.15.29:0/188572764 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 317343639 0 0) 0x7fe03c0cae60 con 0x7fe03c0cd950 2024-04-15T00:01:37.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.535+0000 7fe03a7fc640 1 -- 172.21.15.29:0/188572764 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe024003520 con 0x7fe03c0cd950 2024-04-15T00:01:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.536+0000 7fe03b7fe640 1 -- 172.21.15.29:0/188572764 >> v1:172.21.15.37:6789/0 conn(0x7fe03c0cd950 legacy=0x7fe03c164d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.536+0000 7fe03b7fe640 1 -- 172.21.15.29:0/188572764 >> v1:172.21.15.29:6789/0 conn(0x7fe03c06c670 legacy=0x7fe03c15de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.536+0000 7fe03b7fe640 1 -- 172.21.15.29:0/188572764 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c0cb140 con 0x7fe03c15da50 2024-04-15T00:01:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.540+0000 7fe03b7fe640 1 --2- 172.21.15.29:0/188572764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c15da50 0x7fe03c0cbc20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be83770f57f02997 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.544+0000 7fe03a7fc640 1 -- 172.21.15.29:0/188572764 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0315a0 con 0x7fe03c15da50 2024-04-15T00:01:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.544+0000 7fe03a7fc640 1 -- 172.21.15.29:0/188572764 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c037070 con 0x7fe03c15da50 2024-04-15T00:01:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.544+0000 7fe03a7fc640 1 -- 172.21.15.29:0/188572764 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c031960 con 0x7fe03c15da50 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 -- 172.21.15.29:0/188572764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c15da50 msgr2=0x7fe03c0cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 --2- 172.21.15.29:0/188572764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c15da50 0x7fe03c0cbc20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02b840 comp rx=0 tx=0).stop 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 -- 172.21.15.29:0/188572764 shutdown_connections 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 --2- 172.21.15.29:0/188572764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c15da50 0x7fe03c0cbc20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 -- 172.21.15.29:0/188572764 >> 172.21.15.29:0/188572764 conn(0x7fe03c0cfb70 msgr2=0x7fe03c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 -- 172.21.15.29:0/188572764 shutdown_connections 2024-04-15T00:01:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.545+0000 7fe0420a6640 1 -- 172.21.15.29:0/188572764 wait complete. 2024-04-15T00:01:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.546+0000 7fe0420a6640 1 Processor -- start 2024-04-15T00:01:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.546+0000 7fe0420a6640 1 -- start start 2024-04-15T00:01:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe0420a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c06c670 0x7fe03c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe0420a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 0x7fe03c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe0420a6640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe03c15da50 0x7fe03c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe0420a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0cb700 con 0x7fe03c0cd950 2024-04-15T00:01:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe0420a6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0cac10 con 0x7fe03c06c670 2024-04-15T00:01:37.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe0420a6640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c0c96e0 con 0x7fe03c15da50 2024-04-15T00:01:37.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.547+0000 7fe03affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 0x7fe03c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:37.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.548+0000 7fe03bfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe03c15da50 0x7fe03c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:37.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.548+0000 7fe03b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c06c670 0x7fe03c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:37.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.548+0000 7fe03affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 0x7fe03c14d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46966/0 (socket says 172.21.15.29:46966) 2024-04-15T00:01:37.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.548+0000 7fe03affd640 1 -- 172.21.15.29:0/1263187081 learned_addr learned my addr 172.21.15.29:0/1263187081 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.551+0000 7fe03affd640 1 -- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe03c15da50 msgr2=0x7fe03c14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.551+0000 7fe03affd640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe03c15da50 0x7fe03c14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.551+0000 7fe03affd640 1 -- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c06c670 msgr2=0x7fe03c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.551+0000 7fe03affd640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c06c670 0x7fe03c15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.551+0000 7fe03affd640 1 -- 172.21.15.29:0/1263187081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c15a830 con 0x7fe03c0cd950 2024-04-15T00:01:37.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.553+0000 7fe03affd640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 0x7fe03c14d460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c3c0 tx=0x7fe03000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.557+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0300052d0 con 0x7fe03c0cd950 2024-04-15T00:01:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.557+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe030005490 con 0x7fe03c0cd950 2024-04-15T00:01:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.557+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c15aad0 con 0x7fe03c0cd950 2024-04-15T00:01:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.557+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030007260 con 0x7fe03c0cd950 2024-04-15T00:01:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.557+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c14cf40 con 0x7fe03c0cd950 2024-04-15T00:01:37.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.558+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c0c7b20 con 0x7fe03c0cd950 2024-04-15T00:01:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.824+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe030007400 con 0x7fe03c0cd950 2024-04-15T00:01:37.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.824+0000 7fe023fff640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe02806b9e0 0x7fe02806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:37.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.825+0000 7fe03b7fe640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe02806b9e0 0x7fe02806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:37.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.825+0000 7fe03b7fe640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe02806b9e0 0x7fe02806dea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe02c036000 tx=0x7fe02c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.838+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe0300567d0 con 0x7fe03c0cd950 2024-04-15T00:01:37.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:37.839+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe03c0c7b20 con 0x7fe03c0cd950 2024-04-15T00:01:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.022+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe03c04f540 con 0x7fe03c0cd950 2024-04-15T00:01:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.062+0000 7fe023fff640 1 -- 172.21.15.29:0/1263187081 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7fe030058730 con 0x7fe03c0cd950 2024-04-15T00:01:38.069 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:38.069 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:38.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe02806b9e0 msgr2=0x7fe02806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:38.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe02806b9e0 0x7fe02806dea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe02c036000 tx=0x7fe02c03d040 comp rx=0 tx=0).stop 2024-04-15T00:01:38.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 msgr2=0x7fe03c14d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:38.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 0x7fe03c14d460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c3c0 tx=0x7fe03000c880 comp rx=0 tx=0).stop 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 shutdown_connections 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe02806b9e0 0x7fe02806dea0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe03c15da50 0x7fe03c14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe03c0cd950 0x7fe03c14d460 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 --2- 172.21.15.29:0/1263187081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03c06c670 0x7fe03c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 >> 172.21.15.29:0/1263187081 conn(0x7fe03c0cfb70 msgr2=0x7fe03c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 shutdown_connections 2024-04-15T00:01:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.064+0000 7fe0420a6640 1 -- 172.21.15.29:0/1263187081 wait complete. 2024-04-15T00:01:38.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-15T00:01:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 Processor -- start 2024-04-15T00:01:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 -- start start 2024-04-15T00:01:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93380cf1a0 0x7f933806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380d0800 0x7f93380cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f93380cc1a0 0x7f933815a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f93380cf580 con 0x7f93380cc1a0 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f93380cd980 con 0x7f93380cf1a0 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.182+0000 7f933e55e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f933806c8c0 con 0x7f93380d0800 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.183+0000 7f933cafb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f93380cc1a0 0x7f933815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.183+0000 7f933cafb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f93380cc1a0 0x7f933815a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46980/0 (socket says 172.21.15.29:46980) 2024-04-15T00:01:38.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.183+0000 7f933cafb640 1 -- 172.21.15.29:0/4099857621 learned_addr learned my addr 172.21.15.29:0/4099857621 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.186+0000 7f933cafb640 1 -- 172.21.15.29:0/4099857621 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380d0800 msgr2=0x7f93380cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:38.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.186+0000 7f933cafb640 1 --2- 172.21.15.29:0/4099857621 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380d0800 0x7f93380cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.186+0000 7f933cafb640 1 -- 172.21.15.29:0/4099857621 >> v2:172.21.15.37:3300/0 conn(0x7f93380cf1a0 msgr2=0x7f933806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:38.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.186+0000 7f933cafb640 1 --2- 172.21.15.29:0/4099857621 >> v2:172.21.15.37:3300/0 conn(0x7f93380cf1a0 0x7f933806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.186+0000 7f933cafb640 1 -- 172.21.15.29:0/4099857621 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933806cb50 con 0x7f93380cc1a0 2024-04-15T00:01:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.187+0000 7f933cafb640 1 --2- 172.21.15.29:0/4099857621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380cc1a0 0x7f933815a200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f93380cd6a0 tx=0x7f933002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126cd9ad86db0934 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:38.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.191+0000 7f9336ffd640 1 -- 172.21.15.29:0/4099857621 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933002cb00 con 0x7f93380cc1a0 2024-04-15T00:01:38.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.191+0000 7f9336ffd640 1 -- 172.21.15.29:0/4099857621 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933002cca0 con 0x7f93380cc1a0 2024-04-15T00:01:38.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.191+0000 7f9336ffd640 1 -- 172.21.15.29:0/4099857621 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330034610 con 0x7f93380cc1a0 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 -- 172.21.15.29:0/4099857621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380cc1a0 msgr2=0x7f933815a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 --2- 172.21.15.29:0/4099857621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380cc1a0 0x7f933815a200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f93380cd6a0 tx=0x7f933002bf60 comp rx=0 tx=0).stop 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 -- 172.21.15.29:0/4099857621 shutdown_connections 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 --2- 172.21.15.29:0/4099857621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380cc1a0 0x7f933815a200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 --2- 172.21.15.29:0/4099857621 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380d0800 0x7f93380cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 --2- 172.21.15.29:0/4099857621 >> v2:172.21.15.37:3300/0 conn(0x7f93380cf1a0 0x7f933806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 -- 172.21.15.29:0/4099857621 >> 172.21.15.29:0/4099857621 conn(0x7f93380cfba0 msgr2=0x7f93380cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 -- 172.21.15.29:0/4099857621 shutdown_connections 2024-04-15T00:01:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.192+0000 7f933e55e640 1 -- 172.21.15.29:0/4099857621 wait complete. 2024-04-15T00:01:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.193+0000 7f933e55e640 1 Processor -- start 2024-04-15T00:01:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.193+0000 7f933e55e640 1 -- start start 2024-04-15T00:01:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933e55e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93380cc1a0 0x7f933815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933e55e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380cf1a0 0x7f93381557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933e55e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 0x7f9338155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933e55e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f93380cb180 con 0x7f93380d0800 2024-04-15T00:01:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933e55e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93380caea0 con 0x7f93380cc1a0 2024-04-15T00:01:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933e55e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f93380cb460 con 0x7f93380cf1a0 2024-04-15T00:01:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.194+0000 7f933cafb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 0x7f9338155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.195+0000 7f933cafb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 0x7f9338155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46992/0 (socket says 172.21.15.29:46992) 2024-04-15T00:01:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.195+0000 7f933cafb640 1 -- 172.21.15.29:0/3392556602 learned_addr learned my addr 172.21.15.29:0/3392556602 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.198+0000 7f933cafb640 1 -- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380cf1a0 msgr2=0x7f93381557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.198+0000 7f933cafb640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380cf1a0 0x7f93381557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.198+0000 7f933cafb640 1 -- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93380cc1a0 msgr2=0x7f933815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.198+0000 7f933cafb640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93380cc1a0 0x7f933815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.198+0000 7f933cafb640 1 -- 172.21.15.29:0/3392556602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9338154b70 con 0x7f93380d0800 2024-04-15T00:01:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.200+0000 7f933cafb640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 0x7f9338155d20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9330036040 tx=0x7f9330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.202+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330043020 con 0x7f93380d0800 2024-04-15T00:01:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.202+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933815a950 con 0x7f93380d0800 2024-04-15T00:01:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.202+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93381576f0 con 0x7f93380d0800 2024-04-15T00:01:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.203+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9338155310 con 0x7f93380d0800 2024-04-15T00:01:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.204+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933002ce50 con 0x7f93380d0800 2024-04-15T00:01:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.204+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933003e450 con 0x7f93380d0800 2024-04-15T00:01:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.473+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9330046020 con 0x7f93380d0800 2024-04-15T00:01:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.473+0000 7f9334ff9640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f932406b990 0x7f932406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.473+0000 7f9337fff640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f932406b990 0x7f932406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.474+0000 7f9337fff640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f932406b990 0x7f932406de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9328009710 tx=0x7f9328006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.489+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9330049df0 con 0x7f93380d0800 2024-04-15T00:01:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.489+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f933004d030 con 0x7f93380d0800 2024-04-15T00:01:38.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:38.714+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9338157930 con 0x7f93380d0800 2024-04-15T00:01:39.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.644+0000 7f9334ff9640 1 -- 172.21.15.29:0/3392556602 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f9338157930 con 0x7f93380d0800 2024-04-15T00:01:39.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f932406b990 msgr2=0x7f932406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f932406b990 0x7f932406de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9328009710 tx=0x7f9328006c90 comp rx=0 tx=0).stop 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 msgr2=0x7f9338155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 0x7f9338155d20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9330036040 tx=0x7f9330004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 shutdown_connections 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f932406b990 0x7f932406de50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93380d0800 0x7f9338155d20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f93380cf1a0 0x7f93381557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 --2- 172.21.15.29:0/3392556602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93380cc1a0 0x7f933815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 >> 172.21.15.29:0/3392556602 conn(0x7f93380cfba0 msgr2=0x7f93380afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 shutdown_connections 2024-04-15T00:01:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.647+0000 7f933e55e640 1 -- 172.21.15.29:0/3392556602 wait complete. 2024-04-15T00:01:39.664 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-15T00:01:39.664 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-15T00:01:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.764+0000 7f33a7f1e640 1 Processor -- start 2024-04-15T00:01:39.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.764+0000 7f33a7f1e640 1 -- start start 2024-04-15T00:01:39.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.765+0000 7f33a7f1e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33a00c82f0 0x7f33a00c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:39.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.765+0000 7f33a7f1e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a015a190 con 0x7f33a0154580 2024-04-15T00:01:39.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.765+0000 7f33a7f1e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a006d090 con 0x7f33a00c2c50 2024-04-15T00:01:39.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.765+0000 7f33a7f1e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f33a015a4e0 con 0x7f33a00c82f0 2024-04-15T00:01:39.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.765+0000 7f33a5cba640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f33a0154580 0x7f33a015a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54634/0 (socket says 172.21.15.29:54634) 2024-04-15T00:01:39.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.765+0000 7f33a5cba640 1 -- 172.21.15.29:0/533652749 learned_addr learned my addr 172.21.15.29:0/533652749 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:39.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.766+0000 7f33a54b9640 1 --2- 172.21.15.29:0/533652749 >> v2:172.21.15.37:3300/0 conn(0x7f33a00c82f0 0x7f33a00c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.768+0000 7f33a4cb8640 1 -- 172.21.15.29:0/533652749 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252446506 0 0) 0x7f33a015a190 con 0x7f33a0154580 2024-04-15T00:01:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.768+0000 7f33a4cb8640 1 -- 172.21.15.29:0/533652749 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f338c003520 con 0x7f33a0154580 2024-04-15T00:01:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.769+0000 7f33a54b9640 1 -- 172.21.15.29:0/533652749 >> v1:172.21.15.37:6789/0 conn(0x7f33a00c2c50 legacy=0x7f33a0070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.769+0000 7f33a54b9640 1 -- 172.21.15.29:0/533652749 >> v1:172.21.15.29:6789/0 conn(0x7f33a0154580 legacy=0x7f33a015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.769+0000 7f33a54b9640 1 -- 172.21.15.29:0/533652749 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00c87e0 con 0x7f33a00c82f0 2024-04-15T00:01:39.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.773+0000 7f33a54b9640 1 --2- 172.21.15.29:0/533652749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a00c82f0 0x7f33a00c9de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f33900097a0 tx=0x7f339002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128a57fa2705832 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:39.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.777+0000 7f33a4cb8640 1 -- 172.21.15.29:0/533652749 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390035020 con 0x7f33a00c82f0 2024-04-15T00:01:39.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.777+0000 7f33a4cb8640 1 -- 172.21.15.29:0/533652749 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3390031830 con 0x7f33a00c82f0 2024-04-15T00:01:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.777+0000 7f33a4cb8640 1 -- 172.21.15.29:0/533652749 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390031c00 con 0x7f33a00c82f0 2024-04-15T00:01:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 -- 172.21.15.29:0/533652749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a00c82f0 msgr2=0x7f33a00c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/533652749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a00c82f0 0x7f33a00c9de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f33900097a0 tx=0x7f339002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 -- 172.21.15.29:0/533652749 shutdown_connections 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/533652749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a00c82f0 0x7f33a00c9de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 -- 172.21.15.29:0/533652749 >> 172.21.15.29:0/533652749 conn(0x7f33a00ca3f0 msgr2=0x7f33a00ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 -- 172.21.15.29:0/533652749 shutdown_connections 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.778+0000 7f33a7f1e640 1 -- 172.21.15.29:0/533652749 wait complete. 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.779+0000 7f33a7f1e640 1 Processor -- start 2024-04-15T00:01:39.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.779+0000 7f33a7f1e640 1 -- start start 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.780+0000 7f33a7f1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 0x7f33a01f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.780+0000 7f33a7f1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f33a00c82f0 0x7f33a00cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.780+0000 7f33a7f1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a0154580 0x7f33a00cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.780+0000 7f33a7f1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00c9080 con 0x7f33a00c2c50 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.780+0000 7f33a7f1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00c8da0 con 0x7f33a0154580 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.780+0000 7f33a7f1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f33a015b080 con 0x7f33a00c82f0 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.781+0000 7f33a5cba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 0x7f33a01f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.781+0000 7f33a64bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a0154580 0x7f33a00cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.781+0000 7f33a54b9640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f33a00c82f0 0x7f33a00cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.781+0000 7f33a5cba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 0x7f33a01f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47004/0 (socket says 172.21.15.29:47004) 2024-04-15T00:01:39.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.781+0000 7f33a5cba640 1 -- 172.21.15.29:0/3191682114 learned_addr learned my addr 172.21.15.29:0/3191682114 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:39.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.784+0000 7f33a5cba640 1 -- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f33a00c82f0 msgr2=0x7f33a00cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.784+0000 7f33a5cba640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f33a00c82f0 0x7f33a00cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.784+0000 7f33a5cba640 1 -- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a0154580 msgr2=0x7f33a00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:39.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.784+0000 7f33a5cba640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a0154580 0x7f33a00cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:39.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.784+0000 7f33a5cba640 1 -- 172.21.15.29:0/3191682114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00c4180 con 0x7f33a00c2c50 2024-04-15T00:01:39.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.787+0000 7f33a5cba640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 0x7f33a01f08e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c500 tx=0x7f339c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:39.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.790+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c017070 con 0x7f33a00c2c50 2024-04-15T00:01:39.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.790+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c005ce0 con 0x7f33a00c2c50 2024-04-15T00:01:39.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.790+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c007330 con 0x7f33a00c2c50 2024-04-15T00:01:39.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.790+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00cba90 con 0x7f33a00c2c50 2024-04-15T00:01:39.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.791+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01efe00 con 0x7f33a00c2c50 2024-04-15T00:01:39.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:39.791+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a004f540 con 0x7f33a00c2c50 2024-04-15T00:01:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.055+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f339c01a070 con 0x7f33a00c2c50 2024-04-15T00:01:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.056+0000 7f33967fc640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f338406b9c0 0x7f338406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.056+0000 7f33a54b9640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f338406b9c0 0x7f338406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.057+0000 7f33a54b9640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f338406b9c0 0x7f338406de80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3390036000 tx=0x7f3390008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:40.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.070+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f339c0567f0 con 0x7f33a00c2c50 2024-04-15T00:01:40.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.070+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f339c021020 con 0x7f33a00c2c50 2024-04-15T00:01:40.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.289+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f33a01482c0 con 0x7f33a00c2c50 2024-04-15T00:01:40.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.766+0000 7f33967fc640 1 -- 172.21.15.29:0/3191682114 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f339c058750 con 0x7f33a00c2c50 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f338406b9c0 msgr2=0x7f338406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f338406b9c0 0x7f338406de80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3390036000 tx=0x7f3390008030 comp rx=0 tx=0).stop 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 msgr2=0x7f33a01f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 0x7f33a01f08e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c500 tx=0x7f339c00c9c0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 shutdown_connections 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f338406b9c0 0x7f338406de80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a0154580 0x7f33a00cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f33a00c82f0 0x7f33a00cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 --2- 172.21.15.29:0/3191682114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33a00c2c50 0x7f33a01f08e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 >> 172.21.15.29:0/3191682114 conn(0x7f33a00ca3f0 msgr2=0x7f33a01504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:40.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 shutdown_connections 2024-04-15T00:01:40.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.768+0000 7f33a7f1e640 1 -- 172.21.15.29:0/3191682114 wait complete. 2024-04-15T00:01:40.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-15T00:01:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.884+0000 7f442e5ed640 1 Processor -- start 2024-04-15T00:01:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.884+0000 7f442e5ed640 1 -- start start 2024-04-15T00:01:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.885+0000 7f442e5ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f442815ac30 0x7f442815b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.885+0000 7f442e5ed640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442815ba10 con 0x7f44280cca40 2024-04-15T00:01:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.885+0000 7f442e5ed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442815bc80 con 0x7f44280ca470 2024-04-15T00:01:40.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.885+0000 7f442e5ed640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4428154cc0 con 0x7f442815ac30 2024-04-15T00:01:40.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.885+0000 7f4427fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f442815ac30 0x7f442815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:40.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.886+0000 7f4427fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f442815ac30 0x7f442815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:58556/0 (socket says 172.21.15.29:58556) 2024-04-15T00:01:40.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.886+0000 7f4427fff640 1 -- 172.21.15.29:0/4195127766 learned_addr learned my addr 172.21.15.29:0/4195127766 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:40.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.888+0000 7f4427fff640 1 -- 172.21.15.29:0/4195127766 >> v1:172.21.15.37:6789/0 conn(0x7f44280ca470 legacy=0x7f44280cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:40.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.888+0000 7f4427fff640 1 -- 172.21.15.29:0/4195127766 >> v1:172.21.15.29:6789/0 conn(0x7f44280cca40 legacy=0x7f442815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:40.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.889+0000 7f4427fff640 1 -- 172.21.15.29:0/4195127766 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442815bf60 con 0x7f442815ac30 2024-04-15T00:01:40.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.891+0000 7f4427fff640 1 --2- 172.21.15.29:0/4195127766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f442815b010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4428154e40 tx=0x7f441c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5629e4b1d824906f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:40.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.895+0000 7f4426ffd640 1 -- 172.21.15.29:0/4195127766 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c02f840 con 0x7f442815ac30 2024-04-15T00:01:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.896+0000 7f4426ffd640 1 -- 172.21.15.29:0/4195127766 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c02f9e0 con 0x7f442815ac30 2024-04-15T00:01:40.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.896+0000 7f4426ffd640 1 -- 172.21.15.29:0/4195127766 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c02fdb0 con 0x7f442815ac30 2024-04-15T00:01:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 -- 172.21.15.29:0/4195127766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 msgr2=0x7f442815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 --2- 172.21.15.29:0/4195127766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f442815b010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4428154e40 tx=0x7f441c02ba20 comp rx=0 tx=0).stop 2024-04-15T00:01:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 -- 172.21.15.29:0/4195127766 shutdown_connections 2024-04-15T00:01:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 --2- 172.21.15.29:0/4195127766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f442815b010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 -- 172.21.15.29:0/4195127766 >> 172.21.15.29:0/4195127766 conn(0x7f44280cfaf0 msgr2=0x7f44280cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:40.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 -- 172.21.15.29:0/4195127766 shutdown_connections 2024-04-15T00:01:40.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.897+0000 7f442e5ed640 1 -- 172.21.15.29:0/4195127766 wait complete. 2024-04-15T00:01:40.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.898+0000 7f442e5ed640 1 Processor -- start 2024-04-15T00:01:40.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.898+0000 7f442e5ed640 1 -- start start 2024-04-15T00:01:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442e5ed640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f44280ca470 0x7f44281e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442e5ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44280cca40 0x7f4428151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442e5ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f44281f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442e5ed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f44280ccec0 con 0x7f44280cca40 2024-04-15T00:01:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442e5ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f442815c5b0 con 0x7f442815ac30 2024-04-15T00:01:40.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442e5ed640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f442815d150 con 0x7f44280ca470 2024-04-15T00:01:40.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.899+0000 7f442cb8a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f44281f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:40.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.900+0000 7f4427fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f44280ca470 0x7f44281e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:40.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.900+0000 7f442cb8a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f44281f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:58558/0 (socket says 172.21.15.29:58558) 2024-04-15T00:01:40.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.900+0000 7f442cb8a640 1 -- 172.21.15.29:0/23502050 learned_addr learned my addr 172.21.15.29:0/23502050 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:40.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.903+0000 7f442cb8a640 1 -- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f44280ca470 msgr2=0x7f44281e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:40.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.903+0000 7f442cb8a640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f44280ca470 0x7f44281e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.903+0000 7f442cb8a640 1 -- 172.21.15.29:0/23502050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44280cca40 msgr2=0x7f4428151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:40.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.903+0000 7f442cb8a640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44280cca40 0x7f4428151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:40.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.903+0000 7f442cb8a640 1 -- 172.21.15.29:0/23502050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44281f36c0 con 0x7f442815ac30 2024-04-15T00:01:40.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.905+0000 7f442cb8a640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f44281f3e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f442000c7b0 tx=0x7f442000cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:40.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.909+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420017070 con 0x7f442815ac30 2024-04-15T00:01:40.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.909+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4420003d80 con 0x7f442815ac30 2024-04-15T00:01:40.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.909+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442000ce60 con 0x7f442815ac30 2024-04-15T00:01:40.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.909+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44281511e0 con 0x7f442815ac30 2024-04-15T00:01:40.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.909+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44280c7170 con 0x7f442815ac30 2024-04-15T00:01:40.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:40.910+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442804f540 con 0x7f442815ac30 2024-04-15T00:01:41.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.250+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f442001a070 con 0x7f442815ac30 2024-04-15T00:01:41.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.251+0000 7f4424ff9640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f441406ba10 0x7f441406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:41.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.251+0000 7f4427fff640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f441406ba10 0x7f441406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:41.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.252+0000 7f4427fff640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f441406ba10 0x7f441406ded0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f441c036000 tx=0x7f441c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:41.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.261+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4420056830 con 0x7f442815ac30 2024-04-15T00:01:41.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.272+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4420021020 con 0x7f442815ac30 2024-04-15T00:01:41.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:41.493+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f442806d640 con 0x7f442815ac30 2024-04-15T00:01:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.067+0000 7f4424ff9640 1 -- 172.21.15.29:0/23502050 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f4420058790 con 0x7f442815ac30 2024-04-15T00:01:42.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f441406ba10 msgr2=0x7f441406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f441406ba10 0x7f441406ded0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f441c036000 tx=0x7f441c008030 comp rx=0 tx=0).stop 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 msgr2=0x7f44281f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f44281f3e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f442000c7b0 tx=0x7f442000cc70 comp rx=0 tx=0).stop 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 shutdown_connections 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f441406ba10 0x7f441406ded0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442815ac30 0x7f44281f3e50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44280cca40 0x7f4428151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 --2- 172.21.15.29:0/23502050 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f44280ca470 0x7f44281e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 >> 172.21.15.29:0/23502050 conn(0x7f44280cfaf0 msgr2=0x7f44280cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 shutdown_connections 2024-04-15T00:01:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.069+0000 7f442e5ed640 1 -- 172.21.15.29:0/23502050 wait complete. 2024-04-15T00:01:42.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-15T00:01:42.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.184+0000 7f0c2c2de640 1 Processor -- start 2024-04-15T00:01:42.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.184+0000 7f0c2c2de640 1 -- start start 2024-04-15T00:01:42.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.185+0000 7f0c2c2de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c240cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:42.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.185+0000 7f0c2c2de640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240c8d90 con 0x7f0c2415a940 2024-04-15T00:01:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.185+0000 7f0c2c2de640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240c9640 con 0x7f0c240c9d40 2024-04-15T00:01:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.185+0000 7f0c2c2de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0c240c9920 con 0x7f0c240cd890 2024-04-15T00:01:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.186+0000 7f0c2a87b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0c2415a940 0x7f0c2415adc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54652/0 (socket says 172.21.15.29:54652) 2024-04-15T00:01:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.186+0000 7f0c2a87b640 1 -- 172.21.15.29:0/508821099 learned_addr learned my addr 172.21.15.29:0/508821099 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:42.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.186+0000 7f0c2a07a640 1 --2- 172.21.15.29:0/508821099 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c240cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754615177 0 0) 0x7f0c240c8d90 con 0x7f0c2415a940 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c10003520 con 0x7f0c2415a940 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864639508 0 0) 0x7f0c240c9640 con 0x7f0c240c9d40 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c240c8d90 con 0x7f0c240c9d40 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c2a07a640 1 -- 172.21.15.29:0/508821099 >> v1:172.21.15.37:6789/0 conn(0x7f0c240c9d40 legacy=0x7f0c2415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c2a07a640 1 -- 172.21.15.29:0/508821099 >> v1:172.21.15.29:6789/0 conn(0x7f0c2415a940 legacy=0x7f0c2415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.189+0000 7f0c2a07a640 1 -- 172.21.15.29:0/508821099 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240c87d0 con 0x7f0c240cd890 2024-04-15T00:01:42.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.191+0000 7f0c2a07a640 1 --2- 172.21.15.29:0/508821099 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c240cdc70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097d0 tx=0x7f0c2002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5ddb945c7e9cc19 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:42.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.195+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20035020 con 0x7f0c240cd890 2024-04-15T00:01:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c20031800 con 0x7f0c240cd890 2024-04-15T00:01:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c29078640 1 -- 172.21.15.29:0/508821099 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20031bd0 con 0x7f0c240cd890 2024-04-15T00:01:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 -- 172.21.15.29:0/508821099 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 msgr2=0x7f0c240cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/508821099 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c240cdc70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097d0 tx=0x7f0c2002b8a0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 -- 172.21.15.29:0/508821099 shutdown_connections 2024-04-15T00:01:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/508821099 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c240cdc70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 -- 172.21.15.29:0/508821099 >> 172.21.15.29:0/508821099 conn(0x7f0c24061c20 msgr2=0x7f0c24062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 -- 172.21.15.29:0/508821099 shutdown_connections 2024-04-15T00:01:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.196+0000 7f0c2c2de640 1 -- 172.21.15.29:0/508821099 wait complete. 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.197+0000 7f0c2c2de640 1 Processor -- start 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.197+0000 7f0c2c2de640 1 -- start start 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2c2de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240c9d40 0x7f0c241f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2c2de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c2414a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2c2de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 0x7f0c2414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2c2de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24154910 con 0x7f0c2415a940 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2c2de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2415a420 con 0x7f0c240c9d40 2024-04-15T00:01:42.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2c2de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0c241f0570 con 0x7f0c240cd890 2024-04-15T00:01:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.198+0000 7f0c2a87b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 0x7f0c2414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.199+0000 7f0c2a07a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240c9d40 0x7f0c241f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.199+0000 7f0c29879640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c2414a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.199+0000 7f0c2a87b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 0x7f0c2414efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47018/0 (socket says 172.21.15.29:47018) 2024-04-15T00:01:42.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.199+0000 7f0c2a87b640 1 -- 172.21.15.29:0/247918548 learned_addr learned my addr 172.21.15.29:0/247918548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:42.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.202+0000 7f0c2a87b640 1 -- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 msgr2=0x7f0c2414a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.202+0000 7f0c2a87b640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c2414a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.202+0000 7f0c2a87b640 1 -- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240c9d40 msgr2=0x7f0c241f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:42.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.202+0000 7f0c2a87b640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240c9d40 0x7f0c241f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:42.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.202+0000 7f0c2a87b640 1 -- 172.21.15.29:0/247918548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c241f0810 con 0x7f0c2415a940 2024-04-15T00:01:42.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.204+0000 7f0c2a87b640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 0x7f0c2414efb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00caa0 tx=0x7f0c1c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:42.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.208+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c017070 con 0x7f0c2415a940 2024-04-15T00:01:42.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.208+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00ac20 con 0x7f0c2415a940 2024-04-15T00:01:42.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.208+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c241f0af0 con 0x7f0c2415a940 2024-04-15T00:01:42.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.208+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c012400 con 0x7f0c2415a940 2024-04-15T00:01:42.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.208+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c241f10b0 con 0x7f0c2415a940 2024-04-15T00:01:42.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.209+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2404f540 con 0x7f0c2415a940 2024-04-15T00:01:42.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.472+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0c1c01a070 con 0x7f0c2415a940 2024-04-15T00:01:42.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.473+0000 7f0c1affd640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0c0806b9e0 0x7f0c0806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:42.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.473+0000 7f0c2a07a640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0c0806b9e0 0x7f0c0806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:42.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.474+0000 7f0c2a07a640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0c0806b9e0 0x7f0c0806dea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c20036000 tx=0x7f0c2003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:42.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.486+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0c1c056fe0 con 0x7f0c2415a940 2024-04-15T00:01:42.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.486+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c1c021020 con 0x7f0c2415a940 2024-04-15T00:01:42.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:42.710+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0c240c45f0 con 0x7f0c2415a940 2024-04-15T00:01:43.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.073+0000 7f0c1affd640 1 -- 172.21.15.29:0/247918548 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f0c1c058f40 con 0x7f0c2415a940 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0c0806b9e0 msgr2=0x7f0c0806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0c0806b9e0 0x7f0c0806dea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c20036000 tx=0x7f0c2003c040 comp rx=0 tx=0).stop 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 msgr2=0x7f0c2414efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 0x7f0c2414efb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00caa0 tx=0x7f0c1c00cf60 comp rx=0 tx=0).stop 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 shutdown_connections 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0c0806b9e0 0x7f0c0806dea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c2415a940 0x7f0c2414efb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0c240cd890 0x7f0c2414a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 --2- 172.21.15.29:0/247918548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240c9d40 0x7f0c241f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 >> 172.21.15.29:0/247918548 conn(0x7f0c24061c20 msgr2=0x7f0c240ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 shutdown_connections 2024-04-15T00:01:43.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.075+0000 7f0c2c2de640 1 -- 172.21.15.29:0/247918548 wait complete. 2024-04-15T00:01:43.093 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-15T00:01:43.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:43.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.192+0000 7f88b2374640 1 Processor -- start 2024-04-15T00:01:43.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.192+0000 7f88b2374640 1 -- start start 2024-04-15T00:01:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.193+0000 7f88b2374640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f88ac0cc910 0x7f88ac165d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.193+0000 7f88b2374640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac0cf910 con 0x7f88ac15b110 2024-04-15T00:01:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.193+0000 7f88b2374640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac0cf350 con 0x7f88ac0cc530 2024-04-15T00:01:43.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.193+0000 7f88b2374640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac0cf630 con 0x7f88ac0cc910 2024-04-15T00:01:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.238+0000 7f88b0911640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f88ac0cc910 0x7f88ac165d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:43.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.239+0000 7f88b0911640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f88ac0cc910 0x7f88ac165d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47032/0 (socket says 172.21.15.29:47032) 2024-04-15T00:01:43.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.239+0000 7f88b0911640 1 -- 172.21.15.29:0/1688159440 learned_addr learned my addr 172.21.15.29:0/1688159440 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:43.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.243+0000 7f88b0911640 1 -- 172.21.15.29:0/1688159440 >> v1:172.21.15.37:6789/0 conn(0x7f88ac0cc530 legacy=0x7f88ac06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.243+0000 7f88b0911640 1 -- 172.21.15.29:0/1688159440 >> v1:172.21.15.29:6789/0 conn(0x7f88ac15b110 legacy=0x7f88ac0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.243+0000 7f88b0911640 1 -- 172.21.15.29:0/1688159440 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac15a630 con 0x7f88ac0cc910 2024-04-15T00:01:43.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.247+0000 7f88b0911640 1 --2- 172.21.15.29:0/1688159440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac0cc910 0x7f88ac165d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009e50 tx=0x7f88a402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b42f17942eb67a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.276+0000 7f88aaffd640 1 -- 172.21.15.29:0/1688159440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a402cbb0 con 0x7f88ac0cc910 2024-04-15T00:01:43.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.276+0000 7f88aaffd640 1 -- 172.21.15.29:0/1688159440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a402cd50 con 0x7f88ac0cc910 2024-04-15T00:01:43.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.276+0000 7f88aaffd640 1 -- 172.21.15.29:0/1688159440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4034610 con 0x7f88ac0cc910 2024-04-15T00:01:43.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 -- 172.21.15.29:0/1688159440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac0cc910 msgr2=0x7f88ac165d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 --2- 172.21.15.29:0/1688159440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac0cc910 0x7f88ac165d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009e50 tx=0x7f88a402c010 comp rx=0 tx=0).stop 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 -- 172.21.15.29:0/1688159440 shutdown_connections 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 --2- 172.21.15.29:0/1688159440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac0cc910 0x7f88ac165d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 -- 172.21.15.29:0/1688159440 >> 172.21.15.29:0/1688159440 conn(0x7f88ac0cfb20 msgr2=0x7f88ac0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 -- 172.21.15.29:0/1688159440 shutdown_connections 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.277+0000 7f88b2374640 1 -- 172.21.15.29:0/1688159440 wait complete. 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.278+0000 7f88b2374640 1 Processor -- start 2024-04-15T00:01:43.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.278+0000 7f88b2374640 1 -- start start 2024-04-15T00:01:43.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.279+0000 7f88b2374640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 0x7f88ac157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:43.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.279+0000 7f88b2374640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88ac0cc910 0x7f88ac158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:43.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.279+0000 7f88b2374640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac15b110 0x7f88ac0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:43.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.279+0000 7f88b2374640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0ce700 con 0x7f88ac15b110 2024-04-15T00:01:43.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.279+0000 7f88b2374640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac15abf0 con 0x7f88ac0cc910 2024-04-15T00:01:43.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.279+0000 7f88b2374640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0ccd20 con 0x7f88ac0cc530 2024-04-15T00:01:43.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.280+0000 7f88abfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 0x7f88ac157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:43.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.280+0000 7f88abfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 0x7f88ac157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:42760/0 (socket says 172.21.15.29:42760) 2024-04-15T00:01:43.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.280+0000 7f88abfff640 1 -- 172.21.15.29:0/46672654 learned_addr learned my addr 172.21.15.29:0/46672654 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:43.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.281+0000 7f88b0911640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac15b110 0x7f88ac0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:43.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.282+0000 7f88ab7fe640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88ac0cc910 0x7f88ac158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:43.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.284+0000 7f88abfff640 1 -- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88ac0cc910 msgr2=0x7f88ac158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.284+0000 7f88abfff640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88ac0cc910 0x7f88ac158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.284+0000 7f88abfff640 1 -- 172.21.15.29:0/46672654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac15b110 msgr2=0x7f88ac0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.284+0000 7f88abfff640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac15b110 0x7f88ac0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.284+0000 7f88abfff640 1 -- 172.21.15.29:0/46672654 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac157a00 con 0x7f88ac0cc530 2024-04-15T00:01:43.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.286+0000 7f88abfff640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 0x7f88ac157290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f889c00c3c0 tx=0x7f889c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:43.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.290+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c0052d0 con 0x7f88ac0cc530 2024-04-15T00:01:43.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.290+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c005490 con 0x7f88ac0cc530 2024-04-15T00:01:43.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.290+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac157ce0 con 0x7f88ac0cc530 2024-04-15T00:01:43.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.290+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c007260 con 0x7f88ac0cc530 2024-04-15T00:01:43.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.290+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac0b3650 con 0x7f88ac0cc530 2024-04-15T00:01:43.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.291+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac04f540 con 0x7f88ac0cc530 2024-04-15T00:01:43.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.564+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f889c007400 con 0x7f88ac0cc530 2024-04-15T00:01:43.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.565+0000 7f88a8ff9640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f889806b9e0 0x7f889806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:43.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.565+0000 7f88ab7fe640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f889806b9e0 0x7f889806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:43.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.565+0000 7f88ab7fe640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f889806b9e0 0x7f889806dea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0cb690 tx=0x7f88a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:43.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.568+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f889c056790 con 0x7f88ac0cc530 2024-04-15T00:01:43.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.582+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f889c0586f0 con 0x7f88ac0cc530 2024-04-15T00:01:43.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.850+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88ac0b5aa0 con 0x7f88ac0cc530 2024-04-15T00:01:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.874+0000 7f88a8ff9640 1 -- 172.21.15.29:0/46672654 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6866 (secure 0 0 0) 0x7f889c05c790 con 0x7f88ac0cc530 2024-04-15T00:01:43.880 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:43.880 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:43.065882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4272,"mds_2":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4272":{"gid":4272,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275,4272]},"id":1}]} 2024-04-15T00:01:43.880 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f889806b9e0 msgr2=0x7f889806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f889806b9e0 0x7f889806dea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0cb690 tx=0x7f88a0009040 comp rx=0 tx=0).stop 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 msgr2=0x7f88ac157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 0x7f88ac157290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f889c00c3c0 tx=0x7f889c00c880 comp rx=0 tx=0).stop 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 shutdown_connections 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f889806b9e0 0x7f889806dea0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88ac15b110 0x7f88ac0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88ac0cc910 0x7f88ac158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 --2- 172.21.15.29:0/46672654 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88ac0cc530 0x7f88ac157290 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 >> 172.21.15.29:0/46672654 conn(0x7f88ac0cfb20 msgr2=0x7f88ac14fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 shutdown_connections 2024-04-15T00:01:43.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:43.877+0000 7f88b2374640 1 -- 172.21.15.29:0/46672654 wait complete. 2024-04-15T00:01:43.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.006+0000 7fa04fde0640 1 Processor -- start 2024-04-15T00:01:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.006+0000 7fa04fde0640 1 -- start start 2024-04-15T00:01:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.007+0000 7fa04fde0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c50d0 0x7fa048158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.007+0000 7fa04fde0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0480c54b0 0x7fa0480c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.007+0000 7fa04fde0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04815b9e0 con 0x7fa04815b570 2024-04-15T00:01:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.007+0000 7fa04fde0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa048158120 con 0x7fa0480c54b0 2024-04-15T00:01:44.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.007+0000 7fa04fde0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fa0480c67e0 con 0x7fa0480c50d0 2024-04-15T00:01:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.008+0000 7fa04db7c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c50d0 0x7fa048158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.008+0000 7fa04d37b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0480c54b0 0x7fa0480c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.008+0000 7fa04d37b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0480c54b0 0x7fa0480c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:58586/0 (socket says 172.21.15.29:58586) 2024-04-15T00:01:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.008+0000 7fa04d37b640 1 -- 172.21.15.29:0/893219068 learned_addr learned my addr 172.21.15.29:0/893219068 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.010+0000 7fa04d37b640 1 -- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c50d0 msgr2=0x7fa048158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.010+0000 7fa04d37b640 1 --2- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c50d0 0x7fa048158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.010+0000 7fa04d37b640 1 -- 172.21.15.29:0/893219068 >> v1:172.21.15.29:6789/0 conn(0x7fa04815b570 legacy=0x7fa048140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.010+0000 7fa04d37b640 1 -- 172.21.15.29:0/893219068 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0480c6aa0 con 0x7fa0480c54b0 2024-04-15T00:01:44.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.012+0000 7fa04d37b640 1 --2- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0480c54b0 0x7fa0480c6150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa038009850 tx=0x7fa03802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b5641844a77848f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:44.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.016+0000 7fa04cb7a640 1 -- 172.21.15.29:0/893219068 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038004230 con 0x7fa0480c54b0 2024-04-15T00:01:44.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.016+0000 7fa04cb7a640 1 -- 172.21.15.29:0/893219068 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0380043d0 con 0x7fa0480c54b0 2024-04-15T00:01:44.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.016+0000 7fa04cb7a640 1 -- 172.21.15.29:0/893219068 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038003810 con 0x7fa0480c54b0 2024-04-15T00:01:44.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 -- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0480c54b0 msgr2=0x7fa0480c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 --2- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0480c54b0 0x7fa0480c6150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa038009850 tx=0x7fa03802b960 comp rx=0 tx=0).stop 2024-04-15T00:01:44.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 -- 172.21.15.29:0/893219068 shutdown_connections 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 --2- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0480c54b0 0x7fa0480c6150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 --2- 172.21.15.29:0/893219068 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c50d0 0x7fa048158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 -- 172.21.15.29:0/893219068 >> 172.21.15.29:0/893219068 conn(0x7fa04806fca0 msgr2=0x7fa04806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 -- 172.21.15.29:0/893219068 shutdown_connections 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.017+0000 7fa04fde0640 1 -- 172.21.15.29:0/893219068 wait complete. 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.018+0000 7fa04fde0640 1 Processor -- start 2024-04-15T00:01:44.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.018+0000 7fa04fde0640 1 -- start start 2024-04-15T00:01:44.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04fde0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0480c50d0 0x7fa0481515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04fde0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c54b0 0x7fa0480cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04fde0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 0x7fa0480c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04fde0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa0480c6d80 con 0x7fa0480c50d0 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04fde0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0481586a0 con 0x7fa04815b570 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04fde0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fa0481416c0 con 0x7fa0480c54b0 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.019+0000 7fa04e37d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 0x7fa0480c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.020+0000 7fa04d37b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c54b0 0x7fa0480cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.020+0000 7fa04e37d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 0x7fa0480c1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:58596/0 (socket says 172.21.15.29:58596) 2024-04-15T00:01:44.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.020+0000 7fa04e37d640 1 -- 172.21.15.29:0/3820534098 learned_addr learned my addr 172.21.15.29:0/3820534098 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.024+0000 7fa04d37b640 1 -- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 msgr2=0x7fa0480c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.024+0000 7fa04d37b640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 0x7fa0480c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.024+0000 7fa04d37b640 1 -- 172.21.15.29:0/3820534098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0480c50d0 msgr2=0x7fa0481515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.024+0000 7fa04d37b640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0480c50d0 0x7fa0481515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.024+0000 7fa04d37b640 1 -- 172.21.15.29:0/3820534098 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0480c9550 con 0x7fa0480c54b0 2024-04-15T00:01:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.024+0000 7fa04e37d640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 0x7fa0480c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:44.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.026+0000 7fa04d37b640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c54b0 0x7fa0480cb310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa038004000 tx=0x7fa0380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:44.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.030+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038048070 con 0x7fa0480c54b0 2024-04-15T00:01:44.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.030+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa038003bd0 con 0x7fa0480c54b0 2024-04-15T00:01:44.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.030+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0480c97f0 con 0x7fa0480c54b0 2024-04-15T00:01:44.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.030+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038006040 con 0x7fa0480c54b0 2024-04-15T00:01:44.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.030+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa048159990 con 0x7fa0480c54b0 2024-04-15T00:01:44.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.031+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04804f540 con 0x7fa0480c54b0 2024-04-15T00:01:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.309+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa03804b070 con 0x7fa0480c54b0 2024-04-15T00:01:44.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.309+0000 7fa03e7fc640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa02c06b9c0 0x7fa02c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.310+0000 7fa04db7c640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa02c06b9c0 0x7fa02c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.310+0000 7fa04db7c640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa02c06b9c0 0x7fa02c06de80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa044006a90 tx=0x7fa044006a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:44.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.313+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa038078ef0 con 0x7fa0480c54b0 2024-04-15T00:01:44.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.325+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa038034020 con 0x7fa0480c54b0 2024-04-15T00:01:44.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.534+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa048136a90 con 0x7fa0480c54b0 2024-04-15T00:01:44.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.581+0000 7fa03e7fc640 1 -- 172.21.15.29:0/3820534098 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7fa03807ae50 con 0x7fa0480c54b0 2024-04-15T00:01:44.588 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:44.588 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:44.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa02c06b9c0 msgr2=0x7fa02c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa02c06b9c0 0x7fa02c06de80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa044006a90 tx=0x7fa044006a20 comp rx=0 tx=0).stop 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c54b0 msgr2=0x7fa0480cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c54b0 0x7fa0480cb310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa038004000 tx=0x7fa0380046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 shutdown_connections 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa02c06b9c0 0x7fa02c06de80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa04815b570 0x7fa0480c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa0480c54b0 0x7fa0480cb310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 --2- 172.21.15.29:0/3820534098 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0480c50d0 0x7fa0481515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 >> 172.21.15.29:0/3820534098 conn(0x7fa04806fca0 msgr2=0x7fa04813fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 shutdown_connections 2024-04-15T00:01:44.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.583+0000 7fa04fde0640 1 -- 172.21.15.29:0/3820534098 wait complete. 2024-04-15T00:01:44.601 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-15T00:01:44.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:01:44.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.698+0000 7fe7a5488640 1 Processor -- start 2024-04-15T00:01:44.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.698+0000 7fe7a5488640 1 -- start start 2024-04-15T00:01:44.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe7a5488640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a0163c50 0x7fe7a0166040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe7a5488640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a015a6a0 con 0x7fe7a00cc2f0 2024-04-15T00:01:44.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe7a5488640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a015a960 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe7a5488640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a006de40 con 0x7fe7a0163c50 2024-04-15T00:01:44.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe79effd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe7a00cc2f0 0x7fe7a006d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54678/0 (socket says 172.21.15.29:54678) 2024-04-15T00:01:44.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe79effd640 1 -- 172.21.15.29:0/3350785408 learned_addr learned my addr 172.21.15.29:0/3350785408 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:44.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.699+0000 7fe79f7fe640 1 --2- 172.21.15.29:0/3350785408 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a0163c50 0x7fe7a0166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706654824 0 0) 0x7fe7a015a6a0 con 0x7fe7a00cc2f0 2024-04-15T00:01:44.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe78c003520 con 0x7fe7a00cc2f0 2024-04-15T00:01:44.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367196888 0 0) 0x7fe7a015a960 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7a015a6a0 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79f7fe640 1 -- 172.21.15.29:0/3350785408 >> v1:172.21.15.37:6789/0 conn(0x7fe7a00cc6d0 legacy=0x7fe7a006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79f7fe640 1 -- 172.21.15.29:0/3350785408 >> v1:172.21.15.29:6789/0 conn(0x7fe7a00cc2f0 legacy=0x7fe7a006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.702+0000 7fe79f7fe640 1 -- 172.21.15.29:0/3350785408 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a015ac40 con 0x7fe7a0163c50 2024-04-15T00:01:44.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.705+0000 7fe79f7fe640 1 --2- 172.21.15.29:0/3350785408 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a0163c50 0x7fe7a0166040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe790009dc0 tx=0x7fe79002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=390d756760f8a43d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.709+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790039070 con 0x7fe7a0163c50 2024-04-15T00:01:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.709+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79002cd50 con 0x7fe7a0163c50 2024-04-15T00:01:44.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.709+0000 7fe79dffb640 1 -- 172.21.15.29:0/3350785408 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790034660 con 0x7fe7a0163c50 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 -- 172.21.15.29:0/3350785408 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a0163c50 msgr2=0x7fe7a0166040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3350785408 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a0163c50 0x7fe7a0166040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe790009dc0 tx=0x7fe79002bfa0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 -- 172.21.15.29:0/3350785408 shutdown_connections 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3350785408 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a0163c50 0x7fe7a0166040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 -- 172.21.15.29:0/3350785408 >> 172.21.15.29:0/3350785408 conn(0x7fe7a00cfb20 msgr2=0x7fe7a00cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 -- 172.21.15.29:0/3350785408 shutdown_connections 2024-04-15T00:01:44.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.710+0000 7fe7a5488640 1 -- 172.21.15.29:0/3350785408 wait complete. 2024-04-15T00:01:44.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.711+0000 7fe7a5488640 1 Processor -- start 2024-04-15T00:01:44.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.711+0000 7fe7a5488640 1 -- start start 2024-04-15T00:01:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe7a5488640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a00cc2f0 0x7fe7a014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe7a5488640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a00cc6d0 0x7fe7a014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe7a5488640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 0x7fe7a00c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe7a5488640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a006c420 con 0x7fe7a0163c50 2024-04-15T00:01:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe7a5488640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a015b200 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe7a5488640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a006c700 con 0x7fe7a00cc2f0 2024-04-15T00:01:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.712+0000 7fe79f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 0x7fe7a00c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.713+0000 7fe79effd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a00cc2f0 0x7fe7a014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.713+0000 7fe79e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a00cc6d0 0x7fe7a014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.713+0000 7fe79f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 0x7fe7a00c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47050/0 (socket says 172.21.15.29:47050) 2024-04-15T00:01:44.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.713+0000 7fe79f7fe640 1 -- 172.21.15.29:0/3235393126 learned_addr learned my addr 172.21.15.29:0/3235393126 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:44.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.716+0000 7fe79e7fc640 1 -- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a00cc2f0 msgr2=0x7fe7a014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.716+0000 7fe79e7fc640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a00cc2f0 0x7fe7a014c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.716+0000 7fe79e7fc640 1 -- 172.21.15.29:0/3235393126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 msgr2=0x7fe7a00c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:44.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.717+0000 7fe79e7fc640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 0x7fe7a00c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:44.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.717+0000 7fe79e7fc640 1 -- 172.21.15.29:0/3235393126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a00c7830 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.717+0000 7fe79f7fe640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 0x7fe7a00c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:44.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.717+0000 7fe79effd640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a00cc2f0 0x7fe7a014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:44.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.719+0000 7fe79e7fc640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a00cc6d0 0x7fe7a014caf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c3c0 tx=0x7fe78800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:44.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.723+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788017070 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.723+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7880052f0 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.723+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788003830 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.723+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a015a1a0 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.723+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a0159ec0 con 0x7fe7a00cc6d0 2024-04-15T00:01:44.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:44.724+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a004f540 con 0x7fe7a00cc6d0 2024-04-15T00:01:45.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.002+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe78801a070 con 0x7fe7a00cc6d0 2024-04-15T00:01:45.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.002+0000 7fe7977fe640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe78006ba10 0x7fe78006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.002+0000 7fe79effd640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe78006ba10 0x7fe78006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.003+0000 7fe79effd640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe78006ba10 0x7fe78006ded0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe798000f60 tx=0x7fe798007d70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:45.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.006+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe788013e10 con 0x7fe7a00cc6d0 2024-04-15T00:01:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.016+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe788021080 con 0x7fe7a00cc6d0 2024-04-15T00:01:45.134 INFO:tasks.ceph.mds.f.smithi037.stderr:2024-04-15T00:01:45.125+0000 f7f1640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-15T00:01:45.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.195+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7a014d030 con 0x7fe78006ba10 2024-04-15T00:01:45.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.204+0000 7fe7977fe640 1 -- 172.21.15.29:0/3235393126 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7fe7a014d030 con 0x7fe78006ba10 2024-04-15T00:01:45.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe78006ba10 msgr2=0x7fe78006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe78006ba10 0x7fe78006ded0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe798000f60 tx=0x7fe798007d70 comp rx=0 tx=0).stop 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a00cc6d0 msgr2=0x7fe7a014caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a00cc6d0 0x7fe7a014caf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c3c0 tx=0x7fe78800c880 comp rx=0 tx=0).stop 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 shutdown_connections 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe78006ba10 0x7fe78006ded0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a0163c50 0x7fe7a00c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a00cc6d0 0x7fe7a014caf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.207+0000 7fe7a5488640 1 --2- 172.21.15.29:0/3235393126 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe7a00cc2f0 0x7fe7a014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.208+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 >> 172.21.15.29:0/3235393126 conn(0x7fe7a00cfb20 msgr2=0x7fe7a006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:45.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.208+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 shutdown_connections 2024-04-15T00:01:45.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.208+0000 7fe7a5488640 1 -- 172.21.15.29:0/3235393126 wait complete. 2024-04-15T00:01:45.225 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-15T00:01:45.100357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235224,"kb_used_data":2404,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739496,"statfs":{"total":773094113280,"available":772853243904,"internally_reserved":0,"allocated":2461696,"data_stored":2096894,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089360+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T00:01:20.089360+0000","last_peered":"2024-04-15T00:01:20.089360+0000","last_clean":"2024-04-15T00:01:20.089360+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T00:01:20.089360+0000","last_undegraded":"2024-04-15T00:01:20.089360+0000","last_fullsized":"2024-04-15T00:01:20.089360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752663+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T00:01:20.752663+0000","last_peered":"2024-04-15T00:01:20.752663+0000","last_clean":"2024-04-15T00:01:20.752663+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T00:01:20.752663+0000","last_undegraded":"2024-04-15T00:01:20.752663+0000","last_fullsized":"2024-04-15T00:01:20.752663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752282+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T00:01:20.752282+0000","last_peered":"2024-04-15T00:01:20.752282+0000","last_clean":"2024-04-15T00:01:20.752282+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T00:01:20.752282+0000","last_undegraded":"2024-04-15T00:01:20.752282+0000","last_fullsized":"2024-04-15T00:01:20.752282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752754+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T00:01:20.752754+0000","last_peered":"2024-04-15T00:01:20.752754+0000","last_clean":"2024-04-15T00:01:20.752754+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T00:01:20.752754+0000","last_undegraded":"2024-04-15T00:01:20.752754+0000","last_fullsized":"2024-04-15T00:01:20.752754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089103+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T00:01:20.089103+0000","last_peered":"2024-04-15T00:01:20.089103+0000","last_clean":"2024-04-15T00:01:20.089103+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T00:01:20.089103+0000","last_undegraded":"2024-04-15T00:01:20.089103+0000","last_fullsized":"2024-04-15T00:01:20.089103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166304+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T00:01:20.166304+0000","last_peered":"2024-04-15T00:01:20.166304+0000","last_clean":"2024-04-15T00:01:20.166304+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:20.166304+0000","last_undegraded":"2024-04-15T00:01:20.166304+0000","last_fullsized":"2024-04-15T00:01:20.166304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753020+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T00:01:20.753020+0000","last_peered":"2024-04-15T00:01:20.753020+0000","last_clean":"2024-04-15T00:01:20.753020+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T00:01:20.753020+0000","last_undegraded":"2024-04-15T00:01:20.753020+0000","last_fullsized":"2024-04-15T00:01:20.753020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752445+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T00:01:20.752445+0000","last_peered":"2024-04-15T00:01:20.752445+0000","last_clean":"2024-04-15T00:01:20.752445+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T00:01:20.752445+0000","last_undegraded":"2024-04-15T00:01:20.752445+0000","last_fullsized":"2024-04-15T00:01:20.752445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166778+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T00:01:20.166778+0000","last_peered":"2024-04-15T00:01:20.166778+0000","last_clean":"2024-04-15T00:01:20.166778+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T00:01:20.166778+0000","last_undegraded":"2024-04-15T00:01:20.166778+0000","last_fullsized":"2024-04-15T00:01:20.166778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752631+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T00:01:20.752631+0000","last_peered":"2024-04-15T00:01:20.752631+0000","last_clean":"2024-04-15T00:01:20.752631+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T00:01:20.752631+0000","last_undegraded":"2024-04-15T00:01:20.752631+0000","last_fullsized":"2024-04-15T00:01:20.752631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752755+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T00:01:20.752755+0000","last_peered":"2024-04-15T00:01:20.752755+0000","last_clean":"2024-04-15T00:01:20.752755+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T00:01:20.752755+0000","last_undegraded":"2024-04-15T00:01:20.752755+0000","last_fullsized":"2024-04-15T00:01:20.752755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166639+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T00:01:20.166639+0000","last_peered":"2024-04-15T00:01:20.166639+0000","last_clean":"2024-04-15T00:01:20.166639+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T00:01:20.166639+0000","last_undegraded":"2024-04-15T00:01:20.166639+0000","last_fullsized":"2024-04-15T00:01:20.166639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106577+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T00:01:20.106577+0000","last_peered":"2024-04-15T00:01:20.106577+0000","last_clean":"2024-04-15T00:01:20.106577+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T00:01:20.106577+0000","last_undegraded":"2024-04-15T00:01:20.106577+0000","last_fullsized":"2024-04-15T00:01:20.106577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752629+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T00:01:20.752629+0000","last_peered":"2024-04-15T00:01:20.752629+0000","last_clean":"2024-04-15T00:01:20.752629+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T00:01:20.752629+0000","last_undegraded":"2024-04-15T00:01:20.752629+0000","last_fullsized":"2024-04-15T00:01:20.752629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.167070+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T00:01:20.167070+0000","last_peered":"2024-04-15T00:01:20.167070+0000","last_clean":"2024-04-15T00:01:20.167070+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T00:01:20.167070+0000","last_undegraded":"2024-04-15T00:01:20.167070+0000","last_fullsized":"2024-04-15T00:01:20.167070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752524+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T00:01:20.752524+0000","last_peered":"2024-04-15T00:01:20.752524+0000","last_clean":"2024-04-15T00:01:20.752524+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T00:01:20.752524+0000","last_undegraded":"2024-04-15T00:01:20.752524+0000","last_fullsized":"2024-04-15T00:01:20.752524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095346+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T00:01:20.095346+0000","last_peered":"2024-04-15T00:01:20.095346+0000","last_clean":"2024-04-15T00:01:20.095346+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T00:01:20.095346+0000","last_undegraded":"2024-04-15T00:01:20.095346+0000","last_fullsized":"2024-04-15T00:01:20.095346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166463+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T00:01:20.166463+0000","last_peered":"2024-04-15T00:01:20.166463+0000","last_clean":"2024-04-15T00:01:20.166463+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T00:01:20.166463+0000","last_undegraded":"2024-04-15T00:01:20.166463+0000","last_fullsized":"2024-04-15T00:01:20.166463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752180+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T00:01:20.752180+0000","last_peered":"2024-04-15T00:01:20.752180+0000","last_clean":"2024-04-15T00:01:20.752180+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T00:01:20.752180+0000","last_undegraded":"2024-04-15T00:01:20.752180+0000","last_fullsized":"2024-04-15T00:01:20.752180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094976+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T00:01:20.094976+0000","last_peered":"2024-04-15T00:01:20.094976+0000","last_clean":"2024-04-15T00:01:20.094976+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T00:01:20.094976+0000","last_undegraded":"2024-04-15T00:01:20.094976+0000","last_fullsized":"2024-04-15T00:01:20.094976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095541+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T00:01:20.095541+0000","last_peered":"2024-04-15T00:01:20.095541+0000","last_clean":"2024-04-15T00:01:20.095541+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T00:01:20.095541+0000","last_undegraded":"2024-04-15T00:01:20.095541+0000","last_fullsized":"2024-04-15T00:01:20.095541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166348+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T00:01:20.166348+0000","last_peered":"2024-04-15T00:01:20.166348+0000","last_clean":"2024-04-15T00:01:20.166348+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T00:01:20.166348+0000","last_undegraded":"2024-04-15T00:01:20.166348+0000","last_fullsized":"2024-04-15T00:01:20.166348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751928+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T00:01:20.751928+0000","last_peered":"2024-04-15T00:01:20.751928+0000","last_clean":"2024-04-15T00:01:20.751928+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T00:01:20.751928+0000","last_undegraded":"2024-04-15T00:01:20.751928+0000","last_fullsized":"2024-04-15T00:01:20.751928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166454+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T00:01:20.166454+0000","last_peered":"2024-04-15T00:01:20.166454+0000","last_clean":"2024-04-15T00:01:20.166454+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T00:01:20.166454+0000","last_undegraded":"2024-04-15T00:01:20.166454+0000","last_fullsized":"2024-04-15T00:01:20.166454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089457+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T00:01:20.089457+0000","last_peered":"2024-04-15T00:01:20.089457+0000","last_clean":"2024-04-15T00:01:20.089457+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T00:01:20.089457+0000","last_undegraded":"2024-04-15T00:01:20.089457+0000","last_fullsized":"2024-04-15T00:01:20.089457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.107250+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T00:01:20.107250+0000","last_peered":"2024-04-15T00:01:20.107250+0000","last_clean":"2024-04-15T00:01:20.107250+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T00:01:20.107250+0000","last_undegraded":"2024-04-15T00:01:20.107250+0000","last_fullsized":"2024-04-15T00:01:20.107250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166254+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T00:01:20.166254+0000","last_peered":"2024-04-15T00:01:20.166254+0000","last_clean":"2024-04-15T00:01:20.166254+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T00:01:20.166254+0000","last_undegraded":"2024-04-15T00:01:20.166254+0000","last_fullsized":"2024-04-15T00:01:20.166254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752897+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T00:01:20.752897+0000","last_peered":"2024-04-15T00:01:20.752897+0000","last_clean":"2024-04-15T00:01:20.752897+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T00:01:20.752897+0000","last_undegraded":"2024-04-15T00:01:20.752897+0000","last_fullsized":"2024-04-15T00:01:20.752897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095522+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T00:01:20.095522+0000","last_peered":"2024-04-15T00:01:20.095522+0000","last_clean":"2024-04-15T00:01:20.095522+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T00:01:20.095522+0000","last_undegraded":"2024-04-15T00:01:20.095522+0000","last_fullsized":"2024-04-15T00:01:20.095522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751753+0000","last_change":"2024-04-15T00:01:18.977928+0000","last_active":"2024-04-15T00:01:20.751753+0000","last_peered":"2024-04-15T00:01:20.751753+0000","last_clean":"2024-04-15T00:01:20.751753+0000","last_became_active":"2024-04-15T00:01:18.977604+0000","last_became_peered":"2024-04-15T00:01:18.977604+0000","last_unstale":"2024-04-15T00:01:20.751753+0000","last_undegraded":"2024-04-15T00:01:20.751753+0000","last_fullsized":"2024-04-15T00:01:20.751753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:06:14.223038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095175+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T00:01:20.095175+0000","last_peered":"2024-04-15T00:01:20.095175+0000","last_clean":"2024-04-15T00:01:20.095175+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T00:01:20.095175+0000","last_undegraded":"2024-04-15T00:01:20.095175+0000","last_fullsized":"2024-04-15T00:01:20.095175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753099+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T00:01:20.753099+0000","last_peered":"2024-04-15T00:01:20.753099+0000","last_clean":"2024-04-15T00:01:20.753099+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T00:01:20.753099+0000","last_undegraded":"2024-04-15T00:01:20.753099+0000","last_fullsized":"2024-04-15T00:01:20.753099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089045+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T00:01:20.089045+0000","last_peered":"2024-04-15T00:01:20.089045+0000","last_clean":"2024-04-15T00:01:20.089045+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T00:01:20.089045+0000","last_undegraded":"2024-04-15T00:01:20.089045+0000","last_fullsized":"2024-04-15T00:01:20.089045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752847+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T00:01:20.752847+0000","last_peered":"2024-04-15T00:01:20.752847+0000","last_clean":"2024-04-15T00:01:20.752847+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T00:01:20.752847+0000","last_undegraded":"2024-04-15T00:01:20.752847+0000","last_fullsized":"2024-04-15T00:01:20.752847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095287+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T00:01:20.095287+0000","last_peered":"2024-04-15T00:01:20.095287+0000","last_clean":"2024-04-15T00:01:20.095287+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T00:01:20.095287+0000","last_undegraded":"2024-04-15T00:01:20.095287+0000","last_fullsized":"2024-04-15T00:01:20.095287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094979+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T00:01:20.094979+0000","last_peered":"2024-04-15T00:01:20.094979+0000","last_clean":"2024-04-15T00:01:20.094979+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T00:01:20.094979+0000","last_undegraded":"2024-04-15T00:01:20.094979+0000","last_fullsized":"2024-04-15T00:01:20.094979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166647+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T00:01:20.166647+0000","last_peered":"2024-04-15T00:01:20.166647+0000","last_clean":"2024-04-15T00:01:20.166647+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T00:01:20.166647+0000","last_undegraded":"2024-04-15T00:01:20.166647+0000","last_fullsized":"2024-04-15T00:01:20.166647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752116+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T00:01:20.752116+0000","last_peered":"2024-04-15T00:01:20.752116+0000","last_clean":"2024-04-15T00:01:20.752116+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T00:01:20.752116+0000","last_undegraded":"2024-04-15T00:01:20.752116+0000","last_fullsized":"2024-04-15T00:01:20.752116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095283+0000","last_change":"2024-04-15T00:01:18.984989+0000","last_active":"2024-04-15T00:01:20.095283+0000","last_peered":"2024-04-15T00:01:20.095283+0000","last_clean":"2024-04-15T00:01:20.095283+0000","last_became_active":"2024-04-15T00:01:18.984606+0000","last_became_peered":"2024-04-15T00:01:18.984606+0000","last_unstale":"2024-04-15T00:01:20.095283+0000","last_undegraded":"2024-04-15T00:01:20.095283+0000","last_fullsized":"2024-04-15T00:01:20.095283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:53.212218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094833+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T00:01:20.094833+0000","last_peered":"2024-04-15T00:01:20.094833+0000","last_clean":"2024-04-15T00:01:20.094833+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T00:01:20.094833+0000","last_undegraded":"2024-04-15T00:01:20.094833+0000","last_fullsized":"2024-04-15T00:01:20.094833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751760+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T00:01:20.751760+0000","last_peered":"2024-04-15T00:01:20.751760+0000","last_clean":"2024-04-15T00:01:20.751760+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T00:01:20.751760+0000","last_undegraded":"2024-04-15T00:01:20.751760+0000","last_fullsized":"2024-04-15T00:01:20.751760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095578+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T00:01:20.095578+0000","last_peered":"2024-04-15T00:01:20.095578+0000","last_clean":"2024-04-15T00:01:20.095578+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T00:01:20.095578+0000","last_undegraded":"2024-04-15T00:01:20.095578+0000","last_fullsized":"2024-04-15T00:01:20.095578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.088844+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T00:01:20.088844+0000","last_peered":"2024-04-15T00:01:20.088844+0000","last_clean":"2024-04-15T00:01:20.088844+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T00:01:20.088844+0000","last_undegraded":"2024-04-15T00:01:20.088844+0000","last_fullsized":"2024-04-15T00:01:20.088844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752030+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T00:01:20.752030+0000","last_peered":"2024-04-15T00:01:20.752030+0000","last_clean":"2024-04-15T00:01:20.752030+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T00:01:20.752030+0000","last_undegraded":"2024-04-15T00:01:20.752030+0000","last_fullsized":"2024-04-15T00:01:20.752030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089313+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T00:01:20.089313+0000","last_peered":"2024-04-15T00:01:20.089313+0000","last_clean":"2024-04-15T00:01:20.089313+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T00:01:20.089313+0000","last_undegraded":"2024-04-15T00:01:20.089313+0000","last_fullsized":"2024-04-15T00:01:20.089313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752323+0000","last_change":"2024-04-15T00:01:12.992789+0000","last_active":"2024-04-15T00:01:20.752323+0000","last_peered":"2024-04-15T00:01:20.752323+0000","last_clean":"2024-04-15T00:01:20.752323+0000","last_became_active":"2024-04-15T00:01:12.992466+0000","last_became_peered":"2024-04-15T00:01:12.992466+0000","last_unstale":"2024-04-15T00:01:20.752323+0000","last_undegraded":"2024-04-15T00:01:20.752323+0000","last_fullsized":"2024-04-15T00:01:20.752323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752843+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T00:01:20.752843+0000","last_peered":"2024-04-15T00:01:20.752843+0000","last_clean":"2024-04-15T00:01:20.752843+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T00:01:20.752843+0000","last_undegraded":"2024-04-15T00:01:20.752843+0000","last_fullsized":"2024-04-15T00:01:20.752843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752122+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T00:01:20.752122+0000","last_peered":"2024-04-15T00:01:20.752122+0000","last_clean":"2024-04-15T00:01:20.752122+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T00:01:20.752122+0000","last_undegraded":"2024-04-15T00:01:20.752122+0000","last_fullsized":"2024-04-15T00:01:20.752122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106661+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T00:01:20.106661+0000","last_peered":"2024-04-15T00:01:20.106661+0000","last_clean":"2024-04-15T00:01:20.106661+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T00:01:20.106661+0000","last_undegraded":"2024-04-15T00:01:20.106661+0000","last_fullsized":"2024-04-15T00:01:20.106661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752923+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T00:01:20.752923+0000","last_peered":"2024-04-15T00:01:20.752923+0000","last_clean":"2024-04-15T00:01:20.752923+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T00:01:20.752923+0000","last_undegraded":"2024-04-15T00:01:20.752923+0000","last_fullsized":"2024-04-15T00:01:20.752923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752042+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T00:01:20.752042+0000","last_peered":"2024-04-15T00:01:20.752042+0000","last_clean":"2024-04-15T00:01:20.752042+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T00:01:20.752042+0000","last_undegraded":"2024-04-15T00:01:20.752042+0000","last_fullsized":"2024-04-15T00:01:20.752042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106605+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T00:01:20.106605+0000","last_peered":"2024-04-15T00:01:20.106605+0000","last_clean":"2024-04-15T00:01:20.106605+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T00:01:20.106605+0000","last_undegraded":"2024-04-15T00:01:20.106605+0000","last_fullsized":"2024-04-15T00:01:20.106605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752538+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T00:01:20.752538+0000","last_peered":"2024-04-15T00:01:20.752538+0000","last_clean":"2024-04-15T00:01:20.752538+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T00:01:20.752538+0000","last_undegraded":"2024-04-15T00:01:20.752538+0000","last_fullsized":"2024-04-15T00:01:20.752538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095333+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T00:01:20.095333+0000","last_peered":"2024-04-15T00:01:20.095333+0000","last_clean":"2024-04-15T00:01:20.095333+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T00:01:20.095333+0000","last_undegraded":"2024-04-15T00:01:20.095333+0000","last_fullsized":"2024-04-15T00:01:20.095333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089316+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T00:01:20.089316+0000","last_peered":"2024-04-15T00:01:20.089316+0000","last_clean":"2024-04-15T00:01:20.089316+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T00:01:20.089316+0000","last_undegraded":"2024-04-15T00:01:20.089316+0000","last_fullsized":"2024-04-15T00:01:20.089316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753365+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T00:01:20.753365+0000","last_peered":"2024-04-15T00:01:20.753365+0000","last_clean":"2024-04-15T00:01:20.753365+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T00:01:20.753365+0000","last_undegraded":"2024-04-15T00:01:20.753365+0000","last_fullsized":"2024-04-15T00:01:20.753365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752224+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T00:01:20.752224+0000","last_peered":"2024-04-15T00:01:20.752224+0000","last_clean":"2024-04-15T00:01:20.752224+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T00:01:20.752224+0000","last_undegraded":"2024-04-15T00:01:20.752224+0000","last_fullsized":"2024-04-15T00:01:20.752224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751576+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T00:01:20.751576+0000","last_peered":"2024-04-15T00:01:20.751576+0000","last_clean":"2024-04-15T00:01:20.751576+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T00:01:20.751576+0000","last_undegraded":"2024-04-15T00:01:20.751576+0000","last_fullsized":"2024-04-15T00:01:20.751576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753252+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T00:01:20.753252+0000","last_peered":"2024-04-15T00:01:20.753252+0000","last_clean":"2024-04-15T00:01:20.753252+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T00:01:20.753252+0000","last_undegraded":"2024-04-15T00:01:20.753252+0000","last_fullsized":"2024-04-15T00:01:20.753252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.167096+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T00:01:20.167096+0000","last_peered":"2024-04-15T00:01:20.167096+0000","last_clean":"2024-04-15T00:01:20.167096+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T00:01:20.167096+0000","last_undegraded":"2024-04-15T00:01:20.167096+0000","last_fullsized":"2024-04-15T00:01:20.167096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166234+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T00:01:20.166234+0000","last_peered":"2024-04-15T00:01:20.166234+0000","last_clean":"2024-04-15T00:01:20.166234+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T00:01:20.166234+0000","last_undegraded":"2024-04-15T00:01:20.166234+0000","last_fullsized":"2024-04-15T00:01:20.166234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752167+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T00:01:20.752167+0000","last_peered":"2024-04-15T00:01:20.752167+0000","last_clean":"2024-04-15T00:01:20.752167+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T00:01:20.752167+0000","last_undegraded":"2024-04-15T00:01:20.752167+0000","last_fullsized":"2024-04-15T00:01:20.752167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751525+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T00:01:20.751525+0000","last_peered":"2024-04-15T00:01:20.751525+0000","last_clean":"2024-04-15T00:01:20.751525+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T00:01:20.751525+0000","last_undegraded":"2024-04-15T00:01:20.751525+0000","last_fullsized":"2024-04-15T00:01:20.751525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089468+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T00:01:20.089468+0000","last_peered":"2024-04-15T00:01:20.089468+0000","last_clean":"2024-04-15T00:01:20.089468+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T00:01:20.089468+0000","last_undegraded":"2024-04-15T00:01:20.089468+0000","last_fullsized":"2024-04-15T00:01:20.089468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106475+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T00:01:20.106475+0000","last_peered":"2024-04-15T00:01:20.106475+0000","last_clean":"2024-04-15T00:01:20.106475+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T00:01:20.106475+0000","last_undegraded":"2024-04-15T00:01:20.106475+0000","last_fullsized":"2024-04-15T00:01:20.106475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106593+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T00:01:20.106593+0000","last_peered":"2024-04-15T00:01:20.106593+0000","last_clean":"2024-04-15T00:01:20.106593+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T00:01:20.106593+0000","last_undegraded":"2024-04-15T00:01:20.106593+0000","last_fullsized":"2024-04-15T00:01:20.106593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752741+0000","last_change":"2024-04-15T00:01:18.980711+0000","last_active":"2024-04-15T00:01:20.752741+0000","last_peered":"2024-04-15T00:01:20.752741+0000","last_clean":"2024-04-15T00:01:20.752741+0000","last_became_active":"2024-04-15T00:01:18.979809+0000","last_became_peered":"2024-04-15T00:01:18.979809+0000","last_unstale":"2024-04-15T00:01:20.752741+0000","last_undegraded":"2024-04-15T00:01:20.752741+0000","last_fullsized":"2024-04-15T00:01:20.752741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:50:51.590359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752536+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T00:01:20.752536+0000","last_peered":"2024-04-15T00:01:20.752536+0000","last_clean":"2024-04-15T00:01:20.752536+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T00:01:20.752536+0000","last_undegraded":"2024-04-15T00:01:20.752536+0000","last_fullsized":"2024-04-15T00:01:20.752536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752036+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T00:01:20.752036+0000","last_peered":"2024-04-15T00:01:20.752036+0000","last_clean":"2024-04-15T00:01:20.752036+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T00:01:20.752036+0000","last_undegraded":"2024-04-15T00:01:20.752036+0000","last_fullsized":"2024-04-15T00:01:20.752036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752656+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T00:01:20.752656+0000","last_peered":"2024-04-15T00:01:20.752656+0000","last_clean":"2024-04-15T00:01:20.752656+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T00:01:20.752656+0000","last_undegraded":"2024-04-15T00:01:20.752656+0000","last_fullsized":"2024-04-15T00:01:20.752656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089101+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T00:01:20.089101+0000","last_peered":"2024-04-15T00:01:20.089101+0000","last_clean":"2024-04-15T00:01:20.089101+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T00:01:20.089101+0000","last_undegraded":"2024-04-15T00:01:20.089101+0000","last_fullsized":"2024-04-15T00:01:20.089101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:41.905778+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T00:01:41.905778+0000","last_peered":"2024-04-15T00:01:41.905778+0000","last_clean":"2024-04-15T00:01:41.905778+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T00:01:41.905778+0000","last_undegraded":"2024-04-15T00:01:41.905778+0000","last_fullsized":"2024-04-15T00:01:41.905778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752802+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T00:01:20.752802+0000","last_peered":"2024-04-15T00:01:20.752802+0000","last_clean":"2024-04-15T00:01:20.752802+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T00:01:20.752802+0000","last_undegraded":"2024-04-15T00:01:20.752802+0000","last_fullsized":"2024-04-15T00:01:20.752802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752820+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T00:01:20.752820+0000","last_peered":"2024-04-15T00:01:20.752820+0000","last_clean":"2024-04-15T00:01:20.752820+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T00:01:20.752820+0000","last_undegraded":"2024-04-15T00:01:20.752820+0000","last_fullsized":"2024-04-15T00:01:20.752820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:28.729077+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T00:01:28.729077+0000","last_peered":"2024-04-15T00:01:28.729077+0000","last_clean":"2024-04-15T00:01:28.729077+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T00:01:28.729077+0000","last_undegraded":"2024-04-15T00:01:28.729077+0000","last_fullsized":"2024-04-15T00:01:28.729077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095145+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T00:01:20.095145+0000","last_peered":"2024-04-15T00:01:20.095145+0000","last_clean":"2024-04-15T00:01:20.095145+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T00:01:20.095145+0000","last_undegraded":"2024-04-15T00:01:20.095145+0000","last_fullsized":"2024-04-15T00:01:20.095145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166522+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T00:01:20.166522+0000","last_peered":"2024-04-15T00:01:20.166522+0000","last_clean":"2024-04-15T00:01:20.166522+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T00:01:20.166522+0000","last_undegraded":"2024-04-15T00:01:20.166522+0000","last_fullsized":"2024-04-15T00:01:20.166522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095261+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T00:01:20.095261+0000","last_peered":"2024-04-15T00:01:20.095261+0000","last_clean":"2024-04-15T00:01:20.095261+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T00:01:20.095261+0000","last_undegraded":"2024-04-15T00:01:20.095261+0000","last_fullsized":"2024-04-15T00:01:20.095261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166907+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T00:01:20.166907+0000","last_peered":"2024-04-15T00:01:20.166907+0000","last_clean":"2024-04-15T00:01:20.166907+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T00:01:20.166907+0000","last_undegraded":"2024-04-15T00:01:20.166907+0000","last_fullsized":"2024-04-15T00:01:20.166907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089239+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T00:01:20.089239+0000","last_peered":"2024-04-15T00:01:20.089239+0000","last_clean":"2024-04-15T00:01:20.089239+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T00:01:20.089239+0000","last_undegraded":"2024-04-15T00:01:20.089239+0000","last_fullsized":"2024-04-15T00:01:20.089239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752303+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T00:01:20.752303+0000","last_peered":"2024-04-15T00:01:20.752303+0000","last_clean":"2024-04-15T00:01:20.752303+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T00:01:20.752303+0000","last_undegraded":"2024-04-15T00:01:20.752303+0000","last_fullsized":"2024-04-15T00:01:20.752303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752145+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T00:01:20.752145+0000","last_peered":"2024-04-15T00:01:20.752145+0000","last_clean":"2024-04-15T00:01:20.752145+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T00:01:20.752145+0000","last_undegraded":"2024-04-15T00:01:20.752145+0000","last_fullsized":"2024-04-15T00:01:20.752145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752203+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T00:01:20.752203+0000","last_peered":"2024-04-15T00:01:20.752203+0000","last_clean":"2024-04-15T00:01:20.752203+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T00:01:20.752203+0000","last_undegraded":"2024-04-15T00:01:20.752203+0000","last_fullsized":"2024-04-15T00:01:20.752203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.107198+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T00:01:20.107198+0000","last_peered":"2024-04-15T00:01:20.107198+0000","last_clean":"2024-04-15T00:01:20.107198+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T00:01:20.107198+0000","last_undegraded":"2024-04-15T00:01:20.107198+0000","last_fullsized":"2024-04-15T00:01:20.107198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752301+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T00:01:20.752301+0000","last_peered":"2024-04-15T00:01:20.752301+0000","last_clean":"2024-04-15T00:01:20.752301+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T00:01:20.752301+0000","last_undegraded":"2024-04-15T00:01:20.752301+0000","last_fullsized":"2024-04-15T00:01:20.752301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089131+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T00:01:20.089131+0000","last_peered":"2024-04-15T00:01:20.089131+0000","last_clean":"2024-04-15T00:01:20.089131+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T00:01:20.089131+0000","last_undegraded":"2024-04-15T00:01:20.089131+0000","last_fullsized":"2024-04-15T00:01:20.089131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094782+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T00:01:20.094782+0000","last_peered":"2024-04-15T00:01:20.094782+0000","last_clean":"2024-04-15T00:01:20.094782+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T00:01:20.094782+0000","last_undegraded":"2024-04-15T00:01:20.094782+0000","last_fullsized":"2024-04-15T00:01:20.094782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751713+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T00:01:20.751713+0000","last_peered":"2024-04-15T00:01:20.751713+0000","last_clean":"2024-04-15T00:01:20.751713+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T00:01:20.751713+0000","last_undegraded":"2024-04-15T00:01:20.751713+0000","last_fullsized":"2024-04-15T00:01:20.751713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.107148+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T00:01:20.107148+0000","last_peered":"2024-04-15T00:01:20.107148+0000","last_clean":"2024-04-15T00:01:20.107148+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:20.107148+0000","last_undegraded":"2024-04-15T00:01:20.107148+0000","last_fullsized":"2024-04-15T00:01:20.107148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752084+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T00:01:20.752084+0000","last_peered":"2024-04-15T00:01:20.752084+0000","last_clean":"2024-04-15T00:01:20.752084+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T00:01:20.752084+0000","last_undegraded":"2024-04-15T00:01:20.752084+0000","last_fullsized":"2024-04-15T00:01:20.752084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752358+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T00:01:20.752358+0000","last_peered":"2024-04-15T00:01:20.752358+0000","last_clean":"2024-04-15T00:01:20.752358+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T00:01:20.752358+0000","last_undegraded":"2024-04-15T00:01:20.752358+0000","last_fullsized":"2024-04-15T00:01:20.752358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106676+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T00:01:20.106676+0000","last_peered":"2024-04-15T00:01:20.106676+0000","last_clean":"2024-04-15T00:01:20.106676+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T00:01:20.106676+0000","last_undegraded":"2024-04-15T00:01:20.106676+0000","last_fullsized":"2024-04-15T00:01:20.106676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089380+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T00:01:20.089380+0000","last_peered":"2024-04-15T00:01:20.089380+0000","last_clean":"2024-04-15T00:01:20.089380+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T00:01:20.089380+0000","last_undegraded":"2024-04-15T00:01:20.089380+0000","last_fullsized":"2024-04-15T00:01:20.089380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751916+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T00:01:20.751916+0000","last_peered":"2024-04-15T00:01:20.751916+0000","last_clean":"2024-04-15T00:01:20.751916+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T00:01:20.751916+0000","last_undegraded":"2024-04-15T00:01:20.751916+0000","last_fullsized":"2024-04-15T00:01:20.751916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752686+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T00:01:20.752686+0000","last_peered":"2024-04-15T00:01:20.752686+0000","last_clean":"2024-04-15T00:01:20.752686+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T00:01:20.752686+0000","last_undegraded":"2024-04-15T00:01:20.752686+0000","last_fullsized":"2024-04-15T00:01:20.752686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166393+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T00:01:20.166393+0000","last_peered":"2024-04-15T00:01:20.166393+0000","last_clean":"2024-04-15T00:01:20.166393+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T00:01:20.166393+0000","last_undegraded":"2024-04-15T00:01:20.166393+0000","last_fullsized":"2024-04-15T00:01:20.166393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752986+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T00:01:20.752986+0000","last_peered":"2024-04-15T00:01:20.752986+0000","last_clean":"2024-04-15T00:01:20.752986+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T00:01:20.752986+0000","last_undegraded":"2024-04-15T00:01:20.752986+0000","last_fullsized":"2024-04-15T00:01:20.752986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106386+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T00:01:20.106386+0000","last_peered":"2024-04-15T00:01:20.106386+0000","last_clean":"2024-04-15T00:01:20.106386+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T00:01:20.106386+0000","last_undegraded":"2024-04-15T00:01:20.106386+0000","last_fullsized":"2024-04-15T00:01:20.106386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751671+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T00:01:20.751671+0000","last_peered":"2024-04-15T00:01:20.751671+0000","last_clean":"2024-04-15T00:01:20.751671+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T00:01:20.751671+0000","last_undegraded":"2024-04-15T00:01:20.751671+0000","last_fullsized":"2024-04-15T00:01:20.751671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752015+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T00:01:20.752015+0000","last_peered":"2024-04-15T00:01:20.752015+0000","last_clean":"2024-04-15T00:01:20.752015+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T00:01:20.752015+0000","last_undegraded":"2024-04-15T00:01:20.752015+0000","last_fullsized":"2024-04-15T00:01:20.752015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089286+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T00:01:20.089286+0000","last_peered":"2024-04-15T00:01:20.089286+0000","last_clean":"2024-04-15T00:01:20.089286+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T00:01:20.089286+0000","last_undegraded":"2024-04-15T00:01:20.089286+0000","last_fullsized":"2024-04-15T00:01:20.089286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752825+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T00:01:20.752825+0000","last_peered":"2024-04-15T00:01:20.752825+0000","last_clean":"2024-04-15T00:01:20.752825+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T00:01:20.752825+0000","last_undegraded":"2024-04-15T00:01:20.752825+0000","last_fullsized":"2024-04-15T00:01:20.752825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095073+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T00:01:20.095073+0000","last_peered":"2024-04-15T00:01:20.095073+0000","last_clean":"2024-04-15T00:01:20.095073+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T00:01:20.095073+0000","last_undegraded":"2024-04-15T00:01:20.095073+0000","last_fullsized":"2024-04-15T00:01:20.095073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106995+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T00:01:20.106995+0000","last_peered":"2024-04-15T00:01:20.106995+0000","last_clean":"2024-04-15T00:01:20.106995+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T00:01:20.106995+0000","last_undegraded":"2024-04-15T00:01:20.106995+0000","last_fullsized":"2024-04-15T00:01:20.106995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752835+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T00:01:20.752835+0000","last_peered":"2024-04-15T00:01:20.752835+0000","last_clean":"2024-04-15T00:01:20.752835+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T00:01:20.752835+0000","last_undegraded":"2024-04-15T00:01:20.752835+0000","last_fullsized":"2024-04-15T00:01:20.752835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751894+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T00:01:20.751894+0000","last_peered":"2024-04-15T00:01:20.751894+0000","last_clean":"2024-04-15T00:01:20.751894+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T00:01:20.751894+0000","last_undegraded":"2024-04-15T00:01:20.751894+0000","last_fullsized":"2024-04-15T00:01:20.751894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752424+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T00:01:20.752424+0000","last_peered":"2024-04-15T00:01:20.752424+0000","last_clean":"2024-04-15T00:01:20.752424+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T00:01:20.752424+0000","last_undegraded":"2024-04-15T00:01:20.752424+0000","last_fullsized":"2024-04-15T00:01:20.752424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751940+0000","last_change":"2024-04-15T00:01:12.981274+0000","last_active":"2024-04-15T00:01:20.751940+0000","last_peered":"2024-04-15T00:01:20.751940+0000","last_clean":"2024-04-15T00:01:20.751940+0000","last_became_active":"2024-04-15T00:01:12.981018+0000","last_became_peered":"2024-04-15T00:01:12.981018+0000","last_unstale":"2024-04-15T00:01:20.751940+0000","last_undegraded":"2024-04-15T00:01:20.751940+0000","last_fullsized":"2024-04-15T00:01:20.751940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089188+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T00:01:20.089188+0000","last_peered":"2024-04-15T00:01:20.089188+0000","last_clean":"2024-04-15T00:01:20.089188+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T00:01:20.089188+0000","last_undegraded":"2024-04-15T00:01:20.089188+0000","last_fullsized":"2024-04-15T00:01:20.089188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106861+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T00:01:20.106861+0000","last_peered":"2024-04-15T00:01:20.106861+0000","last_clean":"2024-04-15T00:01:20.106861+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T00:01:20.106861+0000","last_undegraded":"2024-04-15T00:01:20.106861+0000","last_fullsized":"2024-04-15T00:01:20.106861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753040+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T00:01:20.753040+0000","last_peered":"2024-04-15T00:01:20.753040+0000","last_clean":"2024-04-15T00:01:20.753040+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T00:01:20.753040+0000","last_undegraded":"2024-04-15T00:01:20.753040+0000","last_fullsized":"2024-04-15T00:01:20.753040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752129+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T00:01:20.752129+0000","last_peered":"2024-04-15T00:01:20.752129+0000","last_clean":"2024-04-15T00:01:20.752129+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T00:01:20.752129+0000","last_undegraded":"2024-04-15T00:01:20.752129+0000","last_fullsized":"2024-04-15T00:01:20.752129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752173+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T00:01:20.752173+0000","last_peered":"2024-04-15T00:01:20.752173+0000","last_clean":"2024-04-15T00:01:20.752173+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T00:01:20.752173+0000","last_undegraded":"2024-04-15T00:01:20.752173+0000","last_fullsized":"2024-04-15T00:01:20.752173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751590+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T00:01:20.751590+0000","last_peered":"2024-04-15T00:01:20.751590+0000","last_clean":"2024-04-15T00:01:20.751590+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T00:01:20.751590+0000","last_undegraded":"2024-04-15T00:01:20.751590+0000","last_fullsized":"2024-04-15T00:01:20.751590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094876+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T00:01:20.094876+0000","last_peered":"2024-04-15T00:01:20.094876+0000","last_clean":"2024-04-15T00:01:20.094876+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T00:01:20.094876+0000","last_undegraded":"2024-04-15T00:01:20.094876+0000","last_fullsized":"2024-04-15T00:01:20.094876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089024+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T00:01:20.089024+0000","last_peered":"2024-04-15T00:01:20.089024+0000","last_clean":"2024-04-15T00:01:20.089024+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T00:01:20.089024+0000","last_undegraded":"2024-04-15T00:01:20.089024+0000","last_fullsized":"2024-04-15T00:01:20.089024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752604+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T00:01:20.752604+0000","last_peered":"2024-04-15T00:01:20.752604+0000","last_clean":"2024-04-15T00:01:20.752604+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T00:01:20.752604+0000","last_undegraded":"2024-04-15T00:01:20.752604+0000","last_fullsized":"2024-04-15T00:01:20.752604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166477+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T00:01:20.166477+0000","last_peered":"2024-04-15T00:01:20.166477+0000","last_clean":"2024-04-15T00:01:20.166477+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T00:01:20.166477+0000","last_undegraded":"2024-04-15T00:01:20.166477+0000","last_fullsized":"2024-04-15T00:01:20.166477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106722+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T00:01:20.106722+0000","last_peered":"2024-04-15T00:01:20.106722+0000","last_clean":"2024-04-15T00:01:20.106722+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T00:01:20.106722+0000","last_undegraded":"2024-04-15T00:01:20.106722+0000","last_fullsized":"2024-04-15T00:01:20.106722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106962+0000","last_change":"2024-04-15T00:01:12.981197+0000","last_active":"2024-04-15T00:01:20.106962+0000","last_peered":"2024-04-15T00:01:20.106962+0000","last_clean":"2024-04-15T00:01:20.106962+0000","last_became_active":"2024-04-15T00:01:12.980960+0000","last_became_peered":"2024-04-15T00:01:12.980960+0000","last_unstale":"2024-04-15T00:01:20.106962+0000","last_undegraded":"2024-04-15T00:01:20.106962+0000","last_fullsized":"2024-04-15T00:01:20.106962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753312+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T00:01:20.753312+0000","last_peered":"2024-04-15T00:01:20.753312+0000","last_clean":"2024-04-15T00:01:20.753312+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T00:01:20.753312+0000","last_undegraded":"2024-04-15T00:01:20.753312+0000","last_fullsized":"2024-04-15T00:01:20.753312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751912+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T00:01:20.751912+0000","last_peered":"2024-04-15T00:01:20.751912+0000","last_clean":"2024-04-15T00:01:20.751912+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T00:01:20.751912+0000","last_undegraded":"2024-04-15T00:01:20.751912+0000","last_fullsized":"2024-04-15T00:01:20.751912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752066+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T00:01:20.752066+0000","last_peered":"2024-04-15T00:01:20.752066+0000","last_clean":"2024-04-15T00:01:20.752066+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T00:01:20.752066+0000","last_undegraded":"2024-04-15T00:01:20.752066+0000","last_fullsized":"2024-04-15T00:01:20.752066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751913+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T00:01:20.751913+0000","last_peered":"2024-04-15T00:01:20.751913+0000","last_clean":"2024-04-15T00:01:20.751913+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T00:01:20.751913+0000","last_undegraded":"2024-04-15T00:01:20.751913+0000","last_fullsized":"2024-04-15T00:01:20.751913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752428+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T00:01:20.752428+0000","last_peered":"2024-04-15T00:01:20.752428+0000","last_clean":"2024-04-15T00:01:20.752428+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T00:01:20.752428+0000","last_undegraded":"2024-04-15T00:01:20.752428+0000","last_fullsized":"2024-04-15T00:01:20.752428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752439+0000","last_change":"2024-04-15T00:01:12.992197+0000","last_active":"2024-04-15T00:01:20.752439+0000","last_peered":"2024-04-15T00:01:20.752439+0000","last_clean":"2024-04-15T00:01:20.752439+0000","last_became_active":"2024-04-15T00:01:12.991917+0000","last_became_peered":"2024-04-15T00:01:12.991917+0000","last_unstale":"2024-04-15T00:01:20.752439+0000","last_undegraded":"2024-04-15T00:01:20.752439+0000","last_fullsized":"2024-04-15T00:01:20.752439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:42:41.040454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089001+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T00:01:20.089001+0000","last_peered":"2024-04-15T00:01:20.089001+0000","last_clean":"2024-04-15T00:01:20.089001+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T00:01:20.089001+0000","last_undegraded":"2024-04-15T00:01:20.089001+0000","last_fullsized":"2024-04-15T00:01:20.089001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095404+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T00:01:20.095404+0000","last_peered":"2024-04-15T00:01:20.095404+0000","last_clean":"2024-04-15T00:01:20.095404+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T00:01:20.095404+0000","last_undegraded":"2024-04-15T00:01:20.095404+0000","last_fullsized":"2024-04-15T00:01:20.095404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753239+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T00:01:20.753239+0000","last_peered":"2024-04-15T00:01:20.753239+0000","last_clean":"2024-04-15T00:01:20.753239+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T00:01:20.753239+0000","last_undegraded":"2024-04-15T00:01:20.753239+0000","last_fullsized":"2024-04-15T00:01:20.753239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":9302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":704307,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":117199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":113447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":113483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":117199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":113357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":113517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":704385,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:01:45.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:01:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 Processor -- start 2024-04-15T00:01:45.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 -- start start 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c6640 0x7f55180c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55180c9d30 0x7f5518158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5518158870 con 0x7f55180c6260 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5518158b50 con 0x7f55180c9d30 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.362+0000 7f551d6de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5518158e30 con 0x7f55180c6640 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.363+0000 7f55167fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c6640 0x7f55180c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.363+0000 7f5516ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f55180c6260 0x7f551815c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54682/0 (socket says 172.21.15.29:54682) 2024-04-15T00:01:45.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.363+0000 7f5516ffd640 1 -- 172.21.15.29:0/3984967534 learned_addr learned my addr 172.21.15.29:0/3984967534 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:45.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.363+0000 7f55177fe640 1 --2- 172.21.15.29:0/3984967534 >> v2:172.21.15.37:3300/0 conn(0x7f55180c9d30 0x7f5518158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f5515ffb640 1 -- 172.21.15.29:0/3984967534 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394213622 0 0) 0x7f5518158870 con 0x7f55180c6260 2024-04-15T00:01:45.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f5515ffb640 1 -- 172.21.15.29:0/3984967534 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5504003520 con 0x7f55180c6260 2024-04-15T00:01:45.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f55167fc640 1 -- 172.21.15.29:0/3984967534 >> v2:172.21.15.37:3300/0 conn(0x7f55180c9d30 msgr2=0x7f5518158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:45.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f55167fc640 1 --2- 172.21.15.29:0/3984967534 >> v2:172.21.15.37:3300/0 conn(0x7f55180c9d30 0x7f5518158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f55167fc640 1 -- 172.21.15.29:0/3984967534 >> v1:172.21.15.29:6789/0 conn(0x7f55180c6260 legacy=0x7f551815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f55167fc640 1 -- 172.21.15.29:0/3984967534 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551815b850 con 0x7f55180c6640 2024-04-15T00:01:45.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.366+0000 7f55177fe640 1 --2- 172.21.15.29:0/3984967534 >> v2:172.21.15.37:3300/0 conn(0x7f55180c9d30 0x7f5518158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:45.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.368+0000 7f55167fc640 1 --2- 172.21.15.29:0/3984967534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c6640 0x7f55180c7cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f55000097a0 tx=0x7f550002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad07617ecb3dbe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:45.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f5515ffb640 1 -- 172.21.15.29:0/3984967534 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500035020 con 0x7f55180c6640 2024-04-15T00:01:45.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f5515ffb640 1 -- 172.21.15.29:0/3984967534 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5500031830 con 0x7f55180c6640 2024-04-15T00:01:45.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f5515ffb640 1 -- 172.21.15.29:0/3984967534 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500031c00 con 0x7f55180c6640 2024-04-15T00:01:45.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 -- 172.21.15.29:0/3984967534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c6640 msgr2=0x7f55180c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 --2- 172.21.15.29:0/3984967534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c6640 0x7f55180c7cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f55000097a0 tx=0x7f550002b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 -- 172.21.15.29:0/3984967534 shutdown_connections 2024-04-15T00:01:45.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 --2- 172.21.15.29:0/3984967534 >> v2:172.21.15.37:3300/0 conn(0x7f55180c9d30 0x7f5518158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 --2- 172.21.15.29:0/3984967534 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c6640 0x7f55180c7cf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 -- 172.21.15.29:0/3984967534 >> 172.21.15.29:0/3984967534 conn(0x7f551806c310 msgr2=0x7f551806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:45.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 -- 172.21.15.29:0/3984967534 shutdown_connections 2024-04-15T00:01:45.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.373+0000 7f551d6de640 1 -- 172.21.15.29:0/3984967534 wait complete. 2024-04-15T00:01:45.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 Processor -- start 2024-04-15T00:01:45.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 -- start start 2024-04-15T00:01:45.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55180c6260 0x7f55181e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 0x7f55181553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c9d30 0x7f551813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f55180701f0 con 0x7f55180c6640 2024-04-15T00:01:45.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5518070070 con 0x7f55180c6260 2024-04-15T00:01:45.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.375+0000 7f551d6de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5518140f20 con 0x7f55180c9d30 2024-04-15T00:01:45.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.376+0000 7f55167fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 0x7f55181553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.376+0000 7f55177fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c9d30 0x7f551813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.376+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55180c6260 0x7f55181e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.376+0000 7f55167fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 0x7f55181553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47060/0 (socket says 172.21.15.29:47060) 2024-04-15T00:01:45.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.376+0000 7f55177fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c9d30 0x7f551813fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:42820/0 (socket says 172.21.15.29:42820) 2024-04-15T00:01:45.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.376+0000 7f55167fc640 1 -- 172.21.15.29:0/1153185532 learned_addr learned my addr 172.21.15.29:0/1153185532 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:45.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.380+0000 7f55167fc640 1 -- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c9d30 msgr2=0x7f551813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.380+0000 7f55167fc640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c9d30 0x7f551813fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.380+0000 7f55167fc640 1 -- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55180c6260 msgr2=0x7f55181e1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.380+0000 7f55167fc640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55180c6260 0x7f55181e1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.380+0000 7f55167fc640 1 -- 172.21.15.29:0/1153185532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5518140350 con 0x7f55180c6640 2024-04-15T00:01:45.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.382+0000 7f55167fc640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 0x7f55181553b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f550002bee0 tx=0x7f55000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:45.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.386+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500035040 con 0x7f55180c6640 2024-04-15T00:01:45.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.386+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550003b920 con 0x7f55180c6640 2024-04-15T00:01:45.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.386+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550003bd10 con 0x7f55180c6640 2024-04-15T00:01:45.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.386+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5518152ab0 con 0x7f55180c6640 2024-04-15T00:01:45.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.386+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5518153070 con 0x7f55180c6640 2024-04-15T00:01:45.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.387+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5518070db0 con 0x7f55180c6640 2024-04-15T00:01:45.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.653+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5500038020 con 0x7f55180c6640 2024-04-15T00:01:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.653+0000 7f550f7fe640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54f806ba10 0x7f54f806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.654+0000 7f5516ffd640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54f806ba10 0x7f54f806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:45.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.654+0000 7f5516ffd640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54f806ba10 0x7f54f806ded0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5510005c00 tx=0x7f5510009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.667+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f55000317b0 con 0x7f55180c6640 2024-04-15T00:01:45.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.667+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5518070db0 con 0x7f55180c6640 2024-04-15T00:01:45.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.854+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55180b9300 con 0x7f54f806ba10 2024-04-15T00:01:45.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.862+0000 7f550f7fe640 1 -- 172.21.15.29:0/1153185532 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7f5510001f60 con 0x7f54f806ba10 2024-04-15T00:01:45.872 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:45.874 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54f806ba10 msgr2=0x7f54f806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54f806ba10 0x7f54f806ded0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5510005c00 tx=0x7f5510009040 comp rx=0 tx=0).stop 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 msgr2=0x7f55181553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 0x7f55181553b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f550002bee0 tx=0x7f55000046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 shutdown_connections 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54f806ba10 0x7f54f806ded0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f55180c9d30 0x7f551813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55180c6640 0x7f55181553b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 --2- 172.21.15.29:0/1153185532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55180c6260 0x7f55181e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 >> 172.21.15.29:0/1153185532 conn(0x7f551806c310 msgr2=0x7f551806ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 shutdown_connections 2024-04-15T00:01:45.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:45.866+0000 7f551d6de640 1 -- 172.21.15.29:0/1153185532 wait complete. 2024-04-15T00:01:45.883 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-15T00:01:45.100357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235224,"kb_used_data":2404,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739496,"statfs":{"total":773094113280,"available":772853243904,"internally_reserved":0,"allocated":2461696,"data_stored":2096894,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089360+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T00:01:20.089360+0000","last_peered":"2024-04-15T00:01:20.089360+0000","last_clean":"2024-04-15T00:01:20.089360+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T00:01:20.089360+0000","last_undegraded":"2024-04-15T00:01:20.089360+0000","last_fullsized":"2024-04-15T00:01:20.089360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752663+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T00:01:20.752663+0000","last_peered":"2024-04-15T00:01:20.752663+0000","last_clean":"2024-04-15T00:01:20.752663+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T00:01:20.752663+0000","last_undegraded":"2024-04-15T00:01:20.752663+0000","last_fullsized":"2024-04-15T00:01:20.752663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752282+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T00:01:20.752282+0000","last_peered":"2024-04-15T00:01:20.752282+0000","last_clean":"2024-04-15T00:01:20.752282+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T00:01:20.752282+0000","last_undegraded":"2024-04-15T00:01:20.752282+0000","last_fullsized":"2024-04-15T00:01:20.752282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752754+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T00:01:20.752754+0000","last_peered":"2024-04-15T00:01:20.752754+0000","last_clean":"2024-04-15T00:01:20.752754+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T00:01:20.752754+0000","last_undegraded":"2024-04-15T00:01:20.752754+0000","last_fullsized":"2024-04-15T00:01:20.752754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089103+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T00:01:20.089103+0000","last_peered":"2024-04-15T00:01:20.089103+0000","last_clean":"2024-04-15T00:01:20.089103+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T00:01:20.089103+0000","last_undegraded":"2024-04-15T00:01:20.089103+0000","last_fullsized":"2024-04-15T00:01:20.089103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166304+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T00:01:20.166304+0000","last_peered":"2024-04-15T00:01:20.166304+0000","last_clean":"2024-04-15T00:01:20.166304+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:20.166304+0000","last_undegraded":"2024-04-15T00:01:20.166304+0000","last_fullsized":"2024-04-15T00:01:20.166304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753020+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T00:01:20.753020+0000","last_peered":"2024-04-15T00:01:20.753020+0000","last_clean":"2024-04-15T00:01:20.753020+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T00:01:20.753020+0000","last_undegraded":"2024-04-15T00:01:20.753020+0000","last_fullsized":"2024-04-15T00:01:20.753020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752445+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T00:01:20.752445+0000","last_peered":"2024-04-15T00:01:20.752445+0000","last_clean":"2024-04-15T00:01:20.752445+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T00:01:20.752445+0000","last_undegraded":"2024-04-15T00:01:20.752445+0000","last_fullsized":"2024-04-15T00:01:20.752445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166778+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T00:01:20.166778+0000","last_peered":"2024-04-15T00:01:20.166778+0000","last_clean":"2024-04-15T00:01:20.166778+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T00:01:20.166778+0000","last_undegraded":"2024-04-15T00:01:20.166778+0000","last_fullsized":"2024-04-15T00:01:20.166778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752631+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T00:01:20.752631+0000","last_peered":"2024-04-15T00:01:20.752631+0000","last_clean":"2024-04-15T00:01:20.752631+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T00:01:20.752631+0000","last_undegraded":"2024-04-15T00:01:20.752631+0000","last_fullsized":"2024-04-15T00:01:20.752631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752755+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T00:01:20.752755+0000","last_peered":"2024-04-15T00:01:20.752755+0000","last_clean":"2024-04-15T00:01:20.752755+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T00:01:20.752755+0000","last_undegraded":"2024-04-15T00:01:20.752755+0000","last_fullsized":"2024-04-15T00:01:20.752755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166639+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T00:01:20.166639+0000","last_peered":"2024-04-15T00:01:20.166639+0000","last_clean":"2024-04-15T00:01:20.166639+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T00:01:20.166639+0000","last_undegraded":"2024-04-15T00:01:20.166639+0000","last_fullsized":"2024-04-15T00:01:20.166639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106577+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T00:01:20.106577+0000","last_peered":"2024-04-15T00:01:20.106577+0000","last_clean":"2024-04-15T00:01:20.106577+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T00:01:20.106577+0000","last_undegraded":"2024-04-15T00:01:20.106577+0000","last_fullsized":"2024-04-15T00:01:20.106577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752629+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T00:01:20.752629+0000","last_peered":"2024-04-15T00:01:20.752629+0000","last_clean":"2024-04-15T00:01:20.752629+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T00:01:20.752629+0000","last_undegraded":"2024-04-15T00:01:20.752629+0000","last_fullsized":"2024-04-15T00:01:20.752629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.167070+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T00:01:20.167070+0000","last_peered":"2024-04-15T00:01:20.167070+0000","last_clean":"2024-04-15T00:01:20.167070+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T00:01:20.167070+0000","last_undegraded":"2024-04-15T00:01:20.167070+0000","last_fullsized":"2024-04-15T00:01:20.167070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752524+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T00:01:20.752524+0000","last_peered":"2024-04-15T00:01:20.752524+0000","last_clean":"2024-04-15T00:01:20.752524+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T00:01:20.752524+0000","last_undegraded":"2024-04-15T00:01:20.752524+0000","last_fullsized":"2024-04-15T00:01:20.752524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095346+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T00:01:20.095346+0000","last_peered":"2024-04-15T00:01:20.095346+0000","last_clean":"2024-04-15T00:01:20.095346+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T00:01:20.095346+0000","last_undegraded":"2024-04-15T00:01:20.095346+0000","last_fullsized":"2024-04-15T00:01:20.095346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166463+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T00:01:20.166463+0000","last_peered":"2024-04-15T00:01:20.166463+0000","last_clean":"2024-04-15T00:01:20.166463+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T00:01:20.166463+0000","last_undegraded":"2024-04-15T00:01:20.166463+0000","last_fullsized":"2024-04-15T00:01:20.166463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752180+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T00:01:20.752180+0000","last_peered":"2024-04-15T00:01:20.752180+0000","last_clean":"2024-04-15T00:01:20.752180+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T00:01:20.752180+0000","last_undegraded":"2024-04-15T00:01:20.752180+0000","last_fullsized":"2024-04-15T00:01:20.752180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094976+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T00:01:20.094976+0000","last_peered":"2024-04-15T00:01:20.094976+0000","last_clean":"2024-04-15T00:01:20.094976+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T00:01:20.094976+0000","last_undegraded":"2024-04-15T00:01:20.094976+0000","last_fullsized":"2024-04-15T00:01:20.094976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095541+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T00:01:20.095541+0000","last_peered":"2024-04-15T00:01:20.095541+0000","last_clean":"2024-04-15T00:01:20.095541+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T00:01:20.095541+0000","last_undegraded":"2024-04-15T00:01:20.095541+0000","last_fullsized":"2024-04-15T00:01:20.095541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166348+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T00:01:20.166348+0000","last_peered":"2024-04-15T00:01:20.166348+0000","last_clean":"2024-04-15T00:01:20.166348+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T00:01:20.166348+0000","last_undegraded":"2024-04-15T00:01:20.166348+0000","last_fullsized":"2024-04-15T00:01:20.166348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751928+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T00:01:20.751928+0000","last_peered":"2024-04-15T00:01:20.751928+0000","last_clean":"2024-04-15T00:01:20.751928+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T00:01:20.751928+0000","last_undegraded":"2024-04-15T00:01:20.751928+0000","last_fullsized":"2024-04-15T00:01:20.751928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166454+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T00:01:20.166454+0000","last_peered":"2024-04-15T00:01:20.166454+0000","last_clean":"2024-04-15T00:01:20.166454+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T00:01:20.166454+0000","last_undegraded":"2024-04-15T00:01:20.166454+0000","last_fullsized":"2024-04-15T00:01:20.166454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089457+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T00:01:20.089457+0000","last_peered":"2024-04-15T00:01:20.089457+0000","last_clean":"2024-04-15T00:01:20.089457+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T00:01:20.089457+0000","last_undegraded":"2024-04-15T00:01:20.089457+0000","last_fullsized":"2024-04-15T00:01:20.089457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.107250+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T00:01:20.107250+0000","last_peered":"2024-04-15T00:01:20.107250+0000","last_clean":"2024-04-15T00:01:20.107250+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T00:01:20.107250+0000","last_undegraded":"2024-04-15T00:01:20.107250+0000","last_fullsized":"2024-04-15T00:01:20.107250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166254+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T00:01:20.166254+0000","last_peered":"2024-04-15T00:01:20.166254+0000","last_clean":"2024-04-15T00:01:20.166254+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T00:01:20.166254+0000","last_undegraded":"2024-04-15T00:01:20.166254+0000","last_fullsized":"2024-04-15T00:01:20.166254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752897+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T00:01:20.752897+0000","last_peered":"2024-04-15T00:01:20.752897+0000","last_clean":"2024-04-15T00:01:20.752897+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T00:01:20.752897+0000","last_undegraded":"2024-04-15T00:01:20.752897+0000","last_fullsized":"2024-04-15T00:01:20.752897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095522+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T00:01:20.095522+0000","last_peered":"2024-04-15T00:01:20.095522+0000","last_clean":"2024-04-15T00:01:20.095522+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T00:01:20.095522+0000","last_undegraded":"2024-04-15T00:01:20.095522+0000","last_fullsized":"2024-04-15T00:01:20.095522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751753+0000","last_change":"2024-04-15T00:01:18.977928+0000","last_active":"2024-04-15T00:01:20.751753+0000","last_peered":"2024-04-15T00:01:20.751753+0000","last_clean":"2024-04-15T00:01:20.751753+0000","last_became_active":"2024-04-15T00:01:18.977604+0000","last_became_peered":"2024-04-15T00:01:18.977604+0000","last_unstale":"2024-04-15T00:01:20.751753+0000","last_undegraded":"2024-04-15T00:01:20.751753+0000","last_fullsized":"2024-04-15T00:01:20.751753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:06:14.223038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095175+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T00:01:20.095175+0000","last_peered":"2024-04-15T00:01:20.095175+0000","last_clean":"2024-04-15T00:01:20.095175+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T00:01:20.095175+0000","last_undegraded":"2024-04-15T00:01:20.095175+0000","last_fullsized":"2024-04-15T00:01:20.095175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753099+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T00:01:20.753099+0000","last_peered":"2024-04-15T00:01:20.753099+0000","last_clean":"2024-04-15T00:01:20.753099+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T00:01:20.753099+0000","last_undegraded":"2024-04-15T00:01:20.753099+0000","last_fullsized":"2024-04-15T00:01:20.753099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089045+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T00:01:20.089045+0000","last_peered":"2024-04-15T00:01:20.089045+0000","last_clean":"2024-04-15T00:01:20.089045+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T00:01:20.089045+0000","last_undegraded":"2024-04-15T00:01:20.089045+0000","last_fullsized":"2024-04-15T00:01:20.089045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752847+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T00:01:20.752847+0000","last_peered":"2024-04-15T00:01:20.752847+0000","last_clean":"2024-04-15T00:01:20.752847+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T00:01:20.752847+0000","last_undegraded":"2024-04-15T00:01:20.752847+0000","last_fullsized":"2024-04-15T00:01:20.752847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095287+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T00:01:20.095287+0000","last_peered":"2024-04-15T00:01:20.095287+0000","last_clean":"2024-04-15T00:01:20.095287+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T00:01:20.095287+0000","last_undegraded":"2024-04-15T00:01:20.095287+0000","last_fullsized":"2024-04-15T00:01:20.095287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094979+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T00:01:20.094979+0000","last_peered":"2024-04-15T00:01:20.094979+0000","last_clean":"2024-04-15T00:01:20.094979+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T00:01:20.094979+0000","last_undegraded":"2024-04-15T00:01:20.094979+0000","last_fullsized":"2024-04-15T00:01:20.094979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166647+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T00:01:20.166647+0000","last_peered":"2024-04-15T00:01:20.166647+0000","last_clean":"2024-04-15T00:01:20.166647+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T00:01:20.166647+0000","last_undegraded":"2024-04-15T00:01:20.166647+0000","last_fullsized":"2024-04-15T00:01:20.166647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752116+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T00:01:20.752116+0000","last_peered":"2024-04-15T00:01:20.752116+0000","last_clean":"2024-04-15T00:01:20.752116+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T00:01:20.752116+0000","last_undegraded":"2024-04-15T00:01:20.752116+0000","last_fullsized":"2024-04-15T00:01:20.752116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095283+0000","last_change":"2024-04-15T00:01:18.984989+0000","last_active":"2024-04-15T00:01:20.095283+0000","last_peered":"2024-04-15T00:01:20.095283+0000","last_clean":"2024-04-15T00:01:20.095283+0000","last_became_active":"2024-04-15T00:01:18.984606+0000","last_became_peered":"2024-04-15T00:01:18.984606+0000","last_unstale":"2024-04-15T00:01:20.095283+0000","last_undegraded":"2024-04-15T00:01:20.095283+0000","last_fullsized":"2024-04-15T00:01:20.095283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:53.212218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094833+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T00:01:20.094833+0000","last_peered":"2024-04-15T00:01:20.094833+0000","last_clean":"2024-04-15T00:01:20.094833+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T00:01:20.094833+0000","last_undegraded":"2024-04-15T00:01:20.094833+0000","last_fullsized":"2024-04-15T00:01:20.094833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751760+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T00:01:20.751760+0000","last_peered":"2024-04-15T00:01:20.751760+0000","last_clean":"2024-04-15T00:01:20.751760+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T00:01:20.751760+0000","last_undegraded":"2024-04-15T00:01:20.751760+0000","last_fullsized":"2024-04-15T00:01:20.751760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095578+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T00:01:20.095578+0000","last_peered":"2024-04-15T00:01:20.095578+0000","last_clean":"2024-04-15T00:01:20.095578+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T00:01:20.095578+0000","last_undegraded":"2024-04-15T00:01:20.095578+0000","last_fullsized":"2024-04-15T00:01:20.095578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.088844+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T00:01:20.088844+0000","last_peered":"2024-04-15T00:01:20.088844+0000","last_clean":"2024-04-15T00:01:20.088844+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T00:01:20.088844+0000","last_undegraded":"2024-04-15T00:01:20.088844+0000","last_fullsized":"2024-04-15T00:01:20.088844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752030+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T00:01:20.752030+0000","last_peered":"2024-04-15T00:01:20.752030+0000","last_clean":"2024-04-15T00:01:20.752030+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T00:01:20.752030+0000","last_undegraded":"2024-04-15T00:01:20.752030+0000","last_fullsized":"2024-04-15T00:01:20.752030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089313+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T00:01:20.089313+0000","last_peered":"2024-04-15T00:01:20.089313+0000","last_clean":"2024-04-15T00:01:20.089313+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T00:01:20.089313+0000","last_undegraded":"2024-04-15T00:01:20.089313+0000","last_fullsized":"2024-04-15T00:01:20.089313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752323+0000","last_change":"2024-04-15T00:01:12.992789+0000","last_active":"2024-04-15T00:01:20.752323+0000","last_peered":"2024-04-15T00:01:20.752323+0000","last_clean":"2024-04-15T00:01:20.752323+0000","last_became_active":"2024-04-15T00:01:12.992466+0000","last_became_peered":"2024-04-15T00:01:12.992466+0000","last_unstale":"2024-04-15T00:01:20.752323+0000","last_undegraded":"2024-04-15T00:01:20.752323+0000","last_fullsized":"2024-04-15T00:01:20.752323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752843+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T00:01:20.752843+0000","last_peered":"2024-04-15T00:01:20.752843+0000","last_clean":"2024-04-15T00:01:20.752843+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T00:01:20.752843+0000","last_undegraded":"2024-04-15T00:01:20.752843+0000","last_fullsized":"2024-04-15T00:01:20.752843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752122+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T00:01:20.752122+0000","last_peered":"2024-04-15T00:01:20.752122+0000","last_clean":"2024-04-15T00:01:20.752122+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T00:01:20.752122+0000","last_undegraded":"2024-04-15T00:01:20.752122+0000","last_fullsized":"2024-04-15T00:01:20.752122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106661+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T00:01:20.106661+0000","last_peered":"2024-04-15T00:01:20.106661+0000","last_clean":"2024-04-15T00:01:20.106661+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T00:01:20.106661+0000","last_undegraded":"2024-04-15T00:01:20.106661+0000","last_fullsized":"2024-04-15T00:01:20.106661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752923+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T00:01:20.752923+0000","last_peered":"2024-04-15T00:01:20.752923+0000","last_clean":"2024-04-15T00:01:20.752923+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T00:01:20.752923+0000","last_undegraded":"2024-04-15T00:01:20.752923+0000","last_fullsized":"2024-04-15T00:01:20.752923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752042+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T00:01:20.752042+0000","last_peered":"2024-04-15T00:01:20.752042+0000","last_clean":"2024-04-15T00:01:20.752042+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T00:01:20.752042+0000","last_undegraded":"2024-04-15T00:01:20.752042+0000","last_fullsized":"2024-04-15T00:01:20.752042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106605+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T00:01:20.106605+0000","last_peered":"2024-04-15T00:01:20.106605+0000","last_clean":"2024-04-15T00:01:20.106605+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T00:01:20.106605+0000","last_undegraded":"2024-04-15T00:01:20.106605+0000","last_fullsized":"2024-04-15T00:01:20.106605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752538+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T00:01:20.752538+0000","last_peered":"2024-04-15T00:01:20.752538+0000","last_clean":"2024-04-15T00:01:20.752538+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T00:01:20.752538+0000","last_undegraded":"2024-04-15T00:01:20.752538+0000","last_fullsized":"2024-04-15T00:01:20.752538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095333+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T00:01:20.095333+0000","last_peered":"2024-04-15T00:01:20.095333+0000","last_clean":"2024-04-15T00:01:20.095333+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T00:01:20.095333+0000","last_undegraded":"2024-04-15T00:01:20.095333+0000","last_fullsized":"2024-04-15T00:01:20.095333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089316+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T00:01:20.089316+0000","last_peered":"2024-04-15T00:01:20.089316+0000","last_clean":"2024-04-15T00:01:20.089316+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T00:01:20.089316+0000","last_undegraded":"2024-04-15T00:01:20.089316+0000","last_fullsized":"2024-04-15T00:01:20.089316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753365+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T00:01:20.753365+0000","last_peered":"2024-04-15T00:01:20.753365+0000","last_clean":"2024-04-15T00:01:20.753365+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T00:01:20.753365+0000","last_undegraded":"2024-04-15T00:01:20.753365+0000","last_fullsized":"2024-04-15T00:01:20.753365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752224+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T00:01:20.752224+0000","last_peered":"2024-04-15T00:01:20.752224+0000","last_clean":"2024-04-15T00:01:20.752224+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T00:01:20.752224+0000","last_undegraded":"2024-04-15T00:01:20.752224+0000","last_fullsized":"2024-04-15T00:01:20.752224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751576+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T00:01:20.751576+0000","last_peered":"2024-04-15T00:01:20.751576+0000","last_clean":"2024-04-15T00:01:20.751576+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T00:01:20.751576+0000","last_undegraded":"2024-04-15T00:01:20.751576+0000","last_fullsized":"2024-04-15T00:01:20.751576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753252+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T00:01:20.753252+0000","last_peered":"2024-04-15T00:01:20.753252+0000","last_clean":"2024-04-15T00:01:20.753252+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T00:01:20.753252+0000","last_undegraded":"2024-04-15T00:01:20.753252+0000","last_fullsized":"2024-04-15T00:01:20.753252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.167096+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T00:01:20.167096+0000","last_peered":"2024-04-15T00:01:20.167096+0000","last_clean":"2024-04-15T00:01:20.167096+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T00:01:20.167096+0000","last_undegraded":"2024-04-15T00:01:20.167096+0000","last_fullsized":"2024-04-15T00:01:20.167096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166234+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T00:01:20.166234+0000","last_peered":"2024-04-15T00:01:20.166234+0000","last_clean":"2024-04-15T00:01:20.166234+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T00:01:20.166234+0000","last_undegraded":"2024-04-15T00:01:20.166234+0000","last_fullsized":"2024-04-15T00:01:20.166234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752167+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T00:01:20.752167+0000","last_peered":"2024-04-15T00:01:20.752167+0000","last_clean":"2024-04-15T00:01:20.752167+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T00:01:20.752167+0000","last_undegraded":"2024-04-15T00:01:20.752167+0000","last_fullsized":"2024-04-15T00:01:20.752167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751525+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T00:01:20.751525+0000","last_peered":"2024-04-15T00:01:20.751525+0000","last_clean":"2024-04-15T00:01:20.751525+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T00:01:20.751525+0000","last_undegraded":"2024-04-15T00:01:20.751525+0000","last_fullsized":"2024-04-15T00:01:20.751525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089468+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T00:01:20.089468+0000","last_peered":"2024-04-15T00:01:20.089468+0000","last_clean":"2024-04-15T00:01:20.089468+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T00:01:20.089468+0000","last_undegraded":"2024-04-15T00:01:20.089468+0000","last_fullsized":"2024-04-15T00:01:20.089468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106475+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T00:01:20.106475+0000","last_peered":"2024-04-15T00:01:20.106475+0000","last_clean":"2024-04-15T00:01:20.106475+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T00:01:20.106475+0000","last_undegraded":"2024-04-15T00:01:20.106475+0000","last_fullsized":"2024-04-15T00:01:20.106475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106593+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T00:01:20.106593+0000","last_peered":"2024-04-15T00:01:20.106593+0000","last_clean":"2024-04-15T00:01:20.106593+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T00:01:20.106593+0000","last_undegraded":"2024-04-15T00:01:20.106593+0000","last_fullsized":"2024-04-15T00:01:20.106593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752741+0000","last_change":"2024-04-15T00:01:18.980711+0000","last_active":"2024-04-15T00:01:20.752741+0000","last_peered":"2024-04-15T00:01:20.752741+0000","last_clean":"2024-04-15T00:01:20.752741+0000","last_became_active":"2024-04-15T00:01:18.979809+0000","last_became_peered":"2024-04-15T00:01:18.979809+0000","last_unstale":"2024-04-15T00:01:20.752741+0000","last_undegraded":"2024-04-15T00:01:20.752741+0000","last_fullsized":"2024-04-15T00:01:20.752741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:50:51.590359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752536+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T00:01:20.752536+0000","last_peered":"2024-04-15T00:01:20.752536+0000","last_clean":"2024-04-15T00:01:20.752536+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T00:01:20.752536+0000","last_undegraded":"2024-04-15T00:01:20.752536+0000","last_fullsized":"2024-04-15T00:01:20.752536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752036+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T00:01:20.752036+0000","last_peered":"2024-04-15T00:01:20.752036+0000","last_clean":"2024-04-15T00:01:20.752036+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T00:01:20.752036+0000","last_undegraded":"2024-04-15T00:01:20.752036+0000","last_fullsized":"2024-04-15T00:01:20.752036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752656+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T00:01:20.752656+0000","last_peered":"2024-04-15T00:01:20.752656+0000","last_clean":"2024-04-15T00:01:20.752656+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T00:01:20.752656+0000","last_undegraded":"2024-04-15T00:01:20.752656+0000","last_fullsized":"2024-04-15T00:01:20.752656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089101+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T00:01:20.089101+0000","last_peered":"2024-04-15T00:01:20.089101+0000","last_clean":"2024-04-15T00:01:20.089101+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T00:01:20.089101+0000","last_undegraded":"2024-04-15T00:01:20.089101+0000","last_fullsized":"2024-04-15T00:01:20.089101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:41.905778+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T00:01:41.905778+0000","last_peered":"2024-04-15T00:01:41.905778+0000","last_clean":"2024-04-15T00:01:41.905778+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T00:01:41.905778+0000","last_undegraded":"2024-04-15T00:01:41.905778+0000","last_fullsized":"2024-04-15T00:01:41.905778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752802+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T00:01:20.752802+0000","last_peered":"2024-04-15T00:01:20.752802+0000","last_clean":"2024-04-15T00:01:20.752802+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T00:01:20.752802+0000","last_undegraded":"2024-04-15T00:01:20.752802+0000","last_fullsized":"2024-04-15T00:01:20.752802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752820+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T00:01:20.752820+0000","last_peered":"2024-04-15T00:01:20.752820+0000","last_clean":"2024-04-15T00:01:20.752820+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T00:01:20.752820+0000","last_undegraded":"2024-04-15T00:01:20.752820+0000","last_fullsized":"2024-04-15T00:01:20.752820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:28.729077+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T00:01:28.729077+0000","last_peered":"2024-04-15T00:01:28.729077+0000","last_clean":"2024-04-15T00:01:28.729077+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T00:01:28.729077+0000","last_undegraded":"2024-04-15T00:01:28.729077+0000","last_fullsized":"2024-04-15T00:01:28.729077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095145+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T00:01:20.095145+0000","last_peered":"2024-04-15T00:01:20.095145+0000","last_clean":"2024-04-15T00:01:20.095145+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T00:01:20.095145+0000","last_undegraded":"2024-04-15T00:01:20.095145+0000","last_fullsized":"2024-04-15T00:01:20.095145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166522+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T00:01:20.166522+0000","last_peered":"2024-04-15T00:01:20.166522+0000","last_clean":"2024-04-15T00:01:20.166522+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T00:01:20.166522+0000","last_undegraded":"2024-04-15T00:01:20.166522+0000","last_fullsized":"2024-04-15T00:01:20.166522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095261+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T00:01:20.095261+0000","last_peered":"2024-04-15T00:01:20.095261+0000","last_clean":"2024-04-15T00:01:20.095261+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T00:01:20.095261+0000","last_undegraded":"2024-04-15T00:01:20.095261+0000","last_fullsized":"2024-04-15T00:01:20.095261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166907+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T00:01:20.166907+0000","last_peered":"2024-04-15T00:01:20.166907+0000","last_clean":"2024-04-15T00:01:20.166907+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T00:01:20.166907+0000","last_undegraded":"2024-04-15T00:01:20.166907+0000","last_fullsized":"2024-04-15T00:01:20.166907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089239+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T00:01:20.089239+0000","last_peered":"2024-04-15T00:01:20.089239+0000","last_clean":"2024-04-15T00:01:20.089239+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T00:01:20.089239+0000","last_undegraded":"2024-04-15T00:01:20.089239+0000","last_fullsized":"2024-04-15T00:01:20.089239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752303+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T00:01:20.752303+0000","last_peered":"2024-04-15T00:01:20.752303+0000","last_clean":"2024-04-15T00:01:20.752303+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T00:01:20.752303+0000","last_undegraded":"2024-04-15T00:01:20.752303+0000","last_fullsized":"2024-04-15T00:01:20.752303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752145+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T00:01:20.752145+0000","last_peered":"2024-04-15T00:01:20.752145+0000","last_clean":"2024-04-15T00:01:20.752145+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T00:01:20.752145+0000","last_undegraded":"2024-04-15T00:01:20.752145+0000","last_fullsized":"2024-04-15T00:01:20.752145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752203+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T00:01:20.752203+0000","last_peered":"2024-04-15T00:01:20.752203+0000","last_clean":"2024-04-15T00:01:20.752203+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T00:01:20.752203+0000","last_undegraded":"2024-04-15T00:01:20.752203+0000","last_fullsized":"2024-04-15T00:01:20.752203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.107198+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T00:01:20.107198+0000","last_peered":"2024-04-15T00:01:20.107198+0000","last_clean":"2024-04-15T00:01:20.107198+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T00:01:20.107198+0000","last_undegraded":"2024-04-15T00:01:20.107198+0000","last_fullsized":"2024-04-15T00:01:20.107198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752301+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T00:01:20.752301+0000","last_peered":"2024-04-15T00:01:20.752301+0000","last_clean":"2024-04-15T00:01:20.752301+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T00:01:20.752301+0000","last_undegraded":"2024-04-15T00:01:20.752301+0000","last_fullsized":"2024-04-15T00:01:20.752301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089131+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T00:01:20.089131+0000","last_peered":"2024-04-15T00:01:20.089131+0000","last_clean":"2024-04-15T00:01:20.089131+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T00:01:20.089131+0000","last_undegraded":"2024-04-15T00:01:20.089131+0000","last_fullsized":"2024-04-15T00:01:20.089131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094782+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T00:01:20.094782+0000","last_peered":"2024-04-15T00:01:20.094782+0000","last_clean":"2024-04-15T00:01:20.094782+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T00:01:20.094782+0000","last_undegraded":"2024-04-15T00:01:20.094782+0000","last_fullsized":"2024-04-15T00:01:20.094782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751713+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T00:01:20.751713+0000","last_peered":"2024-04-15T00:01:20.751713+0000","last_clean":"2024-04-15T00:01:20.751713+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T00:01:20.751713+0000","last_undegraded":"2024-04-15T00:01:20.751713+0000","last_fullsized":"2024-04-15T00:01:20.751713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.107148+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T00:01:20.107148+0000","last_peered":"2024-04-15T00:01:20.107148+0000","last_clean":"2024-04-15T00:01:20.107148+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:20.107148+0000","last_undegraded":"2024-04-15T00:01:20.107148+0000","last_fullsized":"2024-04-15T00:01:20.107148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752084+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T00:01:20.752084+0000","last_peered":"2024-04-15T00:01:20.752084+0000","last_clean":"2024-04-15T00:01:20.752084+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T00:01:20.752084+0000","last_undegraded":"2024-04-15T00:01:20.752084+0000","last_fullsized":"2024-04-15T00:01:20.752084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752358+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T00:01:20.752358+0000","last_peered":"2024-04-15T00:01:20.752358+0000","last_clean":"2024-04-15T00:01:20.752358+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T00:01:20.752358+0000","last_undegraded":"2024-04-15T00:01:20.752358+0000","last_fullsized":"2024-04-15T00:01:20.752358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106676+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T00:01:20.106676+0000","last_peered":"2024-04-15T00:01:20.106676+0000","last_clean":"2024-04-15T00:01:20.106676+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T00:01:20.106676+0000","last_undegraded":"2024-04-15T00:01:20.106676+0000","last_fullsized":"2024-04-15T00:01:20.106676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089380+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T00:01:20.089380+0000","last_peered":"2024-04-15T00:01:20.089380+0000","last_clean":"2024-04-15T00:01:20.089380+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T00:01:20.089380+0000","last_undegraded":"2024-04-15T00:01:20.089380+0000","last_fullsized":"2024-04-15T00:01:20.089380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751916+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T00:01:20.751916+0000","last_peered":"2024-04-15T00:01:20.751916+0000","last_clean":"2024-04-15T00:01:20.751916+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T00:01:20.751916+0000","last_undegraded":"2024-04-15T00:01:20.751916+0000","last_fullsized":"2024-04-15T00:01:20.751916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752686+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T00:01:20.752686+0000","last_peered":"2024-04-15T00:01:20.752686+0000","last_clean":"2024-04-15T00:01:20.752686+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T00:01:20.752686+0000","last_undegraded":"2024-04-15T00:01:20.752686+0000","last_fullsized":"2024-04-15T00:01:20.752686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166393+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T00:01:20.166393+0000","last_peered":"2024-04-15T00:01:20.166393+0000","last_clean":"2024-04-15T00:01:20.166393+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T00:01:20.166393+0000","last_undegraded":"2024-04-15T00:01:20.166393+0000","last_fullsized":"2024-04-15T00:01:20.166393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752986+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T00:01:20.752986+0000","last_peered":"2024-04-15T00:01:20.752986+0000","last_clean":"2024-04-15T00:01:20.752986+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T00:01:20.752986+0000","last_undegraded":"2024-04-15T00:01:20.752986+0000","last_fullsized":"2024-04-15T00:01:20.752986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106386+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T00:01:20.106386+0000","last_peered":"2024-04-15T00:01:20.106386+0000","last_clean":"2024-04-15T00:01:20.106386+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T00:01:20.106386+0000","last_undegraded":"2024-04-15T00:01:20.106386+0000","last_fullsized":"2024-04-15T00:01:20.106386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751671+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T00:01:20.751671+0000","last_peered":"2024-04-15T00:01:20.751671+0000","last_clean":"2024-04-15T00:01:20.751671+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T00:01:20.751671+0000","last_undegraded":"2024-04-15T00:01:20.751671+0000","last_fullsized":"2024-04-15T00:01:20.751671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752015+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T00:01:20.752015+0000","last_peered":"2024-04-15T00:01:20.752015+0000","last_clean":"2024-04-15T00:01:20.752015+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T00:01:20.752015+0000","last_undegraded":"2024-04-15T00:01:20.752015+0000","last_fullsized":"2024-04-15T00:01:20.752015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089286+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T00:01:20.089286+0000","last_peered":"2024-04-15T00:01:20.089286+0000","last_clean":"2024-04-15T00:01:20.089286+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T00:01:20.089286+0000","last_undegraded":"2024-04-15T00:01:20.089286+0000","last_fullsized":"2024-04-15T00:01:20.089286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752825+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T00:01:20.752825+0000","last_peered":"2024-04-15T00:01:20.752825+0000","last_clean":"2024-04-15T00:01:20.752825+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T00:01:20.752825+0000","last_undegraded":"2024-04-15T00:01:20.752825+0000","last_fullsized":"2024-04-15T00:01:20.752825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095073+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T00:01:20.095073+0000","last_peered":"2024-04-15T00:01:20.095073+0000","last_clean":"2024-04-15T00:01:20.095073+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T00:01:20.095073+0000","last_undegraded":"2024-04-15T00:01:20.095073+0000","last_fullsized":"2024-04-15T00:01:20.095073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106995+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T00:01:20.106995+0000","last_peered":"2024-04-15T00:01:20.106995+0000","last_clean":"2024-04-15T00:01:20.106995+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T00:01:20.106995+0000","last_undegraded":"2024-04-15T00:01:20.106995+0000","last_fullsized":"2024-04-15T00:01:20.106995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752835+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T00:01:20.752835+0000","last_peered":"2024-04-15T00:01:20.752835+0000","last_clean":"2024-04-15T00:01:20.752835+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T00:01:20.752835+0000","last_undegraded":"2024-04-15T00:01:20.752835+0000","last_fullsized":"2024-04-15T00:01:20.752835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751894+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T00:01:20.751894+0000","last_peered":"2024-04-15T00:01:20.751894+0000","last_clean":"2024-04-15T00:01:20.751894+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T00:01:20.751894+0000","last_undegraded":"2024-04-15T00:01:20.751894+0000","last_fullsized":"2024-04-15T00:01:20.751894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752424+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T00:01:20.752424+0000","last_peered":"2024-04-15T00:01:20.752424+0000","last_clean":"2024-04-15T00:01:20.752424+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T00:01:20.752424+0000","last_undegraded":"2024-04-15T00:01:20.752424+0000","last_fullsized":"2024-04-15T00:01:20.752424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751940+0000","last_change":"2024-04-15T00:01:12.981274+0000","last_active":"2024-04-15T00:01:20.751940+0000","last_peered":"2024-04-15T00:01:20.751940+0000","last_clean":"2024-04-15T00:01:20.751940+0000","last_became_active":"2024-04-15T00:01:12.981018+0000","last_became_peered":"2024-04-15T00:01:12.981018+0000","last_unstale":"2024-04-15T00:01:20.751940+0000","last_undegraded":"2024-04-15T00:01:20.751940+0000","last_fullsized":"2024-04-15T00:01:20.751940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089188+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T00:01:20.089188+0000","last_peered":"2024-04-15T00:01:20.089188+0000","last_clean":"2024-04-15T00:01:20.089188+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T00:01:20.089188+0000","last_undegraded":"2024-04-15T00:01:20.089188+0000","last_fullsized":"2024-04-15T00:01:20.089188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106861+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T00:01:20.106861+0000","last_peered":"2024-04-15T00:01:20.106861+0000","last_clean":"2024-04-15T00:01:20.106861+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T00:01:20.106861+0000","last_undegraded":"2024-04-15T00:01:20.106861+0000","last_fullsized":"2024-04-15T00:01:20.106861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753040+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T00:01:20.753040+0000","last_peered":"2024-04-15T00:01:20.753040+0000","last_clean":"2024-04-15T00:01:20.753040+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T00:01:20.753040+0000","last_undegraded":"2024-04-15T00:01:20.753040+0000","last_fullsized":"2024-04-15T00:01:20.753040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752129+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T00:01:20.752129+0000","last_peered":"2024-04-15T00:01:20.752129+0000","last_clean":"2024-04-15T00:01:20.752129+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T00:01:20.752129+0000","last_undegraded":"2024-04-15T00:01:20.752129+0000","last_fullsized":"2024-04-15T00:01:20.752129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752173+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T00:01:20.752173+0000","last_peered":"2024-04-15T00:01:20.752173+0000","last_clean":"2024-04-15T00:01:20.752173+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T00:01:20.752173+0000","last_undegraded":"2024-04-15T00:01:20.752173+0000","last_fullsized":"2024-04-15T00:01:20.752173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751590+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T00:01:20.751590+0000","last_peered":"2024-04-15T00:01:20.751590+0000","last_clean":"2024-04-15T00:01:20.751590+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T00:01:20.751590+0000","last_undegraded":"2024-04-15T00:01:20.751590+0000","last_fullsized":"2024-04-15T00:01:20.751590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.094876+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T00:01:20.094876+0000","last_peered":"2024-04-15T00:01:20.094876+0000","last_clean":"2024-04-15T00:01:20.094876+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T00:01:20.094876+0000","last_undegraded":"2024-04-15T00:01:20.094876+0000","last_fullsized":"2024-04-15T00:01:20.094876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089024+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T00:01:20.089024+0000","last_peered":"2024-04-15T00:01:20.089024+0000","last_clean":"2024-04-15T00:01:20.089024+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T00:01:20.089024+0000","last_undegraded":"2024-04-15T00:01:20.089024+0000","last_fullsized":"2024-04-15T00:01:20.089024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752604+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T00:01:20.752604+0000","last_peered":"2024-04-15T00:01:20.752604+0000","last_clean":"2024-04-15T00:01:20.752604+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T00:01:20.752604+0000","last_undegraded":"2024-04-15T00:01:20.752604+0000","last_fullsized":"2024-04-15T00:01:20.752604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.166477+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T00:01:20.166477+0000","last_peered":"2024-04-15T00:01:20.166477+0000","last_clean":"2024-04-15T00:01:20.166477+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T00:01:20.166477+0000","last_undegraded":"2024-04-15T00:01:20.166477+0000","last_fullsized":"2024-04-15T00:01:20.166477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106722+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T00:01:20.106722+0000","last_peered":"2024-04-15T00:01:20.106722+0000","last_clean":"2024-04-15T00:01:20.106722+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T00:01:20.106722+0000","last_undegraded":"2024-04-15T00:01:20.106722+0000","last_fullsized":"2024-04-15T00:01:20.106722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.106962+0000","last_change":"2024-04-15T00:01:12.981197+0000","last_active":"2024-04-15T00:01:20.106962+0000","last_peered":"2024-04-15T00:01:20.106962+0000","last_clean":"2024-04-15T00:01:20.106962+0000","last_became_active":"2024-04-15T00:01:12.980960+0000","last_became_peered":"2024-04-15T00:01:12.980960+0000","last_unstale":"2024-04-15T00:01:20.106962+0000","last_undegraded":"2024-04-15T00:01:20.106962+0000","last_fullsized":"2024-04-15T00:01:20.106962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753312+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T00:01:20.753312+0000","last_peered":"2024-04-15T00:01:20.753312+0000","last_clean":"2024-04-15T00:01:20.753312+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T00:01:20.753312+0000","last_undegraded":"2024-04-15T00:01:20.753312+0000","last_fullsized":"2024-04-15T00:01:20.753312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751912+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T00:01:20.751912+0000","last_peered":"2024-04-15T00:01:20.751912+0000","last_clean":"2024-04-15T00:01:20.751912+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T00:01:20.751912+0000","last_undegraded":"2024-04-15T00:01:20.751912+0000","last_fullsized":"2024-04-15T00:01:20.751912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752066+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T00:01:20.752066+0000","last_peered":"2024-04-15T00:01:20.752066+0000","last_clean":"2024-04-15T00:01:20.752066+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T00:01:20.752066+0000","last_undegraded":"2024-04-15T00:01:20.752066+0000","last_fullsized":"2024-04-15T00:01:20.752066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.751913+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T00:01:20.751913+0000","last_peered":"2024-04-15T00:01:20.751913+0000","last_clean":"2024-04-15T00:01:20.751913+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T00:01:20.751913+0000","last_undegraded":"2024-04-15T00:01:20.751913+0000","last_fullsized":"2024-04-15T00:01:20.751913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752428+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T00:01:20.752428+0000","last_peered":"2024-04-15T00:01:20.752428+0000","last_clean":"2024-04-15T00:01:20.752428+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T00:01:20.752428+0000","last_undegraded":"2024-04-15T00:01:20.752428+0000","last_fullsized":"2024-04-15T00:01:20.752428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.752439+0000","last_change":"2024-04-15T00:01:12.992197+0000","last_active":"2024-04-15T00:01:20.752439+0000","last_peered":"2024-04-15T00:01:20.752439+0000","last_clean":"2024-04-15T00:01:20.752439+0000","last_became_active":"2024-04-15T00:01:12.991917+0000","last_became_peered":"2024-04-15T00:01:12.991917+0000","last_unstale":"2024-04-15T00:01:20.752439+0000","last_undegraded":"2024-04-15T00:01:20.752439+0000","last_fullsized":"2024-04-15T00:01:20.752439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:42:41.040454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.089001+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T00:01:20.089001+0000","last_peered":"2024-04-15T00:01:20.089001+0000","last_clean":"2024-04-15T00:01:20.089001+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T00:01:20.089001+0000","last_undegraded":"2024-04-15T00:01:20.089001+0000","last_fullsized":"2024-04-15T00:01:20.089001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.095404+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T00:01:20.095404+0000","last_peered":"2024-04-15T00:01:20.095404+0000","last_clean":"2024-04-15T00:01:20.095404+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T00:01:20.095404+0000","last_undegraded":"2024-04-15T00:01:20.095404+0000","last_fullsized":"2024-04-15T00:01:20.095404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-15T00:01:20.753239+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T00:01:20.753239+0000","last_peered":"2024-04-15T00:01:20.753239+0000","last_clean":"2024-04-15T00:01:20.753239+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T00:01:20.753239+0000","last_undegraded":"2024-04-15T00:01:20.753239+0000","last_fullsized":"2024-04-15T00:01:20.753239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":9302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":704307,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":117199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":113447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":113483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":117199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":113357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":113517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":704385,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:01:45.889 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-15T00:01:45.889 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-15T00:01:45.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-15T00:01:45.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-15T00:01:45.890 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-15T00:01:46.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.022+0000 7fabc8ded640 1 Processor -- start 2024-04-15T00:01:46.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.022+0000 7fabc8ded640 1 -- start start 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.023+0000 7fabc8ded640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc415b110 0x7fabc40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.023+0000 7fabc8ded640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc40cf910 con 0x7fabc40cc530 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.023+0000 7fabc8ded640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc40cf350 con 0x7fabc40cdff0 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.023+0000 7fabc8ded640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fabc40cf630 con 0x7fabc415b110 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.024+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc415b110 0x7fabc40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.024+0000 7fabc259c640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fabc40cc530 0x7fabc406c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54694/0 (socket says 172.21.15.29:54694) 2024-04-15T00:01:46.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.024+0000 7fabc259c640 1 -- 172.21.15.29:0/2922840387 learned_addr learned my addr 172.21.15.29:0/2922840387 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:46.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.026+0000 7fabc1d9b640 1 -- 172.21.15.29:0/2922840387 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444292149 0 0) 0x7fabc40cf910 con 0x7fabc40cc530 2024-04-15T00:01:46.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.026+0000 7fabc1d9b640 1 -- 172.21.15.29:0/2922840387 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabb0003520 con 0x7fabc40cc530 2024-04-15T00:01:46.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.027+0000 7fabbbfff640 1 -- 172.21.15.29:0/2922840387 >> v1:172.21.15.37:6789/0 conn(0x7fabc40cdff0 legacy=0x7fabc4164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:46.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.027+0000 7fabbbfff640 1 -- 172.21.15.29:0/2922840387 >> v1:172.21.15.29:6789/0 conn(0x7fabc40cc530 legacy=0x7fabc406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.027+0000 7fabbbfff640 1 -- 172.21.15.29:0/2922840387 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc415a630 con 0x7fabc415b110 2024-04-15T00:01:46.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.029+0000 7fabbbfff640 1 --2- 172.21.15.29:0/2922840387 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc415b110 0x7fabc40cc910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fabac0097d0 tx=0x7fabac02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d041349d91015e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:46.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.031+0000 7fabc1d9b640 1 -- 172.21.15.29:0/2922840387 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac035020 con 0x7fabc415b110 2024-04-15T00:01:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc1d9b640 1 -- 172.21.15.29:0/2922840387 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac031800 con 0x7fabc415b110 2024-04-15T00:01:46.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc1d9b640 1 -- 172.21.15.29:0/2922840387 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac031bb0 con 0x7fabc415b110 2024-04-15T00:01:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 -- 172.21.15.29:0/2922840387 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc415b110 msgr2=0x7fabc40cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2922840387 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc415b110 0x7fabc40cc910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fabac0097d0 tx=0x7fabac02b8a0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 -- 172.21.15.29:0/2922840387 shutdown_connections 2024-04-15T00:01:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2922840387 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc415b110 0x7fabc40cc910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 -- 172.21.15.29:0/2922840387 >> 172.21.15.29:0/2922840387 conn(0x7fabc40cfb20 msgr2=0x7fabc40cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 -- 172.21.15.29:0/2922840387 shutdown_connections 2024-04-15T00:01:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.033+0000 7fabc8ded640 1 -- 172.21.15.29:0/2922840387 wait complete. 2024-04-15T00:01:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 Processor -- start 2024-04-15T00:01:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 -- start start 2024-04-15T00:01:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc40cc530 0x7fabc40b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 0x7fabc40b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc415b110 0x7fabc40b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fabc40cebc0 con 0x7fabc40cdff0 2024-04-15T00:01:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabc415abf0 con 0x7fabc415b110 2024-04-15T00:01:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.035+0000 7fabc8ded640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fabc4154b10 con 0x7fabc40cc530 2024-04-15T00:01:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.036+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 0x7fabc40b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.036+0000 7fabc259c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc40cc530 0x7fabc40b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.036+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 0x7fabc40b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47072/0 (socket says 172.21.15.29:47072) 2024-04-15T00:01:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.036+0000 7fabbbfff640 1 -- 172.21.15.29:0/2264636092 learned_addr learned my addr 172.21.15.29:0/2264636092 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.039+0000 7fabc2d9d640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc415b110 0x7fabc40b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.040+0000 7fabbbfff640 1 -- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc40cc530 msgr2=0x7fabc40b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.040+0000 7fabbbfff640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc40cc530 0x7fabc40b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.040+0000 7fabbbfff640 1 -- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc415b110 msgr2=0x7fabc40b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.040+0000 7fabbbfff640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc415b110 0x7fabc40b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.040+0000 7fabbbfff640 1 -- 172.21.15.29:0/2264636092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc40b45d0 con 0x7fabc40cdff0 2024-04-15T00:01:46.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.042+0000 7fabbbfff640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 0x7fabc40b2d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fabac034040 tx=0x7fabac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:46.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.047+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac048070 con 0x7fabc40cdff0 2024-04-15T00:01:46.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.047+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac031600 con 0x7fabc40cdff0 2024-04-15T00:01:46.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.047+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc40b48b0 con 0x7fabc40cdff0 2024-04-15T00:01:46.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.047+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac003a20 con 0x7fabc40cdff0 2024-04-15T00:01:46.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.047+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc40b4e70 con 0x7fabc40cdff0 2024-04-15T00:01:46.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.048+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc404f540 con 0x7fabc40cdff0 2024-04-15T00:01:46.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.311+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fabac04b070 con 0x7fabc40cdff0 2024-04-15T00:01:46.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.312+0000 7fabbaffd640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faba406b990 0x7faba406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.312+0000 7fabc259c640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faba406b990 0x7faba406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.312+0000 7fabc259c640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faba406b990 0x7faba406de50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabb4005880 tx=0x7fabb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:46.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.326+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fabac078c90 con 0x7fabc40cdff0 2024-04-15T00:01:46.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.326+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fabac052020 con 0x7fabc40cdff0 2024-04-15T00:01:46.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.558+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fabc40b5aa0 con 0x7fabc40cdff0 2024-04-15T00:01:46.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.705+0000 7fabbaffd640 1 -- 172.21.15.29:0/2264636092 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172376 (secure 0 0 0) 0x7fabac07fe20 con 0x7fabc40cdff0 2024-04-15T00:01:46.713 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faba406b990 msgr2=0x7faba406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faba406b990 0x7faba406de50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabb4005880 tx=0x7fabb4009040 comp rx=0 tx=0).stop 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 msgr2=0x7fabc40b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 0x7fabc40b2d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fabac034040 tx=0x7fabac0046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 shutdown_connections 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faba406b990 0x7faba406de50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc415b110 0x7fabc40b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabc40cdff0 0x7fabc40b2d60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 --2- 172.21.15.29:0/2264636092 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fabc40cc530 0x7fabc40b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 >> 172.21.15.29:0/2264636092 conn(0x7fabc40cfb20 msgr2=0x7fabc4153370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.707+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 shutdown_connections 2024-04-15T00:01:46.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.708+0000 7fabc8ded640 1 -- 172.21.15.29:0/2264636092 wait complete. 2024-04-15T00:01:46.725 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":4102667027},{"type":"v1","addr":"172.21.15.37:6801","nonce":4102667027}]},"active_addr":"172.21.15.37:6801/4102667027","active_change":"2024-04-15T00:00:46.892855+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3247370104}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1018532538}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":711346221}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1465213775}]}]} 2024-04-15T00:01:46.728 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-15T00:01:46.728 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-15T00:01:46.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.825+0000 7f06726de640 1 Processor -- start 2024-04-15T00:01:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.825+0000 7f06726de640 1 -- start start 2024-04-15T00:01:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.826+0000 7f06726de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 0x7f066c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.826+0000 7f06726de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f066c0cdff0 0x7f066c0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.826+0000 7f06726de640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f066c0cf910 con 0x7f066c15b110 2024-04-15T00:01:46.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.826+0000 7f06726de640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f066c0cf350 con 0x7f066c0cdff0 2024-04-15T00:01:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.826+0000 7f06726de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f066c0cf630 con 0x7f066c0cc530 2024-04-15T00:01:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.827+0000 7f066bfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 0x7f066c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.827+0000 7f066bfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 0x7f066c0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57218/0 (socket says 172.21.15.29:57218) 2024-04-15T00:01:46.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.827+0000 7f066bfff640 1 -- 172.21.15.29:0/3074321769 learned_addr learned my addr 172.21.15.29:0/3074321769 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:46.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.830+0000 7f066bfff640 1 -- 172.21.15.29:0/3074321769 >> v2:172.21.15.29:3300/0 conn(0x7f066c0cdff0 msgr2=0x7f066c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:46.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.830+0000 7f066bfff640 1 --2- 172.21.15.29:0/3074321769 >> v2:172.21.15.29:3300/0 conn(0x7f066c0cdff0 0x7f066c0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.830+0000 7f066bfff640 1 -- 172.21.15.29:0/3074321769 >> v1:172.21.15.29:6789/0 conn(0x7f066c15b110 legacy=0x7f066c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:46.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.830+0000 7f066bfff640 1 -- 172.21.15.29:0/3074321769 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c15a630 con 0x7f066c0cc530 2024-04-15T00:01:46.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.833+0000 7f066bfff640 1 --2- 172.21.15.29:0/3074321769 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 0x7f066c0cc910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0660009870 tx=0x7f066002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12265b83dfeb546d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:46.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.836+0000 7f066affd640 1 -- 172.21.15.29:0/3074321769 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660035020 con 0x7f066c0cc530 2024-04-15T00:01:46.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.836+0000 7f066affd640 1 -- 172.21.15.29:0/3074321769 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0660031640 con 0x7f066c0cc530 2024-04-15T00:01:46.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.836+0000 7f066affd640 1 -- 172.21.15.29:0/3074321769 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066002d040 con 0x7f066c0cc530 2024-04-15T00:01:46.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 -- 172.21.15.29:0/3074321769 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 msgr2=0x7f066c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 --2- 172.21.15.29:0/3074321769 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 0x7f066c0cc910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0660009870 tx=0x7f066002b8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 -- 172.21.15.29:0/3074321769 shutdown_connections 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 --2- 172.21.15.29:0/3074321769 >> v2:172.21.15.29:3300/0 conn(0x7f066c0cdff0 0x7f066c0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 --2- 172.21.15.29:0/3074321769 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c0cc530 0x7f066c0cc910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 -- 172.21.15.29:0/3074321769 >> 172.21.15.29:0/3074321769 conn(0x7f066c0cfb20 msgr2=0x7f066c0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 -- 172.21.15.29:0/3074321769 shutdown_connections 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.837+0000 7f06726de640 1 -- 172.21.15.29:0/3074321769 wait complete. 2024-04-15T00:01:46.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.839+0000 7f06726de640 1 Processor -- start 2024-04-15T00:01:46.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.839+0000 7f06726de640 1 -- start start 2024-04-15T00:01:46.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.839+0000 7f06726de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066c0cc530 0x7f066c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.839+0000 7f06726de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f066c0cdff0 0x7f066c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.840+0000 7f06726de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 0x7f066c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:46.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.840+0000 7f06726de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f066c0cebc0 con 0x7f066c0cdff0 2024-04-15T00:01:46.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.840+0000 7f06726de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f066c15abf0 con 0x7f066c0cc530 2024-04-15T00:01:46.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.840+0000 7f06726de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f066c154b10 con 0x7f066c15b110 2024-04-15T00:01:46.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.840+0000 7f0670c7b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 0x7f066c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.841+0000 7f0670c7b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 0x7f066c0b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57228/0 (socket says 172.21.15.29:57228) 2024-04-15T00:01:46.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.841+0000 7f0670c7b640 1 -- 172.21.15.29:0/1137379392 learned_addr learned my addr 172.21.15.29:0/1137379392 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:46.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.842+0000 7f066b7fe640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f066c0cdff0 0x7f066c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:46.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.846+0000 7f0670c7b640 1 -- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066c0cc530 msgr2=0x7f066c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.846+0000 7f0670c7b640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066c0cc530 0x7f066c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.846+0000 7f0670c7b640 1 -- 172.21.15.29:0/1137379392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f066c0cdff0 msgr2=0x7f066c0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:46.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.846+0000 7f0670c7b640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f066c0cdff0 0x7f066c0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:46.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.846+0000 7f0670c7b640 1 -- 172.21.15.29:0/1137379392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c0b2490 con 0x7f066c15b110 2024-04-15T00:01:46.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.849+0000 7f0670c7b640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 0x7f066c0b0ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f066400b970 tx=0x7f066400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:46.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.852+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664019070 con 0x7f066c15b110 2024-04-15T00:01:46.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.852+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066c0b21b0 con 0x7f066c15b110 2024-04-15T00:01:46.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.852+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f066c159d80 con 0x7f066c15b110 2024-04-15T00:01:46.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:46.853+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066c04f540 con 0x7f066c15b110 2024-04-15T00:01:47.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.171+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066400cb40 con 0x7f066c15b110 2024-04-15T00:01:47.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.171+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664023060 con 0x7f066c15b110 2024-04-15T00:01:47.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.172+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f066401c070 con 0x7f066c15b110 2024-04-15T00:01:47.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.172+0000 7f0668ff9640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f065806b990 0x7f065806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.172+0000 7f066bfff640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f065806b990 0x7f065806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.173+0000 7f066bfff640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f065806b990 0x7f065806de50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0660036000 tx=0x7f0660030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:47.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.177+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0664057360 con 0x7f066c15b110 2024-04-15T00:01:47.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.192+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f06640592c0 con 0x7f066c15b110 2024-04-15T00:01:47.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.378+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f066c06e000 con 0x7f066c15b110 2024-04-15T00:01:47.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.419+0000 7f0668ff9640 1 -- 172.21.15.29:0/1137379392 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18442 (secure 0 0 0) 0x7f066c06e000 con 0x7f066c15b110 2024-04-15T00:01:47.426 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:47.426 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:19.608228+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:47.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f065806b990 msgr2=0x7f065806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:47.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f065806b990 0x7f065806de50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0660036000 tx=0x7f0660030000 comp rx=0 tx=0).stop 2024-04-15T00:01:47.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 msgr2=0x7f066c0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:47.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 0x7f066c0b0ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f066400b970 tx=0x7f066400be30 comp rx=0 tx=0).stop 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 shutdown_connections 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f065806b990 0x7f065806de50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f066c15b110 0x7f066c0b0ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f066c0cdff0 0x7f066c0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 --2- 172.21.15.29:0/1137379392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066c0cc530 0x7f066c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 >> 172.21.15.29:0/1137379392 conn(0x7f066c0cfb20 msgr2=0x7f066c14fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 shutdown_connections 2024-04-15T00:01:47.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.422+0000 7f06726de640 1 -- 172.21.15.29:0/1137379392 wait complete. 2024-04-15T00:01:47.440 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-15T00:01:47.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:47.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.536+0000 7f9300636640 1 Processor -- start 2024-04-15T00:01:47.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.536+0000 7f9300636640 1 -- start start 2024-04-15T00:01:47.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.537+0000 7f9300636640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92f815a530 0x7f92f80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.537+0000 7f9300636640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 0x7f92f80cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.537+0000 7f9300636640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f80ce030 con 0x7f92f80caad0 2024-04-15T00:01:47.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.537+0000 7f9300636640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f92f8154cf0 con 0x7f92f815a530 2024-04-15T00:01:47.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.537+0000 7f9300636640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f92f815b480 con 0x7f92f80cca40 2024-04-15T00:01:47.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.538+0000 7f92fdbd1640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92f815a530 0x7f92f80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.538+0000 7f92febd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 0x7f92f80cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.538+0000 7f92febd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 0x7f92f80cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57238/0 (socket says 172.21.15.29:57238) 2024-04-15T00:01:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.538+0000 7f92febd3640 1 -- 172.21.15.29:0/3960474480 learned_addr learned my addr 172.21.15.29:0/3960474480 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.540+0000 7f92febd3640 1 -- 172.21.15.29:0/3960474480 >> v2:172.21.15.29:3300/0 conn(0x7f92f815a530 msgr2=0x7f92f80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:47.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.540+0000 7f92febd3640 1 --2- 172.21.15.29:0/3960474480 >> v2:172.21.15.29:3300/0 conn(0x7f92f815a530 0x7f92f80cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.540+0000 7f92febd3640 1 -- 172.21.15.29:0/3960474480 >> v1:172.21.15.29:6789/0 conn(0x7f92f80caad0 legacy=0x7f92f80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:47.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.540+0000 7f92febd3640 1 -- 172.21.15.29:0/3960474480 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f815abe0 con 0x7f92f80cca40 2024-04-15T00:01:47.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.543+0000 7f92febd3640 1 --2- 172.21.15.29:0/3960474480 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 0x7f92f80cebd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009e50 tx=0x7f92f402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955d2f945c4b232e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.545+0000 7f92fd3d0640 1 -- 172.21.15.29:0/3960474480 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f402cb00 con 0x7f92f80cca40 2024-04-15T00:01:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f92fd3d0640 1 -- 172.21.15.29:0/3960474480 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f402cca0 con 0x7f92f80cca40 2024-04-15T00:01:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f92fd3d0640 1 -- 172.21.15.29:0/3960474480 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4034610 con 0x7f92f80cca40 2024-04-15T00:01:47.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 -- 172.21.15.29:0/3960474480 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 msgr2=0x7f92f80cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 --2- 172.21.15.29:0/3960474480 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 0x7f92f80cebd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009e50 tx=0x7f92f402bf60 comp rx=0 tx=0).stop 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 -- 172.21.15.29:0/3960474480 shutdown_connections 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 --2- 172.21.15.29:0/3960474480 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f80cca40 0x7f92f80cebd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 --2- 172.21.15.29:0/3960474480 >> v2:172.21.15.29:3300/0 conn(0x7f92f815a530 0x7f92f80cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 -- 172.21.15.29:0/3960474480 >> 172.21.15.29:0/3960474480 conn(0x7f92f80cfb20 msgr2=0x7f92f80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 -- 172.21.15.29:0/3960474480 shutdown_connections 2024-04-15T00:01:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.547+0000 7f9300636640 1 -- 172.21.15.29:0/3960474480 wait complete. 2024-04-15T00:01:47.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 Processor -- start 2024-04-15T00:01:47.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 -- start start 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 0x7f92f815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f80cca40 0x7f92f81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f815a530 0x7f92f815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f92f815b1a0 con 0x7f92f80caad0 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92f815a980 con 0x7f92f80cca40 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.549+0000 7f9300636640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f92f80ce3d0 con 0x7f92f815a530 2024-04-15T00:01:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.550+0000 7f92fe3d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 0x7f92f815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.550+0000 7f92febd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f815a530 0x7f92f815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.550+0000 7f92fdbd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f80cca40 0x7f92f81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.550+0000 7f92fe3d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 0x7f92f815e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36834/0 (socket says 172.21.15.29:36834) 2024-04-15T00:01:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.550+0000 7f92fe3d2640 1 -- 172.21.15.29:0/1207980134 learned_addr learned my addr 172.21.15.29:0/1207980134 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.553+0000 7f92fe3d2640 1 -- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f815a530 msgr2=0x7f92f815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.553+0000 7f92fe3d2640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f815a530 0x7f92f815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.553+0000 7f92fe3d2640 1 -- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f80cca40 msgr2=0x7f92f81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:47.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.553+0000 7f92fe3d2640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f80cca40 0x7f92f81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:47.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.553+0000 7f92fe3d2640 1 -- 172.21.15.29:0/1207980134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f8150de0 con 0x7f92f80caad0 2024-04-15T00:01:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.556+0000 7f92fe3d2640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 0x7f92f815e3a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c400 tx=0x7f92f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.559+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f00052d0 con 0x7f92f80caad0 2024-04-15T00:01:47.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.560+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f0005490 con 0x7f92f80caad0 2024-04-15T00:01:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.560+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f815c5e0 con 0x7f92f80caad0 2024-04-15T00:01:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.560+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0007260 con 0x7f92f80caad0 2024-04-15T00:01:47.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.560+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f815dba0 con 0x7f92f80caad0 2024-04-15T00:01:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.561+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f804f540 con 0x7f92f80caad0 2024-04-15T00:01:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.826+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f92f0007400 con 0x7f92f80caad0 2024-04-15T00:01:47.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.826+0000 7f92eeffd640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92dc06b9e0 0x7f92dc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:47.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.827+0000 7f92fdbd1640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92dc06b9e0 0x7f92dc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:47.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.827+0000 7f92fdbd1640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92dc06b9e0 0x7f92dc06dea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92f80d0510 tx=0x7f92e8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.840+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f92f0056870 con 0x7f92f80caad0 2024-04-15T00:01:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:47.840+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f92f00587d0 con 0x7f92f80caad0 2024-04-15T00:01:48.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.068+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92f806e060 con 0x7f92f80caad0 2024-04-15T00:01:48.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.242+0000 7f92eeffd640 1 -- 172.21.15.29:0/1207980134 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18830 (secure 0 0 0) 0x7f92f005c870 con 0x7f92f80caad0 2024-04-15T00:01:48.249 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:48.249 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":28,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:47.869442+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92dc06b9e0 msgr2=0x7f92dc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92dc06b9e0 0x7f92dc06dea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92f80d0510 tx=0x7f92e8009190 comp rx=0 tx=0).stop 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 msgr2=0x7f92f815e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 0x7f92f815e3a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c400 tx=0x7f92f000c8c0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 shutdown_connections 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92dc06b9e0 0x7f92dc06dea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f815a530 0x7f92f815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f80cca40 0x7f92f81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 --2- 172.21.15.29:0/1207980134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f80caad0 0x7f92f815e3a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 >> 172.21.15.29:0/1207980134 conn(0x7f92f80cfb20 msgr2=0x7f92f80c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 shutdown_connections 2024-04-15T00:01:48.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.244+0000 7f9300636640 1 -- 172.21.15.29:0/1207980134 wait complete. 2024-04-15T00:01:48.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-15T00:01:48.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-15T00:01:48.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-15T00:01:48.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-15T00:01:48.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-15T00:01:48.265 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-15T00:01:48.265 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-15T00:01:48.266 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-15T00:01:48.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.443+0000 7f0cdedcb640 1 Processor -- start 2024-04-15T00:01:48.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.444+0000 7f0cdedcb640 1 -- start start 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.445+0000 7f0cdedcb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cbc90 0x7f0cd80716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.445+0000 7f0cdedcb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cd80c5240 0x7f0cd80c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.445+0000 7f0cdedcb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd8072010 con 0x7f0cd80cb8b0 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.445+0000 7f0cdedcb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd815a770 con 0x7f0cd80c5240 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.445+0000 7f0cdedcb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd8071c20 con 0x7f0cd80cbc90 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.446+0000 7f0cdddc9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0cd80cb8b0 0x7f0cd8156d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44290/0 (socket says 172.21.15.29:44290) 2024-04-15T00:01:48.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.446+0000 7f0cdddc9640 1 -- 172.21.15.29:0/1136880476 learned_addr learned my addr 172.21.15.29:0/1136880476 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:48.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.446+0000 7f42f63d4640 1 Processor -- start 2024-04-15T00:01:48.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.446+0000 7f42f63d4640 1 -- start start 2024-04-15T00:01:48.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.446+0000 7f0cde5ca640 1 --2- 172.21.15.29:0/1136880476 >> v2:172.21.15.37:3300/0 conn(0x7f0cd80c5240 0x7f0cd80c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.446+0000 7f0cdd5c8640 1 --2- 172.21.15.29:0/1136880476 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cbc90 0x7f0cd80716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.448+0000 7f42f63d4640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e804b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.448+0000 7f42f63d4640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e8046f20 con 0x7f42e80d4f80 2024-04-15T00:01:48.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.448+0000 7f42f63d4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e8046160 con 0x7f42e800e290 2024-04-15T00:01:48.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.448+0000 7f42f63d4640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f42e8046440 con 0x7f42e804b080 2024-04-15T00:01:48.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.450+0000 7f42f5bd3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f42e80d4f80 0x7f42e8005ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50490/0 (socket says 172.21.15.29:50490) 2024-04-15T00:01:48.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.450+0000 7f42f5bd3640 1 -- 172.21.15.29:0/2574054536 learned_addr learned my addr 172.21.15.29:0/2574054536 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7f0cdd5c8640 1 -- 172.21.15.29:0/1136880476 >> v2:172.21.15.37:3300/0 conn(0x7f0cd80c5240 msgr2=0x7f0cd80c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7f0cdd5c8640 1 --2- 172.21.15.29:0/1136880476 >> v2:172.21.15.37:3300/0 conn(0x7f0cd80c5240 0x7f0cd80c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7f0cdd5c8640 1 -- 172.21.15.29:0/1136880476 >> v1:172.21.15.37:6789/0 conn(0x7f0cd80cb8b0 legacy=0x7f0cd8156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7f0cdd5c8640 1 -- 172.21.15.29:0/1136880476 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81598c0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7f42f4bd1640 1 --2- 172.21.15.29:0/2574054536 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e804b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7fdde4b1e640 1 Processor -- start 2024-04-15T00:01:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.451+0000 7fdde4b1e640 1 -- start start 2024-04-15T00:01:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.453+0000 7fdde4b1e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdde00c4050 0x7fdde01628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.453+0000 7fdde4b1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c68c0 0x7fdde00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.453+0000 7fdde4b1e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde00c76e0 con 0x7fdde0158a00 2024-04-15T00:01:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.453+0000 7fdde4b1e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fdde0161e60 con 0x7fdde00c4050 2024-04-15T00:01:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.453+0000 7fdde4b1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fdde0162df0 con 0x7fdde00c68c0 2024-04-15T00:01:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7fddded9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c68c0 0x7fdde00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7fddde59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdde0158a00 0x7fdde015f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44310/0 (socket says 172.21.15.29:44310) 2024-04-15T00:01:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.453+0000 7f881fa0f640 1 Processor -- start 2024-04-15T00:01:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.454+0000 7f881fa0f640 1 -- start start 2024-04-15T00:01:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7f881fa0f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8818158a70 0x7f88180c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7f881fa0f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88180c77e0 con 0x7f881815f2f0 2024-04-15T00:01:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7f881fa0f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88180c7ac0 con 0x7f88180c8350 2024-04-15T00:01:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7f881fa0f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f8818162e10 con 0x7f8818158a70 2024-04-15T00:01:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7f0cdd5c8640 1 --2- 172.21.15.29:0/1136880476 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cbc90 0x7f0cd80716e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0cd815a8f0 tx=0x7f0cc802daf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e37418ba283a0f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7fddde59c640 1 -- 172.21.15.29:0/1203485246 learned_addr learned my addr 172.21.15.29:0/1203485246 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.455+0000 7fddddd9b640 1 --2- 172.21.15.29:0/1203485246 >> v2:172.21.15.29:3300/0 conn(0x7fdde00c4050 0x7fdde01628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.456+0000 7f097d76a640 1 Processor -- start 2024-04-15T00:01:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.456+0000 7f097d76a640 1 -- start start 2024-04-15T00:01:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.457+0000 7f881cfaa640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f881815f2f0 0x7f8818162700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50494/0 (socket says 172.21.15.29:50494) 2024-04-15T00:01:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.457+0000 7f881cfaa640 1 -- 172.21.15.29:0/1244719247 learned_addr learned my addr 172.21.15.29:0/1244719247 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.458+0000 7f097d76a640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f0970046450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.458+0000 7f097d76a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09700e3790 0x7f097004be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.458+0000 7f097d76a640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09700dd790 con 0x7f097004ba50 2024-04-15T00:01:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.458+0000 7f097d76a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0970045440 con 0x7f09700e3790 2024-04-15T00:01:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.458+0000 7f097d76a640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0970045fc0 con 0x7f09700dd3b0 2024-04-15T00:01:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.458+0000 7f42f4bd1640 1 -- 172.21.15.29:0/2574054536 >> v1:172.21.15.37:6789/0 conn(0x7f42e800e290 legacy=0x7f42e80db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.459+0000 7f42f4bd1640 1 -- 172.21.15.29:0/2574054536 >> v1:172.21.15.29:6789/0 conn(0x7f42e80d4f80 legacy=0x7f42e8005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.459+0000 7f42f4bd1640 1 -- 172.21.15.29:0/2574054536 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e8046720 con 0x7f42e804b080 2024-04-15T00:01:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.460+0000 7fbe96698640 1 Processor -- start 2024-04-15T00:01:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.460+0000 7fbe96698640 1 -- start start 2024-04-15T00:01:48.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7f097cf69640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09700e3790 0x7f097004be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fbe96698640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbe90152610 0x7fbe90158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fbe96698640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90071d90 0x7fbe900728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fbe96698640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe90072e20 0x7fbe9006b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fbe96698640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbe900c8280 con 0x7fbe90152610 2024-04-15T00:01:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fbe96698640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbe90073680 con 0x7fbe90072e20 2024-04-15T00:01:48.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fbe96698640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbe901529f0 con 0x7fbe90071d90 2024-04-15T00:01:48.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fddddd9b640 1 -- 172.21.15.29:0/1203485246 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c68c0 msgr2=0x7fdde00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fddddd9b640 1 --2- 172.21.15.29:0/1203485246 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c68c0 0x7fdde00c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fddddd9b640 1 -- 172.21.15.29:0/1203485246 >> v1:172.21.15.37:6789/0 conn(0x7fdde0158a00 legacy=0x7fdde015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.461+0000 7fddddd9b640 1 -- 172.21.15.29:0/1203485246 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde00c79c0 con 0x7fdde00c4050 2024-04-15T00:01:48.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.462+0000 7f881d7ab640 1 --2- 172.21.15.29:0/1244719247 >> v2:172.21.15.29:3300/0 conn(0x7f8818158a70 0x7f88180c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.465+0000 7f0cdcdc7640 1 -- 172.21.15.29:0/1136880476 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc802f8b0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.465+0000 7f0cdcdc7640 1 -- 172.21.15.29:0/1136880476 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc802fa50 con 0x7f0cd80cbc90 2024-04-15T00:01:48.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.465+0000 7f0cdcdc7640 1 -- 172.21.15.29:0/1136880476 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc802f8b0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.466+0000 7f097cf69640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09700e3790 0x7f097004be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46786/0 (socket says 172.21.15.29:46786) 2024-04-15T00:01:48.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.466+0000 7f097cf69640 1 -- 172.21.15.29:0/3239056234 learned_addr learned my addr 172.21.15.29:0/3239056234 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.466+0000 7fbe94c35640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe90072e20 0x7fbe9006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.467+0000 7f42f4bd1640 1 --2- 172.21.15.29:0/2574054536 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e804b610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42e00097d0 tx=0x7f42e002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed20ba384adc1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.467+0000 7fbe94c35640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe90072e20 0x7fbe9006b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46802/0 (socket says 172.21.15.29:46802) 2024-04-15T00:01:48.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.467+0000 7fbe94c35640 1 -- 172.21.15.29:0/146334642 learned_addr learned my addr 172.21.15.29:0/146334642 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1136880476 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cbc90 msgr2=0x7f0cd80716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 --2- 172.21.15.29:0/1136880476 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cbc90 0x7f0cd80716e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0cd815a8f0 tx=0x7f0cc802daf0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7fbe8f7fe640 1 --2- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90071d90 0x7fbe900728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1136880476 shutdown_connections 2024-04-15T00:01:48.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 --2- 172.21.15.29:0/1136880476 >> v2:172.21.15.37:3300/0 conn(0x7f0cd80c5240 0x7f0cd80c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 --2- 172.21.15.29:0/1136880476 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cbc90 0x7f0cd80716e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1136880476 >> 172.21.15.29:0/1136880476 conn(0x7f0cd806b200 msgr2=0x7f0cd806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1136880476 shutdown_connections 2024-04-15T00:01:48.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.468+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1136880476 wait complete. 2024-04-15T00:01:48.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.469+0000 7f0977fff640 1 --2- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f0970046450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.469+0000 7f097cf69640 1 -- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 msgr2=0x7f0970046450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.469+0000 7f097cf69640 1 --2- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f0970046450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.469+0000 7f097cf69640 1 -- 172.21.15.29:0/3239056234 >> v1:172.21.15.29:6789/0 conn(0x7f097004ba50 legacy=0x7f09700e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.469+0000 7f097cf69640 1 -- 172.21.15.29:0/3239056234 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09700e3e80 con 0x7f09700e3790 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.470+0000 7f0cdedcb640 1 Processor -- start 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.470+0000 7f0cdedcb640 1 -- start start 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7f0cdedcb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd80c5240 0x7f0cd81e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7f0cdedcb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cb8b0 0x7f0cd81e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7f0cdedcb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd80cbc90 0x7f0cd81e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7f0cdedcb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd815a120 con 0x7f0cd80c5240 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7f0cdedcb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8159e40 con 0x7f0cd80cbc90 2024-04-15T00:01:48.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7f0cdedcb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd815a400 con 0x7f0cd80cb8b0 2024-04-15T00:01:48.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.471+0000 7fddddd9b640 1 --2- 172.21.15.29:0/1203485246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c4050 0x7fdde01628b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009d90 tx=0x7fddd802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84a9d6dd42343f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.472+0000 7f097cf69640 1 --2- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097004be70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0978073bd0 tx=0x7f0978069e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94256dfb7a1be0b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.473+0000 7f0cde5ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd80cbc90 0x7f0cd81e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.473+0000 7f42e7fff640 1 -- 172.21.15.29:0/2574054536 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0034070 con 0x7f42e804b080 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.473+0000 7f42e7fff640 1 -- 172.21.15.29:0/2574054536 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e0030880 con 0x7f42e804b080 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.473+0000 7f42e7fff640 1 -- 172.21.15.29:0/2574054536 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0030c50 con 0x7f42e804b080 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f42f63d4640 1 -- 172.21.15.29:0/2574054536 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 msgr2=0x7f42e804b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f42f63d4640 1 --2- 172.21.15.29:0/2574054536 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e804b610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42e00097d0 tx=0x7f42e002b9c0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f42f63d4640 1 -- 172.21.15.29:0/2574054536 shutdown_connections 2024-04-15T00:01:48.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7fbe94c35640 1 -- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90071d90 msgr2=0x7fbe900728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7fbe94c35640 1 --2- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90071d90 0x7fbe900728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7fbe94c35640 1 -- 172.21.15.29:0/146334642 >> v2:172.21.15.29:3300/0 conn(0x7fbe90152610 msgr2=0x7fbe90158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7fbe94c35640 1 --2- 172.21.15.29:0/146334642 >> v2:172.21.15.29:3300/0 conn(0x7fbe90152610 0x7fbe90158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f42f63d4640 1 --2- 172.21.15.29:0/2574054536 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e804b610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7fbe94c35640 1 -- 172.21.15.29:0/146334642 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe900c7390 con 0x7fbe90072e20 2024-04-15T00:01:48.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f881d7ab640 1 -- 172.21.15.29:0/1244719247 >> v1:172.21.15.37:6789/0 conn(0x7f88180c8350 legacy=0x7f88181691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f881d7ab640 1 -- 172.21.15.29:0/1244719247 >> v1:172.21.15.29:6789/0 conn(0x7f881815f2f0 legacy=0x7f8818162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f881d7ab640 1 -- 172.21.15.29:0/1244719247 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8818161f00 con 0x7f8818158a70 2024-04-15T00:01:48.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.474+0000 7f42f63d4640 1 -- 172.21.15.29:0/2574054536 >> 172.21.15.29:0/2574054536 conn(0x7f42e8050170 msgr2=0x7f42e8050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.475+0000 7f42f63d4640 1 -- 172.21.15.29:0/2574054536 shutdown_connections 2024-04-15T00:01:48.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.475+0000 7f42f63d4640 1 -- 172.21.15.29:0/2574054536 wait complete. 2024-04-15T00:01:48.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.475+0000 7f721522d640 1 Processor -- start 2024-04-15T00:01:48.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.475+0000 7f721522d640 1 -- start start 2024-04-15T00:01:48.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f721522d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72101522d0 0x7f7210158af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f42f63d4640 1 Processor -- start 2024-04-15T00:01:48.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f721522d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72100c3590 0x7f72100c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f721522d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7210159030 con 0x7f7210070490 2024-04-15T00:01:48.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f721522d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f72100c8800 con 0x7f72100c3590 2024-04-15T00:01:48.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f721522d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f72100c8a30 con 0x7f72101522d0 2024-04-15T00:01:48.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f42f63d4640 1 -- start start 2024-04-15T00:01:48.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f0cde5ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd80cbc90 0x7f0cd81e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46810/0 (socket says 172.21.15.29:46810) 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.476+0000 7f0cde5ca640 1 -- 172.21.15.29:0/1260994095 learned_addr learned my addr 172.21.15.29:0/1260994095 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.477+0000 7f42f63d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42e800e290 0x7f42e80dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.477+0000 7f42f63d4640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e80de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.477+0000 7f42f63d4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42e80d4f80 0x7f42e81781e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.477+0000 7f42f63d4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f42e80d5410 con 0x7f42e80d4f80 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.477+0000 7f42f63d4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42e80065e0 con 0x7f42e800e290 2024-04-15T00:01:48.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.477+0000 7f42f63d4640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f42e8045320 con 0x7f42e804b080 2024-04-15T00:01:48.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.478+0000 7f0cdd5c8640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cb8b0 0x7f0cd81e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.480+0000 7fbe94c35640 1 --2- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90072e20 0x7fbe9006b370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe900ca000 tx=0x7fbe8802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d371880a3787e81 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.480+0000 7f42f4bd1640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e80de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.481+0000 7f42f4bd1640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e80de5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57336/0 (socket says 172.21.15.29:57336) 2024-04-15T00:01:48.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.481+0000 7f42f4bd1640 1 -- 172.21.15.29:0/3195959946 learned_addr learned my addr 172.21.15.29:0/3195959946 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.481+0000 7f881d7ab640 1 --2- 172.21.15.29:0/1244719247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8818158a70 0x7f88180c68c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f880c0097a0 tx=0x7f880c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc19553375ef5d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.481+0000 7f0cdddc9640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd80c5240 0x7f0cd81e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.483+0000 7f0cde5ca640 1 -- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cb8b0 msgr2=0x7f0cd81e2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.483+0000 7f0cde5ca640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cd80cb8b0 0x7f0cd81e2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.483+0000 7f0cde5ca640 1 -- 172.21.15.29:0/1260994095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd80c5240 msgr2=0x7f0cd81e1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.483+0000 7f0cde5ca640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cd80c5240 0x7f0cd81e1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.483+0000 7f0cde5ca640 1 -- 172.21.15.29:0/1260994095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd80c8f30 con 0x7f0cd80cbc90 2024-04-15T00:01:48.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.485+0000 7f534c0a6640 1 Processor -- start 2024-04-15T00:01:48.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.486+0000 7f534c0a6640 1 -- start start 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.486+0000 7f534c0a6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f534406b850 0x7f534415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.486+0000 7f534c0a6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53440c9f80 con 0x7f5344070b50 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.486+0000 7f534c0a6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53440ca260 con 0x7f534406b470 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.487+0000 7f534c0a6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f53440c7a00 con 0x7f534406b850 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.488+0000 7f42f4bd1640 1 -- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42e800e290 msgr2=0x7f42e80dd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.488+0000 7f42f4bd1640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42e800e290 0x7f42e80dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.488+0000 7f42f4bd1640 1 -- 172.21.15.29:0/3195959946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42e80d4f80 msgr2=0x7f42e81781e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.488+0000 7f42f4bd1640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42e80d4f80 0x7f42e81781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.488+0000 7f42f4bd1640 1 -- 172.21.15.29:0/3195959946 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e80ceef0 con 0x7f42e804b080 2024-04-15T00:01:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.491+0000 7fbe8effd640 1 -- 172.21.15.29:0/146334642 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8802cb00 con 0x7fbe90072e20 2024-04-15T00:01:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.491+0000 7fbe8effd640 1 -- 172.21.15.29:0/146334642 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8802cca0 con 0x7fbe90072e20 2024-04-15T00:01:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.491+0000 7fbe8effd640 1 -- 172.21.15.29:0/146334642 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88034610 con 0x7fbe90072e20 2024-04-15T00:01:48.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 -- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90072e20 msgr2=0x7fbe9006b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 --2- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90072e20 0x7fbe9006b370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe900ca000 tx=0x7fbe8802bf60 comp rx=0 tx=0).stop 2024-04-15T00:01:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7f0cde5ca640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd80cbc90 0x7f0cd81e31b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400e850 tx=0x7f0cd400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 -- 172.21.15.29:0/146334642 shutdown_connections 2024-04-15T00:01:48.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7f42f4bd1640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e80de5f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42e00098f0 tx=0x7f42e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 --2- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90072e20 0x7fbe9006b370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 --2- 172.21.15.29:0/146334642 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90071d90 0x7fbe900728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 --2- 172.21.15.29:0/146334642 >> v2:172.21.15.29:3300/0 conn(0x7fbe90152610 0x7fbe90158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 -- 172.21.15.29:0/146334642 >> 172.21.15.29:0/146334642 conn(0x7fbe900c8c70 msgr2=0x7fbe900c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 -- 172.21.15.29:0/146334642 shutdown_connections 2024-04-15T00:01:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7fbe96698640 1 -- 172.21.15.29:0/146334642 wait complete. 2024-04-15T00:01:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7f0976ffd640 1 -- 172.21.15.29:0/3239056234 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09780ae600 con 0x7f09700e3790 2024-04-15T00:01:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7f0976ffd640 1 -- 172.21.15.29:0/3239056234 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09780ae7e0 con 0x7f09700e3790 2024-04-15T00:01:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.492+0000 7f0976ffd640 1 -- 172.21.15.29:0/3239056234 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09780aec50 con 0x7f09700e3790 2024-04-15T00:01:48.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7fdddd59a640 1 -- 172.21.15.29:0/1203485246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8039070 con 0x7fdde00c4050 2024-04-15T00:01:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7fdddd59a640 1 -- 172.21.15.29:0/1203485246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd802cc50 con 0x7fdde00c4050 2024-04-15T00:01:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 -- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 msgr2=0x7f097004be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 --2- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097004be70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0978073bd0 tx=0x7f0978069e70 comp rx=0 tx=0).stop 2024-04-15T00:01:48.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7fdddd59a640 1 -- 172.21.15.29:0/1203485246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8034440 con 0x7fdde00c4050 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 -- 172.21.15.29:0/3239056234 shutdown_connections 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 --2- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097004be70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 --2- 172.21.15.29:0/3239056234 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f0970046450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 -- 172.21.15.29:0/3239056234 >> 172.21.15.29:0/3239056234 conn(0x7f0970050170 msgr2=0x7f0970050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 -- 172.21.15.29:0/3239056234 shutdown_connections 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.493+0000 7f097d76a640 1 -- 172.21.15.29:0/3239056234 wait complete. 2024-04-15T00:01:48.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7f720ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72101522d0 0x7f7210158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1203485246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c4050 msgr2=0x7fdde01628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 --2- 172.21.15.29:0/1203485246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c4050 0x7fdde01628b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009d90 tx=0x7fddd802bea0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1203485246 shutdown_connections 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 --2- 172.21.15.29:0/1203485246 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c68c0 0x7fdde00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 --2- 172.21.15.29:0/1203485246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c4050 0x7fdde01628b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1203485246 >> 172.21.15.29:0/1203485246 conn(0x7fdde006f140 msgr2=0x7fdde006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1203485246 shutdown_connections 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1203485246 wait complete. 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7f534a643640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5344070b50 0x7f5344154060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50504/0 (socket says 172.21.15.29:50504) 2024-04-15T00:01:48.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7f534a643640 1 -- 172.21.15.29:0/662153698 learned_addr learned my addr 172.21.15.29:0/662153698 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:48.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fbe96698640 1 Processor -- start 2024-04-15T00:01:48.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0034040 con 0x7f42e804b080 2024-04-15T00:01:48.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e80db9d0 con 0x7f42e804b080 2024-04-15T00:01:48.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e80c8890 con 0x7f42e804b080 2024-04-15T00:01:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.494+0000 7fbe96698640 1 -- start start 2024-04-15T00:01:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.495+0000 7f720e59c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72100c3590 0x7f72100c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.495+0000 7f097d76a640 1 Processor -- start 2024-04-15T00:01:48.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7f097d76a640 1 -- start start 2024-04-15T00:01:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42e804bc50 con 0x7f42e804b080 2024-04-15T00:01:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7f5349641640 1 --2- 172.21.15.29:0/662153698 >> v2:172.21.15.37:3300/0 conn(0x7f534406b850 0x7f534415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fbe96698640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90071d90 0x7fbe90152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fbe96698640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe90072e20 0x7fbe900c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7f720ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72101522d0 0x7f7210158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46814/0 (socket says 172.21.15.29:46814) 2024-04-15T00:01:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7f720ed9d640 1 -- 172.21.15.29:0/4217564262 learned_addr learned my addr 172.21.15.29:0/4217564262 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fdde4b1e640 1 Processor -- start 2024-04-15T00:01:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fbe96698640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90152610 0x7fbe90147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fbe96698640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900c7c30 con 0x7fbe90072e20 2024-04-15T00:01:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fbe96698640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe900c7950 con 0x7fbe90071d90 2024-04-15T00:01:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fbe96698640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbe900c7f10 con 0x7fbe90152610 2024-04-15T00:01:48.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.496+0000 7fdde4b1e640 1 -- start start 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7f097d76a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f097004ba50 0x7f0970169160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7f097d76a640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f097017cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7f097d76a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097016f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7f097d76a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0970045970 con 0x7f097004ba50 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7f097d76a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09700e3c20 con 0x7f09700e3790 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7f097d76a640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0970045c50 con 0x7f09700dd3b0 2024-04-15T00:01:48.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7fdde4b1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c4050 0x7fdde00c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7fdde4b1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c68c0 0x7fdde00cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7fdde4b1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde0158a00 0x7fdde013a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7fdde4b1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdde00c28c0 con 0x7fdde00c68c0 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7fdde4b1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01620b0 con 0x7fdde0158a00 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.497+0000 7fdde4b1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fdde00c2a40 con 0x7fdde00c4050 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.500+0000 7f720ed9d640 1 -- 172.21.15.29:0/4217564262 >> v2:172.21.15.29:3300/0 conn(0x7f72100c3590 msgr2=0x7f72100c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.500+0000 7f720ed9d640 1 --2- 172.21.15.29:0/4217564262 >> v2:172.21.15.29:3300/0 conn(0x7f72100c3590 0x7f72100c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.500+0000 7f720ed9d640 1 -- 172.21.15.29:0/4217564262 >> v1:172.21.15.37:6789/0 conn(0x7f7210070490 legacy=0x7f72100cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.500+0000 7f720ed9d640 1 -- 172.21.15.29:0/4217564262 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72100c8d10 con 0x7f72101522d0 2024-04-15T00:01:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.500+0000 7f5348e40640 1 -- 172.21.15.29:0/662153698 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438623804 0 0) 0x7f53440c9f80 con 0x7f5344070b50 2024-04-15T00:01:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.501+0000 7f5348e40640 1 -- 172.21.15.29:0/662153698 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5330003520 con 0x7f5344070b50 2024-04-15T00:01:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.501+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4017070 con 0x7f0cd80cbc90 2024-04-15T00:01:48.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.501+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd400c940 con 0x7f0cd80cbc90 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.501+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400eea0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.501+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd80c83b0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.502+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd80c8970 con 0x7f0cd80cbc90 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.503+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cd80cae50 con 0x7f0cd80cbc90 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.503+0000 7fddddd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c68c0 0x7fdde00cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.504+0000 7f5349641640 1 -- 172.21.15.29:0/662153698 >> v1:172.21.15.37:6789/0 conn(0x7f534406b470 legacy=0x7f53440c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.504+0000 7f5349641640 1 -- 172.21.15.29:0/662153698 >> v1:172.21.15.29:6789/0 conn(0x7f5344070b50 legacy=0x7f5344154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.504+0000 7f5349641640 1 -- 172.21.15.29:0/662153698 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534415dbd0 con 0x7f534406b850 2024-04-15T00:01:48.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.504+0000 7fbe8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90071d90 0x7fbe90152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.506+0000 7f720ed9d640 1 --2- 172.21.15.29:0/4217564262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f7210158af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7210070420 tx=0x7f720402b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3493e64661975d1c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.507+0000 7fbe8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90071d90 0x7fbe90152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46844/0 (socket says 172.21.15.29:46844) 2024-04-15T00:01:48.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.507+0000 7fbe8ffff640 1 -- 172.21.15.29:0/1729785630 learned_addr learned my addr 172.21.15.29:0/1729785630 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.507+0000 7fddddd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c68c0 0x7fdde00cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36926/0 (socket says 172.21.15.29:36926) 2024-04-15T00:01:48.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.507+0000 7fddddd9b640 1 -- 172.21.15.29:0/1608766513 learned_addr learned my addr 172.21.15.29:0/1608766513 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.508+0000 7f880bfff640 1 -- 172.21.15.29:0/1244719247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c034070 con 0x7f8818158a70 2024-04-15T00:01:48.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.508+0000 7f880bfff640 1 -- 172.21.15.29:0/1244719247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880c030610 con 0x7f8818158a70 2024-04-15T00:01:48.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.508+0000 7f880bfff640 1 -- 172.21.15.29:0/1244719247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c0309e0 con 0x7f8818158a70 2024-04-15T00:01:48.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.508+0000 7fbe8f7fe640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe90072e20 0x7fbe900c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 -- 172.21.15.29:0/1244719247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8818158a70 msgr2=0x7f88180c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 --2- 172.21.15.29:0/1244719247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8818158a70 0x7f88180c68c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f880c0097a0 tx=0x7f880c02b960 comp rx=0 tx=0).stop 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 -- 172.21.15.29:0/1244719247 shutdown_connections 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 --2- 172.21.15.29:0/1244719247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8818158a70 0x7f88180c68c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 -- 172.21.15.29:0/1244719247 >> 172.21.15.29:0/1244719247 conn(0x7f881806f140 msgr2=0x7f881806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 -- 172.21.15.29:0/1244719247 shutdown_connections 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.509+0000 7f881fa0f640 1 -- 172.21.15.29:0/1244719247 wait complete. 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.510+0000 7f881fa0f640 1 Processor -- start 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.510+0000 7f881fa0f640 1 -- start start 2024-04-15T00:01:48.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.511+0000 7f881fa0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88180c8350 0x7f881815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.511+0000 7f881fa0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8818158a70 0x7f8818148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.511+0000 7f881fa0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f881815f2f0 0x7f88181f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.511+0000 7f881fa0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f881815f760 con 0x7f881815f2f0 2024-04-15T00:01:48.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.511+0000 7f881fa0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8818162270 con 0x7f8818158a70 2024-04-15T00:01:48.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.511+0000 7f881fa0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f88180c4050 con 0x7f88180c8350 2024-04-15T00:01:48.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.513+0000 7fddddd9b640 1 -- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c4050 msgr2=0x7fdde00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.513+0000 7fddddd9b640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdde00c4050 0x7fdde00c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.513+0000 7fddddd9b640 1 -- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde0158a00 msgr2=0x7fdde013a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.513+0000 7fddddd9b640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde0158a00 0x7fdde013a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.513+0000 7fddddd9b640 1 -- 172.21.15.29:0/1608766513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde01410a0 con 0x7fdde00c68c0 2024-04-15T00:01:48.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.518+0000 7fbe8f7fe640 1 -- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90152610 msgr2=0x7fbe90147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.518+0000 7fbe8f7fe640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbe90152610 0x7fbe90147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.518+0000 7fbe8f7fe640 1 -- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90071d90 msgr2=0x7fbe90152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.518+0000 7fbe8f7fe640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe90071d90 0x7fbe90152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.518+0000 7fbe8f7fe640 1 -- 172.21.15.29:0/1729785630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe90153170 con 0x7fbe90072e20 2024-04-15T00:01:48.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.519+0000 7fddddd9b640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c68c0 0x7fdde00cc110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddd8037040 tx=0x7fddd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.522+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e804bc50 con 0x7f42e804b080 2024-04-15T00:01:48.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.522+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0039cb0 con 0x7f42e804b080 2024-04-15T00:01:48.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.522+0000 7fbe8f7fe640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe90072e20 0x7fbe900c3ae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e870 tx=0x7fbe8400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.523+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f42e0037070 con 0x7f42e804b080 2024-04-15T00:01:48.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.523+0000 7f097cf69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097016f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.523+0000 7f42e5ffb640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f42d406b9c0 0x7f42d406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.523+0000 7f42f53d2640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f42d406b9c0 0x7f42d406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.524+0000 7f097cf69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097016f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46854/0 (socket says 172.21.15.29:46854) 2024-04-15T00:01:48.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.524+0000 7f097cf69640 1 -- 172.21.15.29:0/2174419603 learned_addr learned my addr 172.21.15.29:0/2174419603 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.524+0000 7f42f53d2640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f42d406b9c0 0x7f42d406de80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f00502f0 tx=0x7f42f0069e70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.525+0000 7f0977fff640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f097004ba50 0x7f0970169160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.526+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f42e0079c50 con 0x7f42e804b080 2024-04-15T00:01:48.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.526+0000 7f42e5ffb640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f42d40752d0 0x7f42d4077770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.526+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 --> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42e003ae50 con 0x7f42d40752d0 2024-04-15T00:01:48.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.526+0000 7f42f5bd3640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f42d40752d0 0x7f42d4077770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.527+0000 7f42f5bd3640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f42d40752d0 0x7f42d4077770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.527+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42e0077e50 con 0x7f42e804b080 2024-04-15T00:01:48.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.528+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== osd.4 v2:172.21.15.37:6802/3398267610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42e003ae50 con 0x7f42d40752d0 2024-04-15T00:01:48.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.529+0000 7f09777fe640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f097017cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.530+0000 7f881d7ab640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88180c8350 0x7f881815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.530+0000 7f881d7ab640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88180c8350 0x7f881815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57370/0 (socket says 172.21.15.29:57370) 2024-04-15T00:01:48.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.530+0000 7f881d7ab640 1 -- 172.21.15.29:0/248551743 learned_addr learned my addr 172.21.15.29:0/248551743 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.533+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8039050 con 0x7fdde00c68c0 2024-04-15T00:01:48.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.533+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd8045070 con 0x7fdde00c68c0 2024-04-15T00:01:48.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde0155af0 con 0x7fdde00c68c0 2024-04-15T00:01:48.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde00cb630 con 0x7fdde00c68c0 2024-04-15T00:01:48.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd803e610 con 0x7fdde00c68c0 2024-04-15T00:01:48.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7f0977fff640 1 -- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 msgr2=0x7f097017cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7f0977fff640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f09700dd3b0 0x7f097017cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7f0977fff640 1 -- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 msgr2=0x7f097016f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7f0977fff640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09700e3790 0x7f097016f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7f0977fff640 1 -- 172.21.15.29:0/2174419603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097016c010 con 0x7f097004ba50 2024-04-15T00:01:48.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.534+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdde004f540 con 0x7fdde00c68c0 2024-04-15T00:01:48.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.539+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0cd401a070 con 0x7f0cd80cbc90 2024-04-15T00:01:48.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f0cce7fc640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0cbc06ba10 0x7f0cbc06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f0cdddc9640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0cbc06ba10 0x7f0cbc06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f881d7ab640 1 -- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8818158a70 msgr2=0x7f8818148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f881d7ab640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8818158a70 0x7f8818148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f881d7ab640 1 -- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f881815f2f0 msgr2=0x7f88181f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f881d7ab640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f881815f2f0 0x7f88181f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f881d7ab640 1 -- 172.21.15.29:0/248551743 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88181f60d0 con 0x7f88180c8350 2024-04-15T00:01:48.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.540+0000 7f0cdddc9640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0cbc06ba10 0x7f0cbc06ded0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00012e0 tx=0x7f0cd00013e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.543+0000 7f881d7ab640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88180c8350 0x7f881815d5c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f880c0098c0 tx=0x7f880c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.543+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f0cd4056fc0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.543+0000 7f0cce7fc640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f0cbc0753a0 0x7f0cbc077840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.543+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 --> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cd4007e50 con 0x7f0cbc0753a0 2024-04-15T00:01:48.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.544+0000 7f0cdd5c8640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f0cbc0753a0 0x7f0cbc077840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.544+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0cd40551c0 con 0x7f0cd80cbc90 2024-04-15T00:01:48.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.544+0000 7f0cdd5c8640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f0cbc0753a0 0x7f0cbc077840 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.544+0000 7f0977fff640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f097004ba50 0x7f0970169160 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c5e0 tx=0x7f096c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.545+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 --> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f42e80d4540 con 0x7f42d40752d0 2024-04-15T00:01:48.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.545+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== osd.7 v2:172.21.15.37:6810/68685228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cd4007e50 con 0x7f0cbc0753a0 2024-04-15T00:01:48.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42e5ffb640 1 -- 172.21.15.29:0/3195959946 <== osd.4 v2:172.21.15.37:6802/3398267610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f42e80d4540 con 0x7f42d40752d0 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f42d40752d0 msgr2=0x7f42d4077770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f42d40752d0 0x7f42d4077770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f42d406b9c0 msgr2=0x7f42d406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f42d406b9c0 0x7f42d406de80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f00502f0 tx=0x7f42f0069e70 comp rx=0 tx=0).stop 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 msgr2=0x7f42e80de5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 --2- 172.21.15.29:0/3195959946 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42e804b080 0x7f42e80de5f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42e00098f0 tx=0x7f42e00046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f5bd3640 1 -- 172.21.15.29:0/3195959946 reap_dead start 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 shutdown_connections 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.546+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 >> 172.21.15.29:0/3195959946 conn(0x7f42e8050170 msgr2=0x7f42e80cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.547+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 shutdown_connections 2024-04-15T00:01:48.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.547+0000 7f42f63d4640 1 -- 172.21.15.29:0/3195959946 wait complete. 2024-04-15T00:01:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.547+0000 7f720dd9b640 1 -- 172.21.15.29:0/4217564262 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204035020 con 0x7f72101522d0 2024-04-15T00:01:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.547+0000 7f720dd9b640 1 -- 172.21.15.29:0/4217564262 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7204031870 con 0x7f72101522d0 2024-04-15T00:01:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.547+0000 7f720dd9b640 1 -- 172.21.15.29:0/4217564262 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204031c40 con 0x7f72101522d0 2024-04-15T00:01:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c048070 con 0x7f88180c8350 2024-04-15T00:01:48.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880c039a10 con 0x7f88180c8350 2024-04-15T00:01:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c034040 con 0x7f88180c8350 2024-04-15T00:01:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88181f5240 con 0x7f88180c8350 2024-04-15T00:01:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f881815c5c0 con 0x7f88180c8350 2024-04-15T00:01:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 -- 172.21.15.29:0/4217564262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 msgr2=0x7f7210158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 --2- 172.21.15.29:0/4217564262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f7210158af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7210070420 tx=0x7f720402b930 comp rx=0 tx=0).stop 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 -- 172.21.15.29:0/4217564262 shutdown_connections 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 --2- 172.21.15.29:0/4217564262 >> v2:172.21.15.29:3300/0 conn(0x7f72100c3590 0x7f72100c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 --2- 172.21.15.29:0/4217564262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f7210158af0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 -- 172.21.15.29:0/4217564262 >> 172.21.15.29:0/4217564262 conn(0x7f72100623e0 msgr2=0x7f7210071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 -- 172.21.15.29:0/4217564262 shutdown_connections 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.548+0000 7f721522d640 1 -- 172.21.15.29:0/4217564262 wait complete. 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.549+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87f8001030 con 0x7f88180c8350 2024-04-15T00:01:48.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.549+0000 7f5349641640 1 --2- 172.21.15.29:0/662153698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b850 0x7f534415ad80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f53340097a0 tx=0x7f533402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30aa4572b2c25fd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.550+0000 7f721522d640 1 Processor -- start 2024-04-15T00:01:48.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.551+0000 7f721522d640 1 -- start start 2024-04-15T00:01:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.552+0000 7f721522d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7210070490 0x7f72100cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.552+0000 7f721522d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72100c3590 0x7f721006d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.552+0000 7f721522d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f721013f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.552+0000 7f721522d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f72100c3070 con 0x7f72100c3590 2024-04-15T00:01:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.552+0000 7f721522d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72100c2d90 con 0x7f72101522d0 2024-04-15T00:01:48.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.552+0000 7f721522d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f72100c9740 con 0x7f7210070490 2024-04-15T00:01:48.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.558+0000 7f720f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f721013f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.565 INFO:teuthology.orchestra.run.smithi029.stdout:60129542159 2024-04-15T00:01:48.565 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T00:01:48.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.559+0000 7f5348e40640 1 -- 172.21.15.29:0/662153698 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334034070 con 0x7f534406b850 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.559+0000 7f5348e40640 1 -- 172.21.15.29:0/662153698 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334030610 con 0x7f534406b850 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.559+0000 7f5348e40640 1 -- 172.21.15.29:0/662153698 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334034070 con 0x7f534406b850 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 -- 172.21.15.29:0/662153698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b850 msgr2=0x7f534415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 --2- 172.21.15.29:0/662153698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b850 0x7f534415ad80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f53340097a0 tx=0x7f533402b960 comp rx=0 tx=0).stop 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 -- 172.21.15.29:0/662153698 shutdown_connections 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 --2- 172.21.15.29:0/662153698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b850 0x7f534415ad80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 -- 172.21.15.29:0/662153698 >> 172.21.15.29:0/662153698 conn(0x7f534406ea50 msgr2=0x7f53440725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 -- 172.21.15.29:0/662153698 shutdown_connections 2024-04-15T00:01:48.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.560+0000 7f534c0a6640 1 -- 172.21.15.29:0/662153698 wait complete. 2024-04-15T00:01:48.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.561+0000 7f534c0a6640 1 Processor -- start 2024-04-15T00:01:48.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.561+0000 7f534c0a6640 1 -- start start 2024-04-15T00:01:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.562+0000 7f534c0a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b470 0x7f53440c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.562+0000 7f534c0a6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f534406b850 0x7f534415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.562+0000 7f534c0a6640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5344070b50 0x7f53441565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.562+0000 7f534c0a6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f534415d8c0 con 0x7f534406b850 2024-04-15T00:01:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.562+0000 7f534c0a6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f534415e190 con 0x7f534406b470 2024-04-15T00:01:48.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.562+0000 7f534c0a6640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f534415e6b0 con 0x7f5344070b50 2024-04-15T00:01:48.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.564+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 --> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cd80cae50 con 0x7f0cbc0753a0 2024-04-15T00:01:48.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.564+0000 7f720f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f721013f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46888/0 (socket says 172.21.15.29:46888) 2024-04-15T00:01:48.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.564+0000 7f720f59e640 1 -- 172.21.15.29:0/3769067854 learned_addr learned my addr 172.21.15.29:0/3769067854 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.564+0000 7f0cce7fc640 1 -- 172.21.15.29:0/1260994095 <== osd.7 v2:172.21.15.37:6810/68685228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0cd80cae50 con 0x7f0cbc0753a0 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.564+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f0cbc0753a0 msgr2=0x7f0cbc077840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.564+0000 7f0cdedcb640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f0cbc0753a0 0x7f0cbc077840 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0cbc06ba10 msgr2=0x7f0cbc06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0cbc06ba10 0x7f0cbc06ded0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00012e0 tx=0x7f0cd00013e0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd80cbc90 msgr2=0x7f0cd81e31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 --2- 172.21.15.29:0/1260994095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd80cbc90 0x7f0cd81e31b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400e850 tx=0x7f0cd400ec50 comp rx=0 tx=0).stop 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cde5ca640 1 -- 172.21.15.29:0/1260994095 reap_dead start 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 shutdown_connections 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 >> 172.21.15.29:0/1260994095 conn(0x7f0cd806b200 msgr2=0x7f0cd81e5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 shutdown_connections 2024-04-15T00:01:48.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.565+0000 7f0cdedcb640 1 -- 172.21.15.29:0/1260994095 wait complete. 2024-04-15T00:01:48.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.566+0000 7f5349e42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b470 0x7f53440c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.567+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fddd803e7b0 con 0x7fdde00c68c0 2024-04-15T00:01:48.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.567+0000 7fddceffd640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fddc006b9e0 0x7fddc006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.568+0000 7fddde59c640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fddc006b9e0 0x7fddc006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.568+0000 7fddde59c640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fddc006b9e0 0x7fddc006dea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fddd4001550 tx=0x7fddd4007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.570+0000 7f720f59e640 1 -- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7210070490 msgr2=0x7f72100cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.570+0000 7f720f59e640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7210070490 0x7f72100cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.570+0000 7f720f59e640 1 -- 172.21.15.29:0/3769067854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72100c3590 msgr2=0x7f721006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.570+0000 7f720f59e640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72100c3590 0x7f721006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.570+0000 7f720f59e640 1 -- 172.21.15.29:0/3769067854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721015c3f0 con 0x7f72101522d0 2024-04-15T00:01:48.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.572+0000 7f5349e42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b470 0x7f53440c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46898/0 (socket says 172.21.15.29:46898) 2024-04-15T00:01:48.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.573+0000 7f5349e42640 1 -- 172.21.15.29:0/3263047361 learned_addr learned my addr 172.21.15.29:0/3263047361 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.573+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84017070 con 0x7fbe90072e20 2024-04-15T00:01:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.573+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8400ee60 con 0x7fbe90072e20 2024-04-15T00:01:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.573+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe901ee1f0 con 0x7fbe90072e20 2024-04-15T00:01:48.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.573+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400cb60 con 0x7fbe90072e20 2024-04-15T00:01:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.574+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fddd807a290 con 0x7fdde00c68c0 2024-04-15T00:01:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.574+0000 7fddceffd640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7fddc00753f0 0x7fddc0077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.573+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe901ee7b0 con 0x7fbe90072e20 2024-04-15T00:01:48.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.574+0000 7f720f59e640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f721013f910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f720800b9f0 tx=0x7f720800beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.574+0000 7fddded9d640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7fddc00753f0 0x7fddc0077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.574+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe900cbf90 con 0x7fbe90072e20 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.574+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 --> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddd8004810 con 0x7fddc00753f0 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.575+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddd8078490 con 0x7fdde00c68c0 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.575+0000 7fddded9d640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7fddc00753f0 0x7fddc0077890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.575+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c015070 con 0x7f097004ba50 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.575+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096c004220 con 0x7f097004ba50 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.575+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09700491c0 con 0x7f097004ba50 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.575+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0970049760 con 0x7f097004ba50 2024-04-15T00:01:48.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.576+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f880c04b070 con 0x7f88180c8350 2024-04-15T00:01:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.576+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c003610 con 0x7f097004ba50 2024-04-15T00:01:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.576+0000 7f8809ffb640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f87fc06b9e0 0x7f87fc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.576+0000 7f881cfaa640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f87fc06b9e0 0x7f87fc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.576+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== osd.0 v2:172.21.15.29:6800/1292838260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddd8004810 con 0x7fddc00753f0 2024-04-15T00:01:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f881cfaa640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f87fc06b9e0 0x7f87fc06dea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8818158360 tx=0x7f8814007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09700052b0 con 0x7f097004ba50 2024-04-15T00:01:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f5349e42640 1 -- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5344070b50 msgr2=0x7f53441565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f5349e42640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5344070b50 0x7f53441565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f5349e42640 1 -- 172.21.15.29:0/3263047361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f534406b850 msgr2=0x7f534415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f5349e42640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f534406b850 0x7f534415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.577+0000 7f5349e42640 1 -- 172.21.15.29:0/3263047361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534415d450 con 0x7f534406b470 2024-04-15T00:01:48.585 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:48.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T00:01:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.580+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f880c039de0 con 0x7f88180c8350 2024-04-15T00:01:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.580+0000 7f8809ffb640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f87fc075380 0x7f87fc077820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.580+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 --> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f880c001d30 con 0x7f87fc075380 2024-04-15T00:01:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.580+0000 7f881dfac640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f87fc075380 0x7f87fc077820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.580+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f880c077020 con 0x7f88180c8350 2024-04-15T00:01:48.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.580+0000 7f881dfac640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f87fc075380 0x7f87fc077820 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.582+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== osd.3 v2:172.21.15.29:6816/3034992974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f880c001d30 con 0x7f87fc075380 2024-04-15T00:01:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.585+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208019070 con 0x7f72101522d0 2024-04-15T00:01:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.585+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720800cbd0 con 0x7f72101522d0 2024-04-15T00:01:48.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.585+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208014440 con 0x7f72101522d0 2024-04-15T00:01:48.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.586+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721006df20 con 0x7f72101522d0 2024-04-15T00:01:48.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.586+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721006e1c0 con 0x7f72101522d0 2024-04-15T00:01:48.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.586+0000 7f5349e42640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b470 0x7f53440c8bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f534000c410 tx=0x7f534000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.587+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f721004f540 con 0x7f72101522d0 2024-04-15T00:01:48.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.605+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 --> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdde00cbed0 con 0x7fddc00753f0 2024-04-15T00:01:48.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.606+0000 7fddceffd640 1 -- 172.21.15.29:0/1608766513 <== osd.0 v2:172.21.15.29:6800/1292838260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdde00cbed0 con 0x7fddc00753f0 2024-04-15T00:01:48.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.606+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7fddc00753f0 msgr2=0x7fddc0077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.606+0000 7fdde4b1e640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7fddc00753f0 0x7fddc0077890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fddc006b9e0 msgr2=0x7fddc006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fddc006b9e0 0x7fddc006dea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fddd4001550 tx=0x7fddd4007a40 comp rx=0 tx=0).stop 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c68c0 msgr2=0x7fdde00cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 --2- 172.21.15.29:0/1608766513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdde00c68c0 0x7fdde00cc110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddd8037040 tx=0x7fddd8004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fddded9d640 1 -- 172.21.15.29:0/1608766513 reap_dead start 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 shutdown_connections 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 >> 172.21.15.29:0/1608766513 conn(0x7fdde006f140 msgr2=0x7fdde00c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 shutdown_connections 2024-04-15T00:01:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.607+0000 7fdde4b1e640 1 -- 172.21.15.29:0/1608766513 wait complete. 2024-04-15T00:01:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.610+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f720801c070 con 0x7f72101522d0 2024-04-15T00:01:48.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.610+0000 7f71f77fe640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f71fc06b9e0 0x7f71fc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.611+0000 7f720ed9d640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f71fc06b9e0 0x7f71fc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.611+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f7208057340 con 0x7f72101522d0 2024-04-15T00:01:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.611+0000 7f720ed9d640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f71fc06b9e0 0x7f71fc06dea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7204036000 tx=0x7f7204030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.612+0000 7f71f77fe640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7f71fc0753f0 0x7f71fc077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.612+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 --> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7208022ec0 con 0x7f71fc0753f0 2024-04-15T00:01:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.612+0000 7f720e59c640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7f71fc0753f0 0x7f71fc077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.612+0000 7f720e59c640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7f71fc0753f0 0x7f71fc077890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.612+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 --> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f87f8002dd0 con 0x7f87fc075380 2024-04-15T00:01:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.613+0000 7f8809ffb640 1 -- 172.21.15.29:0/248551743 <== osd.3 v2:172.21.15.29:6816/3034992974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f87f8002dd0 con 0x7f87fc075380 2024-04-15T00:01:48.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.613+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== osd.5 v2:172.21.15.37:6826/3779753926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7208022ec0 con 0x7f71fc0753f0 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.614+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f87fc075380 msgr2=0x7f87fc077820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.614+0000 7f881fa0f640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f87fc075380 0x7f87fc077820 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.614+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f87fc06b9e0 msgr2=0x7f87fc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.614+0000 7f881fa0f640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f87fc06b9e0 0x7f87fc06dea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8818158360 tx=0x7f8814007a40 comp rx=0 tx=0).stop 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.614+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88180c8350 msgr2=0x7f881815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.614+0000 7f881fa0f640 1 --2- 172.21.15.29:0/248551743 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f88180c8350 0x7f881815d5c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f880c0098c0 tx=0x7f880c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.615+0000 7f881dfac640 1 -- 172.21.15.29:0/248551743 reap_dead start 2024-04-15T00:01:48.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.615+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 shutdown_connections 2024-04-15T00:01:48.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.615+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7208055540 con 0x7f72101522d0 2024-04-15T00:01:48.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.615+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 >> 172.21.15.29:0/248551743 conn(0x7f881806f140 msgr2=0x7f88180c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.615+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 shutdown_connections 2024-04-15T00:01:48.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.615+0000 7f881fa0f640 1 -- 172.21.15.29:0/248551743 wait complete. 2024-04-15T00:01:48.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.617+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340017070 con 0x7f534406b470 2024-04-15T00:01:48.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.617+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53400035f0 con 0x7f534406b470 2024-04-15T00:01:48.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.617+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53400039e0 con 0x7f534406b470 2024-04-15T00:01:48.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.617+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534414f000 con 0x7f534406b470 2024-04-15T00:01:48.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.617+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441546c0 con 0x7f534406b470 2024-04-15T00:01:48.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.619+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53440c9f80 con 0x7f534406b470 2024-04-15T00:01:48.630 INFO:teuthology.orchestra.run.smithi029.stdout:55834574862 2024-04-15T00:01:48.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T00:01:48.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.627+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbe8401a070 con 0x7fbe90072e20 2024-04-15T00:01:48.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.627+0000 7fbe8cff9640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbe7c06b990 0x7fbe7c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.628+0000 7fbe8ffff640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbe7c06b990 0x7fbe7c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.628+0000 7fbe8ffff640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbe7c06b990 0x7fbe7c06de50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009950 tx=0x7fbe80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.636 INFO:teuthology.orchestra.run.smithi029.stdout:64424509455 2024-04-15T00:01:48.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T00:01:48.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.637+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbe84057580 con 0x7fbe90072e20 2024-04-15T00:01:48.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.638+0000 7fbe8cff9640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7fbe7c075320 0x7fbe7c0777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.638+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 --> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe7c077e90 con 0x7fbe7c075320 2024-04-15T00:01:48.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.638+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe84055780 con 0x7fbe90072e20 2024-04-15T00:01:48.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.638+0000 7fbe94c35640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7fbe7c075320 0x7fbe7c0777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.639+0000 7fbe94c35640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7fbe7c075320 0x7fbe7c0777c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.640+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== osd.2 v2:172.21.15.29:6824/2157921057 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe7c077e90 con 0x7fbe7c075320 2024-04-15T00:01:48.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.646+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5340003b80 con 0x7f534406b470 2024-04-15T00:01:48.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.646+0000 7f533a7fc640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f532806b990 0x7f532806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.647+0000 7f5349641640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f532806b990 0x7f532806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.647+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 --> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f721004f540 con 0x7f71fc0753f0 2024-04-15T00:01:48.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.648+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5340056470 con 0x7f534406b470 2024-04-15T00:01:48.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.648+0000 7f533a7fc640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f5328075320 0x7f53280777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.648+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 --> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5328077e90 con 0x7f5328075320 2024-04-15T00:01:48.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.648+0000 7f71f77fe640 1 -- 172.21.15.29:0/3769067854 <== osd.5 v2:172.21.15.37:6826/3779753926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f721004f540 con 0x7f71fc0753f0 2024-04-15T00:01:48.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.649+0000 7f5349641640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f532806b990 0x7f532806de50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5334036000 tx=0x7f533403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.649+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7f71fc0753f0 msgr2=0x7f71fc077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.649+0000 7f721522d640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7f71fc0753f0 0x7f71fc077890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.649+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f71fc06b9e0 msgr2=0x7f71fc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.649+0000 7f721522d640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f71fc06b9e0 0x7f71fc06dea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7204036000 tx=0x7f7204030000 comp rx=0 tx=0).stop 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 msgr2=0x7f721013f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f721522d640 1 --2- 172.21.15.29:0/3769067854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72101522d0 0x7f721013f910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f720800b9f0 tx=0x7f720800beb0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f720f59e640 1 -- 172.21.15.29:0/3769067854 reap_dead start 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 shutdown_connections 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 >> 172.21.15.29:0/3769067854 conn(0x7f72100623e0 msgr2=0x7f72100cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5340054670 con 0x7f534406b470 2024-04-15T00:01:48.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 shutdown_connections 2024-04-15T00:01:48.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.650+0000 7f721522d640 1 -- 172.21.15.29:0/3769067854 wait complete. 2024-04-15T00:01:48.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.651+0000 7f534a643640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f5328075320 0x7f53280777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.654+0000 7f534a643640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f5328075320 0x7f53280777c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.656+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== osd.6 v2:172.21.15.37:6811/4118171972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5328077e90 con 0x7f5328075320 2024-04-15T00:01:48.674 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:48.674 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T00:01:48.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.672+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f096c0037b0 con 0x7f097004ba50 2024-04-15T00:01:48.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.673+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 --> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe900721d0 con 0x7fbe7c075320 2024-04-15T00:01:48.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.673+0000 7f0974ff9640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f095c06ba10 0x7f095c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.673+0000 7f09777fe640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f095c06ba10 0x7f095c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.674+0000 7f09777fe640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f095c06ba10 0x7f095c06ded0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0964006fd0 tx=0x7f0964009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.674+0000 7fbe8cff9640 1 -- 172.21.15.29:0/1729785630 <== osd.2 v2:172.21.15.29:6824/2157921057 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe900721d0 con 0x7fbe7c075320 2024-04-15T00:01:48.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.677+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f096c057150 con 0x7f097004ba50 2024-04-15T00:01:48.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.677+0000 7f0974ff9640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f095c075420 0x7f095c0778c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.677+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 --> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f095c077f90 con 0x7f095c075420 2024-04-15T00:01:48.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.677+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f096c055350 con 0x7f097004ba50 2024-04-15T00:01:48.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.678+0000 7f097cf69640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f095c075420 0x7f095c0778c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.678+0000 7f097cf69640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f095c075420 0x7f095c0778c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.678+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7fbe7c075320 msgr2=0x7fbe7c0777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.678+0000 7fbe96698640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7fbe7c075320 0x7fbe7c0777c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.680+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== osd.1 v2:172.21.15.29:6808/367785710 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f095c077f90 con 0x7f095c075420 2024-04-15T00:01:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.680+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbe7c06b990 msgr2=0x7fbe7c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.680+0000 7fbe96698640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbe7c06b990 0x7fbe7c06de50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009950 tx=0x7fbe80008040 comp rx=0 tx=0).stop 2024-04-15T00:01:48.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.680+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe90072e20 msgr2=0x7fbe900c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.680+0000 7fbe96698640 1 --2- 172.21.15.29:0/1729785630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe90072e20 0x7fbe900c3ae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e870 tx=0x7fbe8400ed30 comp rx=0 tx=0).stop 2024-04-15T00:01:48.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.681+0000 7fbe94c35640 1 -- 172.21.15.29:0/1729785630 reap_dead start 2024-04-15T00:01:48.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.682+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 shutdown_connections 2024-04-15T00:01:48.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.682+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 >> 172.21.15.29:0/1729785630 conn(0x7fbe900c8c70 msgr2=0x7fbe900c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.683+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 shutdown_connections 2024-04-15T00:01:48.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.683+0000 7fbe96698640 1 -- 172.21.15.29:0/1729785630 wait complete. 2024-04-15T00:01:48.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.702+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 --> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53440c9f80 con 0x7f5328075320 2024-04-15T00:01:48.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.703+0000 7f533a7fc640 1 -- 172.21.15.29:0/3263047361 <== osd.6 v2:172.21.15.37:6811/4118171972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53440c9f80 con 0x7f5328075320 2024-04-15T00:01:48.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.703+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f5328075320 msgr2=0x7f53280777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.703+0000 7f534c0a6640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f5328075320 0x7f53280777c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f532806b990 msgr2=0x7f532806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534c0a6640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f532806b990 0x7f532806de50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5334036000 tx=0x7f533403b040 comp rx=0 tx=0).stop 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b470 msgr2=0x7f53440c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534c0a6640 1 --2- 172.21.15.29:0/3263047361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f534406b470 0x7f53440c8bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f534000c410 tx=0x7f534000c8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534a643640 1 -- 172.21.15.29:0/3263047361 reap_dead start 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 shutdown_connections 2024-04-15T00:01:48.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.704+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 >> 172.21.15.29:0/3263047361 conn(0x7f534406ea50 msgr2=0x7f534406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.709+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 shutdown_connections 2024-04-15T00:01:48.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.709+0000 7f534c0a6640 1 -- 172.21.15.29:0/3263047361 wait complete. 2024-04-15T00:01:48.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.713+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 --> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f097004b830 con 0x7f095c075420 2024-04-15T00:01:48.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.714+0000 7f0974ff9640 1 -- 172.21.15.29:0/2174419603 <== osd.1 v2:172.21.15.29:6808/367785710 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f097004b830 con 0x7f095c075420 2024-04-15T00:01:48.721 INFO:teuthology.orchestra.run.smithi029.stdout:64424509453 2024-04-15T00:01:48.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T00:01:48.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.715+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f095c075420 msgr2=0x7f095c0778c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.715+0000 7f097d76a640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f095c075420 0x7f095c0778c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f095c06ba10 msgr2=0x7f095c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f095c06ba10 0x7f095c06ded0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0964006fd0 tx=0x7f0964009060 comp rx=0 tx=0).stop 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f097004ba50 msgr2=0x7f0970169160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 --2- 172.21.15.29:0/2174419603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f097004ba50 0x7f0970169160 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c5e0 tx=0x7f096c00caa0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097cf69640 1 -- 172.21.15.29:0/2174419603 reap_dead start 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 shutdown_connections 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 >> 172.21.15.29:0/2174419603 conn(0x7f0970050170 msgr2=0x7f09700056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 shutdown_connections 2024-04-15T00:01:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.716+0000 7f097d76a640 1 -- 172.21.15.29:0/2174419603 wait complete. 2024-04-15T00:01:48.740 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:48.740 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.728+0000 7fddad6bc640 1 Processor -- start 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.728+0000 7fddad6bc640 1 -- start start 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.729+0000 7fddad6bc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdda00dd320 0x7fdda00e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.729+0000 7fddad6bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdda0049410 0x7fdda0007560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.729+0000 7fddad6bc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda004f440 0x7fdda0050340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.729+0000 7fddad6bc640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fdda0007aa0 con 0x7fdda00dd320 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.729+0000 7fddad6bc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdda00061e0 con 0x7fdda0049410 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.729+0000 7fddad6bc640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00064c0 con 0x7fdda004f440 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.730+0000 7fdda7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdda00dd320 0x7fdda00e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.730+0000 7fdda7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdda00dd320 0x7fdda00e3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36972/0 (socket says 172.21.15.29:36972) 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.730+0000 7fdda7fff640 1 -- 172.21.15.29:0/2936034503 learned_addr learned my addr 172.21.15.29:0/2936034503 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.731+0000 7fdda77fe640 1 --2- 172.21.15.29:0/2936034503 >> v2:172.21.15.37:3300/0 conn(0x7fdda0049410 0x7fdda0007560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.731+0000 7fddacebb640 1 --2- 172.21.15.29:0/2936034503 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda004f440 0x7fdda0050340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.735+0000 7fdda7fff640 1 -- 172.21.15.29:0/2936034503 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda004f440 msgr2=0x7fdda0050340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.735+0000 7fdda7fff640 1 --2- 172.21.15.29:0/2936034503 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda004f440 0x7fdda0050340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.735+0000 7fdda7fff640 1 -- 172.21.15.29:0/2936034503 >> v2:172.21.15.37:3300/0 conn(0x7fdda0049410 msgr2=0x7fdda0007560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.735+0000 7fdda7fff640 1 --2- 172.21.15.29:0/2936034503 >> v2:172.21.15.37:3300/0 conn(0x7fdda0049410 0x7fdda0007560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.735+0000 7fdda7fff640 1 -- 172.21.15.29:0/2936034503 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda00067a0 con 0x7fdda00dd320 2024-04-15T00:01:48.744 INFO:teuthology.orchestra.run.smithi029.stdout:64424509455 2024-04-15T00:01:48.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T00:01:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.739+0000 7fdda7fff640 1 --2- 172.21.15.29:0/2936034503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00dd320 0x7fdda00e3b70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdda00385e0 tx=0x7fdd9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27785866fe06ee8f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.745+0000 7fdda6ffd640 1 -- 172.21.15.29:0/2936034503 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94035020 con 0x7fdda00dd320 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.745+0000 7fdda6ffd640 1 -- 172.21.15.29:0/2936034503 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94031640 con 0x7fdda00dd320 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 -- 172.21.15.29:0/2936034503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00dd320 msgr2=0x7fdda00e3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 --2- 172.21.15.29:0/2936034503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00dd320 0x7fdda00e3b70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdda00385e0 tx=0x7fdd9402b8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 -- 172.21.15.29:0/2936034503 shutdown_connections 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 --2- 172.21.15.29:0/2936034503 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda004f440 0x7fdda0050340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 --2- 172.21.15.29:0/2936034503 >> v2:172.21.15.37:3300/0 conn(0x7fdda0049410 0x7fdda0007560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 --2- 172.21.15.29:0/2936034503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00dd320 0x7fdda00e3b70 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdda00385e0 tx=0x7fdd9402b8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.746+0000 7fddad6bc640 1 -- 172.21.15.29:0/2936034503 >> 172.21.15.29:0/2936034503 conn(0x7fdda0054570 msgr2=0x7fdda0054980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.748+0000 7fddad6bc640 1 -- 172.21.15.29:0/2936034503 shutdown_connections 2024-04-15T00:01:48.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.751+0000 7fddad6bc640 1 -- 172.21.15.29:0/2936034503 wait complete. 2024-04-15T00:01:48.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.753+0000 7fddad6bc640 1 Processor -- start 2024-04-15T00:01:48.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.753+0000 7fddad6bc640 1 -- start start 2024-04-15T00:01:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.754+0000 7fb710d1e640 1 Processor -- start 2024-04-15T00:01:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.755+0000 7fb710d1e640 1 -- start start 2024-04-15T00:01:48.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fb710d1e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb704045300 0x7fb704045730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fb710d1e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb704045c70 con 0x7fb7040e67a0 2024-04-15T00:01:48.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fb710d1e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb704006ac0 con 0x7fb7040dd480 2024-04-15T00:01:48.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fb710d1e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb7040076d0 con 0x7fb704045300 2024-04-15T00:01:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.754+0000 7fddad6bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 0x7fdda00e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.754+0000 7fddad6bc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda004f440 0x7fdda00dd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.755+0000 7fdda7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 0x7fdda00e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fdda7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 0x7fdda00e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46914/0 (socket says 172.21.15.29:46914) 2024-04-15T00:01:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fddad6bc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda00c4680 0x7fdda00dc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fddad6bc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0007040 con 0x7fdda004f440 2024-04-15T00:01:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fddad6bc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0006d60 con 0x7fdda0049410 2024-04-15T00:01:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fddad6bc640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00dd700 con 0x7fdda00c4680 2024-04-15T00:01:48.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.757+0000 7fb70ad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb7040e67a0 0x7fb7040e6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50518/0 (socket says 172.21.15.29:50518) 2024-04-15T00:01:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.757+0000 7fb70ad9d640 1 -- 172.21.15.29:0/68075392 learned_addr learned my addr 172.21.15.29:0/68075392 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.756+0000 7fdda7fff640 1 -- 172.21.15.29:0/1224509507 learned_addr learned my addr 172.21.15.29:0/1224509507 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.758+0000 7fdda77fe640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda004f440 0x7fdda00dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.760+0000 7fdda7fff640 1 -- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda00c4680 msgr2=0x7fdda00dc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.760+0000 7fdda7fff640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda00c4680 0x7fdda00dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.760+0000 7fdda7fff640 1 -- 172.21.15.29:0/1224509507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda004f440 msgr2=0x7fdda00dd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.760+0000 7fdda7fff640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda004f440 0x7fdda00dd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.760+0000 7fdda7fff640 1 -- 172.21.15.29:0/1224509507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda00db6d0 con 0x7fdda0049410 2024-04-15T00:01:48.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.761+0000 7fb709d9b640 1 --2- 172.21.15.29:0/68075392 >> v2:172.21.15.37:3300/0 conn(0x7fb704045300 0x7fb704045730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.764+0000 7fdda7fff640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 0x7fdda00e01f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009870 tx=0x7fdd940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.766+0000 7fb709d9b640 1 -- 172.21.15.29:0/68075392 >> v1:172.21.15.37:6789/0 conn(0x7fb7040dd480 legacy=0x7fb70404b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.766+0000 7fb709d9b640 1 -- 172.21.15.29:0/68075392 >> v1:172.21.15.29:6789/0 conn(0x7fb7040e67a0 legacy=0x7fb7040e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.766+0000 7fb709d9b640 1 -- 172.21.15.29:0/68075392 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb704006da0 con 0x7fb704045300 2024-04-15T00:01:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.770+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94040070 con 0x7fdda0049410 2024-04-15T00:01:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.770+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94039cd0 con 0x7fdda0049410 2024-04-15T00:01:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.770+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94035040 con 0x7fdda0049410 2024-04-15T00:01:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.770+0000 7fddad6bc640 1 -- 172.21.15.29:0/1224509507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda00db9b0 con 0x7fdda0049410 2024-04-15T00:01:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.770+0000 7fddad6bc640 1 -- 172.21.15.29:0/1224509507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda00df9f0 con 0x7fdda0049410 2024-04-15T00:01:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.772+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd80005290 con 0x7fdda0049410 2024-04-15T00:01:48.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.794+0000 7f82a4c08640 1 Processor -- start 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.794+0000 7f82a4c08640 1 -- start start 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.795+0000 7f82a4c08640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.795+0000 7f82a4c08640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a0158420 con 0x7f82a00c3610 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.795+0000 7f82a4c08640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a0158700 con 0x7f82a01520a0 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.795+0000 7f82a4c08640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f82a01589e0 con 0x7f82a015bc20 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.796+0000 7f829ed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.796+0000 7f829ed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57410/0 (socket says 172.21.15.29:57410) 2024-04-15T00:01:48.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.796+0000 7f829ed9d640 1 -- 172.21.15.29:0/948820404 learned_addr learned my addr 172.21.15.29:0/948820404 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.801+0000 7f829ed9d640 1 -- 172.21.15.29:0/948820404 >> v1:172.21.15.37:6789/0 conn(0x7f82a01520a0 legacy=0x7f82a00cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.801+0000 7f829ed9d640 1 -- 172.21.15.29:0/948820404 >> v1:172.21.15.29:6789/0 conn(0x7f82a00c3610 legacy=0x7f82a0071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.801+0000 7f829ed9d640 1 -- 172.21.15.29:0/948820404 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a0158cc0 con 0x7f82a015bc20 2024-04-15T00:01:48.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.803+0000 7f829ed9d640 1 --2- 172.21.15.29:0/948820404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a015c0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8298009e80 tx=0x7f829802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c12d1243e9f46a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.810+0000 7f829d59a640 1 -- 172.21.15.29:0/948820404 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829802ca50 con 0x7f82a015bc20 2024-04-15T00:01:48.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.810+0000 7f829d59a640 1 -- 172.21.15.29:0/948820404 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829802cbf0 con 0x7f82a015bc20 2024-04-15T00:01:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 -- 172.21.15.29:0/948820404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 msgr2=0x7f82a015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 --2- 172.21.15.29:0/948820404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a015c0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8298009e80 tx=0x7f829802beb0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f829d59a640 1 -- 172.21.15.29:0/948820404 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82980343f0 con 0x7f82a015bc20 2024-04-15T00:01:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 -- 172.21.15.29:0/948820404 shutdown_connections 2024-04-15T00:01:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 --2- 172.21.15.29:0/948820404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a015c0b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 -- 172.21.15.29:0/948820404 >> 172.21.15.29:0/948820404 conn(0x7f82a0070830 msgr2=0x7f82a006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 -- 172.21.15.29:0/948820404 shutdown_connections 2024-04-15T00:01:48.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.811+0000 7f82a4c08640 1 -- 172.21.15.29:0/948820404 wait complete. 2024-04-15T00:01:48.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.813+0000 7f82a4c08640 1 Processor -- start 2024-04-15T00:01:48.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.813+0000 7f82a4c08640 1 -- start start 2024-04-15T00:01:48.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.814+0000 7f82a4c08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82a00c3610 0x7f82a0150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f74df181640 1 Processor -- start 2024-04-15T00:01:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f82a4c08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82a01520a0 0x7f82a0154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f82a4c08640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f82a4c08640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f82a0152480 con 0x7f82a00c3610 2024-04-15T00:01:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f74df181640 1 -- start start 2024-04-15T00:01:48.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f82a4c08640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82a015b700 con 0x7f82a01520a0 2024-04-15T00:01:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f82a4c08640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f82a00cb2a0 con 0x7f82a015bc20 2024-04-15T00:01:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f829e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82a00c3610 0x7f82a0150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.815+0000 7f829ed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.816+0000 7f829ed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a00cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57422/0 (socket says 172.21.15.29:57422) 2024-04-15T00:01:48.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.816+0000 7f829ed9d640 1 -- 172.21.15.29:0/3390745052 learned_addr learned my addr 172.21.15.29:0/3390745052 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.816+0000 7f74df181640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74d815b110 0x7f74d80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.817+0000 7f74df181640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74d80cdff0 0x7f74d80ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.817+0000 7f74df181640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d80cf910 con 0x7f74d80cc530 2024-04-15T00:01:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.817+0000 7f74df181640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f74d80cf350 con 0x7f74d815b110 2024-04-15T00:01:48.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.817+0000 7f74df181640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f74d80cf630 con 0x7f74d80cdff0 2024-04-15T00:01:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.820+0000 7f829ed9d640 1 -- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82a01520a0 msgr2=0x7f82a0154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.820+0000 7f829ed9d640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82a01520a0 0x7f82a0154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.820+0000 7f829ed9d640 1 -- 172.21.15.29:0/3390745052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82a00c3610 msgr2=0x7f82a0150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.820+0000 7f829ed9d640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82a00c3610 0x7f82a0150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.821+0000 7f829ed9d640 1 -- 172.21.15.29:0/3390745052 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a00ccc60 con 0x7f82a015bc20 2024-04-15T00:01:48.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.824+0000 7f829ed9d640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a00cb8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8298009fa0 tx=0x7f8298004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.824+0000 7f74d7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74d815b110 0x7f74d80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.825+0000 7f74d7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74d815b110 0x7f74d80cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36980/0 (socket says 172.21.15.29:36980) 2024-04-15T00:01:48.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.825+0000 7f74d7fff640 1 -- 172.21.15.29:0/2691807490 learned_addr learned my addr 172.21.15.29:0/2691807490 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.828+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298044020 con 0x7f82a015bc20 2024-04-15T00:01:48.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.828+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8298040670 con 0x7f82a015bc20 2024-04-15T00:01:48.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.828+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298040a20 con 0x7f82a015bc20 2024-04-15T00:01:48.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.829+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a01f2720 con 0x7f82a015bc20 2024-04-15T00:01:48.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.829+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a00cd200 con 0x7f82a015bc20 2024-04-15T00:01:48.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.830+0000 7f74d7fff640 1 -- 172.21.15.29:0/2691807490 >> v2:172.21.15.37:3300/0 conn(0x7f74d80cdff0 msgr2=0x7f74d80ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.830+0000 7f74d7fff640 1 --2- 172.21.15.29:0/2691807490 >> v2:172.21.15.37:3300/0 conn(0x7f74d80cdff0 0x7f74d80ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.830+0000 7f74d7fff640 1 -- 172.21.15.29:0/2691807490 >> v1:172.21.15.29:6789/0 conn(0x7f74d80cc530 legacy=0x7f74d806c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.830+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a00cd400 con 0x7f82a015bc20 2024-04-15T00:01:48.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.830+0000 7f74d7fff640 1 -- 172.21.15.29:0/2691807490 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d815a630 con 0x7f74d815b110 2024-04-15T00:01:48.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.837+0000 7f74d7fff640 1 --2- 172.21.15.29:0/2691807490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d815b110 0x7f74d80cc910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f74d80c6b80 tx=0x7f74c402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a676f366febcc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.843+0000 7f74d77fe640 1 -- 172.21.15.29:0/2691807490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4034070 con 0x7f74d815b110 2024-04-15T00:01:48.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.843+0000 7f74d77fe640 1 -- 172.21.15.29:0/2691807490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c4030870 con 0x7f74d815b110 2024-04-15T00:01:48.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.843+0000 7f74d77fe640 1 -- 172.21.15.29:0/2691807490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4030c40 con 0x7f74d815b110 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.844+0000 7f74df181640 1 -- 172.21.15.29:0/2691807490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d815b110 msgr2=0x7f74d80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.844+0000 7f74df181640 1 --2- 172.21.15.29:0/2691807490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d815b110 0x7f74d80cc910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f74d80c6b80 tx=0x7f74c402b9b0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.845+0000 7f74df181640 1 -- 172.21.15.29:0/2691807490 shutdown_connections 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.845+0000 7f74df181640 1 --2- 172.21.15.29:0/2691807490 >> v2:172.21.15.37:3300/0 conn(0x7f74d80cdff0 0x7f74d80ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.845+0000 7f74df181640 1 --2- 172.21.15.29:0/2691807490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d815b110 0x7f74d80cc910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.845+0000 7f74df181640 1 -- 172.21.15.29:0/2691807490 >> 172.21.15.29:0/2691807490 conn(0x7f74d80cfb20 msgr2=0x7f74d80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.846+0000 7f74df181640 1 -- 172.21.15.29:0/2691807490 shutdown_connections 2024-04-15T00:01:48.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.846+0000 7f74df181640 1 -- 172.21.15.29:0/2691807490 wait complete. 2024-04-15T00:01:48.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.847+0000 7f74df181640 1 Processor -- start 2024-04-15T00:01:48.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.847+0000 7f74df181640 1 -- start start 2024-04-15T00:01:48.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.849+0000 7f74df181640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d80cc530 0x7f74d80b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.849+0000 7f74df181640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 0x7f74d80af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.849+0000 7f74df181640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f74d815b110 0x7f74d80aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.849+0000 7f74df181640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f74d80cebc0 con 0x7f74d80cdff0 2024-04-15T00:01:48.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.849+0000 7f74df181640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74d815abf0 con 0x7f74d80cc530 2024-04-15T00:01:48.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.849+0000 7f74df181640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f74d8154b10 con 0x7f74d815b110 2024-04-15T00:01:48.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.850+0000 7f74d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 0x7f74d80af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.850+0000 7f74d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 0x7f74d80af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36988/0 (socket says 172.21.15.29:36988) 2024-04-15T00:01:48.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.850+0000 7f74d7fff640 1 -- 172.21.15.29:0/2651759523 learned_addr learned my addr 172.21.15.29:0/2651759523 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.852+0000 7f1d0f51e640 1 Processor -- start 2024-04-15T00:01:48.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.853+0000 7f1d0f51e640 1 -- start start 2024-04-15T00:01:48.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.854+0000 7f1d0f51e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d08157bf0 0x7f1d0815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.854+0000 7f1d0f51e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d080c7ad0 0x7f1d081619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.854+0000 7f1d0f51e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d080c6e50 con 0x7f1d080c7660 2024-04-15T00:01:48.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.854+0000 7f1d0f51e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1d080c7f00 con 0x7f1d08157bf0 2024-04-15T00:01:48.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.855+0000 7f1d0f51e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1d080c3ff0 con 0x7f1d080c7ad0 2024-04-15T00:01:48.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.858+0000 7f74d7fff640 1 -- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f74d815b110 msgr2=0x7f74d80aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.858+0000 7f74d7fff640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f74d815b110 0x7f74d80aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.858+0000 7f74d7fff640 1 -- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d80cc530 msgr2=0x7f74d80b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.858+0000 7f74d7fff640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d80cc530 0x7f74d80b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.858+0000 7f74d7fff640 1 -- 172.21.15.29:0/2651759523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d80b15f0 con 0x7f74d80cdff0 2024-04-15T00:01:48.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.858+0000 7f1d0d2ba640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d08157bf0 0x7f1d0815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.861+0000 7f1d0d2ba640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d08157bf0 0x7f1d0815ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36994/0 (socket says 172.21.15.29:36994) 2024-04-15T00:01:48.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.861+0000 7f1d0d2ba640 1 -- 172.21.15.29:0/3493152067 learned_addr learned my addr 172.21.15.29:0/3493152067 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:48.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.864+0000 7f1d0d2ba640 1 -- 172.21.15.29:0/3493152067 >> v2:172.21.15.37:3300/0 conn(0x7f1d080c7ad0 msgr2=0x7f1d081619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.864+0000 7f1d0d2ba640 1 --2- 172.21.15.29:0/3493152067 >> v2:172.21.15.37:3300/0 conn(0x7f1d080c7ad0 0x7f1d081619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.864+0000 7f1d0d2ba640 1 -- 172.21.15.29:0/3493152067 >> v1:172.21.15.37:6789/0 conn(0x7f1d080c7660 legacy=0x7f1d080c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:48.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.865+0000 7f1d0d2ba640 1 -- 172.21.15.29:0/3493152067 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0815a630 con 0x7f1d08157bf0 2024-04-15T00:01:48.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.870+0000 7f74d7fff640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 0x7f74d80af9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009960 tx=0x7f74c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.870+0000 7f1d0d2ba640 1 --2- 172.21.15.29:0/3493152067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d08157bf0 0x7f1d0815ae10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d080ca450 tx=0x7f1d0402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebe0d2d43b19d08 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:48.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f1cfffff640 1 -- 172.21.15.29:0/3493152067 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04034070 con 0x7f1d08157bf0 2024-04-15T00:01:48.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f1cfffff640 1 -- 172.21.15.29:0/3493152067 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04030860 con 0x7f1d08157bf0 2024-04-15T00:01:48.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f1cfffff640 1 -- 172.21.15.29:0/3493152067 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04034070 con 0x7f1d08157bf0 2024-04-15T00:01:48.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4034040 con 0x7f74d80cdff0 2024-04-15T00:01:48.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c40433f0 con 0x7f74d80cdff0 2024-04-15T00:01:48.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c40437e0 con 0x7f74d80cdff0 2024-04-15T00:01:48.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81569b0 con 0x7f74d80cdff0 2024-04-15T00:01:48.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.880+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d8156f70 con 0x7f74d80cdff0 2024-04-15T00:01:48.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 -- 172.21.15.29:0/3493152067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d08157bf0 msgr2=0x7f1d0815ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:48.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/3493152067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d08157bf0 0x7f1d0815ae10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d080ca450 tx=0x7f1d0402b9a0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 -- 172.21.15.29:0/3493152067 shutdown_connections 2024-04-15T00:01:48.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/3493152067 >> v2:172.21.15.37:3300/0 conn(0x7f1d080c7ad0 0x7f1d081619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/3493152067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d08157bf0 0x7f1d0815ae10 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d080ca450 tx=0x7f1d0402b9a0 comp rx=0 tx=0).stop 2024-04-15T00:01:48.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 -- 172.21.15.29:0/3493152067 >> 172.21.15.29:0/3493152067 conn(0x7f1d0806c310 msgr2=0x7f1d0806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:48.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.882+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b8005290 con 0x7f74d80cdff0 2024-04-15T00:01:48.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.881+0000 7f1d0f51e640 1 -- 172.21.15.29:0/3493152067 shutdown_connections 2024-04-15T00:01:48.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.882+0000 7f1d0f51e640 1 -- 172.21.15.29:0/3493152067 wait complete. 2024-04-15T00:01:48.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.883+0000 7f1d0f51e640 1 Processor -- start 2024-04-15T00:01:48.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.883+0000 7f1d0f51e640 1 -- start start 2024-04-15T00:01:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.884+0000 7f1d0f51e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d080c7660 0x7f1d081eee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.884+0000 7f1d0f51e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 0x7f1d08148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.884+0000 7f1d0f51e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d0806b970 0x7f1d081e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.884+0000 7f1d0f51e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080c4590 con 0x7f1d080c7660 2024-04-15T00:01:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.884+0000 7f1d0f51e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080c42b0 con 0x7f1d080c7ad0 2024-04-15T00:01:48.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.884+0000 7f1d0f51e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1d080c4870 con 0x7f1d0806b970 2024-04-15T00:01:48.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.885+0000 7f92f7084640 1 Processor -- start 2024-04-15T00:01:48.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.885+0000 7f92f7084640 1 -- start start 2024-04-15T00:01:48.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.887+0000 7f92f7084640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92f0157bf0 0x7f92f015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.887+0000 7f92f7084640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f00c6e50 con 0x7f92f00c7660 2024-04-15T00:01:48.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.887+0000 7f92f7084640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f00c3ff0 con 0x7f92f00c7ad0 2024-04-15T00:01:48.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.887+0000 7f92f7084640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f92f00c7f00 con 0x7f92f0157bf0 2024-04-15T00:01:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.888+0000 7f2b0a29d640 1 Processor -- start 2024-04-15T00:01:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.888+0000 7f2b0a29d640 1 -- start start 2024-04-15T00:01:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.889+0000 7f2b0a29d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b040c3610 0x7f2b04071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.889+0000 7f2b0a29d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b04158420 con 0x7f2b041520a0 2024-04-15T00:01:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.889+0000 7f2b0a29d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b04158700 con 0x7f2b040716a0 2024-04-15T00:01:48.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.889+0000 7f2b0a29d640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2b041589e0 con 0x7f2b040c3610 2024-04-15T00:01:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.892+0000 7fb9880de640 1 Processor -- start 2024-04-15T00:01:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.892+0000 7fb9880de640 1 -- start start 2024-04-15T00:01:48.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.893+0000 7fb9880de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800c7a80 0x7fb9800c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.893+0000 7fb9880de640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb980070ec0 con 0x7fb9800725d0 2024-04-15T00:01:48.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.893+0000 7fb9880de640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb98015d9a0 con 0x7fb9801543f0 2024-04-15T00:01:48.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.893+0000 7fb9880de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb98015dc80 con 0x7fb9800c7a80 2024-04-15T00:01:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.903+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f74c4037070 con 0x7f74d80cdff0 2024-04-15T00:01:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.903+0000 7f74d57fa640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f74bc06b9e0 0x7f74bc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.903+0000 7f74dcf1d640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f74bc06b9e0 0x7f74bc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:48.904+0000 7f74dcf1d640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f74bc06b9e0 0x7f74bc06dea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f60 tx=0x7f74cc0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.050+0000 7fb709d9b640 1 --2- 172.21.15.29:0/68075392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704045300 0x7fb704045730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097a0 tx=0x7fb6fc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c371ef2dcc56c49e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.051+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdd9404b060 con 0x7fdda0049410 2024-04-15T00:01:49.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.051+0000 7fdda4ff9640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fdd8c06b9e0 0x7fdd8c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.051+0000 7fdda77fe640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fdd8c06b9e0 0x7fdd8c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.052+0000 7fdda77fe640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fdd8c06b9e0 0x7fdd8c06dea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdda8000b60 tx=0x7fdda808e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.054+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdd94078c40 con 0x7fdda0049410 2024-04-15T00:01:49.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.065+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdd9407b2a0 con 0x7fdda0049410 2024-04-15T00:01:49.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.089+0000 7f92f4e20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92f0157bf0 0x7f92f015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.090+0000 7f1d0cab9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 0x7f1d08148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.091+0000 7f92f4e20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92f0157bf0 0x7f92f015ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46980/0 (socket says 172.21.15.29:46980) 2024-04-15T00:01:49.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.091+0000 7f92f4e20640 1 -- 172.21.15.29:0/2731268215 learned_addr learned my addr 172.21.15.29:0/2731268215 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.092+0000 7f1d0cab9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 0x7f1d08148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:46964/0 (socket says 172.21.15.29:46964) 2024-04-15T00:01:49.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.092+0000 7f1d0cab9640 1 -- 172.21.15.29:0/1037893421 learned_addr learned my addr 172.21.15.29:0/1037893421 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.099+0000 7f1d0cab9640 1 -- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d0806b970 msgr2=0x7f1d081e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.099+0000 7f1d0cab9640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d0806b970 0x7f1d081e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.099+0000 7f1d0cab9640 1 -- 172.21.15.29:0/1037893421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d080c7660 msgr2=0x7f1d081eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.099+0000 7f1d0cab9640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d080c7660 0x7f1d081eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.099+0000 7f1d0cab9640 1 -- 172.21.15.29:0/1037893421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d081ef370 con 0x7f1d080c7ad0 2024-04-15T00:01:49.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb70959a640 1 -- 172.21.15.29:0/68075392 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc034070 con 0x7fb704045300 2024-04-15T00:01:49.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb70959a640 1 -- 172.21.15.29:0/68075392 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6fc030610 con 0x7fb704045300 2024-04-15T00:01:49.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb70959a640 1 -- 172.21.15.29:0/68075392 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0309e0 con 0x7fb704045300 2024-04-15T00:01:49.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 -- 172.21.15.29:0/68075392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704045300 msgr2=0x7fb704045730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 --2- 172.21.15.29:0/68075392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704045300 0x7fb704045730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097a0 tx=0x7fb6fc02b960 comp rx=0 tx=0).stop 2024-04-15T00:01:49.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 -- 172.21.15.29:0/68075392 shutdown_connections 2024-04-15T00:01:49.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 --2- 172.21.15.29:0/68075392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704045300 0x7fb704045730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 -- 172.21.15.29:0/68075392 >> 172.21.15.29:0/68075392 conn(0x7fb7040501b0 msgr2=0x7fb7040505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 -- 172.21.15.29:0/68075392 shutdown_connections 2024-04-15T00:01:49.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.101+0000 7fb710d1e640 1 -- 172.21.15.29:0/68075392 wait complete. 2024-04-15T00:01:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.103+0000 7f92f4e20640 1 -- 172.21.15.29:0/2731268215 >> v1:172.21.15.37:6789/0 conn(0x7f92f00c7ad0 legacy=0x7f92f01619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.103+0000 7f92f4e20640 1 -- 172.21.15.29:0/2731268215 >> v1:172.21.15.29:6789/0 conn(0x7f92f00c7660 legacy=0x7f92f00c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:49.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.103+0000 7f92f4e20640 1 -- 172.21.15.29:0/2731268215 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f015a630 con 0x7f92f0157bf0 2024-04-15T00:01:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.103+0000 7fb710d1e640 1 Processor -- start 2024-04-15T00:01:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.103+0000 7fb710d1e640 1 -- start start 2024-04-15T00:01:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.104+0000 7fb710d1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb704045300 0x7fb7040bc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.104+0000 7fb710d1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7040dd480 0x7fb7040e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.104+0000 7fb710d1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 0x7fb7040353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.104+0000 7fb710d1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb7040dd860 con 0x7fb704045300 2024-04-15T00:01:49.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.104+0000 7fb710d1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb704007360 con 0x7fb7040dd480 2024-04-15T00:01:49.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.104+0000 7fb710d1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb70404c730 con 0x7fb7040e67a0 2024-04-15T00:01:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.109+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8298047020 con 0x7f82a015bc20 2024-04-15T00:01:49.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.110+0000 7f828effd640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f828006b9e0 0x7f828006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.110+0000 7f829e59c640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f828006b9e0 0x7f828006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.111+0000 7f829e59c640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f828006b9e0 0x7f828006dea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8294007fd0 tx=0x7f8294007e10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.112+0000 7f1d0cab9640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 0x7f1d08148590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800c440 tx=0x7f1cf800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.116+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f829807a040 con 0x7f82a015bc20 2024-04-15T00:01:49.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.117+0000 7f92f4e20640 1 --2- 172.21.15.29:0/2731268215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f0157bf0 0x7f92f015ae10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92e400bb10 tx=0x7f92e402e170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8743c7c548d3e43c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.124+0000 7f2b0883a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2b040716a0 0x7f2b0415bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44370/0 (socket says 172.21.15.29:44370) 2024-04-15T00:01:49.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.124+0000 7f2b0883a640 1 -- 172.21.15.29:0/1608026654 learned_addr learned my addr 172.21.15.29:0/1608026654 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:49.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.127+0000 7f92ef7fe640 1 -- 172.21.15.29:0/2731268215 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e403b070 con 0x7f92f0157bf0 2024-04-15T00:01:49.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.127+0000 7f92ef7fe640 1 -- 172.21.15.29:0/2731268215 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e4036440 con 0x7f92f0157bf0 2024-04-15T00:01:49.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.127+0000 7f92ef7fe640 1 -- 172.21.15.29:0/2731268215 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4036810 con 0x7f92f0157bf0 2024-04-15T00:01:49.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f82a00cd400 con 0x7f82a015bc20 2024-04-15T00:01:49.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 -- 172.21.15.29:0/2731268215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f0157bf0 msgr2=0x7f92f015ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 --2- 172.21.15.29:0/2731268215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f0157bf0 0x7f92f015ae10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92e400bb10 tx=0x7f92e402e170 comp rx=0 tx=0).stop 2024-04-15T00:01:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 -- 172.21.15.29:0/2731268215 shutdown_connections 2024-04-15T00:01:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 --2- 172.21.15.29:0/2731268215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f0157bf0 0x7f92f015ae10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 -- 172.21.15.29:0/2731268215 >> 172.21.15.29:0/2731268215 conn(0x7f92f006c310 msgr2=0x7f92f006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 -- 172.21.15.29:0/2731268215 shutdown_connections 2024-04-15T00:01:49.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.128+0000 7f92f7084640 1 -- 172.21.15.29:0/2731268215 wait complete. 2024-04-15T00:01:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.129+0000 7fb985e7a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9801543f0 0x7fb98015ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44374/0 (socket says 172.21.15.29:44374) 2024-04-15T00:01:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.129+0000 7fb985e7a640 1 -- 172.21.15.29:0/1928284973 learned_addr learned my addr 172.21.15.29:0/1928284973 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.130+0000 7f92f7084640 1 Processor -- start 2024-04-15T00:01:49.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.130+0000 7f92f7084640 1 -- start start 2024-04-15T00:01:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.131+0000 7fb98667b640 1 --2- 172.21.15.29:0/1928284973 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800c7a80 0x7fb9800c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.131+0000 7fb70ad9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 0x7fb7040353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.131+0000 7f92f7084640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f00c7660 0x7f92f0149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.131+0000 7f92f7084640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f00c7ad0 0x7f92f01570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.132+0000 7f92f7084640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 0x7f92f0141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.132+0000 7f92f7084640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00c4590 con 0x7f92f00c7660 2024-04-15T00:01:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.132+0000 7f92f7084640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00c42b0 con 0x7f92f00c7ad0 2024-04-15T00:01:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.132+0000 7f92f7084640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f92f00c4870 con 0x7f92f0157bf0 2024-04-15T00:01:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.132+0000 7fb70ad9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 0x7fb7040353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57470/0 (socket says 172.21.15.29:57470) 2024-04-15T00:01:49.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.132+0000 7fb70ad9d640 1 -- 172.21.15.29:0/1562695024 learned_addr learned my addr 172.21.15.29:0/1562695024 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.137+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8017070 con 0x7f1d080c7ad0 2024-04-15T00:01:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.137+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf80035f0 con 0x7f1d080c7ad0 2024-04-15T00:01:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.137+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80039e0 con 0x7f1d080c7ad0 2024-04-15T00:01:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.137+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d081dfb20 con 0x7f1d080c7ad0 2024-04-15T00:01:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.137+0000 7fb709d9b640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7040dd480 0x7fb7040e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.137+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081477b0 con 0x7f1d080c7ad0 2024-04-15T00:01:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.138+0000 7fb70ad9d640 1 -- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7040dd480 msgr2=0x7fb7040e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.138+0000 7fb70ad9d640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7040dd480 0x7fb7040e4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.138+0000 7fb70ad9d640 1 -- 172.21.15.29:0/1562695024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb704045300 msgr2=0x7fb7040bc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.138+0000 7fb70ad9d640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb704045300 0x7fb7040bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.138+0000 7fb70ad9d640 1 -- 172.21.15.29:0/1562695024 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7040e48b0 con 0x7fb7040e67a0 2024-04-15T00:01:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.138+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0804f540 con 0x7f1d080c7ad0 2024-04-15T00:01:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.141+0000 7fb98667b640 1 -- 172.21.15.29:0/1928284973 >> v1:172.21.15.37:6789/0 conn(0x7fb9801543f0 legacy=0x7fb98015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.141+0000 7fb98667b640 1 -- 172.21.15.29:0/1928284973 >> v1:172.21.15.29:6789/0 conn(0x7fb9800725d0 legacy=0x7fb9800c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.141+0000 7fb98667b640 1 -- 172.21.15.29:0/1928284973 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98015df60 con 0x7fb9800c7a80 2024-04-15T00:01:49.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.142+0000 7f92f5621640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 0x7f92f0141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.144+0000 7fb70ad9d640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 0x7fb7040353f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb70c073ea0 tx=0x7fb70c073770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.144+0000 7fb98667b640 1 --2- 172.21.15.29:0/1928284973 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800c7a80 0x7fb9800c9240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb978009dc0 tx=0x7fb97802bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7674276dae1754 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.145+0000 7f92f5621640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 0x7f92f0141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57482/0 (socket says 172.21.15.29:57482) 2024-04-15T00:01:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.145+0000 7f92f5621640 1 -- 172.21.15.29:0/1135727696 learned_addr learned my addr 172.21.15.29:0/1135727696 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.147+0000 7f2b02ffd640 1 -- 172.21.15.29:0/1608026654 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493602795 0 0) 0x7f2b04158700 con 0x7f2b040716a0 2024-04-15T00:01:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.147+0000 7f2b02ffd640 1 -- 172.21.15.29:0/1608026654 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aec003520 con 0x7f2b040716a0 2024-04-15T00:01:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb984e78640 1 -- 172.21.15.29:0/1928284973 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978039070 con 0x7fb9800c7a80 2024-04-15T00:01:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb984e78640 1 -- 172.21.15.29:0/1928284973 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97802ccc0 con 0x7fb9800c7a80 2024-04-15T00:01:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb984e78640 1 -- 172.21.15.29:0/1928284973 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978034660 con 0x7fb9800c7a80 2024-04-15T00:01:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb9880de640 1 -- 172.21.15.29:0/1928284973 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800c7a80 msgr2=0x7fb9800c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb9880de640 1 --2- 172.21.15.29:0/1928284973 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800c7a80 0x7fb9800c9240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb978009dc0 tx=0x7fb97802bf10 comp rx=0 tx=0).stop 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb9880de640 1 -- 172.21.15.29:0/1928284973 shutdown_connections 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.152+0000 7fb9880de640 1 --2- 172.21.15.29:0/1928284973 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800c7a80 0x7fb9800c9240 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb9880de640 1 -- 172.21.15.29:0/1928284973 >> 172.21.15.29:0/1928284973 conn(0x7fb98006c310 msgr2=0x7fb98006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb9880de640 1 -- 172.21.15.29:0/1928284973 shutdown_connections 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb9880de640 1 -- 172.21.15.29:0/1928284973 wait complete. 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0707e0 con 0x7fb7040e67a0 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c0709a0 con 0x7fb7040e67a0 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7040d7610 con 0x7fb7040e67a0 2024-04-15T00:01:49.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c070e10 con 0x7fb7040e67a0 2024-04-15T00:01:49.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.153+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7040c5630 con 0x7fb7040e67a0 2024-04-15T00:01:49.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.154+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb704008160 con 0x7fb7040e67a0 2024-04-15T00:01:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.155+0000 7fb9880de640 1 Processor -- start 2024-04-15T00:01:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.155+0000 7fb9880de640 1 -- start start 2024-04-15T00:01:49.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7f92f5621640 1 -- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f00c7ad0 msgr2=0x7f92f01570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7f92f5621640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f00c7ad0 0x7f92f01570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7f92f5621640 1 -- 172.21.15.29:0/1135727696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f00c7660 msgr2=0x7f92f0149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7f92f5621640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f00c7660 0x7f92f0149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7f92f5621640 1 -- 172.21.15.29:0/1135727696 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f00c8b70 con 0x7f92f0157bf0 2024-04-15T00:01:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7fb9880de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800725d0 0x7fb980154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.156+0000 7fb9880de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9801543f0 0x7fb980074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.157+0000 7fb9880de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 0x7fb98014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.157+0000 7fb9880de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb9800709a0 con 0x7fb980155c30 2024-04-15T00:01:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.157+0000 7fb9880de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb98015e520 con 0x7fb9801543f0 2024-04-15T00:01:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.157+0000 7fb9880de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb980070b20 con 0x7fb9800725d0 2024-04-15T00:01:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.175+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1cf801a070 con 0x7f1d080c7ad0 2024-04-15T00:01:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.175+0000 7f1cfdffb640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1cec06b9e0 0x7f1cec06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.175+0000 7f1d0d2ba640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1cec06b9e0 0x7f1cec06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.176+0000 7f1d0d2ba640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1cec06b9e0 0x7f1cec06dea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1d04036000 tx=0x7f1d0403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.179+0000 7f92f5621640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 0x7f92f0141510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e8002200 tx=0x7f92e800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.180+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb70c09e3a0 con 0x7fb7040e67a0 2024-04-15T00:01:49.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.180+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1cf8056530 con 0x7f1d080c7ad0 2024-04-15T00:01:49.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.180+0000 7fb6faffd640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb6ec06b9c0 0x7fb6ec06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.181+0000 7fb70a59c640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb6ec06b9c0 0x7fb6ec06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.181+0000 7fb70a59c640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb6ec06b9c0 0x7fb6ec06de80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb700003cc0 tx=0x7fb7000079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.181+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f74c40795f0 con 0x7f74d80cdff0 2024-04-15T00:01:49.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.181+0000 7f2b037fe640 1 --2- 172.21.15.29:0/1608026654 >> v2:172.21.15.29:3300/0 conn(0x7f2b040c3610 0x7f2b04071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.181+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f74c403e070 con 0x7f74d80cdff0 2024-04-15T00:01:49.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.182+0000 7fb985679640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9801543f0 0x7fb980074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.185+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb70c0d3700 con 0x7fb7040e67a0 2024-04-15T00:01:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.238+0000 7f2b037fe640 1 -- 172.21.15.29:0/1608026654 >> v1:172.21.15.37:6789/0 conn(0x7f2b040716a0 legacy=0x7f2b0415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.238+0000 7f2b037fe640 1 -- 172.21.15.29:0/1608026654 >> v1:172.21.15.29:6789/0 conn(0x7f2b041520a0 legacy=0x7f2b040cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:49.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.238+0000 7f2b037fe640 1 -- 172.21.15.29:0/1608026654 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b04158cc0 con 0x7f2b040c3610 2024-04-15T00:01:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.268+0000 7f2b037fe640 1 --2- 172.21.15.29:0/1608026654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b040c3610 0x7f2b04071160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2af80097a0 tx=0x7f2af802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f5041323eb9ef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.270+0000 7fb98667b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 0x7fb98014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.273+0000 7fb98667b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 0x7fb98014f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37040/0 (socket says 172.21.15.29:37040) 2024-04-15T00:01:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.273+0000 7fb98667b640 1 -- 172.21.15.29:0/87381081 learned_addr learned my addr 172.21.15.29:0/87381081 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.281+0000 7fb98667b640 1 -- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800725d0 msgr2=0x7fb980154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.281+0000 7fb98667b640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800725d0 0x7fb980154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.281+0000 7fb98667b640 1 -- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9801543f0 msgr2=0x7fb980074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.281+0000 7fb98667b640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9801543f0 0x7fb980074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.282+0000 7fb98667b640 1 -- 172.21.15.29:0/87381081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9801f44f0 con 0x7fb980155c30 2024-04-15T00:01:49.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.288+0000 7fb98667b640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 0x7fb98014f2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb978037040 tx=0x7fb978004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.289+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdd80005850 con 0x7fdda0049410 2024-04-15T00:01:49.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.297+0000 7f2b02ffd640 1 -- 172.21.15.29:0/1608026654 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8035020 con 0x7f2b040c3610 2024-04-15T00:01:49.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.297+0000 7f2b02ffd640 1 -- 172.21.15.29:0/1608026654 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af8031830 con 0x7f2b040c3610 2024-04-15T00:01:49.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.297+0000 7f2b02ffd640 1 -- 172.21.15.29:0/1608026654 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8031c00 con 0x7f2b040c3610 2024-04-15T00:01:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978039050 con 0x7fb980155c30 2024-04-15T00:01:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978045070 con 0x7fb980155c30 2024-04-15T00:01:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9801554c0 con 0x7fb980155c30 2024-04-15T00:01:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97803e850 con 0x7fb980155c30 2024-04-15T00:01:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9801f3a10 con 0x7fb980155c30 2024-04-15T00:01:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 -- 172.21.15.29:0/1608026654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b040c3610 msgr2=0x7f2b04071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/1608026654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b040c3610 0x7f2b04071160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2af80097a0 tx=0x7f2af802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 -- 172.21.15.29:0/1608026654 shutdown_connections 2024-04-15T00:01:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/1608026654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b040c3610 0x7f2b04071160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 -- 172.21.15.29:0/1608026654 >> 172.21.15.29:0/1608026654 conn(0x7f2b04070830 msgr2=0x7f2b0406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 -- 172.21.15.29:0/1608026654 shutdown_connections 2024-04-15T00:01:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.298+0000 7f2b0a29d640 1 -- 172.21.15.29:0/1608026654 wait complete. 2024-04-15T00:01:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.299+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98004f540 con 0x7fb980155c30 2024-04-15T00:01:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.300+0000 7f2b0a29d640 1 Processor -- start 2024-04-15T00:01:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.301+0000 7f2b0a29d640 1 -- start start 2024-04-15T00:01:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.302+0000 7f2b0a29d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 0x7f2b040cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.302+0000 7f2b0a29d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b040c3610 0x7f2b04157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.302+0000 7f2b0a29d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b041520a0 0x7f2b041ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.302+0000 7f2b0a29d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04152480 con 0x7f2b041520a0 2024-04-15T00:01:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.302+0000 7f2b0a29d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0415b700 con 0x7f2b040716a0 2024-04-15T00:01:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.302+0000 7f2b0a29d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2b040cb2a0 con 0x7f2b040c3610 2024-04-15T00:01:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.319+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb97803e9f0 con 0x7fb980155c30 2024-04-15T00:01:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.320+0000 7fb9767fc640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb96406b990 0x7fb96406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.320+0000 7fb985e7a640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb96406b990 0x7fb96406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.321+0000 7fb985e7a640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb96406b990 0x7fb96406de50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb97c000f60 tx=0x7fb97c007a80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.324+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb97803fe40 con 0x7fb980155c30 2024-04-15T00:01:49.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.327+0000 7f2b0883a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b041520a0 0x7f2b041ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.391+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f74b8005850 con 0x7f74d80cdff0 2024-04-15T00:01:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.394+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f82a0151be0 con 0x7f82a015bc20 2024-04-15T00:01:49.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.458+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 0x7f2b040cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.459+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 0x7f2b040cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47026/0 (socket says 172.21.15.29:47026) 2024-04-15T00:01:49.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.459+0000 7f2b03fff640 1 -- 172.21.15.29:0/2740778575 learned_addr learned my addr 172.21.15.29:0/2740778575 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.479+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb704008160 con 0x7fb7040e67a0 2024-04-15T00:01:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.479+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1cf8021080 con 0x7f1d080c7ad0 2024-04-15T00:01:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.480+0000 7f2b037fe640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b040c3610 0x7f2b04157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.480+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8003d80 con 0x7f92f0157bf0 2024-04-15T00:01:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.480+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e8015070 con 0x7f92f0157bf0 2024-04-15T00:01:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.480+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f01ef6b0 con 0x7f92f0157bf0 2024-04-15T00:01:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.481+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80052b0 con 0x7f92f0157bf0 2024-04-15T00:01:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.481+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f01efc70 con 0x7f92f0157bf0 2024-04-15T00:01:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.482+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f004f540 con 0x7f92f0157bf0 2024-04-15T00:01:49.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.490+0000 7f2b03fff640 1 -- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b040c3610 msgr2=0x7f2b04157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.490+0000 7f2b03fff640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b040c3610 0x7f2b04157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.490+0000 7f2b03fff640 1 -- 172.21.15.29:0/2740778575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b041520a0 msgr2=0x7f2b041ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.490+0000 7f2b03fff640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b041520a0 0x7f2b041ef430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.490+0000 7f2b03fff640 1 -- 172.21.15.29:0/2740778575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b040cdd70 con 0x7f2b040716a0 2024-04-15T00:01:49.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.494+0000 7fdda4ff9640 1 -- 172.21.15.29:0/1224509507 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd9407aba0 con 0x7fdda0049410 2024-04-15T00:01:49.501 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fdd8c06b9e0 msgr2=0x7fdd8c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fdd8c06b9e0 0x7fdd8c06dea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdda8000b60 tx=0x7fdda808e040 comp rx=0 tx=0).stop 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 msgr2=0x7fdda00e01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 0x7fdda00e01f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009870 tx=0x7fdd940046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 shutdown_connections 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fdd8c06b9e0 0x7fdd8c06dea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fdda00c4680 0x7fdda00dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda004f440 0x7fdda00dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 --2- 172.21.15.29:0/1224509507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0049410 0x7fdda00e01f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.497+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 >> 172.21.15.29:0/1224509507 conn(0x7fdda0054570 msgr2=0x7fdda0038ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.498+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 shutdown_connections 2024-04-15T00:01:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.498+0000 7fdd927fc640 1 -- 172.21.15.29:0/1224509507 wait complete. 2024-04-15T00:01:49.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.498+0000 7f2b03fff640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 0x7f2b040cd490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2af400b410 tx=0x7f2af400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.503+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4015020 con 0x7f2b040716a0 2024-04-15T00:01:49.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.503+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b041e39f0 con 0x7f2b040716a0 2024-04-15T00:01:49.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.503+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b040ce750 con 0x7f2b040716a0 2024-04-15T00:01:49.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.504+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af40058d0 con 0x7f2b040716a0 2024-04-15T00:01:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.505+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4005c80 con 0x7f2b040716a0 2024-04-15T00:01:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.505+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0404f540 con 0x7f2b040716a0 2024-04-15T00:01:49.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542158 for osd.4 2024-04-15T00:01:49.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.616+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb97807cd90 con 0x7fb980155c30 2024-04-15T00:01:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.635+0000 7f74d57fa640 1 -- 172.21.15.29:0/2651759523 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74c407bc50 con 0x7f74d80cdff0 2024-04-15T00:01:49.641 INFO:teuthology.orchestra.run.smithi029.stdout:64424509454 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f74bc06b9e0 msgr2=0x7f74bc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f74bc06b9e0 0x7f74bc06dea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000f60 tx=0x7f74cc0079b0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 msgr2=0x7f74d80af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 0x7f74d80af9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009960 tx=0x7f74c40046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 shutdown_connections 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f74bc06b9e0 0x7f74bc06dea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f74d815b110 0x7f74d80aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74d80cdff0 0x7f74d80af9d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 --2- 172.21.15.29:0/2651759523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d80cc530 0x7f74d80b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.638+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 >> 172.21.15.29:0/2651759523 conn(0x7f74d80cfb20 msgr2=0x7f74d80cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.639+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 shutdown_connections 2024-04-15T00:01:49.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.639+0000 7f74df181640 1 -- 172.21.15.29:0/2651759523 wait complete. 2024-04-15T00:01:49.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.3 2024-04-15T00:01:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.676+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb7040052f0 con 0x7fb7040e67a0 2024-04-15T00:01:49.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.698+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1d08154a60 con 0x7f1d080c7ad0 2024-04-15T00:01:49.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.760+0000 7f828effd640 1 -- 172.21.15.29:0/3390745052 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f829804e030 con 0x7f82a015bc20 2024-04-15T00:01:49.766 INFO:teuthology.orchestra.run.smithi029.stdout:55834574861 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.761+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f828006b9e0 msgr2=0x7f828006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.761+0000 7f82a4c08640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f828006b9e0 0x7f828006dea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8294007fd0 tx=0x7f8294007e10 comp rx=0 tx=0).stop 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.761+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 msgr2=0x7f82a00cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.761+0000 7f82a4c08640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a00cb8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8298009fa0 tx=0x7f8298004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 shutdown_connections 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f828006b9e0 0x7f828006dea0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f82a015bc20 0x7f82a00cb8b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82a01520a0 0x7f82a0154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 --2- 172.21.15.29:0/3390745052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82a00c3610 0x7f82a0150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 >> 172.21.15.29:0/3390745052 conn(0x7f82a0070830 msgr2=0x7f82a00ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 shutdown_connections 2024-04-15T00:01:49.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.762+0000 7f82a4c08640 1 -- 172.21.15.29:0/3390745052 wait complete. 2024-04-15T00:01:49.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2024-04-15T00:01:49.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.776+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f92e8005450 con 0x7f92f0157bf0 2024-04-15T00:01:49.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.776+0000 7f92ed7fa640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92d406ba10 0x7f92d406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.776+0000 7f92f4e20640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92d406ba10 0x7f92d406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.777+0000 7f92f4e20640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92d406ba10 0x7f92d406ded0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92e4038000 tx=0x7f92e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.780+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f92e805b050 con 0x7f92f0157bf0 2024-04-15T00:01:49.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.791+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2af4018020 con 0x7f2b040716a0 2024-04-15T00:01:49.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.791+0000 7f2b00ff9640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2af006b990 0x7f2af006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:49.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.791+0000 7f2b037fe640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2af006b990 0x7f2af006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:49.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.792+0000 7f2b037fe640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2af006b990 0x7f2af006de50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2af8036000 tx=0x7f2af8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:49.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.794+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f92f00c8b70 con 0x7f92f0157bf0 2024-04-15T00:01:49.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.798+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2af4022e00 con 0x7f2b040716a0 2024-04-15T00:01:49.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.817+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2af401f030 con 0x7f2b040716a0 2024-04-15T00:01:49.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.825+0000 7f1cfdffb640 1 -- 172.21.15.29:0/1037893421 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cf8058b90 con 0x7f1d080c7ad0 2024-04-15T00:01:49.831 INFO:teuthology.orchestra.run.smithi029.stdout:60129542157 2024-04-15T00:01:49.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1cec06b9e0 msgr2=0x7f1cec06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1cec06b9e0 0x7f1cec06dea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1d04036000 tx=0x7f1d0403b040 comp rx=0 tx=0).stop 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 msgr2=0x7f1d08148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 0x7f1d08148590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800c440 tx=0x7f1cf800c900 comp rx=0 tx=0).stop 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 shutdown_connections 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1cec06b9e0 0x7f1cec06dea0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1d0806b970 0x7f1d081e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d080c7ad0 0x7f1d08148590 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 --2- 172.21.15.29:0/1037893421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d080c7660 0x7f1d081eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 >> 172.21.15.29:0/1037893421 conn(0x7f1d0806c310 msgr2=0x7f1d080c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 shutdown_connections 2024-04-15T00:01:49.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.828+0000 7f1d0f51e640 1 -- 172.21.15.29:0/1037893421 wait complete. 2024-04-15T00:01:49.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.5 2024-04-15T00:01:49.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.851+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb9801547d0 con 0x7fb980155c30 2024-04-15T00:01:49.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.864+0000 7fb6faffd640 1 -- 172.21.15.29:0/1562695024 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb70c0d5d60 con 0x7fb7040e67a0 2024-04-15T00:01:49.871 INFO:teuthology.orchestra.run.smithi029.stdout:60129542157 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb6ec06b9c0 msgr2=0x7fb6ec06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb6ec06b9c0 0x7fb6ec06de80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb700003cc0 tx=0x7fb7000079b0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 msgr2=0x7fb7040353f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 0x7fb7040353f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb70c073ea0 tx=0x7fb70c073770 comp rx=0 tx=0).stop 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 shutdown_connections 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb6ec06b9c0 0x7fb6ec06de80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb7040e67a0 0x7fb7040353f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7040dd480 0x7fb7040e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 --2- 172.21.15.29:0/1562695024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb704045300 0x7fb7040bc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.866+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 >> 172.21.15.29:0/1562695024 conn(0x7fb7040501b0 msgr2=0x7fb7040db8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.867+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 shutdown_connections 2024-04-15T00:01:49.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.867+0000 7fb710d1e640 1 -- 172.21.15.29:0/1562695024 wait complete. 2024-04-15T00:01:49.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.7 2024-04-15T00:01:49.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.895+0000 7fb9767fc640 1 -- 172.21.15.29:0/87381081 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb97807c690 con 0x7fb980155c30 2024-04-15T00:01:49.902 INFO:teuthology.orchestra.run.smithi029.stdout:64424509454 2024-04-15T00:01:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb96406b990 msgr2=0x7fb96406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb96406b990 0x7fb96406de50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb97c000f60 tx=0x7fb97c007a80 comp rx=0 tx=0).stop 2024-04-15T00:01:49.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 msgr2=0x7fb98014f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 0x7fb98014f2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb978037040 tx=0x7fb978004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 shutdown_connections 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb96406b990 0x7fb96406de50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb980155c30 0x7fb98014f2a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9801543f0 0x7fb980074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 --2- 172.21.15.29:0/87381081 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb9800725d0 0x7fb980154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 >> 172.21.15.29:0/87381081 conn(0x7fb98006c310 msgr2=0x7fb9800c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 shutdown_connections 2024-04-15T00:01:49.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:49.898+0000 7fb9880de640 1 -- 172.21.15.29:0/87381081 wait complete. 2024-04-15T00:01:49.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.1 2024-04-15T00:01:50.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.011+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f92f00c7440 con 0x7f92f0157bf0 2024-04-15T00:01:50.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.047+0000 7f92ed7fa640 1 -- 172.21.15.29:0/1135727696 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92e805d6b0 con 0x7f92f0157bf0 2024-04-15T00:01:50.054 INFO:teuthology.orchestra.run.smithi029.stdout:64424509453 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.049+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92d406ba10 msgr2=0x7f92d406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.049+0000 7f92f7084640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92d406ba10 0x7f92d406ded0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92e4038000 tx=0x7f92e4008040 comp rx=0 tx=0).stop 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 msgr2=0x7f92f0141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 0x7f92f0141510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e8002200 tx=0x7f92e800cc40 comp rx=0 tx=0).stop 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 shutdown_connections 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f92d406ba10 0x7f92d406ded0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f92f0157bf0 0x7f92f0141510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92f00c7ad0 0x7f92f01570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 --2- 172.21.15.29:0/1135727696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f00c7660 0x7f92f0149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 >> 172.21.15.29:0/1135727696 conn(0x7f92f006c310 msgr2=0x7f92f0159530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 shutdown_connections 2024-04-15T00:01:50.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.050+0000 7f92f7084640 1 -- 172.21.15.29:0/1135727696 wait complete. 2024-04-15T00:01:50.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.054+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2b040c8100 con 0x7f2b040716a0 2024-04-15T00:01:50.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.2 2024-04-15T00:01:50.071 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.066+0000 7f2b00ff9640 1 -- 172.21.15.29:0/2740778575 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2af4059600 con 0x7f2b040716a0 2024-04-15T00:01:50.072 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2af006b990 msgr2=0x7f2af006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2af006b990 0x7f2af006de50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2af8036000 tx=0x7f2af8008030 comp rx=0 tx=0).stop 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 msgr2=0x7f2b040cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 0x7f2b040cd490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2af400b410 tx=0x7f2af400b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 shutdown_connections 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2af006b990 0x7f2af006de50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b041520a0 0x7f2b041ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2b040c3610 0x7f2b04157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 --2- 172.21.15.29:0/2740778575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b040716a0 0x7f2b040cd490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.068+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 >> 172.21.15.29:0/2740778575 conn(0x7f2b04070830 msgr2=0x7f2b0414f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:50.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.069+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 shutdown_connections 2024-04-15T00:01:50.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.069+0000 7f2b0a29d640 1 -- 172.21.15.29:0/2740778575 wait complete. 2024-04-15T00:01:50.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.6 2024-04-15T00:01:50.086 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:50.226 INFO:tasks.ceph.mds.f.smithi037.stderr:2024-04-15T00:01:50.220+0000 f7f1640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-15T00:01:50.522 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T00:01:50.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.623+0000 7f0631ade640 1 Processor -- start 2024-04-15T00:01:50.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.623+0000 7f0631ade640 1 -- start start 2024-04-15T00:01:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f0631ade640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f062c15b110 0x7f062c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f0631ade640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c0cdff0 0x7f062c0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f0631ade640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c0cf910 con 0x7f062c0cc530 2024-04-15T00:01:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f0631ade640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f062c0cf350 con 0x7f062c15b110 2024-04-15T00:01:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f0631ade640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f062c0cf630 con 0x7f062c0cdff0 2024-04-15T00:01:50.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f062affd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f062c15b110 0x7f062c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f062bfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c0cdff0 0x7f062c0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f062b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f062c0cc530 0x7f062c06c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44386/0 (socket says 172.21.15.29:44386) 2024-04-15T00:01:50.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.624+0000 7f062b7fe640 1 -- 172.21.15.29:0/3311447200 learned_addr learned my addr 172.21.15.29:0/3311447200 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.627+0000 7f062affd640 1 -- 172.21.15.29:0/3311447200 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c0cdff0 msgr2=0x7f062c0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.627+0000 7f062affd640 1 --2- 172.21.15.29:0/3311447200 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c0cdff0 0x7f062c0ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.627+0000 7f062affd640 1 -- 172.21.15.29:0/3311447200 >> v1:172.21.15.37:6789/0 conn(0x7f062c0cc530 legacy=0x7f062c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.627+0000 7f062affd640 1 -- 172.21.15.29:0/3311447200 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c15a630 con 0x7f062c15b110 2024-04-15T00:01:50.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.629+0000 7f062affd640 1 --2- 172.21.15.29:0/3311447200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c15b110 0x7f062c0cc910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06140097a0 tx=0x7f061402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecdfa814ebc15c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f062a7fc640 1 -- 172.21.15.29:0/3311447200 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614035020 con 0x7f062c15b110 2024-04-15T00:01:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f062a7fc640 1 -- 172.21.15.29:0/3311447200 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0614031830 con 0x7f062c15b110 2024-04-15T00:01:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f062a7fc640 1 -- 172.21.15.29:0/3311447200 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614031c00 con 0x7f062c15b110 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f0631ade640 1 -- 172.21.15.29:0/3311447200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c15b110 msgr2=0x7f062c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f0631ade640 1 --2- 172.21.15.29:0/3311447200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c15b110 0x7f062c0cc910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06140097a0 tx=0x7f061402b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f0631ade640 1 -- 172.21.15.29:0/3311447200 shutdown_connections 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f0631ade640 1 --2- 172.21.15.29:0/3311447200 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c0cdff0 0x7f062c0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f0631ade640 1 --2- 172.21.15.29:0/3311447200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c15b110 0x7f062c0cc910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.633+0000 7f0631ade640 1 -- 172.21.15.29:0/3311447200 >> 172.21.15.29:0/3311447200 conn(0x7f062c0cfb20 msgr2=0x7f062c0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.634+0000 7f0631ade640 1 -- 172.21.15.29:0/3311447200 shutdown_connections 2024-04-15T00:01:50.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.634+0000 7f0631ade640 1 -- 172.21.15.29:0/3311447200 wait complete. 2024-04-15T00:01:50.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.635+0000 7f0631ade640 1 Processor -- start 2024-04-15T00:01:50.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.635+0000 7f0631ade640 1 -- start start 2024-04-15T00:01:50.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f0631ade640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c0cc530 0x7f062c15df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f0631ade640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 0x7f062c1e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f0631ade640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c15b110 0x7f062c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f0631ade640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0cebc0 con 0x7f062c0cdff0 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f0631ade640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f062c15abf0 con 0x7f062c0cc530 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f0631ade640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f062c154b10 con 0x7f062c15b110 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f062affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 0x7f062c1e6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f062b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c0cc530 0x7f062c15df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.636+0000 7f062bfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c15b110 0x7f062c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.637+0000 7f062affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 0x7f062c1e6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37058/0 (socket says 172.21.15.29:37058) 2024-04-15T00:01:50.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.637+0000 7f062affd640 1 -- 172.21.15.29:0/2573981170 learned_addr learned my addr 172.21.15.29:0/2573981170 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:50.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.640+0000 7f062affd640 1 -- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c15b110 msgr2=0x7f062c0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.640+0000 7f062affd640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c15b110 0x7f062c0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.640+0000 7f062affd640 1 -- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c0cc530 msgr2=0x7f062c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.640+0000 7f062affd640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c0cc530 0x7f062c15df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.640+0000 7f062affd640 1 -- 172.21.15.29:0/2573981170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c1f02c0 con 0x7f062c0cdff0 2024-04-15T00:01:50.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.642+0000 7f062affd640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 0x7f062c1e6cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0614034040 tx=0x7f06140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.646+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614040070 con 0x7f062c0cdff0 2024-04-15T00:01:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.646+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061403a910 con 0x7f062c0cdff0 2024-04-15T00:01:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.646+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614035040 con 0x7f062c0cdff0 2024-04-15T00:01:50.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.646+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c1f05a0 con 0x7f062c0cdff0 2024-04-15T00:01:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.646+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c1f0b60 con 0x7f062c0cdff0 2024-04-15T00:01:50.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.647+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c04f540 con 0x7f062c0cdff0 2024-04-15T00:01:50.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T00:01:50.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.666+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0614038020 con 0x7f062c0cdff0 2024-04-15T00:01:50.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.666+0000 7f0623fff640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f060c06b9e0 0x7f060c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.666+0000 7f062b7fe640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f060c06b9e0 0x7f060c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.667+0000 7f062b7fe640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f060c06b9e0 0x7f060c06dea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f061c007fd0 tx=0x7f061c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.670+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0614078b60 con 0x7f062c0cdff0 2024-04-15T00:01:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.760+0000 7f4e83e76640 1 Processor -- start 2024-04-15T00:01:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.760+0000 7f4e83e76640 1 -- start start 2024-04-15T00:01:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.761+0000 7f4e83e76640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 0x7f4e7c0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.761+0000 7f4e83e76640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c157fb0 con 0x7f4e7c0ce1e0 2024-04-15T00:01:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.761+0000 7f4e83e76640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c0ce650 con 0x7f4e7c0cddc0 2024-04-15T00:01:50.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.761+0000 7f4e83e76640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c158230 con 0x7f4e7c14ea00 2024-04-15T00:01:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.762+0000 7f4e81411640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4e7c0cddc0 0x7f4e7c070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44402/0 (socket says 172.21.15.29:44402) 2024-04-15T00:01:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.762+0000 7f4e81411640 1 -- 172.21.15.29:0/2054197196 learned_addr learned my addr 172.21.15.29:0/2054197196 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.764+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449167748 0 0) 0x7f4e7c0ce650 con 0x7f4e7c0cddc0 2024-04-15T00:01:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.764+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e68003520 con 0x7f4e7c0cddc0 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 <== mon.1 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3698250797 0 0) 0x7f4e68003520 con 0x7f4e7c0cddc0 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 msgr2=0x7f4e7c0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 0x7f4e7c0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 >> v1:172.21.15.29:6789/0 conn(0x7f4e7c0ce1e0 legacy=0x7f4e7c1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c158510 con 0x7f4e7c0cddc0 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 <== mon.1 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1744880889 0 0) 0x7f4e78001670 con 0x7f4e7c0cddc0 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 >> v1:172.21.15.37:6789/0 conn(0x7f4e7c0cddc0 legacy=0x7f4e7c070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 0x7f4e680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e680040f0 0x7f4e68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e68004e60 0x7f4e6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c158230 con 0x7f4e680040f0 2024-04-15T00:01:50.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680055d0 con 0x7f4e68004e60 2024-04-15T00:01:50.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.768+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6800bf00 con 0x7f4e7c14ea00 2024-04-15T00:01:50.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.770+0000 7f4e82413640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e68004e60 0x7f4e6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.773+0000 7f4e81c12640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 0x7f4e680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T00:01:50.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.775+0000 7f4e82413640 1 -- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 msgr2=0x7f4e680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.775+0000 7f4e82413640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e7c14ea00 0x7f4e680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.775+0000 7f4e82413640 1 -- 172.21.15.29:0/2054197196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e680040f0 msgr2=0x7f4e68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.775+0000 7f4e82413640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e680040f0 0x7f4e68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.775+0000 7f4e82413640 1 -- 172.21.15.29:0/2054197196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e68003520 con 0x7f4e68004e60 2024-04-15T00:01:50.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.778+0000 7f4e82413640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e68004e60 0x7f4e6800b9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e74001d80 tx=0x7f4e68005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a179f478955d0728 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.782+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74001920 con 0x7f4e68004e60 2024-04-15T00:01:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.782+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e74035070 con 0x7f4e68004e60 2024-04-15T00:01:50.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.782+0000 7f4e80c10640 1 -- 172.21.15.29:0/2054197196 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74003b90 con 0x7f4e68004e60 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e83e76640 1 -- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e68004e60 msgr2=0x7f4e6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2054197196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e68004e60 0x7f4e6800b9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e74001d80 tx=0x7f4e68005830 comp rx=0 tx=0).stop 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e82413640 1 -- 172.21.15.29:0/2054197196 reap_dead start 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e83e76640 1 -- 172.21.15.29:0/2054197196 shutdown_connections 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e83e76640 1 -- 172.21.15.29:0/2054197196 >> 172.21.15.29:0/2054197196 conn(0x7f4e7c061e00 msgr2=0x7f4e7c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e83e76640 1 -- 172.21.15.29:0/2054197196 shutdown_connections 2024-04-15T00:01:50.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.783+0000 7f4e83e76640 1 -- 172.21.15.29:0/2054197196 wait complete. 2024-04-15T00:01:50.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.784+0000 7f4e83e76640 1 Processor -- start 2024-04-15T00:01:50.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.784+0000 7f4e83e76640 1 -- start start 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e83e76640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e68004e60 0x7f4e7c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e83e76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e7c155720 0x7f4e7c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e83e76640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 0x7f4e7c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e83e76640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c158db0 con 0x7f4e7c155720 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e83e76640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c158ad0 con 0x7f4e7c151d50 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e83e76640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c14ede0 con 0x7f4e68004e60 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.785+0000 7f4e81c12640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e68004e60 0x7f4e7c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.786+0000 7f4e82413640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 0x7f4e7c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.786+0000 7f4e82413640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 0x7f4e7c14a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47050/0 (socket says 172.21.15.29:47050) 2024-04-15T00:01:50.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.786+0000 7f4e82413640 1 -- 172.21.15.29:0/2463614361 learned_addr learned my addr 172.21.15.29:0/2463614361 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:50.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.789+0000 7f4e81c12640 1 -- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 msgr2=0x7f4e7c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.789+0000 7f4e81c12640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 0x7f4e7c14a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.789+0000 7f4e81c12640 1 -- 172.21.15.29:0/2463614361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e7c155720 msgr2=0x7f4e7c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.789+0000 7f4e81c12640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e7c155720 0x7f4e7c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.790+0000 7f4e81c12640 1 -- 172.21.15.29:0/2463614361 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0c6470 con 0x7f4e68004e60 2024-04-15T00:01:50.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.790+0000 7f4e82413640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 0x7f4e7c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:50.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.793+0000 7f4e81c12640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e68004e60 0x7f4e7c0c5800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00e840 tx=0x7f4e6c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.796+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c009e00 con 0x7f4e68004e60 2024-04-15T00:01:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.796+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6c004030 con 0x7f4e68004e60 2024-04-15T00:01:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.796+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c1ee570 con 0x7f4e68004e60 2024-04-15T00:01:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.796+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c004400 con 0x7f4e68004e60 2024-04-15T00:01:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.796+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c0c5000 con 0x7f4e68004e60 2024-04-15T00:01:50.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.798+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7c04f540 con 0x7f4e68004e60 2024-04-15T00:01:50.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.826+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4e6c00c940 con 0x7f4e68004e60 2024-04-15T00:01:50.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.826+0000 7f4e727fc640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4e6006b990 0x7f4e6006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.826+0000 7f4e81411640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4e6006b990 0x7f4e6006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.827+0000 7f4e81411640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4e6006b990 0x7f4e6006de50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e78001eb0 tx=0x7f4e780015f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.829+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f4e6c0574a0 con 0x7f4e68004e60 2024-04-15T00:01:50.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T00:01:50.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.880+0000 7fc2791cf640 1 Processor -- start 2024-04-15T00:01:50.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.880+0000 7fc2791cf640 1 -- start start 2024-04-15T00:01:50.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T00:01:50.987 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T00:01:50.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.880+0000 7fc2791cf640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc274143740 0x7fc2740caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.880+0000 7fc2791cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc27415d8a0 0x7fc27406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.880+0000 7fc2791cf640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc27415dca0 0x7fc274071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.880+0000 7fc2791cf640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc27406ccf0 con 0x7fc274143740 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.881+0000 7fc2791cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc27415a2d0 con 0x7fc27415d8a0 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.881+0000 7fc2791cf640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc27406cf90 con 0x7fc27415dca0 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.881+0000 7fc27259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc27415d8a0 0x7fc27406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.882+0000 7fc27259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc27415d8a0 0x7fc27406c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47066/0 (socket says 172.21.15.29:47066) 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.882+0000 7fc27259c640 1 -- 172.21.15.29:0/3361588304 learned_addr learned my addr 172.21.15.29:0/3361588304 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.884+0000 7fc27259c640 1 -- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc27415dca0 msgr2=0x7fc274071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.884+0000 7fc27259c640 1 --2- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc27415dca0 0x7fc274071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.884+0000 7fc27259c640 1 -- 172.21.15.29:0/3361588304 >> v2:172.21.15.29:3300/0 conn(0x7fc274143740 msgr2=0x7fc2740caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.884+0000 7fc27259c640 1 --2- 172.21.15.29:0/3361588304 >> v2:172.21.15.29:3300/0 conn(0x7fc274143740 0x7fc2740caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.884+0000 7fc27259c640 1 -- 172.21.15.29:0/3361588304 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27415a590 con 0x7fc27415d8a0 2024-04-15T00:01:50.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.887+0000 7fc27259c640 1 --2- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc27415d8a0 0x7fc27406c310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2740700a0 tx=0x7fc26802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee6a7945670d325 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.891+0000 7fc271d9b640 1 -- 172.21.15.29:0/3361588304 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26802e070 con 0x7fc27415d8a0 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.891+0000 7fc271d9b640 1 -- 172.21.15.29:0/3361588304 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268037070 con 0x7fc27415d8a0 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.891+0000 7fc271d9b640 1 -- 172.21.15.29:0/3361588304 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268031a00 con 0x7fc27415d8a0 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.891+0000 7fc2791cf640 1 -- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc27415d8a0 msgr2=0x7fc27406c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.891+0000 7fc2791cf640 1 --2- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc27415d8a0 0x7fc27406c310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2740700a0 tx=0x7fc26802b880 comp rx=0 tx=0).stop 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 -- 172.21.15.29:0/3361588304 shutdown_connections 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 --2- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc27415dca0 0x7fc274071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 --2- 172.21.15.29:0/3361588304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc27415d8a0 0x7fc27406c310 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 --2- 172.21.15.29:0/3361588304 >> v2:172.21.15.29:3300/0 conn(0x7fc274143740 0x7fc2740caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 -- 172.21.15.29:0/3361588304 >> 172.21.15.29:0/3361588304 conn(0x7fc274070830 msgr2=0x7fc27406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 -- 172.21.15.29:0/3361588304 shutdown_connections 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.892+0000 7fc2791cf640 1 -- 172.21.15.29:0/3361588304 wait complete. 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.893+0000 7fc2791cf640 1 Processor -- start 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.893+0000 7fc2791cf640 1 -- start start 2024-04-15T00:01:50.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc2791cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 0x7fc2740cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc2791cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc27415d8a0 0x7fc2740c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc2791cf640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc2740cc5b0 0x7fc2740c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc2791cf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc27415b070 con 0x7fc27415d8a0 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc2791cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc27415ab50 con 0x7fc274143740 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc2791cf640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc27415b1f0 con 0x7fc2740cc5b0 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.894+0000 7fc272d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 0x7fc2740cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.895+0000 7fc272d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 0x7fc2740cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47074/0 (socket says 172.21.15.29:47074) 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.895+0000 7fc272d9d640 1 -- 172.21.15.29:0/946691472 learned_addr learned my addr 172.21.15.29:0/946691472 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.898+0000 7fc272d9d640 1 -- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc2740cc5b0 msgr2=0x7fc2740c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.898+0000 7fc272d9d640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc2740cc5b0 0x7fc2740c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.899+0000 7fc272d9d640 1 -- 172.21.15.29:0/946691472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc27415d8a0 msgr2=0x7fc2740c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.899+0000 7fc272d9d640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc27415d8a0 0x7fc2740c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.899+0000 7fc272d9d640 1 -- 172.21.15.29:0/946691472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741e5840 con 0x7fc274143740 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.901+0000 7fc272d9d640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 0x7fc2740cd170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b4a0 tx=0x7fc26400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:50.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.905+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264014070 con 0x7fc274143740 2024-04-15T00:01:50.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.905+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264010610 con 0x7fc274143740 2024-04-15T00:01:50.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.905+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2740cda30 con 0x7fc274143740 2024-04-15T00:01:50.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.905+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264010a00 con 0x7fc274143740 2024-04-15T00:01:50.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.905+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741e5ab0 con 0x7fc274143740 2024-04-15T00:01:50.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.906+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27415a0f0 con 0x7fc274143740 2024-04-15T00:01:50.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.939+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0614031800 con 0x7f062c0cdff0 2024-04-15T00:01:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.952+0000 7f97f280f640 1 Processor -- start 2024-04-15T00:01:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.952+0000 7f97f280f640 1 -- start start 2024-04-15T00:01:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.953+0000 7f97f280f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97ec0cc530 0x7f97ec0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.953+0000 7f97f280f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec0cdff0 0x7f97ec0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.953+0000 7f97f280f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ec0cf910 con 0x7f97ec15b110 2024-04-15T00:01:50.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.953+0000 7f97f280f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97ec0cf350 con 0x7f97ec0cc530 2024-04-15T00:01:50.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:50.953+0000 7f97f280f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec0cf630 con 0x7f97ec0cdff0 2024-04-15T00:01:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.009+0000 7f97eb7fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f97ec15b110 0x7f97ec06c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50568/0 (socket says 172.21.15.29:50568) 2024-04-15T00:01:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.009+0000 7f97eb7fe640 1 -- 172.21.15.29:0/1135095245 learned_addr learned my addr 172.21.15.29:0/1135095245 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:51.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.013+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339136367 0 0) 0x7f97ec0cf910 con 0x7f97ec15b110 2024-04-15T00:01:51.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.014+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97d8003520 con 0x7f97ec15b110 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4000475266 0 0) 0x7f97d8003520 con 0x7f97ec15b110 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec0cdff0 msgr2=0x7f97ec0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec0cdff0 0x7f97ec0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 >> v2:172.21.15.37:3300/0 conn(0x7f97ec0cc530 msgr2=0x7f97ec0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 --2- 172.21.15.29:0/1135095245 >> v2:172.21.15.37:3300/0 conn(0x7f97ec0cc530 0x7f97ec0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec15a630 con 0x7f97ec15b110 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1744880889 0 0) 0x7f97dc001670 con 0x7f97ec15b110 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 >> v1:172.21.15.29:6789/0 conn(0x7f97ec15b110 legacy=0x7f97ec06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80039b0 0x7f97d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec0cdff0 0x7f97d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e60 0x7f97d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0cf350 con 0x7f97d8004e60 2024-04-15T00:01:51.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0cf630 con 0x7f97d80039b0 2024-04-15T00:01:51.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.018+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f97d8005590 con 0x7f97ec0cdff0 2024-04-15T00:01:51.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.022+0000 7f97f0dac640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e60 0x7f97d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.025+0000 7f97f0dac640 1 -- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec0cdff0 msgr2=0x7f97d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.025+0000 7f97f0dac640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec0cdff0 0x7f97d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.025+0000 7f97f0dac640 1 -- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80039b0 msgr2=0x7f97d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.025+0000 7f97f0dac640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80039b0 0x7f97d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.025+0000 7f97f0dac640 1 -- 172.21.15.29:0/1135095245 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d8003520 con 0x7f97d8004e60 2024-04-15T00:01:51.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.027+0000 7f97f0dac640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e60 0x7f97d800b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009e10 tx=0x7f97d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f73127dd9bc311c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.031+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4039070 con 0x7f97d8004e60 2024-04-15T00:01:51.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.031+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e4006e50 con 0x7f97d8004e60 2024-04-15T00:01:51.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.031+0000 7f97eaffd640 1 -- 172.21.15.29:0/1135095245 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4009a10 con 0x7f97d8004e60 2024-04-15T00:01:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f280f640 1 -- 172.21.15.29:0/1135095245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e60 msgr2=0x7f97d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f280f640 1 --2- 172.21.15.29:0/1135095245 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97d8004e60 0x7f97d800b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009e10 tx=0x7f97d8005830 comp rx=0 tx=0).stop 2024-04-15T00:01:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f0dac640 1 -- 172.21.15.29:0/1135095245 reap_dead start 2024-04-15T00:01:51.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f280f640 1 -- 172.21.15.29:0/1135095245 shutdown_connections 2024-04-15T00:01:51.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f280f640 1 -- 172.21.15.29:0/1135095245 >> 172.21.15.29:0/1135095245 conn(0x7f97ec0cfb20 msgr2=0x7f97ec0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f280f640 1 -- 172.21.15.29:0/1135095245 shutdown_connections 2024-04-15T00:01:51.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.032+0000 7f97f280f640 1 -- 172.21.15.29:0/1135095245 wait complete. 2024-04-15T00:01:51.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.034+0000 7f97f280f640 1 Processor -- start 2024-04-15T00:01:51.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.034+0000 7f97f280f640 1 -- start start 2024-04-15T00:01:51.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97f280f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec1e6d20 0x7f97ec1f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97f280f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 0x7f97ec1f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97f280f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97ec1e7100 0x7f97ec1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97f280f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0cebc0 con 0x7f97ec14b060 2024-04-15T00:01:51.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97f280f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec15abf0 con 0x7f97ec1e7100 2024-04-15T00:01:51.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97f280f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec154b10 con 0x7f97ec1e6d20 2024-04-15T00:01:51.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.036+0000 7f97eb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 0x7f97ec1f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.037+0000 7f97eb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 0x7f97ec1f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37132/0 (socket says 172.21.15.29:37132) 2024-04-15T00:01:51.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.037+0000 7f97eb7fe640 1 -- 172.21.15.29:0/1745485272 learned_addr learned my addr 172.21.15.29:0/1745485272 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:51.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.040+0000 7f97eb7fe640 1 -- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec1e6d20 msgr2=0x7f97ec1f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.040+0000 7f97eb7fe640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec1e6d20 0x7f97ec1f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.040+0000 7f97eb7fe640 1 -- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97ec1e7100 msgr2=0x7f97ec1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.040+0000 7f97eb7fe640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97ec1e7100 0x7f97ec1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.040+0000 7f97eb7fe640 1 -- 172.21.15.29:0/1745485272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec1f3830 con 0x7f97ec14b060 2024-04-15T00:01:51.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.043+0000 7f97eb7fe640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 0x7f97ec1f0b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00ca70 tx=0x7f97dc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.047+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc018070 con 0x7f97ec14b060 2024-04-15T00:01:51.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.047+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ec1f3b10 con 0x7f97ec14b060 2024-04-15T00:01:51.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.047+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ec1f40d0 con 0x7f97ec14b060 2024-04-15T00:01:51.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.048+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ec04f540 con 0x7f97ec14b060 2024-04-15T00:01:51.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.049+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97dc004cb0 con 0x7f97ec14b060 2024-04-15T00:01:51.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.049+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc022060 con 0x7f97ec14b060 2024-04-15T00:01:51.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.096+0000 7fecd7ed5640 1 Processor -- start 2024-04-15T00:01:51.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.096+0000 7fecd7ed5640 1 -- start start 2024-04-15T00:01:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.098+0000 7fecd7ed5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 0x7fecd015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.098+0000 7fecd7ed5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fecd0070490 0x7fecd0070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.098+0000 7fecd7ed5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd0154960 con 0x7fecd0154580 2024-04-15T00:01:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.098+0000 7fecd7ed5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fecd0070e60 con 0x7fecd0070490 2024-04-15T00:01:51.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.098+0000 7fecd7ed5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fecd015a580 con 0x7fecd015bc60 2024-04-15T00:01:51.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.104+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4e6c017020 con 0x7f4e68004e60 2024-04-15T00:01:51.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.116+0000 7fe944368640 1 Processor -- start 2024-04-15T00:01:51.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.116+0000 7fe944368640 1 -- start start 2024-04-15T00:01:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.117+0000 7fe944368640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe93c1511a0 0x7fe93c0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.117+0000 7fecd5470640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 0x7fecd015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.117+0000 7fe944368640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c0c5870 con 0x7fe93c0c4930 2024-04-15T00:01:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.117+0000 7fe944368640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c0c5b50 con 0x7fe93c072cd0 2024-04-15T00:01:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.117+0000 7fe944368640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe93c0c2cf0 con 0x7fe93c1511a0 2024-04-15T00:01:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.118+0000 7fecd5470640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 0x7fecd015c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57602/0 (socket says 172.21.15.29:57602) 2024-04-15T00:01:51.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.118+0000 7fecd5470640 1 -- 172.21.15.29:0/3509871628 learned_addr learned my addr 172.21.15.29:0/3509871628 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.122+0000 7fecd5470640 1 -- 172.21.15.29:0/3509871628 >> v2:172.21.15.29:3300/0 conn(0x7fecd0070490 msgr2=0x7fecd0070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.122+0000 7fecd5470640 1 --2- 172.21.15.29:0/3509871628 >> v2:172.21.15.29:3300/0 conn(0x7fecd0070490 0x7fecd0070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.122+0000 7fecd5470640 1 -- 172.21.15.29:0/3509871628 >> v1:172.21.15.29:6789/0 conn(0x7fecd0154580 legacy=0x7fecd00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.122+0000 7fecd5470640 1 -- 172.21.15.29:0/3509871628 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd015a860 con 0x7fecd015bc60 2024-04-15T00:01:51.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.129+0000 7fecd5470640 1 --2- 172.21.15.29:0/3509871628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 0x7fecd015c080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fecc00098a0 tx=0x7fecc002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe7e245c9d15f111 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.133+0000 7fecd4c6f640 1 -- 172.21.15.29:0/3509871628 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0035020 con 0x7fecd015bc60 2024-04-15T00:01:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.133+0000 7fecd4c6f640 1 -- 172.21.15.29:0/3509871628 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc0031640 con 0x7fecd015bc60 2024-04-15T00:01:51.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.133+0000 7fecd4c6f640 1 -- 172.21.15.29:0/3509871628 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc002d040 con 0x7fecd015bc60 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3509871628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 msgr2=0x7fecd015c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3509871628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 0x7fecd015c080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fecc00098a0 tx=0x7fecc002b8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3509871628 shutdown_connections 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3509871628 >> v2:172.21.15.29:3300/0 conn(0x7fecd0070490 0x7fecd0070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3509871628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd015bc60 0x7fecd015c080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3509871628 >> 172.21.15.29:0/3509871628 conn(0x7fecd0061e00 msgr2=0x7fecd0062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3509871628 shutdown_connections 2024-04-15T00:01:51.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.134+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3509871628 wait complete. 2024-04-15T00:01:51.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.136+0000 7fecd7ed5640 1 Processor -- start 2024-04-15T00:01:51.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.136+0000 7fecd7ed5640 1 -- start start 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.137+0000 7fecd7ed5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd0070490 0x7fecd00c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.137+0000 7fecd7ed5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 0x7fecd0153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.138+0000 7fecd7ed5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecd015bc60 0x7fecd00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.138+0000 7fecd7ed5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fecd015b100 con 0x7fecd015bc60 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.138+0000 7fecd7ed5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fecd015ae20 con 0x7fecd0070490 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.138+0000 7fecd7ed5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fecd015b740 con 0x7fecd0154580 2024-04-15T00:01:51.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.138+0000 7fecd5470640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 0x7fecd0153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.139+0000 7fecd5470640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 0x7fecd0153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:57610/0 (socket says 172.21.15.29:57610) 2024-04-15T00:01:51.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.139+0000 7fecd5470640 1 -- 172.21.15.29:0/3827014689 learned_addr learned my addr 172.21.15.29:0/3827014689 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:51.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.142+0000 7fecd5470640 1 -- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd0070490 msgr2=0x7fecd00c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.142+0000 7fecd5470640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd0070490 0x7fecd00c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.142+0000 7fecd5470640 1 -- 172.21.15.29:0/3827014689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecd015bc60 msgr2=0x7fecd00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.142+0000 7fecd5470640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecd015bc60 0x7fecd00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.142+0000 7fecd5470640 1 -- 172.21.15.29:0/3827014689 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd01f0520 con 0x7fecd0154580 2024-04-15T00:01:51.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.145+0000 7fecd5470640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 0x7fecd0153320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecc002bf00 tx=0x7fecc00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.149+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f062c06e000 con 0x7f062c0cdff0 2024-04-15T00:01:51.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.149+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc003ac60 con 0x7fecd0154580 2024-04-15T00:01:51.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.149+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc003ae00 con 0x7fecd0154580 2024-04-15T00:01:51.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.149+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0044630 con 0x7fecd0154580 2024-04-15T00:01:51.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.149+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd01f07c0 con 0x7fecd0154580 2024-04-15T00:01:51.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.149+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd01f0d80 con 0x7fecd0154580 2024-04-15T00:01:51.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.151+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd004f540 con 0x7fecd0154580 2024-04-15T00:01:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.169+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fecc0038020 con 0x7fecd0154580 2024-04-15T00:01:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.169+0000 7fecc67fc640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fecb406b9c0 0x7fecb406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.169+0000 7fecd5c71640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fecb406b9c0 0x7fecb406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.170+0000 7fecd5c71640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fecb406b9c0 0x7fecb406de80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feccc001560 tx=0x7feccc007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.173+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fecc0079630 con 0x7fecd0154580 2024-04-15T00:01:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.188+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc264017070 con 0x7fc274143740 2024-04-15T00:01:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.188+0000 7fc25b7fe640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc26006ba10 0x7fc26006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.189+0000 7fc27259c640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc26006ba10 0x7fc26006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.189+0000 7fc27259c640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc26006ba10 0x7fc26006ded0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc268036000 tx=0x7fc268030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.191+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc264056cf0 con 0x7fc274143740 2024-04-15T00:01:51.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.207+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc27415a0f0 con 0x7fc274143740 2024-04-15T00:01:51.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.219+0000 7fe942905640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe93c072cd0 0x7fe93c156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44406/0 (socket says 172.21.15.29:44406) 2024-04-15T00:01:51.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.219+0000 7fe942905640 1 -- 172.21.15.29:0/1809578868 learned_addr learned my addr 172.21.15.29:0/1809578868 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:51.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.294+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4e7c15c160 con 0x7f4e68004e60 2024-04-15T00:01:51.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.355+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f97dc01b070 con 0x7f97ec14b060 2024-04-15T00:01:51.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.355+0000 7f97e8ff9640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f97cc06b990 0x7f97cc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.356+0000 7f97ebfff640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f97cc06b990 0x7f97cc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.356+0000 7f97ebfff640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f97cc06b990 0x7f97cc06de50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009690 tx=0x7f97d4006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.362+0000 7f0623fff640 1 -- 172.21.15.29:0/2573981170 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0614081080 con 0x7f062c0cdff0 2024-04-15T00:01:51.368 INFO:teuthology.orchestra.run.smithi029.stdout:60129542159 2024-04-15T00:01:51.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f060c06b9e0 msgr2=0x7f060c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f060c06b9e0 0x7f060c06dea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f061c007fd0 tx=0x7f061c007e80 comp rx=0 tx=0).stop 2024-04-15T00:01:51.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 msgr2=0x7f062c1e6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 0x7f062c1e6cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0614034040 tx=0x7f06140046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 shutdown_connections 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f060c06b9e0 0x7f060c06dea0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f062c15b110 0x7f062c0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f062c0cdff0 0x7f062c1e6cb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 --2- 172.21.15.29:0/2573981170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c0cc530 0x7f062c15df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 >> 172.21.15.29:0/2573981170 conn(0x7f062c0cfb20 msgr2=0x7f062c14f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 shutdown_connections 2024-04-15T00:01:51.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.364+0000 7f0631ade640 1 -- 172.21.15.29:0/2573981170 wait complete. 2024-04-15T00:01:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.373+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f97dc056a10 con 0x7f97ec14b060 2024-04-15T00:01:51.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.373+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f97dc058970 con 0x7f97ec14b060 2024-04-15T00:01:51.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542159 for osd.4 2024-04-15T00:01:51.381 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:51.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.380+0000 7fe942104640 1 --2- 172.21.15.29:0/1809578868 >> v2:172.21.15.29:3300/0 conn(0x7fe93c1511a0 0x7fe93c0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.384+0000 7fe942104640 1 -- 172.21.15.29:0/1809578868 >> v1:172.21.15.37:6789/0 conn(0x7fe93c072cd0 legacy=0x7fe93c156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.384+0000 7fe942104640 1 -- 172.21.15.29:0/1809578868 >> v1:172.21.15.29:6789/0 conn(0x7fe93c0c4930 legacy=0x7fe93c0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:51.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.384+0000 7fe942104640 1 -- 172.21.15.29:0/1809578868 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c0c2fd0 con 0x7fe93c1511a0 2024-04-15T00:01:51.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.390+0000 7fe942104640 1 --2- 172.21.15.29:0/1809578868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 0x7fe93c0c4f50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097a0 tx=0x7fe93802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456e1bb6ea03b411 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.409+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc2740c8e20 con 0x7fc274143740 2024-04-15T00:01:51.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.444+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fecc003f070 con 0x7fecd0154580 2024-04-15T00:01:51.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.449+0000 7f4e727fc640 1 -- 172.21.15.29:0/2463614361 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e6c059400 con 0x7f4e68004e60 2024-04-15T00:01:51.455 INFO:teuthology.orchestra.run.smithi029.stdout:64424509455 2024-04-15T00:01:51.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4e6006b990 msgr2=0x7f4e6006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4e6006b990 0x7f4e6006de50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e78001eb0 tx=0x7f4e780015f0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e68004e60 msgr2=0x7f4e7c0c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e68004e60 0x7f4e7c0c5800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00e840 tx=0x7f4e6c00ed00 comp rx=0 tx=0).stop 2024-04-15T00:01:51.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 shutdown_connections 2024-04-15T00:01:51.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4e6006b990 0x7f4e6006de50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7c151d50 0x7f4e7c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e7c155720 0x7f4e7c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 --2- 172.21.15.29:0/2463614361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4e68004e60 0x7f4e7c0c5800 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 >> 172.21.15.29:0/2463614361 conn(0x7f4e7c061e00 msgr2=0x7f4e7c14dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 shutdown_connections 2024-04-15T00:01:51.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.452+0000 7f4e83e76640 1 -- 172.21.15.29:0/2463614361 wait complete. 2024-04-15T00:01:51.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.3 2024-04-15T00:01:51.469 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:51.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.466+0000 7fc25b7fe640 1 -- 172.21.15.29:0/946691472 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc264059350 con 0x7fc274143740 2024-04-15T00:01:51.472 INFO:teuthology.orchestra.run.smithi029.stdout:55834574862 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.468+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc26006ba10 msgr2=0x7fc26006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.468+0000 7fc2791cf640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc26006ba10 0x7fc26006ded0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc268036000 tx=0x7fc268030000 comp rx=0 tx=0).stop 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.468+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 msgr2=0x7fc2740cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.468+0000 7fc2791cf640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 0x7fc2740cd170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b4a0 tx=0x7fc26400b960 comp rx=0 tx=0).stop 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 shutdown_connections 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc26006ba10 0x7fc26006ded0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc2740cc5b0 0x7fc2740c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc27415d8a0 0x7fc2740c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 --2- 172.21.15.29:0/946691472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc274143740 0x7fc2740cd170 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 >> 172.21.15.29:0/946691472 conn(0x7fc274070830 msgr2=0x7fc2740c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 shutdown_connections 2024-04-15T00:01:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.469+0000 7fc2791cf640 1 -- 172.21.15.29:0/946691472 wait complete. 2024-04-15T00:01:51.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.471+0000 7fe941102640 1 -- 172.21.15.29:0/1809578868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938035020 con 0x7fe93c1511a0 2024-04-15T00:01:51.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.476+0000 7fe941102640 1 -- 172.21.15.29:0/1809578868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe938031830 con 0x7fe93c1511a0 2024-04-15T00:01:51.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.476+0000 7fe941102640 1 -- 172.21.15.29:0/1809578868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938031c00 con 0x7fe93c1511a0 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.476+0000 7fe944368640 1 -- 172.21.15.29:0/1809578868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 msgr2=0x7fe93c0c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.476+0000 7fe944368640 1 --2- 172.21.15.29:0/1809578868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 0x7fe93c0c4f50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097a0 tx=0x7fe93802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.476+0000 7fe944368640 1 -- 172.21.15.29:0/1809578868 shutdown_connections 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.476+0000 7fe944368640 1 --2- 172.21.15.29:0/1809578868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 0x7fe93c0c4f50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.477+0000 7fe944368640 1 -- 172.21.15.29:0/1809578868 >> 172.21.15.29:0/1809578868 conn(0x7fe93c06fca0 msgr2=0x7fe93c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.477+0000 7fe944368640 1 -- 172.21.15.29:0/1809578868 shutdown_connections 2024-04-15T00:01:51.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.477+0000 7fe944368640 1 -- 172.21.15.29:0/1809578868 wait complete. 2024-04-15T00:01:51.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.478+0000 7fe944368640 1 Processor -- start 2024-04-15T00:01:51.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.478+0000 7fe944368640 1 -- start start 2024-04-15T00:01:51.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.479+0000 7fe944368640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe93c072cd0 0x7fe93c141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.479+0000 7fe944368640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 0x7fe93c14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.479+0000 7fe944368640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 0x7fe93c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.479+0000 7fe944368640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c0c5490 con 0x7fe93c1511a0 2024-04-15T00:01:51.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.479+0000 7fe944368640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c0c3590 con 0x7fe93c0c4930 2024-04-15T00:01:51.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.479+0000 7fe944368640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe93c0c5610 con 0x7fe93c072cd0 2024-04-15T00:01:51.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.482+0000 7fe941903640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 0x7fe93c14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.483+0000 7fe941903640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 0x7fe93c14cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47126/0 (socket says 172.21.15.29:47126) 2024-04-15T00:01:51.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.483+0000 7fe941903640 1 -- 172.21.15.29:0/2750507710 learned_addr learned my addr 172.21.15.29:0/2750507710 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:51.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.0 2024-04-15T00:01:51.490 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:51.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.486+0000 7fe941903640 1 -- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe93c072cd0 msgr2=0x7fe93c141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.486+0000 7fe941903640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe93c072cd0 0x7fe93c141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.486+0000 7fe941903640 1 -- 172.21.15.29:0/2750507710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 msgr2=0x7fe93c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.486+0000 7fe941903640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 0x7fe93c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.486+0000 7fe941903640 1 -- 172.21.15.29:0/2750507710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c1f1260 con 0x7fe93c0c4930 2024-04-15T00:01:51.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.489+0000 7fe941903640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 0x7fe93c14cb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c410 tx=0x7fe92c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.493+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c017070 con 0x7fe93c0c4930 2024-04-15T00:01:51.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.493+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92c0035f0 con 0x7fe93c0c4930 2024-04-15T00:01:51.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.493+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe93c154be0 con 0x7fe93c0c4930 2024-04-15T00:01:51.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.493+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0039e0 con 0x7fe93c0c4930 2024-04-15T00:01:51.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.493+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93c157920 con 0x7fe93c0c4930 2024-04-15T00:01:51.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.494+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93c074a90 con 0x7fe93c0c4930 2024-04-15T00:01:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.519+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe92c01a070 con 0x7fe93c0c4930 2024-04-15T00:01:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.519+0000 7fe932ffd640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe92006ba10 0x7fe92006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:51.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.520+0000 7fe942104640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe92006ba10 0x7fe92006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:51.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.520+0000 7fe942104640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe92006ba10 0x7fe92006ded0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe938036000 tx=0x7fe938030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.523+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe92c056670 con 0x7fe93c0c4930 2024-04-15T00:01:51.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.595+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f97ec0b5aa0 con 0x7f97ec14b060 2024-04-15T00:01:51.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.604+0000 7f97e8ff9640 1 -- 172.21.15.29:0/1745485272 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97dc05ca10 con 0x7f97ec14b060 2024-04-15T00:01:51.610 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f97cc06b990 msgr2=0x7f97cc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f97cc06b990 0x7f97cc06de50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009690 tx=0x7f97d4006c90 comp rx=0 tx=0).stop 2024-04-15T00:01:51.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 msgr2=0x7f97ec1f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 0x7f97ec1f0b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00ca70 tx=0x7f97dc00cf30 comp rx=0 tx=0).stop 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 shutdown_connections 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f97cc06b990 0x7f97cc06de50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97ec1e7100 0x7f97ec1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f97ec14b060 0x7f97ec1f0b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 --2- 172.21.15.29:0/1745485272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f97ec1e6d20 0x7f97ec1f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 >> 172.21.15.29:0/1745485272 conn(0x7f97ec0cfb20 msgr2=0x7f97ec0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 shutdown_connections 2024-04-15T00:01:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.606+0000 7f97f280f640 1 -- 172.21.15.29:0/1745485272 wait complete. 2024-04-15T00:01:51.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.5 2024-04-15T00:01:51.624 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:51.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.640+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fecd00cba80 con 0x7fecd0154580 2024-04-15T00:01:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.654+0000 7fecc67fc640 1 -- 172.21.15.29:0/3827014689 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecd0154960 con 0x7fecd0154580 2024-04-15T00:01:51.661 INFO:teuthology.orchestra.run.smithi029.stdout:60129542158 2024-04-15T00:01:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fecb406b9c0 msgr2=0x7fecb406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fecb406b9c0 0x7fecb406de80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feccc001560 tx=0x7feccc007990 comp rx=0 tx=0).stop 2024-04-15T00:01:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 msgr2=0x7fecd0153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 0x7fecd0153320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecc002bf00 tx=0x7fecc00046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 shutdown_connections 2024-04-15T00:01:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fecb406b9c0 0x7fecb406de80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecd015bc60 0x7fecd00711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fecd0154580 0x7fecd0153320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 --2- 172.21.15.29:0/3827014689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd0070490 0x7fecd00c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:51.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 >> 172.21.15.29:0/3827014689 conn(0x7fecd0061e00 msgr2=0x7fecd00ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:51.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 shutdown_connections 2024-04-15T00:01:51.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.656+0000 7fecd7ed5640 1 -- 172.21.15.29:0/3827014689 wait complete. 2024-04-15T00:01:51.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.7 2024-04-15T00:01:51.674 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:51.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:51.820+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe93c074a90 con 0x7fe93c0c4930 2024-04-15T00:01:52.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.028+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe93c04f540 con 0x7fe93c0c4930 2024-04-15T00:01:52.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.032+0000 7fe932ffd640 1 -- 172.21.15.29:0/2750507710 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe92c021020 con 0x7fe93c0c4930 2024-04-15T00:01:52.038 INFO:teuthology.orchestra.run.smithi029.stdout:64424509455 2024-04-15T00:01:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe92006ba10 msgr2=0x7fe92006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe92006ba10 0x7fe92006ded0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe938036000 tx=0x7fe938030000 comp rx=0 tx=0).stop 2024-04-15T00:01:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 msgr2=0x7fe93c14cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 0x7fe93c14cb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c410 tx=0x7fe92c00c8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 shutdown_connections 2024-04-15T00:01:52.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe92006ba10 0x7fe92006ded0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe93c1511a0 0x7fe93c14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0c4930 0x7fe93c14cb60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 --2- 172.21.15.29:0/2750507710 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe93c072cd0 0x7fe93c141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 >> 172.21.15.29:0/2750507710 conn(0x7fe93c06fca0 msgr2=0x7fe93c0c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:52.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 shutdown_connections 2024-04-15T00:01:52.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.034+0000 7fe944368640 1 -- 172.21.15.29:0/2750507710 wait complete. 2024-04-15T00:01:52.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.1 2024-04-15T00:01:52.051 DEBUG:teuthology.parallel:result is None 2024-04-15T00:01:52.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T00:01:52.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:01:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 Processor -- start 2024-04-15T00:01:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 -- start start 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4de815ad00 0x7f4de80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4de80c2ec0 0x7f4de80c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de80c3890 con 0x7f4de80cdc80 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f4de815e5b0 con 0x7f4de80c2ec0 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.147+0000 7f4ded11e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4de815d750 con 0x7f4de815ad00 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.148+0000 7f4de759e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4de80c2ec0 0x7f4de80c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.148+0000 7f4de659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4de815ad00 0x7f4de80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.148+0000 7f4de6d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4de80cdc80 0x7f4de8070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50586/0 (socket says 172.21.15.29:50586) 2024-04-15T00:01:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.148+0000 7f4de6d9d640 1 -- 172.21.15.29:0/2955938629 learned_addr learned my addr 172.21.15.29:0/2955938629 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.152+0000 7f4de659c640 1 -- 172.21.15.29:0/2955938629 >> v2:172.21.15.29:3300/0 conn(0x7f4de80c2ec0 msgr2=0x7f4de80c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.152+0000 7f4de659c640 1 --2- 172.21.15.29:0/2955938629 >> v2:172.21.15.29:3300/0 conn(0x7f4de80c2ec0 0x7f4de80c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.152+0000 7f4de659c640 1 -- 172.21.15.29:0/2955938629 >> v1:172.21.15.29:6789/0 conn(0x7f4de80cdc80 legacy=0x7f4de8070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.152+0000 7f4de659c640 1 -- 172.21.15.29:0/2955938629 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de815d9a0 con 0x7f4de815ad00 2024-04-15T00:01:52.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.155+0000 7f4de659c640 1 --2- 172.21.15.29:0/2955938629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de80ce060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4de80c4d50 tx=0x7f4ddc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a874bcca6e5cec05 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:52.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.159+0000 7f4de5d9b640 1 -- 172.21.15.29:0/2955938629 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc035020 con 0x7f4de815ad00 2024-04-15T00:01:52.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4de5d9b640 1 -- 172.21.15.29:0/2955938629 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc031830 con 0x7f4de815ad00 2024-04-15T00:01:52.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4de5d9b640 1 -- 172.21.15.29:0/2955938629 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc031c00 con 0x7f4de815ad00 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 -- 172.21.15.29:0/2955938629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 msgr2=0x7f4de80ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 --2- 172.21.15.29:0/2955938629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de80ce060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4de80c4d50 tx=0x7f4ddc02b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 -- 172.21.15.29:0/2955938629 shutdown_connections 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 --2- 172.21.15.29:0/2955938629 >> v2:172.21.15.29:3300/0 conn(0x7f4de80c2ec0 0x7f4de80c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 --2- 172.21.15.29:0/2955938629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de80ce060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 -- 172.21.15.29:0/2955938629 >> 172.21.15.29:0/2955938629 conn(0x7f4de8061e00 msgr2=0x7f4de8062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 -- 172.21.15.29:0/2955938629 shutdown_connections 2024-04-15T00:01:52.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.160+0000 7f4ded11e640 1 -- 172.21.15.29:0/2955938629 wait complete. 2024-04-15T00:01:52.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 Processor -- start 2024-04-15T00:01:52.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 -- start start 2024-04-15T00:01:52.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 0x7f4de8149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4de80cdc80 0x7f4de8157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4de815df60 con 0x7f4de80c2ec0 2024-04-15T00:01:52.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4de815b140 con 0x7f4de815ad00 2024-04-15T00:01:52.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.162+0000 7f4ded11e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4de815e240 con 0x7f4de80cdc80 2024-04-15T00:01:52.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.163+0000 7f4de6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 0x7f4de8149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.163+0000 7f4de759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.163+0000 7f4de659c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4de80cdc80 0x7f4de8157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.163+0000 7f4de6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 0x7f4de8149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37168/0 (socket says 172.21.15.29:37168) 2024-04-15T00:01:52.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.163+0000 7f4de6d9d640 1 -- 172.21.15.29:0/186886749 learned_addr learned my addr 172.21.15.29:0/186886749 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:52.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.167+0000 7f4de6d9d640 1 -- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4de80cdc80 msgr2=0x7f4de8157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.167+0000 7f4de6d9d640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4de80cdc80 0x7f4de8157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.167+0000 7f4de6d9d640 1 -- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 msgr2=0x7f4de815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.167+0000 7f4de6d9d640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.167+0000 7f4de6d9d640 1 -- 172.21.15.29:0/186886749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de815d150 con 0x7f4de80c2ec0 2024-04-15T00:01:52.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.167+0000 7f4de659c640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4de80cdc80 0x7f4de8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:52.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.169+0000 7f4de6d9d640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 0x7f4de8149d30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c3c0 tx=0x7f4dd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:52.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.173+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8017070 con 0x7f4de80c2ec0 2024-04-15T00:01:52.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.173+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd8005ce0 con 0x7f4de80c2ec0 2024-04-15T00:01:52.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.173+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80072f0 con 0x7f4de80c2ec0 2024-04-15T00:01:52.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.173+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de8159b00 con 0x7f4de80c2ec0 2024-04-15T00:01:52.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.173+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de81f0000 con 0x7f4de80c2ec0 2024-04-15T00:01:52.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.174+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de804f540 con 0x7f4de80c2ec0 2024-04-15T00:01:52.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.194+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4dd801a070 con 0x7f4de80c2ec0 2024-04-15T00:01:52.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.194+0000 7f4dcf7fe640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4dd406ba10 0x7f4dd406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.194+0000 7f4de659c640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4dd406ba10 0x7f4dd406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.195+0000 7f4de659c640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4dd406ba10 0x7f4dd406ded0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc036000 tx=0x7f4ddc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:52.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.196+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f4dd8056580 con 0x7f4de80c2ec0 2024-04-15T00:01:52.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.456+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4dd8021020 con 0x7f4de80c2ec0 2024-04-15T00:01:52.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.649+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4de80c8530 con 0x7f4dd406ba10 2024-04-15T00:01:52.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.658+0000 7f4dcf7fe640 1 -- 172.21.15.29:0/186886749 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332665 (secure 0 0 0) 0x7f4ddc09b390 con 0x7f4dd406ba10 2024-04-15T00:01:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4dd406ba10 msgr2=0x7f4dd406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4dd406ba10 0x7f4dd406ded0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc036000 tx=0x7f4ddc008030 comp rx=0 tx=0).stop 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 msgr2=0x7f4de8149d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 0x7f4de8149d30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c3c0 tx=0x7f4dd800c880 comp rx=0 tx=0).stop 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 shutdown_connections 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f4dd406ba10 0x7f4dd406ded0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de815ad00 0x7f4de815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f4de80cdc80 0x7f4de8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 --2- 172.21.15.29:0/186886749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4de80c2ec0 0x7f4de8149d30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 >> 172.21.15.29:0/186886749 conn(0x7f4de8061e00 msgr2=0x7f4de81e3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 shutdown_connections 2024-04-15T00:01:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.661+0000 7f4ded11e640 1 -- 172.21.15.29:0/186886749 wait complete. 2024-04-15T00:01:52.678 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-15T00:01:51.101923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600542,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":357,"num_write_kb":2476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":290,"ondisk_log_size":290,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":324,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235452,"kb_used_data":2656,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739268,"statfs":{"total":773094113280,"available":772853010432,"internally_reserved":0,"allocated":2719744,"data_stored":2156545,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5534,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002166"},"pg_stats":[{"pgid":"2.1f","version":"27'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098460+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T00:01:48.098460+0000","last_peered":"2024-04-15T00:01:48.098460+0000","last_clean":"2024-04-15T00:01:48.098460+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T00:01:48.098460+0000","last_undegraded":"2024-04-15T00:01:48.098460+0000","last_fullsized":"2024-04-15T00:01:48.098460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.093209+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T00:01:48.093209+0000","last_peered":"2024-04-15T00:01:48.093209+0000","last_clean":"2024-04-15T00:01:48.093209+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T00:01:48.093209+0000","last_undegraded":"2024-04-15T00:01:48.093209+0000","last_fullsized":"2024-04-15T00:01:48.093209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.091904+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T00:01:48.091904+0000","last_peered":"2024-04-15T00:01:48.091904+0000","last_clean":"2024-04-15T00:01:48.091904+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T00:01:48.091904+0000","last_undegraded":"2024-04-15T00:01:48.091904+0000","last_fullsized":"2024-04-15T00:01:48.091904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.093372+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T00:01:48.093372+0000","last_peered":"2024-04-15T00:01:48.093372+0000","last_clean":"2024-04-15T00:01:48.093372+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T00:01:48.093372+0000","last_undegraded":"2024-04-15T00:01:48.093372+0000","last_fullsized":"2024-04-15T00:01:48.093372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098197+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T00:01:48.098197+0000","last_peered":"2024-04-15T00:01:48.098197+0000","last_clean":"2024-04-15T00:01:48.098197+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T00:01:48.098197+0000","last_undegraded":"2024-04-15T00:01:48.098197+0000","last_fullsized":"2024-04-15T00:01:48.098197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270113+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T00:01:50.270113+0000","last_peered":"2024-04-15T00:01:50.270113+0000","last_clean":"2024-04-15T00:01:50.270113+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:50.270113+0000","last_undegraded":"2024-04-15T00:01:50.270113+0000","last_fullsized":"2024-04-15T00:01:50.270113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324715+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T00:01:50.324715+0000","last_peered":"2024-04-15T00:01:50.324715+0000","last_clean":"2024-04-15T00:01:50.324715+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T00:01:50.324715+0000","last_undegraded":"2024-04-15T00:01:50.324715+0000","last_fullsized":"2024-04-15T00:01:50.324715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993022+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T00:01:49.993022+0000","last_peered":"2024-04-15T00:01:49.993022+0000","last_clean":"2024-04-15T00:01:49.993022+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T00:01:49.993022+0000","last_undegraded":"2024-04-15T00:01:49.993022+0000","last_fullsized":"2024-04-15T00:01:49.993022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270378+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T00:01:50.270378+0000","last_peered":"2024-04-15T00:01:50.270378+0000","last_clean":"2024-04-15T00:01:50.270378+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T00:01:50.270378+0000","last_undegraded":"2024-04-15T00:01:50.270378+0000","last_fullsized":"2024-04-15T00:01:50.270378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324595+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T00:01:50.324595+0000","last_peered":"2024-04-15T00:01:50.324595+0000","last_clean":"2024-04-15T00:01:50.324595+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T00:01:50.324595+0000","last_undegraded":"2024-04-15T00:01:50.324595+0000","last_fullsized":"2024-04-15T00:01:50.324595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993348+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T00:01:49.993348+0000","last_peered":"2024-04-15T00:01:49.993348+0000","last_clean":"2024-04-15T00:01:49.993348+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T00:01:49.993348+0000","last_undegraded":"2024-04-15T00:01:49.993348+0000","last_fullsized":"2024-04-15T00:01:49.993348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270221+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T00:01:50.270221+0000","last_peered":"2024-04-15T00:01:50.270221+0000","last_clean":"2024-04-15T00:01:50.270221+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T00:01:50.270221+0000","last_undegraded":"2024-04-15T00:01:50.270221+0000","last_fullsized":"2024-04-15T00:01:50.270221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995350+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T00:01:49.995350+0000","last_peered":"2024-04-15T00:01:49.995350+0000","last_clean":"2024-04-15T00:01:49.995350+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T00:01:49.995350+0000","last_undegraded":"2024-04-15T00:01:49.995350+0000","last_fullsized":"2024-04-15T00:01:49.995350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324721+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T00:01:50.324721+0000","last_peered":"2024-04-15T00:01:50.324721+0000","last_clean":"2024-04-15T00:01:50.324721+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T00:01:50.324721+0000","last_undegraded":"2024-04-15T00:01:50.324721+0000","last_fullsized":"2024-04-15T00:01:50.324721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270793+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T00:01:50.270793+0000","last_peered":"2024-04-15T00:01:50.270793+0000","last_clean":"2024-04-15T00:01:50.270793+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T00:01:50.270793+0000","last_undegraded":"2024-04-15T00:01:50.270793+0000","last_fullsized":"2024-04-15T00:01:50.270793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.091990+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T00:01:48.091990+0000","last_peered":"2024-04-15T00:01:48.091990+0000","last_clean":"2024-04-15T00:01:48.091990+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T00:01:48.091990+0000","last_undegraded":"2024-04-15T00:01:48.091990+0000","last_fullsized":"2024-04-15T00:01:48.091990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089109+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T00:01:48.089109+0000","last_peered":"2024-04-15T00:01:48.089109+0000","last_clean":"2024-04-15T00:01:48.089109+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T00:01:48.089109+0000","last_undegraded":"2024-04-15T00:01:48.089109+0000","last_fullsized":"2024-04-15T00:01:48.089109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270363+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T00:01:50.270363+0000","last_peered":"2024-04-15T00:01:50.270363+0000","last_clean":"2024-04-15T00:01:50.270363+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T00:01:50.270363+0000","last_undegraded":"2024-04-15T00:01:50.270363+0000","last_fullsized":"2024-04-15T00:01:50.270363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092890+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T00:01:48.092890+0000","last_peered":"2024-04-15T00:01:48.092890+0000","last_clean":"2024-04-15T00:01:48.092890+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T00:01:48.092890+0000","last_undegraded":"2024-04-15T00:01:48.092890+0000","last_fullsized":"2024-04-15T00:01:48.092890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.088689+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T00:01:48.088689+0000","last_peered":"2024-04-15T00:01:48.088689+0000","last_clean":"2024-04-15T00:01:48.088689+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T00:01:48.088689+0000","last_undegraded":"2024-04-15T00:01:48.088689+0000","last_fullsized":"2024-04-15T00:01:48.088689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.090176+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T00:01:48.090176+0000","last_peered":"2024-04-15T00:01:48.090176+0000","last_clean":"2024-04-15T00:01:48.090176+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T00:01:48.090176+0000","last_undegraded":"2024-04-15T00:01:48.090176+0000","last_fullsized":"2024-04-15T00:01:48.090176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270275+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T00:01:50.270275+0000","last_peered":"2024-04-15T00:01:50.270275+0000","last_clean":"2024-04-15T00:01:50.270275+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T00:01:50.270275+0000","last_undegraded":"2024-04-15T00:01:50.270275+0000","last_fullsized":"2024-04-15T00:01:50.270275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324319+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T00:01:50.324319+0000","last_peered":"2024-04-15T00:01:50.324319+0000","last_clean":"2024-04-15T00:01:50.324319+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T00:01:50.324319+0000","last_undegraded":"2024-04-15T00:01:50.324319+0000","last_fullsized":"2024-04-15T00:01:50.324319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270444+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T00:01:50.270444+0000","last_peered":"2024-04-15T00:01:50.270444+0000","last_clean":"2024-04-15T00:01:50.270444+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T00:01:50.270444+0000","last_undegraded":"2024-04-15T00:01:50.270444+0000","last_fullsized":"2024-04-15T00:01:50.270444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098216+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T00:01:48.098216+0000","last_peered":"2024-04-15T00:01:48.098216+0000","last_clean":"2024-04-15T00:01:48.098216+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T00:01:48.098216+0000","last_undegraded":"2024-04-15T00:01:48.098216+0000","last_fullsized":"2024-04-15T00:01:48.098216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996347+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T00:01:49.996347+0000","last_peered":"2024-04-15T00:01:49.996347+0000","last_clean":"2024-04-15T00:01:49.996347+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T00:01:49.996347+0000","last_undegraded":"2024-04-15T00:01:49.996347+0000","last_fullsized":"2024-04-15T00:01:49.996347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270132+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T00:01:50.270132+0000","last_peered":"2024-04-15T00:01:50.270132+0000","last_clean":"2024-04-15T00:01:50.270132+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T00:01:50.270132+0000","last_undegraded":"2024-04-15T00:01:50.270132+0000","last_fullsized":"2024-04-15T00:01:50.270132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.093932+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T00:01:48.093932+0000","last_peered":"2024-04-15T00:01:48.093932+0000","last_clean":"2024-04-15T00:01:48.093932+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T00:01:48.093932+0000","last_undegraded":"2024-04-15T00:01:48.093932+0000","last_fullsized":"2024-04-15T00:01:48.093932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.090186+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T00:01:48.090186+0000","last_peered":"2024-04-15T00:01:48.090186+0000","last_clean":"2024-04-15T00:01:48.090186+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T00:01:48.090186+0000","last_undegraded":"2024-04-15T00:01:48.090186+0000","last_fullsized":"2024-04-15T00:01:48.090186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"peering","last_fresh":"2024-04-15T00:01:21.287990+0000","last_change":"2024-04-15T00:01:48.092183+0000","last_active":"2024-04-15T00:01:48.092183+0000","last_peered":"2024-04-15T00:01:21.287990+0000","last_clean":"2024-04-15T00:01:21.287990+0000","last_became_active":"2024-04-15T00:01:18.977604+0000","last_became_peered":"2024-04-15T00:01:18.977604+0000","last_unstale":"2024-04-15T00:01:21.287990+0000","last_undegraded":"2024-04-15T00:01:21.287990+0000","last_fullsized":"2024-04-15T00:01:21.287990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1,2,7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089222+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T00:01:48.089222+0000","last_peered":"2024-04-15T00:01:48.089222+0000","last_clean":"2024-04-15T00:01:48.089222+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T00:01:48.089222+0000","last_undegraded":"2024-04-15T00:01:48.089222+0000","last_fullsized":"2024-04-15T00:01:48.089222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324829+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T00:01:50.324829+0000","last_peered":"2024-04-15T00:01:50.324829+0000","last_clean":"2024-04-15T00:01:50.324829+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T00:01:50.324829+0000","last_undegraded":"2024-04-15T00:01:50.324829+0000","last_fullsized":"2024-04-15T00:01:50.324829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097791+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T00:01:48.097791+0000","last_peered":"2024-04-15T00:01:48.097791+0000","last_clean":"2024-04-15T00:01:48.097791+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T00:01:48.097791+0000","last_undegraded":"2024-04-15T00:01:48.097791+0000","last_fullsized":"2024-04-15T00:01:48.097791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993555+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T00:01:49.993555+0000","last_peered":"2024-04-15T00:01:49.993555+0000","last_clean":"2024-04-15T00:01:49.993555+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T00:01:49.993555+0000","last_undegraded":"2024-04-15T00:01:49.993555+0000","last_fullsized":"2024-04-15T00:01:49.993555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089310+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T00:01:48.089310+0000","last_peered":"2024-04-15T00:01:48.089310+0000","last_clean":"2024-04-15T00:01:48.089310+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T00:01:48.089310+0000","last_undegraded":"2024-04-15T00:01:48.089310+0000","last_fullsized":"2024-04-15T00:01:48.089310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.088869+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T00:01:48.088869+0000","last_peered":"2024-04-15T00:01:48.088869+0000","last_clean":"2024-04-15T00:01:48.088869+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T00:01:48.088869+0000","last_undegraded":"2024-04-15T00:01:48.088869+0000","last_fullsized":"2024-04-15T00:01:48.088869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270278+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T00:01:50.270278+0000","last_peered":"2024-04-15T00:01:50.270278+0000","last_clean":"2024-04-15T00:01:50.270278+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T00:01:50.270278+0000","last_undegraded":"2024-04-15T00:01:50.270278+0000","last_fullsized":"2024-04-15T00:01:50.270278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992881+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T00:01:49.992881+0000","last_peered":"2024-04-15T00:01:49.992881+0000","last_clean":"2024-04-15T00:01:49.992881+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T00:01:49.992881+0000","last_undegraded":"2024-04-15T00:01:49.992881+0000","last_fullsized":"2024-04-15T00:01:49.992881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.003001+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T00:01:50.003001+0000","last_peered":"2024-04-15T00:01:50.003001+0000","last_clean":"2024-04-15T00:01:50.003001+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T00:01:50.003001+0000","last_undegraded":"2024-04-15T00:01:50.003001+0000","last_fullsized":"2024-04-15T00:01:50.003001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:49.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.088676+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T00:01:48.088676+0000","last_peered":"2024-04-15T00:01:48.088676+0000","last_clean":"2024-04-15T00:01:48.088676+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T00:01:48.088676+0000","last_undegraded":"2024-04-15T00:01:48.088676+0000","last_fullsized":"2024-04-15T00:01:48.088676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.989769+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T00:01:49.989769+0000","last_peered":"2024-04-15T00:01:49.989769+0000","last_clean":"2024-04-15T00:01:49.989769+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T00:01:49.989769+0000","last_undegraded":"2024-04-15T00:01:49.989769+0000","last_fullsized":"2024-04-15T00:01:49.989769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.090276+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T00:01:48.090276+0000","last_peered":"2024-04-15T00:01:48.090276+0000","last_clean":"2024-04-15T00:01:48.090276+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T00:01:48.090276+0000","last_undegraded":"2024-04-15T00:01:48.090276+0000","last_fullsized":"2024-04-15T00:01:48.090276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097150+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T00:01:48.097150+0000","last_peered":"2024-04-15T00:01:48.097150+0000","last_clean":"2024-04-15T00:01:48.097150+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T00:01:48.097150+0000","last_undegraded":"2024-04-15T00:01:48.097150+0000","last_fullsized":"2024-04-15T00:01:48.097150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324440+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T00:01:50.324440+0000","last_peered":"2024-04-15T00:01:50.324440+0000","last_clean":"2024-04-15T00:01:50.324440+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T00:01:50.324440+0000","last_undegraded":"2024-04-15T00:01:50.324440+0000","last_fullsized":"2024-04-15T00:01:50.324440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098034+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T00:01:48.098034+0000","last_peered":"2024-04-15T00:01:48.098034+0000","last_clean":"2024-04-15T00:01:48.098034+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T00:01:48.098034+0000","last_undegraded":"2024-04-15T00:01:48.098034+0000","last_fullsized":"2024-04-15T00:01:48.098034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":28,"state":"peering","last_fresh":"2024-04-15T00:01:20.752371+0000","last_change":"2024-04-15T00:01:48.715347+0000","last_active":"2024-04-15T00:01:48.715347+0000","last_peered":"2024-04-15T00:01:20.752371+0000","last_clean":"2024-04-15T00:01:20.752371+0000","last_became_active":"2024-04-15T00:01:12.992466+0000","last_became_peered":"2024-04-15T00:01:12.992466+0000","last_unstale":"2024-04-15T00:01:20.752371+0000","last_undegraded":"2024-04-15T00:01:20.752371+0000","last_fullsized":"2024-04-15T00:01:20.752371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992929+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T00:01:49.992929+0000","last_peered":"2024-04-15T00:01:49.992929+0000","last_clean":"2024-04-15T00:01:49.992929+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T00:01:49.992929+0000","last_undegraded":"2024-04-15T00:01:49.992929+0000","last_fullsized":"2024-04-15T00:01:49.992929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324447+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T00:01:50.324447+0000","last_peered":"2024-04-15T00:01:50.324447+0000","last_clean":"2024-04-15T00:01:50.324447+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T00:01:50.324447+0000","last_undegraded":"2024-04-15T00:01:50.324447+0000","last_fullsized":"2024-04-15T00:01:50.324447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995674+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T00:01:49.995674+0000","last_peered":"2024-04-15T00:01:49.995674+0000","last_clean":"2024-04-15T00:01:49.995674+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T00:01:49.995674+0000","last_undegraded":"2024-04-15T00:01:49.995674+0000","last_fullsized":"2024-04-15T00:01:49.995674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324614+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T00:01:50.324614+0000","last_peered":"2024-04-15T00:01:50.324614+0000","last_clean":"2024-04-15T00:01:50.324614+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T00:01:50.324614+0000","last_undegraded":"2024-04-15T00:01:50.324614+0000","last_fullsized":"2024-04-15T00:01:50.324614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990924+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T00:01:49.990924+0000","last_peered":"2024-04-15T00:01:49.990924+0000","last_clean":"2024-04-15T00:01:49.990924+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T00:01:49.990924+0000","last_undegraded":"2024-04-15T00:01:49.990924+0000","last_fullsized":"2024-04-15T00:01:49.990924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995245+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T00:01:49.995245+0000","last_peered":"2024-04-15T00:01:49.995245+0000","last_clean":"2024-04-15T00:01:49.995245+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T00:01:49.995245+0000","last_undegraded":"2024-04-15T00:01:49.995245+0000","last_fullsized":"2024-04-15T00:01:49.995245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993084+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T00:01:49.993084+0000","last_peered":"2024-04-15T00:01:49.993084+0000","last_clean":"2024-04-15T00:01:49.993084+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T00:01:49.993084+0000","last_undegraded":"2024-04-15T00:01:49.993084+0000","last_fullsized":"2024-04-15T00:01:49.993084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089731+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T00:01:48.089731+0000","last_peered":"2024-04-15T00:01:48.089731+0000","last_clean":"2024-04-15T00:01:48.089731+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T00:01:48.089731+0000","last_undegraded":"2024-04-15T00:01:48.089731+0000","last_fullsized":"2024-04-15T00:01:48.089731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097980+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T00:01:48.097980+0000","last_peered":"2024-04-15T00:01:48.097980+0000","last_clean":"2024-04-15T00:01:48.097980+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T00:01:48.097980+0000","last_undegraded":"2024-04-15T00:01:48.097980+0000","last_fullsized":"2024-04-15T00:01:48.097980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325024+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T00:01:50.325024+0000","last_peered":"2024-04-15T00:01:50.325024+0000","last_clean":"2024-04-15T00:01:50.325024+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T00:01:50.325024+0000","last_undegraded":"2024-04-15T00:01:50.325024+0000","last_fullsized":"2024-04-15T00:01:50.325024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990332+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T00:01:49.990332+0000","last_peered":"2024-04-15T00:01:49.990332+0000","last_clean":"2024-04-15T00:01:49.990332+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T00:01:49.990332+0000","last_undegraded":"2024-04-15T00:01:49.990332+0000","last_fullsized":"2024-04-15T00:01:49.990332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992269+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T00:01:49.992269+0000","last_peered":"2024-04-15T00:01:49.992269+0000","last_clean":"2024-04-15T00:01:49.992269+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T00:01:49.992269+0000","last_undegraded":"2024-04-15T00:01:49.992269+0000","last_fullsized":"2024-04-15T00:01:49.992269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324899+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T00:01:50.324899+0000","last_peered":"2024-04-15T00:01:50.324899+0000","last_clean":"2024-04-15T00:01:50.324899+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T00:01:50.324899+0000","last_undegraded":"2024-04-15T00:01:50.324899+0000","last_fullsized":"2024-04-15T00:01:50.324899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270686+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T00:01:50.270686+0000","last_peered":"2024-04-15T00:01:50.270686+0000","last_clean":"2024-04-15T00:01:50.270686+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T00:01:50.270686+0000","last_undegraded":"2024-04-15T00:01:50.270686+0000","last_fullsized":"2024-04-15T00:01:50.270686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270113+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T00:01:50.270113+0000","last_peered":"2024-04-15T00:01:50.270113+0000","last_clean":"2024-04-15T00:01:50.270113+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T00:01:50.270113+0000","last_undegraded":"2024-04-15T00:01:50.270113+0000","last_fullsized":"2024-04-15T00:01:50.270113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324372+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T00:01:50.324372+0000","last_peered":"2024-04-15T00:01:50.324372+0000","last_clean":"2024-04-15T00:01:50.324372+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T00:01:50.324372+0000","last_undegraded":"2024-04-15T00:01:50.324372+0000","last_fullsized":"2024-04-15T00:01:50.324372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.989582+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T00:01:49.989582+0000","last_peered":"2024-04-15T00:01:49.989582+0000","last_clean":"2024-04-15T00:01:49.989582+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T00:01:49.989582+0000","last_undegraded":"2024-04-15T00:01:49.989582+0000","last_fullsized":"2024-04-15T00:01:49.989582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097924+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T00:01:48.097924+0000","last_peered":"2024-04-15T00:01:48.097924+0000","last_clean":"2024-04-15T00:01:48.097924+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T00:01:48.097924+0000","last_undegraded":"2024-04-15T00:01:48.097924+0000","last_fullsized":"2024-04-15T00:01:48.097924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.994857+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T00:01:49.994857+0000","last_peered":"2024-04-15T00:01:49.994857+0000","last_clean":"2024-04-15T00:01:49.994857+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T00:01:49.994857+0000","last_undegraded":"2024-04-15T00:01:49.994857+0000","last_fullsized":"2024-04-15T00:01:49.994857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995199+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T00:01:49.995199+0000","last_peered":"2024-04-15T00:01:49.995199+0000","last_clean":"2024-04-15T00:01:49.995199+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T00:01:49.995199+0000","last_undegraded":"2024-04-15T00:01:49.995199+0000","last_fullsized":"2024-04-15T00:01:49.995199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"peering","last_fresh":"2024-04-15T00:01:21.288091+0000","last_change":"2024-04-15T00:01:48.092256+0000","last_active":"2024-04-15T00:01:48.092256+0000","last_peered":"2024-04-15T00:01:21.288091+0000","last_clean":"2024-04-15T00:01:21.288091+0000","last_became_active":"2024-04-15T00:01:18.979809+0000","last_became_peered":"2024-04-15T00:01:18.979809+0000","last_unstale":"2024-04-15T00:01:21.288091+0000","last_undegraded":"2024-04-15T00:01:21.288091+0000","last_fullsized":"2024-04-15T00:01:21.288091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,6,7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324509+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T00:01:50.324509+0000","last_peered":"2024-04-15T00:01:50.324509+0000","last_clean":"2024-04-15T00:01:50.324509+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T00:01:50.324509+0000","last_undegraded":"2024-04-15T00:01:50.324509+0000","last_fullsized":"2024-04-15T00:01:50.324509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992805+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T00:01:49.992805+0000","last_peered":"2024-04-15T00:01:49.992805+0000","last_clean":"2024-04-15T00:01:49.992805+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T00:01:49.992805+0000","last_undegraded":"2024-04-15T00:01:49.992805+0000","last_fullsized":"2024-04-15T00:01:49.992805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.093080+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T00:01:48.093080+0000","last_peered":"2024-04-15T00:01:48.093080+0000","last_clean":"2024-04-15T00:01:48.093080+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T00:01:48.093080+0000","last_undegraded":"2024-04-15T00:01:48.093080+0000","last_fullsized":"2024-04-15T00:01:48.093080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097528+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T00:01:48.097528+0000","last_peered":"2024-04-15T00:01:48.097528+0000","last_clean":"2024-04-15T00:01:48.097528+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T00:01:48.097528+0000","last_undegraded":"2024-04-15T00:01:48.097528+0000","last_fullsized":"2024-04-15T00:01:48.097528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098327+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T00:01:48.098327+0000","last_peered":"2024-04-15T00:01:48.098327+0000","last_clean":"2024-04-15T00:01:48.098327+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T00:01:48.098327+0000","last_undegraded":"2024-04-15T00:01:48.098327+0000","last_fullsized":"2024-04-15T00:01:48.098327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993248+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T00:01:49.993248+0000","last_peered":"2024-04-15T00:01:49.993248+0000","last_clean":"2024-04-15T00:01:49.993248+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T00:01:49.993248+0000","last_undegraded":"2024-04-15T00:01:49.993248+0000","last_fullsized":"2024-04-15T00:01:49.993248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324579+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T00:01:50.324579+0000","last_peered":"2024-04-15T00:01:50.324579+0000","last_clean":"2024-04-15T00:01:50.324579+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T00:01:50.324579+0000","last_undegraded":"2024-04-15T00:01:50.324579+0000","last_fullsized":"2024-04-15T00:01:50.324579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'14","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995704+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T00:01:49.995704+0000","last_peered":"2024-04-15T00:01:49.995704+0000","last_clean":"2024-04-15T00:01:49.995704+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T00:01:49.995704+0000","last_undegraded":"2024-04-15T00:01:49.995704+0000","last_fullsized":"2024-04-15T00:01:49.995704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.088990+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T00:01:48.088990+0000","last_peered":"2024-04-15T00:01:48.088990+0000","last_clean":"2024-04-15T00:01:48.088990+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T00:01:48.088990+0000","last_undegraded":"2024-04-15T00:01:48.088990+0000","last_fullsized":"2024-04-15T00:01:48.088990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270621+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T00:01:50.270621+0000","last_peered":"2024-04-15T00:01:50.270621+0000","last_clean":"2024-04-15T00:01:50.270621+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T00:01:50.270621+0000","last_undegraded":"2024-04-15T00:01:50.270621+0000","last_fullsized":"2024-04-15T00:01:50.270621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089632+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T00:01:48.089632+0000","last_peered":"2024-04-15T00:01:48.089632+0000","last_clean":"2024-04-15T00:01:48.089632+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T00:01:48.089632+0000","last_undegraded":"2024-04-15T00:01:48.089632+0000","last_fullsized":"2024-04-15T00:01:48.089632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270546+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T00:01:50.270546+0000","last_peered":"2024-04-15T00:01:50.270546+0000","last_clean":"2024-04-15T00:01:50.270546+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T00:01:50.270546+0000","last_undegraded":"2024-04-15T00:01:50.270546+0000","last_fullsized":"2024-04-15T00:01:50.270546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098347+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T00:01:48.098347+0000","last_peered":"2024-04-15T00:01:48.098347+0000","last_clean":"2024-04-15T00:01:48.098347+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T00:01:48.098347+0000","last_undegraded":"2024-04-15T00:01:48.098347+0000","last_fullsized":"2024-04-15T00:01:48.098347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993267+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T00:01:49.993267+0000","last_peered":"2024-04-15T00:01:49.993267+0000","last_clean":"2024-04-15T00:01:49.993267+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T00:01:49.993267+0000","last_undegraded":"2024-04-15T00:01:49.993267+0000","last_fullsized":"2024-04-15T00:01:49.993267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092790+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T00:01:48.092790+0000","last_peered":"2024-04-15T00:01:48.092790+0000","last_clean":"2024-04-15T00:01:48.092790+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T00:01:48.092790+0000","last_undegraded":"2024-04-15T00:01:48.092790+0000","last_fullsized":"2024-04-15T00:01:48.092790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993162+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T00:01:49.993162+0000","last_peered":"2024-04-15T00:01:49.993162+0000","last_clean":"2024-04-15T00:01:49.993162+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T00:01:49.993162+0000","last_undegraded":"2024-04-15T00:01:49.993162+0000","last_fullsized":"2024-04-15T00:01:49.993162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996121+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T00:01:49.996121+0000","last_peered":"2024-04-15T00:01:49.996121+0000","last_clean":"2024-04-15T00:01:49.996121+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T00:01:49.996121+0000","last_undegraded":"2024-04-15T00:01:49.996121+0000","last_fullsized":"2024-04-15T00:01:49.996121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092014+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T00:01:48.092014+0000","last_peered":"2024-04-15T00:01:48.092014+0000","last_clean":"2024-04-15T00:01:48.092014+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T00:01:48.092014+0000","last_undegraded":"2024-04-15T00:01:48.092014+0000","last_fullsized":"2024-04-15T00:01:48.092014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097806+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T00:01:48.097806+0000","last_peered":"2024-04-15T00:01:48.097806+0000","last_clean":"2024-04-15T00:01:48.097806+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T00:01:48.097806+0000","last_undegraded":"2024-04-15T00:01:48.097806+0000","last_fullsized":"2024-04-15T00:01:48.097806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.088530+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T00:01:48.088530+0000","last_peered":"2024-04-15T00:01:48.088530+0000","last_clean":"2024-04-15T00:01:48.088530+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T00:01:48.088530+0000","last_undegraded":"2024-04-15T00:01:48.088530+0000","last_fullsized":"2024-04-15T00:01:48.088530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992539+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T00:01:49.992539+0000","last_peered":"2024-04-15T00:01:49.992539+0000","last_clean":"2024-04-15T00:01:49.992539+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T00:01:49.992539+0000","last_undegraded":"2024-04-15T00:01:49.992539+0000","last_fullsized":"2024-04-15T00:01:49.992539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995980+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T00:01:49.995980+0000","last_peered":"2024-04-15T00:01:49.995980+0000","last_clean":"2024-04-15T00:01:49.995980+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:49.995980+0000","last_undegraded":"2024-04-15T00:01:49.995980+0000","last_fullsized":"2024-04-15T00:01:49.995980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092821+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T00:01:48.092821+0000","last_peered":"2024-04-15T00:01:48.092821+0000","last_clean":"2024-04-15T00:01:48.092821+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T00:01:48.092821+0000","last_undegraded":"2024-04-15T00:01:48.092821+0000","last_fullsized":"2024-04-15T00:01:48.092821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092558+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T00:01:48.092558+0000","last_peered":"2024-04-15T00:01:48.092558+0000","last_clean":"2024-04-15T00:01:48.092558+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T00:01:48.092558+0000","last_undegraded":"2024-04-15T00:01:48.092558+0000","last_fullsized":"2024-04-15T00:01:48.092558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995514+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T00:01:49.995514+0000","last_peered":"2024-04-15T00:01:49.995514+0000","last_clean":"2024-04-15T00:01:49.995514+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T00:01:49.995514+0000","last_undegraded":"2024-04-15T00:01:49.995514+0000","last_fullsized":"2024-04-15T00:01:49.995514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098219+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T00:01:48.098219+0000","last_peered":"2024-04-15T00:01:48.098219+0000","last_clean":"2024-04-15T00:01:48.098219+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T00:01:48.098219+0000","last_undegraded":"2024-04-15T00:01:48.098219+0000","last_fullsized":"2024-04-15T00:01:48.098219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990627+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T00:01:49.990627+0000","last_peered":"2024-04-15T00:01:49.990627+0000","last_clean":"2024-04-15T00:01:49.990627+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T00:01:49.990627+0000","last_undegraded":"2024-04-15T00:01:49.990627+0000","last_fullsized":"2024-04-15T00:01:49.990627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092160+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T00:01:48.092160+0000","last_peered":"2024-04-15T00:01:48.092160+0000","last_clean":"2024-04-15T00:01:48.092160+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T00:01:48.092160+0000","last_undegraded":"2024-04-15T00:01:48.092160+0000","last_fullsized":"2024-04-15T00:01:48.092160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270369+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T00:01:50.270369+0000","last_peered":"2024-04-15T00:01:50.270369+0000","last_clean":"2024-04-15T00:01:50.270369+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T00:01:50.270369+0000","last_undegraded":"2024-04-15T00:01:50.270369+0000","last_fullsized":"2024-04-15T00:01:50.270369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.093134+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T00:01:48.093134+0000","last_peered":"2024-04-15T00:01:48.093134+0000","last_clean":"2024-04-15T00:01:48.093134+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T00:01:48.093134+0000","last_undegraded":"2024-04-15T00:01:48.093134+0000","last_fullsized":"2024-04-15T00:01:48.093134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.994877+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T00:01:49.994877+0000","last_peered":"2024-04-15T00:01:49.994877+0000","last_clean":"2024-04-15T00:01:49.994877+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T00:01:49.994877+0000","last_undegraded":"2024-04-15T00:01:49.994877+0000","last_fullsized":"2024-04-15T00:01:49.994877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.989663+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T00:01:49.989663+0000","last_peered":"2024-04-15T00:01:49.989663+0000","last_clean":"2024-04-15T00:01:49.989663+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T00:01:49.989663+0000","last_undegraded":"2024-04-15T00:01:49.989663+0000","last_fullsized":"2024-04-15T00:01:49.989663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992769+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T00:01:49.992769+0000","last_peered":"2024-04-15T00:01:49.992769+0000","last_clean":"2024-04-15T00:01:49.992769+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T00:01:49.992769+0000","last_undegraded":"2024-04-15T00:01:49.992769+0000","last_fullsized":"2024-04-15T00:01:49.992769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098080+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T00:01:48.098080+0000","last_peered":"2024-04-15T00:01:48.098080+0000","last_clean":"2024-04-15T00:01:48.098080+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T00:01:48.098080+0000","last_undegraded":"2024-04-15T00:01:48.098080+0000","last_fullsized":"2024-04-15T00:01:48.098080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.094243+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T00:01:48.094243+0000","last_peered":"2024-04-15T00:01:48.094243+0000","last_clean":"2024-04-15T00:01:48.094243+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T00:01:48.094243+0000","last_undegraded":"2024-04-15T00:01:48.094243+0000","last_fullsized":"2024-04-15T00:01:48.094243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089479+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T00:01:48.089479+0000","last_peered":"2024-04-15T00:01:48.089479+0000","last_clean":"2024-04-15T00:01:48.089479+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T00:01:48.089479+0000","last_undegraded":"2024-04-15T00:01:48.089479+0000","last_fullsized":"2024-04-15T00:01:48.089479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996089+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T00:01:49.996089+0000","last_peered":"2024-04-15T00:01:49.996089+0000","last_clean":"2024-04-15T00:01:49.996089+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T00:01:49.996089+0000","last_undegraded":"2024-04-15T00:01:49.996089+0000","last_fullsized":"2024-04-15T00:01:49.996089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.093847+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T00:01:48.093847+0000","last_peered":"2024-04-15T00:01:48.093847+0000","last_clean":"2024-04-15T00:01:48.093847+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T00:01:48.093847+0000","last_undegraded":"2024-04-15T00:01:48.093847+0000","last_fullsized":"2024-04-15T00:01:48.093847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992512+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T00:01:49.992512+0000","last_peered":"2024-04-15T00:01:49.992512+0000","last_clean":"2024-04-15T00:01:49.992512+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T00:01:49.992512+0000","last_undegraded":"2024-04-15T00:01:49.992512+0000","last_fullsized":"2024-04-15T00:01:49.992512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092664+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T00:01:48.092664+0000","last_peered":"2024-04-15T00:01:48.092664+0000","last_clean":"2024-04-15T00:01:48.092664+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T00:01:48.092664+0000","last_undegraded":"2024-04-15T00:01:48.092664+0000","last_fullsized":"2024-04-15T00:01:48.092664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325599+0000","last_change":"2024-04-15T00:01:50.325599+0000","last_active":"2024-04-15T00:01:50.325599+0000","last_peered":"2024-04-15T00:01:50.325599+0000","last_clean":"2024-04-15T00:01:50.325599+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T00:01:50.325599+0000","last_undegraded":"2024-04-15T00:01:50.325599+0000","last_fullsized":"2024-04-15T00:01:50.325599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097886+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T00:01:48.097886+0000","last_peered":"2024-04-15T00:01:48.097886+0000","last_clean":"2024-04-15T00:01:48.097886+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T00:01:48.097886+0000","last_undegraded":"2024-04-15T00:01:48.097886+0000","last_fullsized":"2024-04-15T00:01:48.097886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995667+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T00:01:49.995667+0000","last_peered":"2024-04-15T00:01:49.995667+0000","last_clean":"2024-04-15T00:01:49.995667+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T00:01:49.995667+0000","last_undegraded":"2024-04-15T00:01:49.995667+0000","last_fullsized":"2024-04-15T00:01:49.995667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324746+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T00:01:50.324746+0000","last_peered":"2024-04-15T00:01:50.324746+0000","last_clean":"2024-04-15T00:01:50.324746+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T00:01:50.324746+0000","last_undegraded":"2024-04-15T00:01:50.324746+0000","last_fullsized":"2024-04-15T00:01:50.324746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990298+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T00:01:49.990298+0000","last_peered":"2024-04-15T00:01:49.990298+0000","last_clean":"2024-04-15T00:01:49.990298+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T00:01:49.990298+0000","last_undegraded":"2024-04-15T00:01:49.990298+0000","last_fullsized":"2024-04-15T00:01:49.990298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993104+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T00:01:49.993104+0000","last_peered":"2024-04-15T00:01:49.993104+0000","last_clean":"2024-04-15T00:01:49.993104+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T00:01:49.993104+0000","last_undegraded":"2024-04-15T00:01:49.993104+0000","last_fullsized":"2024-04-15T00:01:49.993104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992448+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T00:01:49.992448+0000","last_peered":"2024-04-15T00:01:49.992448+0000","last_clean":"2024-04-15T00:01:49.992448+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T00:01:49.992448+0000","last_undegraded":"2024-04-15T00:01:49.992448+0000","last_fullsized":"2024-04-15T00:01:49.992448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.088581+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T00:01:48.088581+0000","last_peered":"2024-04-15T00:01:48.088581+0000","last_clean":"2024-04-15T00:01:48.088581+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T00:01:48.088581+0000","last_undegraded":"2024-04-15T00:01:48.088581+0000","last_fullsized":"2024-04-15T00:01:48.088581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097428+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T00:01:48.097428+0000","last_peered":"2024-04-15T00:01:48.097428+0000","last_clean":"2024-04-15T00:01:48.097428+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T00:01:48.097428+0000","last_undegraded":"2024-04-15T00:01:48.097428+0000","last_fullsized":"2024-04-15T00:01:48.097428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092249+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T00:01:48.092249+0000","last_peered":"2024-04-15T00:01:48.092249+0000","last_clean":"2024-04-15T00:01:48.092249+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T00:01:48.092249+0000","last_undegraded":"2024-04-15T00:01:48.092249+0000","last_fullsized":"2024-04-15T00:01:48.092249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270553+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T00:01:50.270553+0000","last_peered":"2024-04-15T00:01:50.270553+0000","last_clean":"2024-04-15T00:01:50.270553+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T00:01:50.270553+0000","last_undegraded":"2024-04-15T00:01:50.270553+0000","last_fullsized":"2024-04-15T00:01:50.270553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995774+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T00:01:49.995774+0000","last_peered":"2024-04-15T00:01:49.995774+0000","last_clean":"2024-04-15T00:01:49.995774+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T00:01:49.995774+0000","last_undegraded":"2024-04-15T00:01:49.995774+0000","last_fullsized":"2024-04-15T00:01:49.995774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.997896+0000","last_change":"2024-04-15T00:01:49.997896+0000","last_active":"2024-04-15T00:01:49.997896+0000","last_peered":"2024-04-15T00:01:49.997896+0000","last_clean":"2024-04-15T00:01:49.997896+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T00:01:49.997896+0000","last_undegraded":"2024-04-15T00:01:49.997896+0000","last_fullsized":"2024-04-15T00:01:49.997896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:52:44.356891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325022+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T00:01:50.325022+0000","last_peered":"2024-04-15T00:01:50.325022+0000","last_clean":"2024-04-15T00:01:50.325022+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T00:01:50.325022+0000","last_undegraded":"2024-04-15T00:01:50.325022+0000","last_fullsized":"2024-04-15T00:01:50.325022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.092726+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T00:01:48.092726+0000","last_peered":"2024-04-15T00:01:48.092726+0000","last_clean":"2024-04-15T00:01:48.092726+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T00:01:48.092726+0000","last_undegraded":"2024-04-15T00:01:48.092726+0000","last_fullsized":"2024-04-15T00:01:48.092726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324269+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T00:01:50.324269+0000","last_peered":"2024-04-15T00:01:50.324269+0000","last_clean":"2024-04-15T00:01:50.324269+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T00:01:50.324269+0000","last_undegraded":"2024-04-15T00:01:50.324269+0000","last_fullsized":"2024-04-15T00:01:50.324269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992668+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T00:01:49.992668+0000","last_peered":"2024-04-15T00:01:49.992668+0000","last_clean":"2024-04-15T00:01:49.992668+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T00:01:49.992668+0000","last_undegraded":"2024-04-15T00:01:49.992668+0000","last_fullsized":"2024-04-15T00:01:49.992668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324309+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T00:01:50.324309+0000","last_peered":"2024-04-15T00:01:50.324309+0000","last_clean":"2024-04-15T00:01:50.324309+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T00:01:50.324309+0000","last_undegraded":"2024-04-15T00:01:50.324309+0000","last_fullsized":"2024-04-15T00:01:50.324309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.003849+0000","last_change":"2024-04-15T00:01:50.003849+0000","last_active":"2024-04-15T00:01:50.003849+0000","last_peered":"2024-04-15T00:01:50.003849+0000","last_clean":"2024-04-15T00:01:50.003849+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T00:01:50.003849+0000","last_undegraded":"2024-04-15T00:01:50.003849+0000","last_fullsized":"2024-04-15T00:01:50.003849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097847+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T00:01:48.097847+0000","last_peered":"2024-04-15T00:01:48.097847+0000","last_clean":"2024-04-15T00:01:48.097847+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T00:01:48.097847+0000","last_undegraded":"2024-04-15T00:01:48.097847+0000","last_fullsized":"2024-04-15T00:01:48.097847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.089966+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T00:01:48.089966+0000","last_peered":"2024-04-15T00:01:48.089966+0000","last_clean":"2024-04-15T00:01:48.089966+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T00:01:48.089966+0000","last_undegraded":"2024-04-15T00:01:48.089966+0000","last_fullsized":"2024-04-15T00:01:48.089966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324952+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T00:01:50.324952+0000","last_peered":"2024-04-15T00:01:50.324952+0000","last_clean":"2024-04-15T00:01:50.324952+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T00:01:50.324952+0000","last_undegraded":"2024-04-15T00:01:50.324952+0000","last_fullsized":"2024-04-15T00:01:50.324952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10174,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":19738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":712963,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":125127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":123839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":121825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":118001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":339968,"data_stored":128932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":114301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":711557,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:01:52.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T00:01:52.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.814+0000 7ff6c3836640 1 Processor -- start 2024-04-15T00:01:52.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.814+0000 7ff6c3836640 1 -- start start 2024-04-15T00:01:52.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c3836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c50d0 0x7ff6bc158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c3836640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6bc0c54b0 0x7ff6bc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c3836640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6bc15b9e0 con 0x7ff6bc15b570 2024-04-15T00:01:52.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c3836640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc158120 con 0x7ff6bc0c54b0 2024-04-15T00:01:52.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c3836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc0c67e0 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c15d2640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c50d0 0x7ff6bc158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c1dd3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff6bc15b570 0x7ff6bc140fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50590/0 (socket says 172.21.15.29:50590) 2024-04-15T00:01:52.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.815+0000 7ff6c1dd3640 1 -- 172.21.15.29:0/748284452 learned_addr learned my addr 172.21.15.29:0/748284452 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:52.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.818+0000 7ff6affff640 1 -- 172.21.15.29:0/748284452 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523894298 0 0) 0x7ff6bc15b9e0 con 0x7ff6bc15b570 2024-04-15T00:01:52.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.818+0000 7ff6affff640 1 -- 172.21.15.29:0/748284452 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a8003520 con 0x7ff6bc15b570 2024-04-15T00:01:52.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.818+0000 7ff6c15d2640 1 -- 172.21.15.29:0/748284452 >> v2:172.21.15.37:3300/0 conn(0x7ff6bc0c54b0 msgr2=0x7ff6bc0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:52.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.818+0000 7ff6c15d2640 1 --2- 172.21.15.29:0/748284452 >> v2:172.21.15.37:3300/0 conn(0x7ff6bc0c54b0 0x7ff6bc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.818+0000 7ff6c15d2640 1 -- 172.21.15.29:0/748284452 >> v1:172.21.15.29:6789/0 conn(0x7ff6bc15b570 legacy=0x7ff6bc140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.818+0000 7ff6c15d2640 1 -- 172.21.15.29:0/748284452 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc0c6aa0 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.820+0000 7ff6c15d2640 1 --2- 172.21.15.29:0/748284452 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c50d0 0x7ff6bc158bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00097a0 tx=0x7ff6b002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f642a313490345 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.822+0000 7ff6affff640 1 -- 172.21.15.29:0/748284452 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0034070 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.824+0000 7ff6affff640 1 -- 172.21.15.29:0/748284452 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b0030610 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.824+0000 7ff6affff640 1 -- 172.21.15.29:0/748284452 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00309c0 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 -- 172.21.15.29:0/748284452 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c50d0 msgr2=0x7ff6bc158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 --2- 172.21.15.29:0/748284452 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c50d0 0x7ff6bc158bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00097a0 tx=0x7ff6b002b960 comp rx=0 tx=0).stop 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 -- 172.21.15.29:0/748284452 shutdown_connections 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 --2- 172.21.15.29:0/748284452 >> v2:172.21.15.37:3300/0 conn(0x7ff6bc0c54b0 0x7ff6bc0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 --2- 172.21.15.29:0/748284452 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c50d0 0x7ff6bc158bc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 -- 172.21.15.29:0/748284452 >> 172.21.15.29:0/748284452 conn(0x7ff6bc06fca0 msgr2=0x7ff6bc06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 -- 172.21.15.29:0/748284452 shutdown_connections 2024-04-15T00:01:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.825+0000 7ff6c3836640 1 -- 172.21.15.29:0/748284452 wait complete. 2024-04-15T00:01:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.826+0000 7ff6c3836640 1 Processor -- start 2024-04-15T00:01:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.826+0000 7ff6c3836640 1 -- start start 2024-04-15T00:01:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.826+0000 7ff6c3836640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 0x7ff6bc1f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.826+0000 7ff6c3836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c54b0 0x7ff6bc1edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c3836640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc15b570 0x7ff6bc134f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c3836640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc0c6d80 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c3836640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc1586a0 con 0x7ff6bc15b570 2024-04-15T00:01:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c3836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc1416c0 con 0x7ff6bc0c54b0 2024-04-15T00:01:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c15d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 0x7ff6bc1f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c0dd1640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c54b0 0x7ff6bc1edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c15d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 0x7ff6bc1f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37182/0 (socket says 172.21.15.29:37182) 2024-04-15T00:01:52.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.827+0000 7ff6c15d2640 1 -- 172.21.15.29:0/1340297573 learned_addr learned my addr 172.21.15.29:0/1340297573 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.831+0000 7ff6c15d2640 1 -- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c54b0 msgr2=0x7ff6bc1edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.831+0000 7ff6c15d2640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c54b0 0x7ff6bc1edfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.831+0000 7ff6c15d2640 1 -- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc15b570 msgr2=0x7ff6bc134f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.831+0000 7ff6c15d2640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc15b570 0x7ff6bc134f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:52.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.831+0000 7ff6c15d2640 1 -- 172.21.15.29:0/1340297573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc155840 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.833+0000 7ff6c15d2640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 0x7ff6bc1f20a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff6b002b9a0 tx=0x7ff6b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:52.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.851+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0047070 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.851+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b0030410 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.851+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc135440 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.851+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0034050 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.851+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc13f320 con 0x7ff6bc0c50d0 2024-04-15T00:01:52.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:52.852+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6bc155f60 con 0x7ff6bc0c50d0 2024-04-15T00:01:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.129+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff6b004a070 con 0x7ff6bc0c50d0 2024-04-15T00:01:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.129+0000 7ff6adffb640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff6a006b9e0 0x7ff6a006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:53.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.129+0000 7ff6c0dd1640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff6a006b9e0 0x7ff6a006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:53.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.130+0000 7ff6c0dd1640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff6a006b9e0 0x7ff6a006dea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc140290 tx=0x7ff6b8009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.144+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff6b0078b70 con 0x7ff6bc0c50d0 2024-04-15T00:01:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.145+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff6bc155f60 con 0x7ff6bc0c50d0 2024-04-15T00:01:53.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.322+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6bc04f540 con 0x7ff6a006b9e0 2024-04-15T00:01:53.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.330+0000 7ff6adffb640 1 -- 172.21.15.29:0/1340297573 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332780 (secure 0 0 0) 0x7ff6bc04f540 con 0x7ff6a006b9e0 2024-04-15T00:01:53.346 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:53.349 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T00:01:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff6a006b9e0 msgr2=0x7ff6a006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff6a006b9e0 0x7ff6a006dea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc140290 tx=0x7ff6b8009110 comp rx=0 tx=0).stop 2024-04-15T00:01:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 msgr2=0x7ff6bc1f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 0x7ff6bc1f20a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff6b002b9a0 tx=0x7ff6b00046c0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 shutdown_connections 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff6a006b9e0 0x7ff6a006dea0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6bc15b570 0x7ff6bc134f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff6bc0c54b0 0x7ff6bc1edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 --2- 172.21.15.29:0/1340297573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c50d0 0x7ff6bc1f20a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 >> 172.21.15.29:0/1340297573 conn(0x7ff6bc06fca0 msgr2=0x7ff6bc1398c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 shutdown_connections 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.334+0000 7ff6c3836640 1 -- 172.21.15.29:0/1340297573 wait complete. 2024-04-15T00:01:53.352 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-15T00:01:53.102551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600542,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":363,"num_write_kb":2482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":295,"ondisk_log_size":295,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235524,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739196,"statfs":{"total":773094113280,"available":772852936704,"internally_reserved":0,"allocated":2777088,"data_stored":2185381,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5534,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002193"},"pg_stats":[{"pgid":"2.1f","version":"27'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098460+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T00:01:48.098460+0000","last_peered":"2024-04-15T00:01:48.098460+0000","last_clean":"2024-04-15T00:01:48.098460+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T00:01:48.098460+0000","last_undegraded":"2024-04-15T00:01:48.098460+0000","last_fullsized":"2024-04-15T00:01:48.098460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.000288+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T00:01:50.000288+0000","last_peered":"2024-04-15T00:01:50.000288+0000","last_clean":"2024-04-15T00:01:50.000288+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T00:01:50.000288+0000","last_undegraded":"2024-04-15T00:01:50.000288+0000","last_fullsized":"2024-04-15T00:01:50.000288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999523+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T00:01:49.999523+0000","last_peered":"2024-04-15T00:01:49.999523+0000","last_clean":"2024-04-15T00:01:49.999523+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T00:01:49.999523+0000","last_undegraded":"2024-04-15T00:01:49.999523+0000","last_fullsized":"2024-04-15T00:01:49.999523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.000441+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T00:01:50.000441+0000","last_peered":"2024-04-15T00:01:50.000441+0000","last_clean":"2024-04-15T00:01:50.000441+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T00:01:50.000441+0000","last_undegraded":"2024-04-15T00:01:50.000441+0000","last_fullsized":"2024-04-15T00:01:50.000441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098197+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T00:01:48.098197+0000","last_peered":"2024-04-15T00:01:48.098197+0000","last_clean":"2024-04-15T00:01:48.098197+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T00:01:48.098197+0000","last_undegraded":"2024-04-15T00:01:48.098197+0000","last_fullsized":"2024-04-15T00:01:48.098197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270113+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T00:01:50.270113+0000","last_peered":"2024-04-15T00:01:50.270113+0000","last_clean":"2024-04-15T00:01:50.270113+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:50.270113+0000","last_undegraded":"2024-04-15T00:01:50.270113+0000","last_fullsized":"2024-04-15T00:01:50.270113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324715+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T00:01:50.324715+0000","last_peered":"2024-04-15T00:01:50.324715+0000","last_clean":"2024-04-15T00:01:50.324715+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T00:01:50.324715+0000","last_undegraded":"2024-04-15T00:01:50.324715+0000","last_fullsized":"2024-04-15T00:01:50.324715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993022+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T00:01:49.993022+0000","last_peered":"2024-04-15T00:01:49.993022+0000","last_clean":"2024-04-15T00:01:49.993022+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T00:01:49.993022+0000","last_undegraded":"2024-04-15T00:01:49.993022+0000","last_fullsized":"2024-04-15T00:01:49.993022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270378+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T00:01:50.270378+0000","last_peered":"2024-04-15T00:01:50.270378+0000","last_clean":"2024-04-15T00:01:50.270378+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T00:01:50.270378+0000","last_undegraded":"2024-04-15T00:01:50.270378+0000","last_fullsized":"2024-04-15T00:01:50.270378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324595+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T00:01:50.324595+0000","last_peered":"2024-04-15T00:01:50.324595+0000","last_clean":"2024-04-15T00:01:50.324595+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T00:01:50.324595+0000","last_undegraded":"2024-04-15T00:01:50.324595+0000","last_fullsized":"2024-04-15T00:01:50.324595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993348+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T00:01:49.993348+0000","last_peered":"2024-04-15T00:01:49.993348+0000","last_clean":"2024-04-15T00:01:49.993348+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T00:01:49.993348+0000","last_undegraded":"2024-04-15T00:01:49.993348+0000","last_fullsized":"2024-04-15T00:01:49.993348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270221+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T00:01:50.270221+0000","last_peered":"2024-04-15T00:01:50.270221+0000","last_clean":"2024-04-15T00:01:50.270221+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T00:01:50.270221+0000","last_undegraded":"2024-04-15T00:01:50.270221+0000","last_fullsized":"2024-04-15T00:01:50.270221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995350+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T00:01:49.995350+0000","last_peered":"2024-04-15T00:01:49.995350+0000","last_clean":"2024-04-15T00:01:49.995350+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T00:01:49.995350+0000","last_undegraded":"2024-04-15T00:01:49.995350+0000","last_fullsized":"2024-04-15T00:01:49.995350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324721+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T00:01:50.324721+0000","last_peered":"2024-04-15T00:01:50.324721+0000","last_clean":"2024-04-15T00:01:50.324721+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T00:01:50.324721+0000","last_undegraded":"2024-04-15T00:01:50.324721+0000","last_fullsized":"2024-04-15T00:01:50.324721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270793+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T00:01:50.270793+0000","last_peered":"2024-04-15T00:01:50.270793+0000","last_clean":"2024-04-15T00:01:50.270793+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T00:01:50.270793+0000","last_undegraded":"2024-04-15T00:01:50.270793+0000","last_fullsized":"2024-04-15T00:01:50.270793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999962+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T00:01:49.999962+0000","last_peered":"2024-04-15T00:01:49.999962+0000","last_clean":"2024-04-15T00:01:49.999962+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T00:01:49.999962+0000","last_undegraded":"2024-04-15T00:01:49.999962+0000","last_fullsized":"2024-04-15T00:01:49.999962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995861+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T00:01:49.995861+0000","last_peered":"2024-04-15T00:01:49.995861+0000","last_clean":"2024-04-15T00:01:49.995861+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T00:01:49.995861+0000","last_undegraded":"2024-04-15T00:01:49.995861+0000","last_fullsized":"2024-04-15T00:01:49.995861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270363+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T00:01:50.270363+0000","last_peered":"2024-04-15T00:01:50.270363+0000","last_clean":"2024-04-15T00:01:50.270363+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T00:01:50.270363+0000","last_undegraded":"2024-04-15T00:01:50.270363+0000","last_fullsized":"2024-04-15T00:01:50.270363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.001404+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T00:01:50.001404+0000","last_peered":"2024-04-15T00:01:50.001404+0000","last_clean":"2024-04-15T00:01:50.001404+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T00:01:50.001404+0000","last_undegraded":"2024-04-15T00:01:50.001404+0000","last_fullsized":"2024-04-15T00:01:50.001404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995399+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T00:01:49.995399+0000","last_peered":"2024-04-15T00:01:49.995399+0000","last_clean":"2024-04-15T00:01:49.995399+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T00:01:49.995399+0000","last_undegraded":"2024-04-15T00:01:49.995399+0000","last_fullsized":"2024-04-15T00:01:49.995399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996891+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T00:01:49.996891+0000","last_peered":"2024-04-15T00:01:49.996891+0000","last_clean":"2024-04-15T00:01:49.996891+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T00:01:49.996891+0000","last_undegraded":"2024-04-15T00:01:49.996891+0000","last_fullsized":"2024-04-15T00:01:49.996891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270275+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T00:01:50.270275+0000","last_peered":"2024-04-15T00:01:50.270275+0000","last_clean":"2024-04-15T00:01:50.270275+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T00:01:50.270275+0000","last_undegraded":"2024-04-15T00:01:50.270275+0000","last_fullsized":"2024-04-15T00:01:50.270275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324319+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T00:01:50.324319+0000","last_peered":"2024-04-15T00:01:50.324319+0000","last_clean":"2024-04-15T00:01:50.324319+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T00:01:50.324319+0000","last_undegraded":"2024-04-15T00:01:50.324319+0000","last_fullsized":"2024-04-15T00:01:50.324319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270444+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T00:01:50.270444+0000","last_peered":"2024-04-15T00:01:50.270444+0000","last_clean":"2024-04-15T00:01:50.270444+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T00:01:50.270444+0000","last_undegraded":"2024-04-15T00:01:50.270444+0000","last_fullsized":"2024-04-15T00:01:50.270444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098216+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T00:01:48.098216+0000","last_peered":"2024-04-15T00:01:48.098216+0000","last_clean":"2024-04-15T00:01:48.098216+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T00:01:48.098216+0000","last_undegraded":"2024-04-15T00:01:48.098216+0000","last_fullsized":"2024-04-15T00:01:48.098216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996347+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T00:01:49.996347+0000","last_peered":"2024-04-15T00:01:49.996347+0000","last_clean":"2024-04-15T00:01:49.996347+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T00:01:49.996347+0000","last_undegraded":"2024-04-15T00:01:49.996347+0000","last_fullsized":"2024-04-15T00:01:49.996347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270132+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T00:01:50.270132+0000","last_peered":"2024-04-15T00:01:50.270132+0000","last_clean":"2024-04-15T00:01:50.270132+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T00:01:50.270132+0000","last_undegraded":"2024-04-15T00:01:50.270132+0000","last_fullsized":"2024-04-15T00:01:50.270132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.001294+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T00:01:50.001294+0000","last_peered":"2024-04-15T00:01:50.001294+0000","last_clean":"2024-04-15T00:01:50.001294+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T00:01:50.001294+0000","last_undegraded":"2024-04-15T00:01:50.001294+0000","last_fullsized":"2024-04-15T00:01:50.001294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996541+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T00:01:49.996541+0000","last_peered":"2024-04-15T00:01:49.996541+0000","last_clean":"2024-04-15T00:01:49.996541+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T00:01:49.996541+0000","last_undegraded":"2024-04-15T00:01:49.996541+0000","last_fullsized":"2024-04-15T00:01:49.996541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325887+0000","last_change":"2024-04-15T00:01:50.325887+0000","last_active":"2024-04-15T00:01:50.325887+0000","last_peered":"2024-04-15T00:01:50.325887+0000","last_clean":"2024-04-15T00:01:50.325887+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T00:01:50.325887+0000","last_undegraded":"2024-04-15T00:01:50.325887+0000","last_fullsized":"2024-04-15T00:01:50.325887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:56:24.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996509+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T00:01:49.996509+0000","last_peered":"2024-04-15T00:01:49.996509+0000","last_clean":"2024-04-15T00:01:49.996509+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T00:01:49.996509+0000","last_undegraded":"2024-04-15T00:01:49.996509+0000","last_fullsized":"2024-04-15T00:01:49.996509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324829+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T00:01:50.324829+0000","last_peered":"2024-04-15T00:01:50.324829+0000","last_clean":"2024-04-15T00:01:50.324829+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T00:01:50.324829+0000","last_undegraded":"2024-04-15T00:01:50.324829+0000","last_fullsized":"2024-04-15T00:01:50.324829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097791+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T00:01:48.097791+0000","last_peered":"2024-04-15T00:01:48.097791+0000","last_clean":"2024-04-15T00:01:48.097791+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T00:01:48.097791+0000","last_undegraded":"2024-04-15T00:01:48.097791+0000","last_fullsized":"2024-04-15T00:01:48.097791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993555+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T00:01:49.993555+0000","last_peered":"2024-04-15T00:01:49.993555+0000","last_clean":"2024-04-15T00:01:49.993555+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T00:01:49.993555+0000","last_undegraded":"2024-04-15T00:01:49.993555+0000","last_fullsized":"2024-04-15T00:01:49.993555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996604+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T00:01:49.996604+0000","last_peered":"2024-04-15T00:01:49.996604+0000","last_clean":"2024-04-15T00:01:49.996604+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T00:01:49.996604+0000","last_undegraded":"2024-04-15T00:01:49.996604+0000","last_fullsized":"2024-04-15T00:01:49.996604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995482+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T00:01:49.995482+0000","last_peered":"2024-04-15T00:01:49.995482+0000","last_clean":"2024-04-15T00:01:49.995482+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T00:01:49.995482+0000","last_undegraded":"2024-04-15T00:01:49.995482+0000","last_fullsized":"2024-04-15T00:01:49.995482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270278+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T00:01:50.270278+0000","last_peered":"2024-04-15T00:01:50.270278+0000","last_clean":"2024-04-15T00:01:50.270278+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T00:01:50.270278+0000","last_undegraded":"2024-04-15T00:01:50.270278+0000","last_fullsized":"2024-04-15T00:01:50.270278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992881+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T00:01:49.992881+0000","last_peered":"2024-04-15T00:01:49.992881+0000","last_clean":"2024-04-15T00:01:49.992881+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T00:01:49.992881+0000","last_undegraded":"2024-04-15T00:01:49.992881+0000","last_fullsized":"2024-04-15T00:01:49.992881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.003001+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T00:01:50.003001+0000","last_peered":"2024-04-15T00:01:50.003001+0000","last_clean":"2024-04-15T00:01:50.003001+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T00:01:50.003001+0000","last_undegraded":"2024-04-15T00:01:50.003001+0000","last_fullsized":"2024-04-15T00:01:50.003001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:49.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995692+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T00:01:49.995692+0000","last_peered":"2024-04-15T00:01:49.995692+0000","last_clean":"2024-04-15T00:01:49.995692+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T00:01:49.995692+0000","last_undegraded":"2024-04-15T00:01:49.995692+0000","last_fullsized":"2024-04-15T00:01:49.995692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.989769+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T00:01:49.989769+0000","last_peered":"2024-04-15T00:01:49.989769+0000","last_clean":"2024-04-15T00:01:49.989769+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T00:01:49.989769+0000","last_undegraded":"2024-04-15T00:01:49.989769+0000","last_fullsized":"2024-04-15T00:01:49.989769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996984+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T00:01:49.996984+0000","last_peered":"2024-04-15T00:01:49.996984+0000","last_clean":"2024-04-15T00:01:49.996984+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T00:01:49.996984+0000","last_undegraded":"2024-04-15T00:01:49.996984+0000","last_fullsized":"2024-04-15T00:01:49.996984+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097150+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T00:01:48.097150+0000","last_peered":"2024-04-15T00:01:48.097150+0000","last_clean":"2024-04-15T00:01:48.097150+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T00:01:48.097150+0000","last_undegraded":"2024-04-15T00:01:48.097150+0000","last_fullsized":"2024-04-15T00:01:48.097150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324440+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T00:01:50.324440+0000","last_peered":"2024-04-15T00:01:50.324440+0000","last_clean":"2024-04-15T00:01:50.324440+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T00:01:50.324440+0000","last_undegraded":"2024-04-15T00:01:50.324440+0000","last_fullsized":"2024-04-15T00:01:50.324440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098034+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T00:01:48.098034+0000","last_peered":"2024-04-15T00:01:48.098034+0000","last_clean":"2024-04-15T00:01:48.098034+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T00:01:48.098034+0000","last_undegraded":"2024-04-15T00:01:48.098034+0000","last_fullsized":"2024-04-15T00:01:48.098034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.998011+0000","last_change":"2024-04-15T00:01:49.998011+0000","last_active":"2024-04-15T00:01:49.998011+0000","last_peered":"2024-04-15T00:01:49.998011+0000","last_clean":"2024-04-15T00:01:49.998011+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T00:01:49.998011+0000","last_undegraded":"2024-04-15T00:01:49.998011+0000","last_fullsized":"2024-04-15T00:01:49.998011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:09:28.962143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992929+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T00:01:49.992929+0000","last_peered":"2024-04-15T00:01:49.992929+0000","last_clean":"2024-04-15T00:01:49.992929+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T00:01:49.992929+0000","last_undegraded":"2024-04-15T00:01:49.992929+0000","last_fullsized":"2024-04-15T00:01:49.992929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324447+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T00:01:50.324447+0000","last_peered":"2024-04-15T00:01:50.324447+0000","last_clean":"2024-04-15T00:01:50.324447+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T00:01:50.324447+0000","last_undegraded":"2024-04-15T00:01:50.324447+0000","last_fullsized":"2024-04-15T00:01:50.324447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995674+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T00:01:49.995674+0000","last_peered":"2024-04-15T00:01:49.995674+0000","last_clean":"2024-04-15T00:01:49.995674+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T00:01:49.995674+0000","last_undegraded":"2024-04-15T00:01:49.995674+0000","last_fullsized":"2024-04-15T00:01:49.995674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324614+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T00:01:50.324614+0000","last_peered":"2024-04-15T00:01:50.324614+0000","last_clean":"2024-04-15T00:01:50.324614+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T00:01:50.324614+0000","last_undegraded":"2024-04-15T00:01:50.324614+0000","last_fullsized":"2024-04-15T00:01:50.324614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990924+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T00:01:49.990924+0000","last_peered":"2024-04-15T00:01:49.990924+0000","last_clean":"2024-04-15T00:01:49.990924+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T00:01:49.990924+0000","last_undegraded":"2024-04-15T00:01:49.990924+0000","last_fullsized":"2024-04-15T00:01:49.990924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995245+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T00:01:49.995245+0000","last_peered":"2024-04-15T00:01:49.995245+0000","last_clean":"2024-04-15T00:01:49.995245+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T00:01:49.995245+0000","last_undegraded":"2024-04-15T00:01:49.995245+0000","last_fullsized":"2024-04-15T00:01:49.995245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993084+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T00:01:49.993084+0000","last_peered":"2024-04-15T00:01:49.993084+0000","last_clean":"2024-04-15T00:01:49.993084+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T00:01:49.993084+0000","last_undegraded":"2024-04-15T00:01:49.993084+0000","last_fullsized":"2024-04-15T00:01:49.993084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.997081+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T00:01:49.997081+0000","last_peered":"2024-04-15T00:01:49.997081+0000","last_clean":"2024-04-15T00:01:49.997081+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T00:01:49.997081+0000","last_undegraded":"2024-04-15T00:01:49.997081+0000","last_fullsized":"2024-04-15T00:01:49.997081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097980+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T00:01:48.097980+0000","last_peered":"2024-04-15T00:01:48.097980+0000","last_clean":"2024-04-15T00:01:48.097980+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T00:01:48.097980+0000","last_undegraded":"2024-04-15T00:01:48.097980+0000","last_fullsized":"2024-04-15T00:01:48.097980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325024+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T00:01:50.325024+0000","last_peered":"2024-04-15T00:01:50.325024+0000","last_clean":"2024-04-15T00:01:50.325024+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T00:01:50.325024+0000","last_undegraded":"2024-04-15T00:01:50.325024+0000","last_fullsized":"2024-04-15T00:01:50.325024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990332+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T00:01:49.990332+0000","last_peered":"2024-04-15T00:01:49.990332+0000","last_clean":"2024-04-15T00:01:49.990332+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T00:01:49.990332+0000","last_undegraded":"2024-04-15T00:01:49.990332+0000","last_fullsized":"2024-04-15T00:01:49.990332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992269+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T00:01:49.992269+0000","last_peered":"2024-04-15T00:01:49.992269+0000","last_clean":"2024-04-15T00:01:49.992269+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T00:01:49.992269+0000","last_undegraded":"2024-04-15T00:01:49.992269+0000","last_fullsized":"2024-04-15T00:01:49.992269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324899+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T00:01:50.324899+0000","last_peered":"2024-04-15T00:01:50.324899+0000","last_clean":"2024-04-15T00:01:50.324899+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T00:01:50.324899+0000","last_undegraded":"2024-04-15T00:01:50.324899+0000","last_fullsized":"2024-04-15T00:01:50.324899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270686+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T00:01:50.270686+0000","last_peered":"2024-04-15T00:01:50.270686+0000","last_clean":"2024-04-15T00:01:50.270686+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T00:01:50.270686+0000","last_undegraded":"2024-04-15T00:01:50.270686+0000","last_fullsized":"2024-04-15T00:01:50.270686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270113+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T00:01:50.270113+0000","last_peered":"2024-04-15T00:01:50.270113+0000","last_clean":"2024-04-15T00:01:50.270113+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T00:01:50.270113+0000","last_undegraded":"2024-04-15T00:01:50.270113+0000","last_fullsized":"2024-04-15T00:01:50.270113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324372+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T00:01:50.324372+0000","last_peered":"2024-04-15T00:01:50.324372+0000","last_clean":"2024-04-15T00:01:50.324372+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T00:01:50.324372+0000","last_undegraded":"2024-04-15T00:01:50.324372+0000","last_fullsized":"2024-04-15T00:01:50.324372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.989582+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T00:01:49.989582+0000","last_peered":"2024-04-15T00:01:49.989582+0000","last_clean":"2024-04-15T00:01:49.989582+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T00:01:49.989582+0000","last_undegraded":"2024-04-15T00:01:49.989582+0000","last_fullsized":"2024-04-15T00:01:49.989582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097924+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T00:01:48.097924+0000","last_peered":"2024-04-15T00:01:48.097924+0000","last_clean":"2024-04-15T00:01:48.097924+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T00:01:48.097924+0000","last_undegraded":"2024-04-15T00:01:48.097924+0000","last_fullsized":"2024-04-15T00:01:48.097924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.994857+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T00:01:49.994857+0000","last_peered":"2024-04-15T00:01:49.994857+0000","last_clean":"2024-04-15T00:01:49.994857+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T00:01:49.994857+0000","last_undegraded":"2024-04-15T00:01:49.994857+0000","last_fullsized":"2024-04-15T00:01:49.994857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995199+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T00:01:49.995199+0000","last_peered":"2024-04-15T00:01:49.995199+0000","last_clean":"2024-04-15T00:01:49.995199+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T00:01:49.995199+0000","last_undegraded":"2024-04-15T00:01:49.995199+0000","last_fullsized":"2024-04-15T00:01:49.995199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.326200+0000","last_change":"2024-04-15T00:01:50.326200+0000","last_active":"2024-04-15T00:01:50.326200+0000","last_peered":"2024-04-15T00:01:50.326200+0000","last_clean":"2024-04-15T00:01:50.326200+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T00:01:50.326200+0000","last_undegraded":"2024-04-15T00:01:50.326200+0000","last_fullsized":"2024-04-15T00:01:50.326200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:32:27.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324509+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T00:01:50.324509+0000","last_peered":"2024-04-15T00:01:50.324509+0000","last_clean":"2024-04-15T00:01:50.324509+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T00:01:50.324509+0000","last_undegraded":"2024-04-15T00:01:50.324509+0000","last_fullsized":"2024-04-15T00:01:50.324509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992805+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T00:01:49.992805+0000","last_peered":"2024-04-15T00:01:49.992805+0000","last_clean":"2024-04-15T00:01:49.992805+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T00:01:49.992805+0000","last_undegraded":"2024-04-15T00:01:49.992805+0000","last_fullsized":"2024-04-15T00:01:49.992805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999105+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T00:01:49.999105+0000","last_peered":"2024-04-15T00:01:49.999105+0000","last_clean":"2024-04-15T00:01:49.999105+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T00:01:49.999105+0000","last_undegraded":"2024-04-15T00:01:49.999105+0000","last_fullsized":"2024-04-15T00:01:49.999105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097528+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T00:01:48.097528+0000","last_peered":"2024-04-15T00:01:48.097528+0000","last_clean":"2024-04-15T00:01:48.097528+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T00:01:48.097528+0000","last_undegraded":"2024-04-15T00:01:48.097528+0000","last_fullsized":"2024-04-15T00:01:48.097528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098327+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T00:01:48.098327+0000","last_peered":"2024-04-15T00:01:48.098327+0000","last_clean":"2024-04-15T00:01:48.098327+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T00:01:48.098327+0000","last_undegraded":"2024-04-15T00:01:48.098327+0000","last_fullsized":"2024-04-15T00:01:48.098327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993248+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T00:01:49.993248+0000","last_peered":"2024-04-15T00:01:49.993248+0000","last_clean":"2024-04-15T00:01:49.993248+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T00:01:49.993248+0000","last_undegraded":"2024-04-15T00:01:49.993248+0000","last_fullsized":"2024-04-15T00:01:49.993248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324579+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T00:01:50.324579+0000","last_peered":"2024-04-15T00:01:50.324579+0000","last_clean":"2024-04-15T00:01:50.324579+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T00:01:50.324579+0000","last_undegraded":"2024-04-15T00:01:50.324579+0000","last_fullsized":"2024-04-15T00:01:50.324579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'14","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995704+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T00:01:49.995704+0000","last_peered":"2024-04-15T00:01:49.995704+0000","last_clean":"2024-04-15T00:01:49.995704+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T00:01:49.995704+0000","last_undegraded":"2024-04-15T00:01:49.995704+0000","last_fullsized":"2024-04-15T00:01:49.995704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995584+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T00:01:49.995584+0000","last_peered":"2024-04-15T00:01:49.995584+0000","last_clean":"2024-04-15T00:01:49.995584+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T00:01:49.995584+0000","last_undegraded":"2024-04-15T00:01:49.995584+0000","last_fullsized":"2024-04-15T00:01:49.995584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270621+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T00:01:50.270621+0000","last_peered":"2024-04-15T00:01:50.270621+0000","last_clean":"2024-04-15T00:01:50.270621+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T00:01:50.270621+0000","last_undegraded":"2024-04-15T00:01:50.270621+0000","last_fullsized":"2024-04-15T00:01:50.270621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996985+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T00:01:49.996985+0000","last_peered":"2024-04-15T00:01:49.996985+0000","last_clean":"2024-04-15T00:01:49.996985+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T00:01:49.996985+0000","last_undegraded":"2024-04-15T00:01:49.996985+0000","last_fullsized":"2024-04-15T00:01:49.996985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270546+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T00:01:50.270546+0000","last_peered":"2024-04-15T00:01:50.270546+0000","last_clean":"2024-04-15T00:01:50.270546+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T00:01:50.270546+0000","last_undegraded":"2024-04-15T00:01:50.270546+0000","last_fullsized":"2024-04-15T00:01:50.270546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098347+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T00:01:48.098347+0000","last_peered":"2024-04-15T00:01:48.098347+0000","last_clean":"2024-04-15T00:01:48.098347+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T00:01:48.098347+0000","last_undegraded":"2024-04-15T00:01:48.098347+0000","last_fullsized":"2024-04-15T00:01:48.098347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993267+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T00:01:49.993267+0000","last_peered":"2024-04-15T00:01:49.993267+0000","last_clean":"2024-04-15T00:01:49.993267+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T00:01:49.993267+0000","last_undegraded":"2024-04-15T00:01:49.993267+0000","last_fullsized":"2024-04-15T00:01:49.993267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.998968+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T00:01:49.998968+0000","last_peered":"2024-04-15T00:01:49.998968+0000","last_clean":"2024-04-15T00:01:49.998968+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T00:01:49.998968+0000","last_undegraded":"2024-04-15T00:01:49.998968+0000","last_fullsized":"2024-04-15T00:01:49.998968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993162+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T00:01:49.993162+0000","last_peered":"2024-04-15T00:01:49.993162+0000","last_clean":"2024-04-15T00:01:49.993162+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T00:01:49.993162+0000","last_undegraded":"2024-04-15T00:01:49.993162+0000","last_fullsized":"2024-04-15T00:01:49.993162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996121+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T00:01:49.996121+0000","last_peered":"2024-04-15T00:01:49.996121+0000","last_clean":"2024-04-15T00:01:49.996121+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T00:01:49.996121+0000","last_undegraded":"2024-04-15T00:01:49.996121+0000","last_fullsized":"2024-04-15T00:01:49.996121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999619+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T00:01:49.999619+0000","last_peered":"2024-04-15T00:01:49.999619+0000","last_clean":"2024-04-15T00:01:49.999619+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T00:01:49.999619+0000","last_undegraded":"2024-04-15T00:01:49.999619+0000","last_fullsized":"2024-04-15T00:01:49.999619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097806+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T00:01:48.097806+0000","last_peered":"2024-04-15T00:01:48.097806+0000","last_clean":"2024-04-15T00:01:48.097806+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T00:01:48.097806+0000","last_undegraded":"2024-04-15T00:01:48.097806+0000","last_fullsized":"2024-04-15T00:01:48.097806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995220+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T00:01:49.995220+0000","last_peered":"2024-04-15T00:01:49.995220+0000","last_clean":"2024-04-15T00:01:49.995220+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T00:01:49.995220+0000","last_undegraded":"2024-04-15T00:01:49.995220+0000","last_fullsized":"2024-04-15T00:01:49.995220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992539+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T00:01:49.992539+0000","last_peered":"2024-04-15T00:01:49.992539+0000","last_clean":"2024-04-15T00:01:49.992539+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T00:01:49.992539+0000","last_undegraded":"2024-04-15T00:01:49.992539+0000","last_fullsized":"2024-04-15T00:01:49.992539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995980+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T00:01:49.995980+0000","last_peered":"2024-04-15T00:01:49.995980+0000","last_clean":"2024-04-15T00:01:49.995980+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T00:01:49.995980+0000","last_undegraded":"2024-04-15T00:01:49.995980+0000","last_fullsized":"2024-04-15T00:01:49.995980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999060+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T00:01:49.999060+0000","last_peered":"2024-04-15T00:01:49.999060+0000","last_clean":"2024-04-15T00:01:49.999060+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T00:01:49.999060+0000","last_undegraded":"2024-04-15T00:01:49.999060+0000","last_fullsized":"2024-04-15T00:01:49.999060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999759+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T00:01:49.999759+0000","last_peered":"2024-04-15T00:01:49.999759+0000","last_clean":"2024-04-15T00:01:49.999759+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T00:01:49.999759+0000","last_undegraded":"2024-04-15T00:01:49.999759+0000","last_fullsized":"2024-04-15T00:01:49.999759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995514+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T00:01:49.995514+0000","last_peered":"2024-04-15T00:01:49.995514+0000","last_clean":"2024-04-15T00:01:49.995514+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T00:01:49.995514+0000","last_undegraded":"2024-04-15T00:01:49.995514+0000","last_fullsized":"2024-04-15T00:01:49.995514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098219+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T00:01:48.098219+0000","last_peered":"2024-04-15T00:01:48.098219+0000","last_clean":"2024-04-15T00:01:48.098219+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T00:01:48.098219+0000","last_undegraded":"2024-04-15T00:01:48.098219+0000","last_fullsized":"2024-04-15T00:01:48.098219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990627+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T00:01:49.990627+0000","last_peered":"2024-04-15T00:01:49.990627+0000","last_clean":"2024-04-15T00:01:49.990627+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T00:01:49.990627+0000","last_undegraded":"2024-04-15T00:01:49.990627+0000","last_fullsized":"2024-04-15T00:01:49.990627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.000710+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T00:01:50.000710+0000","last_peered":"2024-04-15T00:01:50.000710+0000","last_clean":"2024-04-15T00:01:50.000710+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T00:01:50.000710+0000","last_undegraded":"2024-04-15T00:01:50.000710+0000","last_fullsized":"2024-04-15T00:01:50.000710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270369+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T00:01:50.270369+0000","last_peered":"2024-04-15T00:01:50.270369+0000","last_clean":"2024-04-15T00:01:50.270369+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T00:01:50.270369+0000","last_undegraded":"2024-04-15T00:01:50.270369+0000","last_fullsized":"2024-04-15T00:01:50.270369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.000611+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T00:01:50.000611+0000","last_peered":"2024-04-15T00:01:50.000611+0000","last_clean":"2024-04-15T00:01:50.000611+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T00:01:50.000611+0000","last_undegraded":"2024-04-15T00:01:50.000611+0000","last_fullsized":"2024-04-15T00:01:50.000611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.994877+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T00:01:49.994877+0000","last_peered":"2024-04-15T00:01:49.994877+0000","last_clean":"2024-04-15T00:01:49.994877+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T00:01:49.994877+0000","last_undegraded":"2024-04-15T00:01:49.994877+0000","last_fullsized":"2024-04-15T00:01:49.994877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.989663+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T00:01:49.989663+0000","last_peered":"2024-04-15T00:01:49.989663+0000","last_clean":"2024-04-15T00:01:49.989663+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T00:01:49.989663+0000","last_undegraded":"2024-04-15T00:01:49.989663+0000","last_fullsized":"2024-04-15T00:01:49.989663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992769+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T00:01:49.992769+0000","last_peered":"2024-04-15T00:01:49.992769+0000","last_clean":"2024-04-15T00:01:49.992769+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T00:01:49.992769+0000","last_undegraded":"2024-04-15T00:01:49.992769+0000","last_fullsized":"2024-04-15T00:01:49.992769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.098080+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T00:01:48.098080+0000","last_peered":"2024-04-15T00:01:48.098080+0000","last_clean":"2024-04-15T00:01:48.098080+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T00:01:48.098080+0000","last_undegraded":"2024-04-15T00:01:48.098080+0000","last_fullsized":"2024-04-15T00:01:48.098080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999277+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T00:01:49.999277+0000","last_peered":"2024-04-15T00:01:49.999277+0000","last_clean":"2024-04-15T00:01:49.999277+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T00:01:49.999277+0000","last_undegraded":"2024-04-15T00:01:49.999277+0000","last_fullsized":"2024-04-15T00:01:49.999277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996840+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T00:01:49.996840+0000","last_peered":"2024-04-15T00:01:49.996840+0000","last_clean":"2024-04-15T00:01:49.996840+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T00:01:49.996840+0000","last_undegraded":"2024-04-15T00:01:49.996840+0000","last_fullsized":"2024-04-15T00:01:49.996840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996089+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T00:01:49.996089+0000","last_peered":"2024-04-15T00:01:49.996089+0000","last_clean":"2024-04-15T00:01:49.996089+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T00:01:49.996089+0000","last_undegraded":"2024-04-15T00:01:49.996089+0000","last_fullsized":"2024-04-15T00:01:49.996089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.001197+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T00:01:50.001197+0000","last_peered":"2024-04-15T00:01:50.001197+0000","last_clean":"2024-04-15T00:01:50.001197+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T00:01:50.001197+0000","last_undegraded":"2024-04-15T00:01:50.001197+0000","last_fullsized":"2024-04-15T00:01:50.001197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992512+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T00:01:49.992512+0000","last_peered":"2024-04-15T00:01:49.992512+0000","last_clean":"2024-04-15T00:01:49.992512+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T00:01:49.992512+0000","last_undegraded":"2024-04-15T00:01:49.992512+0000","last_fullsized":"2024-04-15T00:01:49.992512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999853+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T00:01:49.999853+0000","last_peered":"2024-04-15T00:01:49.999853+0000","last_clean":"2024-04-15T00:01:49.999853+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T00:01:49.999853+0000","last_undegraded":"2024-04-15T00:01:49.999853+0000","last_fullsized":"2024-04-15T00:01:49.999853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325599+0000","last_change":"2024-04-15T00:01:50.325599+0000","last_active":"2024-04-15T00:01:50.325599+0000","last_peered":"2024-04-15T00:01:50.325599+0000","last_clean":"2024-04-15T00:01:50.325599+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T00:01:50.325599+0000","last_undegraded":"2024-04-15T00:01:50.325599+0000","last_fullsized":"2024-04-15T00:01:50.325599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097886+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T00:01:48.097886+0000","last_peered":"2024-04-15T00:01:48.097886+0000","last_clean":"2024-04-15T00:01:48.097886+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T00:01:48.097886+0000","last_undegraded":"2024-04-15T00:01:48.097886+0000","last_fullsized":"2024-04-15T00:01:48.097886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995667+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T00:01:49.995667+0000","last_peered":"2024-04-15T00:01:49.995667+0000","last_clean":"2024-04-15T00:01:49.995667+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T00:01:49.995667+0000","last_undegraded":"2024-04-15T00:01:49.995667+0000","last_fullsized":"2024-04-15T00:01:49.995667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324746+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T00:01:50.324746+0000","last_peered":"2024-04-15T00:01:50.324746+0000","last_clean":"2024-04-15T00:01:50.324746+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T00:01:50.324746+0000","last_undegraded":"2024-04-15T00:01:50.324746+0000","last_fullsized":"2024-04-15T00:01:50.324746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.990298+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T00:01:49.990298+0000","last_peered":"2024-04-15T00:01:49.990298+0000","last_clean":"2024-04-15T00:01:49.990298+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T00:01:49.990298+0000","last_undegraded":"2024-04-15T00:01:49.990298+0000","last_fullsized":"2024-04-15T00:01:49.990298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.993104+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T00:01:49.993104+0000","last_peered":"2024-04-15T00:01:49.993104+0000","last_clean":"2024-04-15T00:01:49.993104+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T00:01:49.993104+0000","last_undegraded":"2024-04-15T00:01:49.993104+0000","last_fullsized":"2024-04-15T00:01:49.993104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992448+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T00:01:49.992448+0000","last_peered":"2024-04-15T00:01:49.992448+0000","last_clean":"2024-04-15T00:01:49.992448+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T00:01:49.992448+0000","last_undegraded":"2024-04-15T00:01:49.992448+0000","last_fullsized":"2024-04-15T00:01:49.992448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995313+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T00:01:49.995313+0000","last_peered":"2024-04-15T00:01:49.995313+0000","last_clean":"2024-04-15T00:01:49.995313+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T00:01:49.995313+0000","last_undegraded":"2024-04-15T00:01:49.995313+0000","last_fullsized":"2024-04-15T00:01:49.995313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097428+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T00:01:48.097428+0000","last_peered":"2024-04-15T00:01:48.097428+0000","last_clean":"2024-04-15T00:01:48.097428+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T00:01:48.097428+0000","last_undegraded":"2024-04-15T00:01:48.097428+0000","last_fullsized":"2024-04-15T00:01:48.097428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.999882+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T00:01:49.999882+0000","last_peered":"2024-04-15T00:01:49.999882+0000","last_clean":"2024-04-15T00:01:49.999882+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T00:01:49.999882+0000","last_undegraded":"2024-04-15T00:01:49.999882+0000","last_fullsized":"2024-04-15T00:01:49.999882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.270553+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T00:01:50.270553+0000","last_peered":"2024-04-15T00:01:50.270553+0000","last_clean":"2024-04-15T00:01:50.270553+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T00:01:50.270553+0000","last_undegraded":"2024-04-15T00:01:50.270553+0000","last_fullsized":"2024-04-15T00:01:50.270553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.995774+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T00:01:49.995774+0000","last_peered":"2024-04-15T00:01:49.995774+0000","last_clean":"2024-04-15T00:01:49.995774+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T00:01:49.995774+0000","last_undegraded":"2024-04-15T00:01:49.995774+0000","last_fullsized":"2024-04-15T00:01:49.995774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.997896+0000","last_change":"2024-04-15T00:01:49.997896+0000","last_active":"2024-04-15T00:01:49.997896+0000","last_peered":"2024-04-15T00:01:49.997896+0000","last_clean":"2024-04-15T00:01:49.997896+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T00:01:49.997896+0000","last_undegraded":"2024-04-15T00:01:49.997896+0000","last_fullsized":"2024-04-15T00:01:49.997896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:52:44.356891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.325022+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T00:01:50.325022+0000","last_peered":"2024-04-15T00:01:50.325022+0000","last_clean":"2024-04-15T00:01:50.325022+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T00:01:50.325022+0000","last_undegraded":"2024-04-15T00:01:50.325022+0000","last_fullsized":"2024-04-15T00:01:50.325022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.998877+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T00:01:49.998877+0000","last_peered":"2024-04-15T00:01:49.998877+0000","last_clean":"2024-04-15T00:01:49.998877+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T00:01:49.998877+0000","last_undegraded":"2024-04-15T00:01:49.998877+0000","last_fullsized":"2024-04-15T00:01:49.998877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324269+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T00:01:50.324269+0000","last_peered":"2024-04-15T00:01:50.324269+0000","last_clean":"2024-04-15T00:01:50.324269+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T00:01:50.324269+0000","last_undegraded":"2024-04-15T00:01:50.324269+0000","last_fullsized":"2024-04-15T00:01:50.324269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.992668+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T00:01:49.992668+0000","last_peered":"2024-04-15T00:01:49.992668+0000","last_clean":"2024-04-15T00:01:49.992668+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T00:01:49.992668+0000","last_undegraded":"2024-04-15T00:01:49.992668+0000","last_fullsized":"2024-04-15T00:01:49.992668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324309+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T00:01:50.324309+0000","last_peered":"2024-04-15T00:01:50.324309+0000","last_clean":"2024-04-15T00:01:50.324309+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T00:01:50.324309+0000","last_undegraded":"2024-04-15T00:01:50.324309+0000","last_fullsized":"2024-04-15T00:01:50.324309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.003849+0000","last_change":"2024-04-15T00:01:50.003849+0000","last_active":"2024-04-15T00:01:50.003849+0000","last_peered":"2024-04-15T00:01:50.003849+0000","last_clean":"2024-04-15T00:01:50.003849+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T00:01:50.003849+0000","last_undegraded":"2024-04-15T00:01:50.003849+0000","last_fullsized":"2024-04-15T00:01:50.003849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T00:01:48.097847+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T00:01:48.097847+0000","last_peered":"2024-04-15T00:01:48.097847+0000","last_clean":"2024-04-15T00:01:48.097847+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T00:01:48.097847+0000","last_undegraded":"2024-04-15T00:01:48.097847+0000","last_fullsized":"2024-04-15T00:01:48.097847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:49.996340+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T00:01:49.996340+0000","last_peered":"2024-04-15T00:01:49.996340+0000","last_clean":"2024-04-15T00:01:49.996340+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T00:01:49.996340+0000","last_undegraded":"2024-04-15T00:01:49.996340+0000","last_fullsized":"2024-04-15T00:01:49.996340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T00:01:50.324952+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T00:01:50.324952+0000","last_peered":"2024-04-15T00:01:50.324952+0000","last_clean":"2024-04-15T00:01:50.324952+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T00:01:50.324952+0000","last_undegraded":"2024-04-15T00:01:50.324952+0000","last_fullsized":"2024-04-15T00:01:50.324952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10174,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":204,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":20348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":712963,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":125127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":123839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":121825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":339968,"data_stored":132136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":339968,"data_stored":128932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":335872,"data_stored":129002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":711557,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T00:01:53.357 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T00:01:53.358 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-15T00:01:53.358 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-15T00:01:53.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-15T00:01:53.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.486+0000 7f3ddb77b640 1 Processor -- start 2024-04-15T00:01:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.487+0000 7f3ddb77b640 1 -- start start 2024-04-15T00:01:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.487+0000 7f3ddb77b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dd40d06c0 0x7f3dd415e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.487+0000 7f3ddb77b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd40cb7a0 con 0x7f3dd40cbde0 2024-04-15T00:01:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.487+0000 7f3ddb77b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd40cba80 con 0x7f3dd40cf150 2024-04-15T00:01:53.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.487+0000 7f3ddb77b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd40cd980 con 0x7f3dd40d06c0 2024-04-15T00:01:53.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.488+0000 7f3dd9d18640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3dd40d06c0 0x7f3dd415e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:53.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.488+0000 7f3dd9517640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3dd40cf150 0x7f3dd406c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44416/0 (socket says 172.21.15.29:44416) 2024-04-15T00:01:53.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.488+0000 7f3dd9517640 1 -- 172.21.15.29:0/1190641000 learned_addr learned my addr 172.21.15.29:0/1190641000 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:53.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.491+0000 7f3dd3fff640 1 -- 172.21.15.29:0/1190641000 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228408068 0 0) 0x7f3dd40cba80 con 0x7f3dd40cf150 2024-04-15T00:01:53.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.491+0000 7f3dd3fff640 1 -- 172.21.15.29:0/1190641000 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dbc003520 con 0x7f3dd40cf150 2024-04-15T00:01:53.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.492+0000 7f3dd9d18640 1 -- 172.21.15.29:0/1190641000 >> v1:172.21.15.37:6789/0 conn(0x7f3dd40cf150 legacy=0x7f3dd406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.492+0000 7f3dd9d18640 1 -- 172.21.15.29:0/1190641000 >> v1:172.21.15.29:6789/0 conn(0x7f3dd40cbde0 legacy=0x7f3dd415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.492+0000 7f3dd9d18640 1 -- 172.21.15.29:0/1190641000 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd406b970 con 0x7f3dd40d06c0 2024-04-15T00:01:53.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.496+0000 7f3dd9d18640 1 --2- 172.21.15.29:0/1190641000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40d06c0 0x7f3dd415e190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009d90 tx=0x7f3dc402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9a0104a70d4f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:53.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.499+0000 7f3dd3fff640 1 -- 172.21.15.29:0/1190641000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4039070 con 0x7f3dd40d06c0 2024-04-15T00:01:53.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.499+0000 7f3dd3fff640 1 -- 172.21.15.29:0/1190641000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc402cd80 con 0x7f3dd40d06c0 2024-04-15T00:01:53.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.499+0000 7f3dd3fff640 1 -- 172.21.15.29:0/1190641000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4034660 con 0x7f3dd40d06c0 2024-04-15T00:01:53.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 -- 172.21.15.29:0/1190641000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40d06c0 msgr2=0x7f3dd415e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/1190641000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40d06c0 0x7f3dd415e190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009d90 tx=0x7f3dc402bfd0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 -- 172.21.15.29:0/1190641000 shutdown_connections 2024-04-15T00:01:53.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/1190641000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40d06c0 0x7f3dd415e190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 -- 172.21.15.29:0/1190641000 >> 172.21.15.29:0/1190641000 conn(0x7f3dd40cfba0 msgr2=0x7f3dd40cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:53.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 -- 172.21.15.29:0/1190641000 shutdown_connections 2024-04-15T00:01:53.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.500+0000 7f3ddb77b640 1 -- 172.21.15.29:0/1190641000 wait complete. 2024-04-15T00:01:53.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.501+0000 7f3ddb77b640 1 Processor -- start 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.501+0000 7f3ddb77b640 1 -- start start 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.502+0000 7f3ddb77b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3dd40cbde0 0x7f3dd40b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.502+0000 7f3ddb77b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 0x7f3dd4155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.502+0000 7f3ddb77b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd40d06c0 0x7f3dd41512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.502+0000 7f3ddb77b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd406bf30 con 0x7f3dd40cf150 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.502+0000 7f3ddb77b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd415e6d0 con 0x7f3dd40d06c0 2024-04-15T00:01:53.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.502+0000 7f3ddb77b640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd415e850 con 0x7f3dd40cbde0 2024-04-15T00:01:53.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.503+0000 7f3dd8d16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 0x7f3dd4155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:53.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.503+0000 7f3dd9d18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd40d06c0 0x7f3dd41512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:53.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.503+0000 7f3dd9517640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3dd40cbde0 0x7f3dd40b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:53.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.503+0000 7f3dd8d16640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 0x7f3dd4155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37190/0 (socket says 172.21.15.29:37190) 2024-04-15T00:01:53.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.503+0000 7f3dd8d16640 1 -- 172.21.15.29:0/3437578803 learned_addr learned my addr 172.21.15.29:0/3437578803 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:53.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.506+0000 7f3dd8d16640 1 -- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3dd40cbde0 msgr2=0x7f3dd40b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.506+0000 7f3dd8d16640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3dd40cbde0 0x7f3dd40b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.506+0000 7f3dd8d16640 1 -- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd40d06c0 msgr2=0x7f3dd41512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:53.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.506+0000 7f3dd8d16640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd40d06c0 0x7f3dd41512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:53.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.506+0000 7f3dd8d16640 1 -- 172.21.15.29:0/3437578803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd40b13c0 con 0x7f3dd40cf150 2024-04-15T00:01:53.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.508+0000 7f3dd8d16640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 0x7f3dd4155960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c430 tx=0x7f3dc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:53.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.512+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80052d0 con 0x7f3dd40cf150 2024-04-15T00:01:53.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.512+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8005490 con 0x7f3dd40cf150 2024-04-15T00:01:53.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.512+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd41574b0 con 0x7f3dd40cf150 2024-04-15T00:01:53.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.512+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8007260 con 0x7f3dd40cf150 2024-04-15T00:01:53.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.512+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd4154e80 con 0x7f3dd40cf150 2024-04-15T00:01:53.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.513+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd404f540 con 0x7f3dd40cf150 2024-04-15T00:01:53.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.533+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3dc8007400 con 0x7f3dd40cf150 2024-04-15T00:01:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.533+0000 7f3dd1ffb640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3dc006ba10 0x7f3dc006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.534+0000 7f3dd9517640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3dc006ba10 0x7f3dc006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:53.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.534+0000 7f3dd9517640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3dc006ba10 0x7f3dc006ded0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc005880 tx=0x7f3dcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:53.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.536+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3dc80567f0 con 0x7f3dd40cf150 2024-04-15T00:01:53.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:53.795+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3dc8058750 con 0x7f3dd40cf150 2024-04-15T00:01:54.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.030+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3dd40b5b20 con 0x7f3dd40cf150 2024-04-15T00:01:54.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.036+0000 7f3dd1ffb640 1 -- 172.21.15.29:0/3437578803 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3dc805c7f0 con 0x7f3dd40cf150 2024-04-15T00:01:54.042 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:54.042 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-15T00:01:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3dc006ba10 msgr2=0x7f3dc006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3dc006ba10 0x7f3dc006ded0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc005880 tx=0x7f3dcc009040 comp rx=0 tx=0).stop 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 msgr2=0x7f3dd4155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 0x7f3dd4155960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c430 tx=0x7f3dc800c8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 shutdown_connections 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3dc006ba10 0x7f3dc006ded0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd40d06c0 0x7f3dd41512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3dd40cf150 0x7f3dd4155960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 --2- 172.21.15.29:0/3437578803 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3dd40cbde0 0x7f3dd40b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 >> 172.21.15.29:0/3437578803 conn(0x7f3dd40cfba0 msgr2=0x7f3dd40c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 shutdown_connections 2024-04-15T00:01:54.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.038+0000 7f3ddb77b640 1 -- 172.21.15.29:0/3437578803 wait complete. 2024-04-15T00:01:54.055 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-15T00:01:54.055 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:54.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.153+0000 7f5cdde36640 1 Processor -- start 2024-04-15T00:01:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.153+0000 7f5cdde36640 1 -- start start 2024-04-15T00:01:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.154+0000 7f5cdde36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cd814ea00 0x7f5cd80c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.154+0000 7f5cdde36640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cd80ce1e0 0x7f5cd81596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.154+0000 7f5cdde36640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd8157fb0 con 0x7f5cd80cddc0 2024-04-15T00:01:54.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.154+0000 7f5cdde36640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd80ce630 con 0x7f5cd80ce1e0 2024-04-15T00:01:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.154+0000 7f5cdde36640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd8158230 con 0x7f5cd814ea00 2024-04-15T00:01:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.155+0000 7f5cd7fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cd80ce1e0 0x7f5cd81596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.155+0000 7f5cd77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cd814ea00 0x7f5cd80c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.155+0000 7f5cd77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cd814ea00 0x7f5cd80c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:47188/0 (socket says 172.21.15.29:47188) 2024-04-15T00:01:54.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.155+0000 7f5cd77fe640 1 -- 172.21.15.29:0/283453620 learned_addr learned my addr 172.21.15.29:0/283453620 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.158+0000 7f5cd77fe640 1 -- 172.21.15.29:0/283453620 >> v2:172.21.15.29:3300/0 conn(0x7f5cd80ce1e0 msgr2=0x7f5cd81596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.158+0000 7f5cd77fe640 1 --2- 172.21.15.29:0/283453620 >> v2:172.21.15.29:3300/0 conn(0x7f5cd80ce1e0 0x7f5cd81596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.158+0000 7f5cd77fe640 1 -- 172.21.15.29:0/283453620 >> v1:172.21.15.29:6789/0 conn(0x7f5cd80cddc0 legacy=0x7f5cd8070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.158+0000 7f5cd77fe640 1 -- 172.21.15.29:0/283453620 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd8158510 con 0x7f5cd814ea00 2024-04-15T00:01:54.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.160+0000 7f5cd77fe640 1 --2- 172.21.15.29:0/283453620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd814ea00 0x7f5cd80c3550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80cea80 tx=0x7f5cc802ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d734bd16321751a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.163+0000 7f5cd67fc640 1 -- 172.21.15.29:0/283453620 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc802f850 con 0x7f5cd814ea00 2024-04-15T00:01:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cd67fc640 1 -- 172.21.15.29:0/283453620 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc802f9f0 con 0x7f5cd814ea00 2024-04-15T00:01:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cd67fc640 1 -- 172.21.15.29:0/283453620 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc802fdc0 con 0x7f5cd814ea00 2024-04-15T00:01:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 -- 172.21.15.29:0/283453620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd814ea00 msgr2=0x7f5cd80c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 --2- 172.21.15.29:0/283453620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd814ea00 0x7f5cd80c3550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80cea80 tx=0x7f5cc802ba30 comp rx=0 tx=0).stop 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 -- 172.21.15.29:0/283453620 shutdown_connections 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 --2- 172.21.15.29:0/283453620 >> v2:172.21.15.29:3300/0 conn(0x7f5cd80ce1e0 0x7f5cd81596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 --2- 172.21.15.29:0/283453620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd814ea00 0x7f5cd80c3550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 -- 172.21.15.29:0/283453620 >> 172.21.15.29:0/283453620 conn(0x7f5cd8061e00 msgr2=0x7f5cd8062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 -- 172.21.15.29:0/283453620 shutdown_connections 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.164+0000 7f5cdde36640 1 -- 172.21.15.29:0/283453620 wait complete. 2024-04-15T00:01:54.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.165+0000 7f5cdde36640 1 Processor -- start 2024-04-15T00:01:54.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 -- start start 2024-04-15T00:01:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80cddc0 0x7f5cd8148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5cd80ce1e0 0x7f5cd806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cd814ea00 0x7f5cd8154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd8158db0 con 0x7f5cd814ea00 2024-04-15T00:01:54.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd8158ad0 con 0x7f5cd80cddc0 2024-04-15T00:01:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.166+0000 7f5cdde36640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd814ede0 con 0x7f5cd80ce1e0 2024-04-15T00:01:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.167+0000 7f5cd7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cd814ea00 0x7f5cd8154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.167+0000 7f5cd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80cddc0 0x7f5cd8148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.167+0000 7f5cd6ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5cd80ce1e0 0x7f5cd806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.167+0000 7f5cd7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cd814ea00 0x7f5cd8154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37198/0 (socket says 172.21.15.29:37198) 2024-04-15T00:01:54.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.167+0000 7f5cd7fff640 1 -- 172.21.15.29:0/192032077 learned_addr learned my addr 172.21.15.29:0/192032077 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:54.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.171+0000 7f5cd77fe640 1 -- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5cd80ce1e0 msgr2=0x7f5cd806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.171+0000 7f5cd77fe640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5cd80ce1e0 0x7f5cd806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.171+0000 7f5cd77fe640 1 -- 172.21.15.29:0/192032077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cd814ea00 msgr2=0x7f5cd8154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.171+0000 7f5cd77fe640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cd814ea00 0x7f5cd8154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.171+0000 7f5cd77fe640 1 -- 172.21.15.29:0/192032077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd81f0c90 con 0x7f5cd80cddc0 2024-04-15T00:01:54.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.173+0000 7f5cd77fe640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80cddc0 0x7f5cd8148810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8033000 tx=0x7f5cc8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:54.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.177+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8037bc0 con 0x7f5cd80cddc0 2024-04-15T00:01:54.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.177+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8046070 con 0x7f5cd80cddc0 2024-04-15T00:01:54.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.177+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8041400 con 0x7f5cd80cddc0 2024-04-15T00:01:54.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.177+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd81f0f70 con 0x7f5cd80cddc0 2024-04-15T00:01:54.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.177+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd81f1530 con 0x7f5cd80cddc0 2024-04-15T00:01:54.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.178+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd8072080 con 0x7f5cd80cddc0 2024-04-15T00:01:54.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.467+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5cc8040070 con 0x7f5cd80cddc0 2024-04-15T00:01:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.468+0000 7f5cbffff640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5cc406ba10 0x7f5cc406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.468+0000 7f5cd6ffd640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5cc406ba10 0x7f5cc406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.468+0000 7f5cd6ffd640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5cc406ba10 0x7f5cc406ded0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8157f80 tx=0x7f5ccc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:54.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.473+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5cc8079da0 con 0x7f5cd80cddc0 2024-04-15T00:01:54.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.489+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5cd8072080 con 0x7f5cd80cddc0 2024-04-15T00:01:54.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.670+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cd80c3550 con 0x7f5cd80cddc0 2024-04-15T00:01:54.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.832+0000 7f5cbffff640 1 -- 172.21.15.29:0/192032077 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7f5cd80c3550 con 0x7f5cd80cddc0 2024-04-15T00:01:54.838 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:54.838 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:54.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5cc406ba10 msgr2=0x7f5cc406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5cc406ba10 0x7f5cc406ded0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8157f80 tx=0x7f5ccc009040 comp rx=0 tx=0).stop 2024-04-15T00:01:54.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80cddc0 msgr2=0x7f5cd8148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80cddc0 0x7f5cd8148810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8033000 tx=0x7f5cc8004730 comp rx=0 tx=0).stop 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 shutdown_connections 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5cc406ba10 0x7f5cc406ded0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cd814ea00 0x7f5cd8154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5cd80ce1e0 0x7f5cd806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 --2- 172.21.15.29:0/192032077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80cddc0 0x7f5cd8148810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 >> 172.21.15.29:0/192032077 conn(0x7f5cd8061e00 msgr2=0x7f5cd8070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 shutdown_connections 2024-04-15T00:01:54.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.834+0000 7f5cdde36640 1 -- 172.21.15.29:0/192032077 wait complete. 2024-04-15T00:01:54.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:01:09.779176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:01:11.503018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:01:16.720777+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:01:54.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:01:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.955+0000 7f988fb1e640 1 Processor -- start 2024-04-15T00:01:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.956+0000 7f988fb1e640 1 -- start start 2024-04-15T00:01:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.956+0000 7f988fb1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988815b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.956+0000 7f988fb1e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98880cca40 0x7f98880ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.956+0000 7f988fb1e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f988815ba10 con 0x7f98880ca470 2024-04-15T00:01:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.956+0000 7f988fb1e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9888154cc0 con 0x7f98880cca40 2024-04-15T00:01:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.956+0000 7f988fb1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f988815c5b0 con 0x7f988815ac30 2024-04-15T00:01:54.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.985+0000 7f988e0bb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98880cca40 0x7f98880ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.987+0000 7f988e0bb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98880cca40 0x7f98880ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37208/0 (socket says 172.21.15.29:37208) 2024-04-15T00:01:54.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.987+0000 7f988e0bb640 1 -- 172.21.15.29:0/3691823935 learned_addr learned my addr 172.21.15.29:0/3691823935 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:54.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.988+0000 7f988d8ba640 1 --2- 172.21.15.29:0/3691823935 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:54.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.990+0000 7f988e0bb640 1 -- 172.21.15.29:0/3691823935 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 msgr2=0x7f988815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.990+0000 7f988e0bb640 1 --2- 172.21.15.29:0/3691823935 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.990+0000 7f988e0bb640 1 -- 172.21.15.29:0/3691823935 >> v1:172.21.15.29:6789/0 conn(0x7f98880ca470 legacy=0x7f98880cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:54.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.990+0000 7f988e0bb640 1 -- 172.21.15.29:0/3691823935 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988815bc80 con 0x7f98880cca40 2024-04-15T00:01:55.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:54.996+0000 7f988e0bb640 1 --2- 172.21.15.29:0/3691823935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98880ca8b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9880009e50 tx=0x7f988002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d58bee4a56ef8c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:55.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.000+0000 7f988c8b8640 1 -- 172.21.15.29:0/3691823935 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988002cb90 con 0x7f98880cca40 2024-04-15T00:01:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.000+0000 7f988c8b8640 1 -- 172.21.15.29:0/3691823935 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988002cd30 con 0x7f98880cca40 2024-04-15T00:01:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.000+0000 7f988c8b8640 1 -- 172.21.15.29:0/3691823935 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880034610 con 0x7f98880cca40 2024-04-15T00:01:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 -- 172.21.15.29:0/3691823935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 msgr2=0x7f98880ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 --2- 172.21.15.29:0/3691823935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98880ca8b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9880009e50 tx=0x7f988002bff0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 -- 172.21.15.29:0/3691823935 shutdown_connections 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 --2- 172.21.15.29:0/3691823935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98880ca8b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 --2- 172.21.15.29:0/3691823935 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 -- 172.21.15.29:0/3691823935 >> 172.21.15.29:0/3691823935 conn(0x7f98880cfaf0 msgr2=0x7f98880cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 -- 172.21.15.29:0/3691823935 shutdown_connections 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.001+0000 7f988fb1e640 1 -- 172.21.15.29:0/3691823935 wait complete. 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.002+0000 7f988fb1e640 1 Processor -- start 2024-04-15T00:01:55.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.002+0000 7f988fb1e640 1 -- start start 2024-04-15T00:01:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.003+0000 7f988fb1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880ca470 0x7f98881558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.003+0000 7f988fb1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98881f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.003+0000 7f988fb1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.003+0000 7f988fb1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f98880ccec0 con 0x7f98880cca40 2024-04-15T00:01:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.003+0000 7f988fb1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f988815c240 con 0x7f98880ca470 2024-04-15T00:01:55.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.003+0000 7f988fb1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f988815ca40 con 0x7f988815ac30 2024-04-15T00:01:55.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.004+0000 7f988d0b9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98881f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.004+0000 7f988d8ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880ca470 0x7f98881558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.004+0000 7f988e0bb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.004+0000 7f988d0b9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98881f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37224/0 (socket says 172.21.15.29:37224) 2024-04-15T00:01:55.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.004+0000 7f988d0b9640 1 -- 172.21.15.29:0/2919243052 learned_addr learned my addr 172.21.15.29:0/2919243052 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.007+0000 7f988d0b9640 1 -- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 msgr2=0x7f988806da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.007+0000 7f988d0b9640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988806da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.007+0000 7f988d0b9640 1 -- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880ca470 msgr2=0x7f98881558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.007+0000 7f988d0b9640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880ca470 0x7f98881558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.007+0000 7f988d0b9640 1 -- 172.21.15.29:0/2919243052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9888156bd0 con 0x7f98880cca40 2024-04-15T00:01:55.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.010+0000 7f988d0b9640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98881f0a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f987800c430 tx=0x7f987800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:55.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.013+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98780052d0 con 0x7f98880cca40 2024-04-15T00:01:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.013+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9878005490 con 0x7f98880cca40 2024-04-15T00:01:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.013+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878007260 con 0x7f98880cca40 2024-04-15T00:01:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.013+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9888156eb0 con 0x7f98880cca40 2024-04-15T00:01:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.013+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98881550c0 con 0x7f98880cca40 2024-04-15T00:01:55.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.014+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988804f540 con 0x7f98880cca40 2024-04-15T00:01:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.033+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9878007400 con 0x7f98880cca40 2024-04-15T00:01:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.033+0000 7f987e7fc640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f986c06ba10 0x7f986c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.033+0000 7f988d8ba640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f986c06ba10 0x7f986c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.034+0000 7f988d8ba640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f986c06ba10 0x7f986c06ded0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f988400aa20 tx=0x7f9884008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.291+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9878056830 con 0x7f98880cca40 2024-04-15T00:01:55.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.291+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9878058790 con 0x7f98880cca40 2024-04-15T00:01:55.359 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:01:55.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:01:55.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.472+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98880c8e60 con 0x7f98880cca40 2024-04-15T00:01:55.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.477+0000 7f987e7fc640 1 -- 172.21.15.29:0/2919243052 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f987805c830 con 0x7f98880cca40 2024-04-15T00:01:55.483 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T00:01:55.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f986c06ba10 msgr2=0x7f986c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f986c06ba10 0x7f986c06ded0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f988400aa20 tx=0x7f9884008040 comp rx=0 tx=0).stop 2024-04-15T00:01:55.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 msgr2=0x7f98881f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98881f0a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f987800c430 tx=0x7f987800c8f0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 shutdown_connections 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f986c06ba10 0x7f986c06ded0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f988815ac30 0x7f988806da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98880cca40 0x7f98881f0a90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 --2- 172.21.15.29:0/2919243052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880ca470 0x7f98881558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 >> 172.21.15.29:0/2919243052 conn(0x7f98880cfaf0 msgr2=0x7f988806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 shutdown_connections 2024-04-15T00:01:55.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.479+0000 7f988fb1e640 1 -- 172.21.15.29:0/2919243052 wait complete. 2024-04-15T00:01:55.496 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:01:55.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 Processor -- start 2024-04-15T00:01:55.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 -- start start 2024-04-15T00:01:55.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba08154a00 0x7fba0815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba080ce600 con 0x7fba0806c3b0 2024-04-15T00:01:55.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fba0815ab40 con 0x7fba08154a00 2024-04-15T00:01:55.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.595+0000 7fba0e3bb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fba080ce8e0 con 0x7fba08154620 2024-04-15T00:01:55.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.596+0000 7fba0c958640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fba0806c3b0 0x7fba080cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50616/0 (socket says 172.21.15.29:50616) 2024-04-15T00:01:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.596+0000 7fba0c958640 1 -- 172.21.15.29:0/463119220 learned_addr learned my addr 172.21.15.29:0/463119220 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.596+0000 7fba077fe640 1 --2- 172.21.15.29:0/463119220 >> v2:172.21.15.37:3300/0 conn(0x7fba08154a00 0x7fba0815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.596+0000 7fba07fff640 1 --2- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.598+0000 7fba06ffd640 1 -- 172.21.15.29:0/463119220 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173484228 0 0) 0x7fba080ce600 con 0x7fba0806c3b0 2024-04-15T00:01:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.598+0000 7fba06ffd640 1 -- 172.21.15.29:0/463119220 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9f0003520 con 0x7fba0806c3b0 2024-04-15T00:01:55.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.599+0000 7fba077fe640 1 -- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 msgr2=0x7fba080cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:55.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.599+0000 7fba077fe640 1 --2- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.599+0000 7fba077fe640 1 -- 172.21.15.29:0/463119220 >> v1:172.21.15.29:6789/0 conn(0x7fba0806c3b0 legacy=0x7fba080cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.599+0000 7fba077fe640 1 -- 172.21.15.29:0/463119220 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba080cebc0 con 0x7fba08154a00 2024-04-15T00:01:55.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.601+0000 7fba077fe640 1 --2- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba08154a00 0x7fba0815afd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80097a0 tx=0x7fb9f802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc65f0f0bfc6192b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:55.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.605+0000 7fba06ffd640 1 -- 172.21.15.29:0/463119220 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8035020 con 0x7fba08154a00 2024-04-15T00:01:55.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba06ffd640 1 -- 172.21.15.29:0/463119220 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8031830 con 0x7fba08154a00 2024-04-15T00:01:55.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba06ffd640 1 -- 172.21.15.29:0/463119220 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8031c00 con 0x7fba08154a00 2024-04-15T00:01:55.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 -- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba08154a00 msgr2=0x7fba0815afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba08154a00 0x7fba0815afd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80097a0 tx=0x7fb9f802b8d0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 -- 172.21.15.29:0/463119220 shutdown_connections 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba08154a00 0x7fba0815afd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/463119220 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 -- 172.21.15.29:0/463119220 >> 172.21.15.29:0/463119220 conn(0x7fba080cfb10 msgr2=0x7fba080cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 -- 172.21.15.29:0/463119220 shutdown_connections 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.606+0000 7fba0e3bb640 1 -- 172.21.15.29:0/463119220 wait complete. 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.607+0000 7fba0e3bb640 1 Processor -- start 2024-04-15T00:01:55.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 -- start start 2024-04-15T00:01:55.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 0x7fba081f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba081f44a0 0x7fba081f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fba080cf610 con 0x7fba0806c3b0 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba0815a480 con 0x7fba081f44a0 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.608+0000 7fba0e3bb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fba080cf790 con 0x7fba08154620 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.609+0000 7fba07fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 0x7fba081f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.609+0000 7fba0c958640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba081f44a0 0x7fba081f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.609+0000 7fba077fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.609+0000 7fba07fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 0x7fba081f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37236/0 (socket says 172.21.15.29:37236) 2024-04-15T00:01:55.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.609+0000 7fba07fff640 1 -- 172.21.15.29:0/3623249776 learned_addr learned my addr 172.21.15.29:0/3623249776 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:55.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.612+0000 7fba07fff640 1 -- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 msgr2=0x7fba080b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.612+0000 7fba07fff640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.612+0000 7fba07fff640 1 -- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba081f44a0 msgr2=0x7fba081f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:55.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.612+0000 7fba07fff640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba081f44a0 0x7fba081f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:55.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.612+0000 7fba07fff640 1 -- 172.21.15.29:0/3623249776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0814cbe0 con 0x7fba0806c3b0 2024-04-15T00:01:55.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.615+0000 7fba07fff640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 0x7fba081f3f60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00e9b0 tx=0x7fb9fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.618+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc017070 con 0x7fba0806c3b0 2024-04-15T00:01:55.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.618+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00c9a0 con 0x7fba0806c3b0 2024-04-15T00:01:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.618+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00cd90 con 0x7fba0806c3b0 2024-04-15T00:01:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.618+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0814ce80 con 0x7fba0806c3b0 2024-04-15T00:01:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.619+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba081f4940 con 0x7fba0806c3b0 2024-04-15T00:01:55.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.619+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba080cb820 con 0x7fba0806c3b0 2024-04-15T00:01:55.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.638+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb9fc01a070 con 0x7fba0806c3b0 2024-04-15T00:01:55.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.638+0000 7fba04ff9640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb9f406b9e0 0x7fb9f406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:55.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.639+0000 7fba077fe640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb9f406b9e0 0x7fb9f406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:55.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.639+0000 7fba077fe640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb9f406b9e0 0x7fb9f406dea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:55.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.642+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb9fc057600 con 0x7fba0806c3b0 2024-04-15T00:01:55.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:55.907+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fba080cb820 con 0x7fba0806c3b0 2024-04-15T00:01:56.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.092+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fba0804f540 con 0x7fba0806c3b0 2024-04-15T00:01:56.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.097+0000 7fba04ff9640 1 -- 172.21.15.29:0/3623249776 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fb9fc059560 con 0x7fba0806c3b0 2024-04-15T00:01:56.103 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:56.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb9f406b9e0 msgr2=0x7fb9f406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb9f406b9e0 0x7fb9f406dea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8036000 tx=0x7fb9f803c040 comp rx=0 tx=0).stop 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 msgr2=0x7fba081f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 0x7fba081f3f60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00e9b0 tx=0x7fb9fc00ee70 comp rx=0 tx=0).stop 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 shutdown_connections 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb9f406b9e0 0x7fb9f406dea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba081f44a0 0x7fba081f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fba08154620 0x7fba080b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 --2- 172.21.15.29:0/3623249776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0806c3b0 0x7fba081f3f60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 >> 172.21.15.29:0/3623249776 conn(0x7fba080cfb10 msgr2=0x7fba080ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 shutdown_connections 2024-04-15T00:01:56.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.099+0000 7fba0e3bb640 1 -- 172.21.15.29:0/3623249776 wait complete. 2024-04-15T00:01:56.116 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:01:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.215+0000 7fbb7d364640 1 Processor -- start 2024-04-15T00:01:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.215+0000 7fbb7d364640 1 -- start start 2024-04-15T00:01:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb7d364640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb780cd890 0x7fbb780cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb7d364640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb780c9d40 0x7fbb7815e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb7d364640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7815e850 con 0x7fbb7815a940 2024-04-15T00:01:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb7d364640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbb780c9920 con 0x7fbb780c9d40 2024-04-15T00:01:56.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb7d364640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780c8d90 con 0x7fbb780cd890 2024-04-15T00:01:56.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb767fc640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb780c9d40 0x7fbb7815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.216+0000 7fbb76ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb780cd890 0x7fbb780cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.217+0000 7fbb777fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb7815a940 0x7fbb7815ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:44418/0 (socket says 172.21.15.29:44418) 2024-04-15T00:01:56.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.217+0000 7fbb777fe640 1 -- 172.21.15.29:0/2522243032 learned_addr learned my addr 172.21.15.29:0/2522243032 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.219+0000 7fbb76ffd640 1 -- 172.21.15.29:0/2522243032 >> v2:172.21.15.29:3300/0 conn(0x7fbb780c9d40 msgr2=0x7fbb7815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.219+0000 7fbb76ffd640 1 --2- 172.21.15.29:0/2522243032 >> v2:172.21.15.29:3300/0 conn(0x7fbb780c9d40 0x7fbb7815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.219+0000 7fbb76ffd640 1 -- 172.21.15.29:0/2522243032 >> v1:172.21.15.37:6789/0 conn(0x7fbb7815a940 legacy=0x7fbb7815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.219+0000 7fbb76ffd640 1 -- 172.21.15.29:0/2522243032 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780c9640 con 0x7fbb780cd890 2024-04-15T00:01:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.221+0000 7fbb76ffd640 1 --2- 172.21.15.29:0/2522243032 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb780cd890 0x7fbb780cdc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009d90 tx=0x7fbb6802bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a78c7eed53a296d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb75ffb640 1 -- 172.21.15.29:0/2522243032 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68039070 con 0x7fbb780cd890 2024-04-15T00:01:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb75ffb640 1 -- 172.21.15.29:0/2522243032 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6802c980 con 0x7fbb780cd890 2024-04-15T00:01:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb75ffb640 1 -- 172.21.15.29:0/2522243032 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6802cd50 con 0x7fbb780cd890 2024-04-15T00:01:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 -- 172.21.15.29:0/2522243032 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb780cd890 msgr2=0x7fbb780cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 --2- 172.21.15.29:0/2522243032 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb780cd890 0x7fbb780cdc70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009d90 tx=0x7fbb6802bc50 comp rx=0 tx=0).stop 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 -- 172.21.15.29:0/2522243032 shutdown_connections 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 --2- 172.21.15.29:0/2522243032 >> v2:172.21.15.29:3300/0 conn(0x7fbb780c9d40 0x7fbb7815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 --2- 172.21.15.29:0/2522243032 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb780cd890 0x7fbb780cdc70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 -- 172.21.15.29:0/2522243032 >> 172.21.15.29:0/2522243032 conn(0x7fbb78061c20 msgr2=0x7fbb78062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 -- 172.21.15.29:0/2522243032 shutdown_connections 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.225+0000 7fbb7d364640 1 -- 172.21.15.29:0/2522243032 wait complete. 2024-04-15T00:01:56.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 Processor -- start 2024-04-15T00:01:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 -- start start 2024-04-15T00:01:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780c9d40 0x7fbb78152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb780cd890 0x7fbb7815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb7815a940 0x7fbb7815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7815a420 con 0x7fbb780cd890 2024-04-15T00:01:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780c8ab0 con 0x7fbb780c9d40 2024-04-15T00:01:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.227+0000 7fbb7d364640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbb78154910 con 0x7fbb7815a940 2024-04-15T00:01:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.228+0000 7fbb767fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb780cd890 0x7fbb7815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.228+0000 7fbb777fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb7815a940 0x7fbb7815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.228+0000 7fbb76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780c9d40 0x7fbb78152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.228+0000 7fbb767fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb780cd890 0x7fbb7815d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37260/0 (socket says 172.21.15.29:37260) 2024-04-15T00:01:56.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.228+0000 7fbb767fc640 1 -- 172.21.15.29:0/3921554709 learned_addr learned my addr 172.21.15.29:0/3921554709 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.232+0000 7fbb777fe640 1 -- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780c9d40 msgr2=0x7fbb78152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.232+0000 7fbb777fe640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780c9d40 0x7fbb78152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.232+0000 7fbb777fe640 1 -- 172.21.15.29:0/3921554709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb780cd890 msgr2=0x7fbb7815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.232+0000 7fbb777fe640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb780cd890 0x7fbb7815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.232+0000 7fbb777fe640 1 -- 172.21.15.29:0/3921554709 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780c5400 con 0x7fbb7815a940 2024-04-15T00:01:56.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.234+0000 7fbb777fe640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb7815a940 0x7fbb7815d750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb7815ea20 tx=0x7fbb7000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.238+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70017070 con 0x7fbb7815a940 2024-04-15T00:01:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.238+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb70005d00 con 0x7fbb7815a940 2024-04-15T00:01:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.238+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb781e5460 con 0x7fbb7815a940 2024-04-15T00:01:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.238+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700072b0 con 0x7fbb7815a940 2024-04-15T00:01:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.238+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7815ca30 con 0x7fbb7815a940 2024-04-15T00:01:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.239+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7804f540 con 0x7fbb7815a940 2024-04-15T00:01:56.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.510+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbb7001a070 con 0x7fbb7815a940 2024-04-15T00:01:56.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.510+0000 7fbb6f7fe640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbb5806b9e0 0x7fbb5806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.510+0000 7fbb76ffd640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbb5806b9e0 0x7fbb5806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.511+0000 7fbb76ffd640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbb5806b9e0 0x7fbb5806dea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036000 tx=0x7fbb68030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:56.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.513+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbb70056600 con 0x7fbb7815a940 2024-04-15T00:01:56.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.524+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbb70021020 con 0x7fbb7815a940 2024-04-15T00:01:56.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.709+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbb780c8fe0 con 0x7fbb7815a940 2024-04-15T00:01:56.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.716+0000 7fbb6f7fe640 1 -- 172.21.15.29:0/3921554709 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fbb70058560 con 0x7fbb7815a940 2024-04-15T00:01:56.721 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-15T00:01:56.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbb5806b9e0 msgr2=0x7fbb5806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbb5806b9e0 0x7fbb5806dea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036000 tx=0x7fbb68030000 comp rx=0 tx=0).stop 2024-04-15T00:01:56.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb7815a940 msgr2=0x7fbb7815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb7815a940 0x7fbb7815d750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb7815ea20 tx=0x7fbb7000c960 comp rx=0 tx=0).stop 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 shutdown_connections 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbb5806b9e0 0x7fbb5806dea0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbb7815a940 0x7fbb7815d750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb780cd890 0x7fbb7815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 --2- 172.21.15.29:0/3921554709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780c9d40 0x7fbb78152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 >> 172.21.15.29:0/3921554709 conn(0x7fbb78061c20 msgr2=0x7fbb780c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 shutdown_connections 2024-04-15T00:01:56.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.717+0000 7fbb7d364640 1 -- 172.21.15.29:0/3921554709 wait complete. 2024-04-15T00:01:56.735 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:01:56.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.835+0000 7f037551e640 1 Processor -- start 2024-04-15T00:01:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.835+0000 7f037551e640 1 -- start start 2024-04-15T00:01:56.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.836+0000 7f037551e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0370143890 0x7f0370070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.836+0000 7f037551e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f037015e3b0 0x7f03700cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.836+0000 7f037551e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037015a5c0 con 0x7f03700ce260 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.836+0000 7f037551e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f0370070ac0 con 0x7f0370143890 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.836+0000 7f037551e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f037015a8a0 con 0x7f037015e3b0 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.837+0000 7f036e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f037015e3b0 0x7f03700cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.837+0000 7f036e7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f037015e3b0 0x7f03700cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:52882/0 (socket says 172.21.15.29:52882) 2024-04-15T00:01:56.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.837+0000 7f036e7fc640 1 -- 172.21.15.29:0/2234857602 learned_addr learned my addr 172.21.15.29:0/2234857602 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:56.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.839+0000 7f036e7fc640 1 -- 172.21.15.29:0/2234857602 >> v2:172.21.15.29:3300/0 conn(0x7f0370143890 msgr2=0x7f0370070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:56.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.839+0000 7f036e7fc640 1 --2- 172.21.15.29:0/2234857602 >> v2:172.21.15.29:3300/0 conn(0x7f0370143890 0x7f0370070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.839+0000 7f036e7fc640 1 -- 172.21.15.29:0/2234857602 >> v1:172.21.15.29:6789/0 conn(0x7f03700ce260 legacy=0x7f03700c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:56.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.839+0000 7f036e7fc640 1 -- 172.21.15.29:0/2234857602 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037015ab80 con 0x7f037015e3b0 2024-04-15T00:01:56.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.842+0000 7f036e7fc640 1 --2- 172.21.15.29:0/2234857602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037015e3b0 0x7f03700cdd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0370073660 tx=0x7f035802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1f29655331a8cf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:56.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f036dffb640 1 -- 172.21.15.29:0/2234857602 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358034070 con 0x7f037015e3b0 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f036dffb640 1 -- 172.21.15.29:0/2234857602 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358030860 con 0x7f037015e3b0 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f036dffb640 1 -- 172.21.15.29:0/2234857602 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358030c30 con 0x7f037015e3b0 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 -- 172.21.15.29:0/2234857602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037015e3b0 msgr2=0x7f03700cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 --2- 172.21.15.29:0/2234857602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037015e3b0 0x7f03700cdd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0370073660 tx=0x7f035802b9a0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 -- 172.21.15.29:0/2234857602 shutdown_connections 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 --2- 172.21.15.29:0/2234857602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f037015e3b0 0x7f03700cdd20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 --2- 172.21.15.29:0/2234857602 >> v2:172.21.15.29:3300/0 conn(0x7f0370143890 0x7f0370070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 -- 172.21.15.29:0/2234857602 >> 172.21.15.29:0/2234857602 conn(0x7f0370061e00 msgr2=0x7f0370062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 -- 172.21.15.29:0/2234857602 shutdown_connections 2024-04-15T00:01:56.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.851+0000 7f037551e640 1 -- 172.21.15.29:0/2234857602 wait complete. 2024-04-15T00:01:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 Processor -- start 2024-04-15T00:01:56.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 -- start start 2024-04-15T00:01:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f03700ce260 0x7f03701588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0370143890 0x7f03701402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 0x7f03701407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f03700c9090 con 0x7f037015e3b0 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f037015b140 con 0x7f0370143890 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.853+0000 7f037551e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f037015e800 con 0x7f03700ce260 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.854+0000 7f036f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 0x7f03701407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.854+0000 7f036e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0370143890 0x7f03701402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.854+0000 7f036effd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f03700ce260 0x7f03701588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.854+0000 7f036f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 0x7f03701407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52746/0 (socket says 172.21.15.29:52746) 2024-04-15T00:01:56.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.854+0000 7f036f7fe640 1 -- 172.21.15.29:0/1949955291 learned_addr learned my addr 172.21.15.29:0/1949955291 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:56.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.858+0000 7f036f7fe640 1 -- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f03700ce260 msgr2=0x7f03701588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.858+0000 7f036f7fe640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f03700ce260 0x7f03701588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.858+0000 7f036f7fe640 1 -- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0370143890 msgr2=0x7f03701402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.858+0000 7f036f7fe640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0370143890 0x7f03701402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:56.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.858+0000 7f036f7fe640 1 -- 172.21.15.29:0/1949955291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03700cd810 con 0x7f037015e3b0 2024-04-15T00:01:56.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.860+0000 7f036f7fe640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 0x7f03701407e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f036000c3c0 tx=0x7f036000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:56.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.863+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360017070 con 0x7f037015e3b0 2024-04-15T00:01:56.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.863+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03600035f0 con 0x7f037015e3b0 2024-04-15T00:01:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.863+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03600039e0 con 0x7f037015e3b0 2024-04-15T00:01:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.863+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0370159140 con 0x7f037015e3b0 2024-04-15T00:01:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.863+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03701f10b0 con 0x7f037015e3b0 2024-04-15T00:01:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:56.864+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037004f540 con 0x7f037015e3b0 2024-04-15T00:01:57.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.130+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f036001a070 con 0x7f037015e3b0 2024-04-15T00:01:57.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.130+0000 7f03677fe640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f035006ba10 0x7f035006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.130+0000 7f036effd640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f035006ba10 0x7f035006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.131+0000 7f036effd640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f035006ba10 0x7f035006ded0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f036800a400 tx=0x7f036800d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:57.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.143+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f03600565a0 con 0x7f037015e3b0 2024-04-15T00:01:57.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.143+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0360021020 con 0x7f037015e3b0 2024-04-15T00:01:57.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.333+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0370154900 con 0x7f037015e3b0 2024-04-15T00:01:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.337+0000 7f03677fe640 1 -- 172.21.15.29:0/1949955291 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f03700cd810 con 0x7f037015e3b0 2024-04-15T00:01:57.343 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.339+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f035006ba10 msgr2=0x7f035006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.339+0000 7f037551e640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f035006ba10 0x7f035006ded0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f036800a400 tx=0x7f036800d040 comp rx=0 tx=0).stop 2024-04-15T00:01:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 msgr2=0x7f03701407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 0x7f03701407e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f036000c3c0 tx=0x7f036000c880 comp rx=0 tx=0).stop 2024-04-15T00:01:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 shutdown_connections 2024-04-15T00:01:57.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f035006ba10 0x7f035006ded0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037015e3b0 0x7f03701407e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0370143890 0x7f03701402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 --2- 172.21.15.29:0/1949955291 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f03700ce260 0x7f03701588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 >> 172.21.15.29:0/1949955291 conn(0x7f0370061e00 msgr2=0x7f03700c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 shutdown_connections 2024-04-15T00:01:57.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.340+0000 7f037551e640 1 -- 172.21.15.29:0/1949955291 wait complete. 2024-04-15T00:01:57.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:01:57.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 Processor -- start 2024-04-15T00:01:57.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 -- start start 2024-04-15T00:01:57.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680cded0 0x7f2668070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2668154070 0x7f26681544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266815a430 con 0x7f26680ce2b0 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f26680707b0 con 0x7f2668154070 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.453+0000 7f266d91e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f266815a6d0 con 0x7f26680cded0 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.454+0000 7f26677fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2668154070 0x7f26681544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.454+0000 7f26667fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26680ce2b0 0x7f266815e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:60624/0 (socket says 172.21.15.29:60624) 2024-04-15T00:01:57.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.454+0000 7f26667fc640 1 -- 172.21.15.29:0/3167442616 learned_addr learned my addr 172.21.15.29:0/3167442616 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:57.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.454+0000 7f2666ffd640 1 --2- 172.21.15.29:0/3167442616 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680cded0 0x7f2668070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.457+0000 7f2665ffb640 1 -- 172.21.15.29:0/3167442616 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152166203 0 0) 0x7f266815a430 con 0x7f26680ce2b0 2024-04-15T00:01:57.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.457+0000 7f2665ffb640 1 -- 172.21.15.29:0/3167442616 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2654003520 con 0x7f26680ce2b0 2024-04-15T00:01:57.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.457+0000 7f26677fe640 1 -- 172.21.15.29:0/3167442616 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680cded0 msgr2=0x7f2668070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:57.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.457+0000 7f26677fe640 1 --2- 172.21.15.29:0/3167442616 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680cded0 0x7f2668070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.457+0000 7f26677fe640 1 -- 172.21.15.29:0/3167442616 >> v1:172.21.15.37:6789/0 conn(0x7f26680ce2b0 legacy=0x7f266815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:57.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.457+0000 7f26677fe640 1 -- 172.21.15.29:0/3167442616 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266815a9b0 con 0x7f2668154070 2024-04-15T00:01:57.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.459+0000 7f26677fe640 1 --2- 172.21.15.29:0/3167442616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2668154070 0x7f26681544f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2658009d90 tx=0x7f265802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf77ed55b73a135 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:57.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f2665ffb640 1 -- 172.21.15.29:0/3167442616 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658039070 con 0x7f2668154070 2024-04-15T00:01:57.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f2665ffb640 1 -- 172.21.15.29:0/3167442616 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265802cc50 con 0x7f2668154070 2024-04-15T00:01:57.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f2665ffb640 1 -- 172.21.15.29:0/3167442616 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658034440 con 0x7f2668154070 2024-04-15T00:01:57.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 -- 172.21.15.29:0/3167442616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2668154070 msgr2=0x7f26681544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 --2- 172.21.15.29:0/3167442616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2668154070 0x7f26681544f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2658009d90 tx=0x7f265802bea0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 -- 172.21.15.29:0/3167442616 shutdown_connections 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 --2- 172.21.15.29:0/3167442616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2668154070 0x7f26681544f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 --2- 172.21.15.29:0/3167442616 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680cded0 0x7f2668070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 -- 172.21.15.29:0/3167442616 >> 172.21.15.29:0/3167442616 conn(0x7f2668061e00 msgr2=0x7f2668062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 -- 172.21.15.29:0/3167442616 shutdown_connections 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.463+0000 7f266d91e640 1 -- 172.21.15.29:0/3167442616 wait complete. 2024-04-15T00:01:57.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.464+0000 7f266d91e640 1 Processor -- start 2024-04-15T00:01:57.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 -- start start 2024-04-15T00:01:57.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26680cded0 0x7f26681f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680ce2b0 0x7f26681efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 0x7f26680c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f266815baa0 con 0x7f26680cded0 2024-04-15T00:01:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f266815af70 con 0x7f2668154070 2024-04-15T00:01:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.465+0000 7f266d91e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f266815bc20 con 0x7f26680ce2b0 2024-04-15T00:01:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.466+0000 7f2666ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26680cded0 0x7f26681f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.466+0000 7f26677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 0x7f26680c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.466+0000 7f26667fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680ce2b0 0x7f26681efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.466+0000 7f2666ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26680cded0 0x7f26681f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52764/0 (socket says 172.21.15.29:52764) 2024-04-15T00:01:57.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.466+0000 7f26677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 0x7f26680c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:52896/0 (socket says 172.21.15.29:52896) 2024-04-15T00:01:57.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.466+0000 7f2666ffd640 1 -- 172.21.15.29:0/659865361 learned_addr learned my addr 172.21.15.29:0/659865361 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.469+0000 7f26677fe640 1 -- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680ce2b0 msgr2=0x7f26681efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.469+0000 7f26677fe640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680ce2b0 0x7f26681efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.469+0000 7f26677fe640 1 -- 172.21.15.29:0/659865361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26680cded0 msgr2=0x7f26681f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:57.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.469+0000 7f26677fe640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26680cded0 0x7f26681f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:57.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.470+0000 7f26677fe640 1 -- 172.21.15.29:0/659865361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26680c78b0 con 0x7f2668154070 2024-04-15T00:01:57.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.472+0000 7f26677fe640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 0x7f26680c3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f26680cea40 tx=0x7f2658004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.476+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658044020 con 0x7f2668154070 2024-04-15T00:01:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.476+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265802ca50 con 0x7f2668154070 2024-04-15T00:01:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.476+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658039040 con 0x7f2668154070 2024-04-15T00:01:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.476+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26680c7b90 con 0x7f2668154070 2024-04-15T00:01:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.476+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26681f35d0 con 0x7f2668154070 2024-04-15T00:01:57.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.476+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266804f540 con 0x7f2668154070 2024-04-15T00:01:57.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.753+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2658047020 con 0x7f2668154070 2024-04-15T00:01:57.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.753+0000 7f265ffff640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f264806b9e0 0x7f264806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:57.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.753+0000 7f2666ffd640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f264806b9e0 0x7f264806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:57.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.754+0000 7f2666ffd640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f264806b9e0 0x7f264806dea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2660009c00 tx=0x7f2660009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:57.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.757+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f265802cc00 con 0x7f2668154070 2024-04-15T00:01:57.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.768+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f265804e030 con 0x7f2668154070 2024-04-15T00:01:58.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:57.994+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f266814e360 con 0x7f2668154070 2024-04-15T00:01:58.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.026+0000 7f265ffff640 1 -- 172.21.15.29:0/659865361 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6912 (secure 0 0 0) 0x7f265807b890 con 0x7f2668154070 2024-04-15T00:01:58.031 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:58.031 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:50.947697+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4275,"mds_1":4272,"mds_2":4266,"mds_3":4258,"mds_4":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4266":{"gid":4266,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4272":{"gid":4272,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4246,4272,4258,4266,4275]},"id":1}]} 2024-04-15T00:01:58.032 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-15T00:01:58.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f264806b9e0 msgr2=0x7f264806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f264806b9e0 0x7f264806dea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2660009c00 tx=0x7f2660009190 comp rx=0 tx=0).stop 2024-04-15T00:01:58.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 msgr2=0x7f26680c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 0x7f26680c3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f26680cea40 tx=0x7f2658004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:58.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 shutdown_connections 2024-04-15T00:01:58.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f264806b9e0 0x7f264806dea0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2668154070 0x7f26680c3770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f26680ce2b0 0x7f26681efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 --2- 172.21.15.29:0/659865361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26680cded0 0x7f26681f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 >> 172.21.15.29:0/659865361 conn(0x7f2668061e00 msgr2=0x7f266814ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 shutdown_connections 2024-04-15T00:01:58.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.027+0000 7f266d91e640 1 -- 172.21.15.29:0/659865361 wait complete. 2024-04-15T00:01:58.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:01:58.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 Processor -- start 2024-04-15T00:01:58.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 -- start start 2024-04-15T00:01:58.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 0x7f3bf015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf0070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bf00709b0 0x7f3bf00c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf015e5b0 con 0x7f3bf00709b0 2024-04-15T00:01:58.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf015d750 con 0x7f3bf00cdc80 2024-04-15T00:01:58.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf71ed640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf015d9a0 con 0x7f3bf00ce060 2024-04-15T00:01:58.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf578a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bf00709b0 0x7f3bf00c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3bf4f89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 0x7f3bf015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.143+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.144+0000 7f3bf4f89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 0x7f3bf015ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:52902/0 (socket says 172.21.15.29:52902) 2024-04-15T00:01:58.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.144+0000 7f3bf4f89640 1 -- 172.21.15.29:0/281038389 learned_addr learned my addr 172.21.15.29:0/281038389 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3be7fff640 1 -- 172.21.15.29:0/281038389 >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 msgr2=0x7f3bf015ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3be7fff640 1 --2- 172.21.15.29:0/281038389 >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 0x7f3bf015ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3be7fff640 1 -- 172.21.15.29:0/281038389 >> v2:172.21.15.29:3300/0 conn(0x7f3bf00709b0 msgr2=0x7f3bf00c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3be7fff640 1 --2- 172.21.15.29:0/281038389 >> v2:172.21.15.29:3300/0 conn(0x7f3bf00709b0 0x7f3bf00c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3be7fff640 1 -- 172.21.15.29:0/281038389 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf015dc80 con 0x7f3bf00ce060 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3bf4f89640 1 --2- 172.21.15.29:0/281038389 >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 0x7f3bf015ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:58.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.147+0000 7f3bf578a640 1 --2- 172.21.15.29:0/281038389 >> v2:172.21.15.29:3300/0 conn(0x7f3bf00709b0 0x7f3bf00c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:01:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.148+0000 7f3be7fff640 1 --2- 172.21.15.29:0/281038389 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf0070470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0070190 tx=0x7f3be002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b285ffc82cc5f2f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:58.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3be77fe640 1 -- 172.21.15.29:0/281038389 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be00315a0 con 0x7f3bf00ce060 2024-04-15T00:01:58.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3be77fe640 1 -- 172.21.15.29:0/281038389 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be0037070 con 0x7f3bf00ce060 2024-04-15T00:01:58.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3be77fe640 1 -- 172.21.15.29:0/281038389 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0031960 con 0x7f3bf00ce060 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 -- 172.21.15.29:0/281038389 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 msgr2=0x7f3bf0070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/281038389 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf0070470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0070190 tx=0x7f3be002b840 comp rx=0 tx=0).stop 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 -- 172.21.15.29:0/281038389 shutdown_connections 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/281038389 >> v2:172.21.15.29:3300/0 conn(0x7f3bf00709b0 0x7f3bf00c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/281038389 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf0070470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/281038389 >> v2:172.21.15.37:3300/0 conn(0x7f3bf00cdc80 0x7f3bf015ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 -- 172.21.15.29:0/281038389 >> 172.21.15.29:0/281038389 conn(0x7f3bf0061e00 msgr2=0x7f3bf0062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 -- 172.21.15.29:0/281038389 shutdown_connections 2024-04-15T00:01:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.153+0000 7f3bf71ed640 1 -- 172.21.15.29:0/281038389 wait complete. 2024-04-15T00:01:58.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.154+0000 7f3bf71ed640 1 Processor -- start 2024-04-15T00:01:58.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.154+0000 7f3bf71ed640 1 -- start start 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.154+0000 7f3bf71ed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 0x7f3bf01f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.154+0000 7f3bf71ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf00cdc80 0x7f3bf0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf71ed640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf00adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf71ed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf00ce4a0 con 0x7f3bf00709b0 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf71ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf015e240 con 0x7f3bf00cdc80 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf71ed640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf01544e0 con 0x7f3bf00ce060 2024-04-15T00:01:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf4f89640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 0x7f3bf01f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf578a640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf00adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3be7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf00cdc80 0x7f3bf0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf4f89640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 0x7f3bf01f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52774/0 (socket says 172.21.15.29:52774) 2024-04-15T00:01:58.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.155+0000 7f3bf4f89640 1 -- 172.21.15.29:0/1961650855 learned_addr learned my addr 172.21.15.29:0/1961650855 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.160+0000 7f3bf4f89640 1 -- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 msgr2=0x7f3bf00adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.160+0000 7f3bf4f89640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf00adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.160+0000 7f3bf4f89640 1 -- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf00cdc80 msgr2=0x7f3bf0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.160+0000 7f3bf4f89640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf00cdc80 0x7f3bf0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.160+0000 7f3bf4f89640 1 -- 172.21.15.29:0/1961650855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf01f0160 con 0x7f3bf00709b0 2024-04-15T00:01:58.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.162+0000 7f3bf4f89640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 0x7f3bf01f3ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00e9b0 tx=0x7f3bec00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.166+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec017070 con 0x7f3bf00709b0 2024-04-15T00:01:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.166+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec00c940 con 0x7f3bf00709b0 2024-04-15T00:01:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.166+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00ccf0 con 0x7f3bf00709b0 2024-04-15T00:01:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.166+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf01f0420 con 0x7f3bf00709b0 2024-04-15T00:01:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.166+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf01f09e0 con 0x7f3bf00709b0 2024-04-15T00:01:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.166+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf004f540 con 0x7f3bf00709b0 2024-04-15T00:01:58.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.186+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3bec01a070 con 0x7f3bf00709b0 2024-04-15T00:01:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.186+0000 7f3be57fa640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3bdc06b990 0x7f3bdc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.186+0000 7f3be7fff640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3bdc06b990 0x7f3bdc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.187+0000 7f3be7fff640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3bdc06b990 0x7f3bdc06de50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3be0036000 tx=0x7f3be003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:58.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.445+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3bec057450 con 0x7f3bf00709b0 2024-04-15T00:01:58.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.445+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3bec0593b0 con 0x7f3bf00709b0 2024-04-15T00:01:58.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.635+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bf00c8530 con 0x7f3bf00709b0 2024-04-15T00:01:58.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.677+0000 7f3be57fa640 1 -- 172.21.15.29:0/1961650855 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7f3bec05d450 con 0x7f3bf00709b0 2024-04-15T00:01:58.683 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:01:58.683 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:01:58.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3bdc06b990 msgr2=0x7f3bdc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3bdc06b990 0x7f3bdc06de50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3be0036000 tx=0x7f3be003d040 comp rx=0 tx=0).stop 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 msgr2=0x7f3bf01f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 0x7f3bf01f3ef0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00e9b0 tx=0x7f3bec00edb0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 shutdown_connections 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f3bdc06b990 0x7f3bdc06de50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f3bf00ce060 0x7f3bf00adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf00cdc80 0x7f3bf0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 --2- 172.21.15.29:0/1961650855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bf00709b0 0x7f3bf01f3ef0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 >> 172.21.15.29:0/1961650855 conn(0x7f3bf0061e00 msgr2=0x7f3bf00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 shutdown_connections 2024-04-15T00:01:58.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.679+0000 7f3bf71ed640 1 -- 172.21.15.29:0/1961650855 wait complete. 2024-04-15T00:01:58.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:01:09.779176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:01:11.503018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:01:16.720777+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T00:01:58.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T00:01:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.796+0000 7f49f077b640 1 Processor -- start 2024-04-15T00:01:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.797+0000 7f49f077b640 1 -- start start 2024-04-15T00:01:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.797+0000 7f49f077b640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f49e8151440 0x7f49e80c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.797+0000 7f49f077b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e80c37e0 con 0x7f49e80c3200 2024-04-15T00:01:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.797+0000 7f49f077b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e80c51d0 con 0x7f49e80c8bf0 2024-04-15T00:01:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.797+0000 7f49f077b640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f49e80c4f80 con 0x7f49e8151440 2024-04-15T00:01:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.798+0000 7f49ee517640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f49e8151440 0x7f49e80c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.798+0000 7f49ee517640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f49e8151440 0x7f49e80c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52788/0 (socket says 172.21.15.29:52788) 2024-04-15T00:01:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.798+0000 7f49ee517640 1 -- 172.21.15.29:0/4234312238 learned_addr learned my addr 172.21.15.29:0/4234312238 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:58.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.801+0000 7f49ee517640 1 -- 172.21.15.29:0/4234312238 >> v1:172.21.15.37:6789/0 conn(0x7f49e80c8bf0 legacy=0x7f49e80c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.801+0000 7f49ee517640 1 -- 172.21.15.29:0/4234312238 >> v1:172.21.15.29:6789/0 conn(0x7f49e80c3200 legacy=0x7f49e80cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.801+0000 7f49ee517640 1 -- 172.21.15.29:0/4234312238 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e80c54b0 con 0x7f49e8151440 2024-04-15T00:01:58.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.806+0000 7f49ee517640 1 --2- 172.21.15.29:0/4234312238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e8151440 0x7f49e80c2cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49e80c5100 tx=0x7f49dc02bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20e637ad5137663 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:58.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.809+0000 7f49ed515640 1 -- 172.21.15.29:0/4234312238 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc02cb80 con 0x7f49e8151440 2024-04-15T00:01:58.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49ed515640 1 -- 172.21.15.29:0/4234312238 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc02cd20 con 0x7f49e8151440 2024-04-15T00:01:58.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49ed515640 1 -- 172.21.15.29:0/4234312238 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc034610 con 0x7f49e8151440 2024-04-15T00:01:58.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 -- 172.21.15.29:0/4234312238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e8151440 msgr2=0x7f49e80c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 --2- 172.21.15.29:0/4234312238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e8151440 0x7f49e80c2cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49e80c5100 tx=0x7f49dc02bfe0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 -- 172.21.15.29:0/4234312238 shutdown_connections 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 --2- 172.21.15.29:0/4234312238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e8151440 0x7f49e80c2cc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 -- 172.21.15.29:0/4234312238 >> 172.21.15.29:0/4234312238 conn(0x7f49e806f100 msgr2=0x7f49e806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 -- 172.21.15.29:0/4234312238 shutdown_connections 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.810+0000 7f49f077b640 1 -- 172.21.15.29:0/4234312238 wait complete. 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.811+0000 7f49f077b640 1 Processor -- start 2024-04-15T00:01:58.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 -- start start 2024-04-15T00:01:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 0x7f49e81e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f49e80c8bf0 0x7f49e80c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8151440 0x7f49e814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f49e80c7b60 con 0x7f49e80c3200 2024-04-15T00:01:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49e80c79e0 con 0x7f49e8151440 2024-04-15T00:01:58.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.812+0000 7f49f077b640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f49e80cbf20 con 0x7f49e80c8bf0 2024-04-15T00:01:58.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.813+0000 7f49ee517640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 0x7f49e81e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.813+0000 7f49edd16640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f49e80c8bf0 0x7f49e80c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:58.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.813+0000 7f49ee517640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 0x7f49e81e6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52804/0 (socket says 172.21.15.29:52804) 2024-04-15T00:01:58.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.813+0000 7f49ee517640 1 -- 172.21.15.29:0/1816644316 learned_addr learned my addr 172.21.15.29:0/1816644316 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:58.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.816+0000 7f49ee517640 1 -- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f49e80c8bf0 msgr2=0x7f49e80c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.816+0000 7f49ee517640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f49e80c8bf0 0x7f49e80c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.816+0000 7f49ee517640 1 -- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8151440 msgr2=0x7f49e814be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:58.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.816+0000 7f49ee517640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8151440 0x7f49e814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:58.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.816+0000 7f49ee517640 1 -- 172.21.15.29:0/1816644316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e81e45d0 con 0x7f49e80c3200 2024-04-15T00:01:58.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.819+0000 7f49ee517640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 0x7f49e81e6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49dc000f80 tx=0x7f49dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.822+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc043020 con 0x7f49e80c3200 2024-04-15T00:01:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.822+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc03e450 con 0x7f49e80c3200 2024-04-15T00:01:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.822+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc03e820 con 0x7f49e80c3200 2024-04-15T00:01:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.822+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e8158140 con 0x7f49e80c3200 2024-04-15T00:01:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.823+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e81e4b50 con 0x7f49e80c3200 2024-04-15T00:01:58.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:58.824+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e804f540 con 0x7f49e80c3200 2024-04-15T00:01:59.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.094+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f49dc005d10 con 0x7f49e80c3200 2024-04-15T00:01:59.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.094+0000 7f49daffd640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f49cc06b9e0 0x7f49cc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.094+0000 7f49edd16640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f49cc06b9e0 0x7f49cc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.095+0000 7f49edd16640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f49cc06b9e0 0x7f49cc06dea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49e8157e80 tx=0x7f49e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:59.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.109+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f49dc07a300 con 0x7f49e80c3200 2024-04-15T00:01:59.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.109+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f49dc07c960 con 0x7f49e80c3200 2024-04-15T00:01:59.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.290+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49e80727d0 con 0x7f49e80c3200 2024-04-15T00:01:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.295+0000 7f49daffd640 1 -- 172.21.15.29:0/1816644316 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f49dc07c260 con 0x7f49e80c3200 2024-04-15T00:01:59.301 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.297+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f49cc06b9e0 msgr2=0x7f49cc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f49cc06b9e0 0x7f49cc06dea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49e8157e80 tx=0x7f49e4009040 comp rx=0 tx=0).stop 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 msgr2=0x7f49e81e6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 0x7f49e81e6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49dc000f80 tx=0x7f49dc004a40 comp rx=0 tx=0).stop 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 shutdown_connections 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f49cc06b9e0 0x7f49cc06dea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8151440 0x7f49e814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f49e80c8bf0 0x7f49e80c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 --2- 172.21.15.29:0/1816644316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49e80c3200 0x7f49e81e6190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 >> 172.21.15.29:0/1816644316 conn(0x7f49e806f100 msgr2=0x7f49e80c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 shutdown_connections 2024-04-15T00:01:59.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.298+0000 7f49f077b640 1 -- 172.21.15.29:0/1816644316 wait complete. 2024-04-15T00:01:59.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T00:01:59.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.413+0000 7f342f876640 1 Processor -- start 2024-04-15T00:01:59.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.413+0000 7f342f876640 1 -- start start 2024-04-15T00:01:59.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.414+0000 7f342f876640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34281523f0 0x7f3428071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.414+0000 7f342f876640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.414+0000 7f342f876640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34281584f0 con 0x7f3428152010 2024-04-15T00:01:59.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.414+0000 7f342f876640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f34281587b0 con 0x7f34281523f0 2024-04-15T00:01:59.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.414+0000 7f342f876640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f3428158a90 con 0x7f34280c36a0 2024-04-15T00:01:59.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.415+0000 7f342ce11640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34281523f0 0x7f3428071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.415+0000 7f342de13640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.415+0000 7f342d612640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3428152010 0x7f34280cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50124/0 (socket says 172.21.15.29:50124) 2024-04-15T00:01:59.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.415+0000 7f342d612640 1 -- 172.21.15.29:0/2703695637 learned_addr learned my addr 172.21.15.29:0/2703695637 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:01:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.417+0000 7f342de13640 1 -- 172.21.15.29:0/2703695637 >> v2:172.21.15.29:3300/0 conn(0x7f34281523f0 msgr2=0x7f3428071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:01:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.417+0000 7f342de13640 1 --2- 172.21.15.29:0/2703695637 >> v2:172.21.15.29:3300/0 conn(0x7f34281523f0 0x7f3428071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.417+0000 7f342de13640 1 -- 172.21.15.29:0/2703695637 >> v1:172.21.15.29:6789/0 conn(0x7f3428152010 legacy=0x7f34280cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.417+0000 7f342de13640 1 -- 172.21.15.29:0/2703695637 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3428158d70 con 0x7f34280c36a0 2024-04-15T00:01:59.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.419+0000 7f342de13640 1 --2- 172.21.15.29:0/2703695637 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428071680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3418009d90 tx=0x7f341802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d8efe3e1785d6f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:59.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f3427fff640 1 -- 172.21.15.29:0/2703695637 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418039070 con 0x7f34280c36a0 2024-04-15T00:01:59.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f3427fff640 1 -- 172.21.15.29:0/2703695637 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341802cce0 con 0x7f34280c36a0 2024-04-15T00:01:59.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f3427fff640 1 -- 172.21.15.29:0/2703695637 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418034660 con 0x7f34280c36a0 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f342f876640 1 -- 172.21.15.29:0/2703695637 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 msgr2=0x7f3428071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f342f876640 1 --2- 172.21.15.29:0/2703695637 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428071680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3418009d90 tx=0x7f341802bf30 comp rx=0 tx=0).stop 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f342f876640 1 -- 172.21.15.29:0/2703695637 shutdown_connections 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f342f876640 1 --2- 172.21.15.29:0/2703695637 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428071680 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f342f876640 1 --2- 172.21.15.29:0/2703695637 >> v2:172.21.15.29:3300/0 conn(0x7f34281523f0 0x7f3428071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.423+0000 7f342f876640 1 -- 172.21.15.29:0/2703695637 >> 172.21.15.29:0/2703695637 conn(0x7f34280707d0 msgr2=0x7f342806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.424+0000 7f342f876640 1 -- 172.21.15.29:0/2703695637 shutdown_connections 2024-04-15T00:01:59.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.424+0000 7f342f876640 1 -- 172.21.15.29:0/2703695637 wait complete. 2024-04-15T00:01:59.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 Processor -- start 2024-04-15T00:01:59.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 -- start start 2024-04-15T00:01:59.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 0x7f3428143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34281523f0 0x7f34280cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3428158140 con 0x7f3428152010 2024-04-15T00:01:59.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f342815b7d0 con 0x7f34281523f0 2024-04-15T00:01:59.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.425+0000 7f342f876640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f34280cbf80 con 0x7f34280c36a0 2024-04-15T00:01:59.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.426+0000 7f342ce11640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 0x7f3428143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.426+0000 7f342d612640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.426+0000 7f342de13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34281523f0 0x7f34280cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.426+0000 7f342ce11640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 0x7f3428143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52832/0 (socket says 172.21.15.29:52832) 2024-04-15T00:01:59.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.426+0000 7f342ce11640 1 -- 172.21.15.29:0/1242557165 learned_addr learned my addr 172.21.15.29:0/1242557165 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:01:59.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.430+0000 7f342ce11640 1 -- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 msgr2=0x7f3428143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.430+0000 7f342ce11640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.430+0000 7f342ce11640 1 -- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34281523f0 msgr2=0x7f34280cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.430+0000 7f342ce11640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34281523f0 0x7f34280cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.430+0000 7f342ce11640 1 -- 172.21.15.29:0/1242557165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34280ce7c0 con 0x7f3428152010 2024-04-15T00:01:59.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.432+0000 7f342ce11640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 0x7f3428143d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f341c00e870 tx=0x7f341c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.435+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c017070 con 0x7f3428152010 2024-04-15T00:01:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.435+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341c00ee60 con 0x7f3428152010 2024-04-15T00:01:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.436+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c00cae0 con 0x7f3428152010 2024-04-15T00:01:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.436+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3428144f20 con 0x7f3428152010 2024-04-15T00:01:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.436+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34280cb930 con 0x7f3428152010 2024-04-15T00:01:59.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.437+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342804f540 con 0x7f3428152010 2024-04-15T00:01:59.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.703+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f341c01a070 con 0x7f3428152010 2024-04-15T00:01:59.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.703+0000 7f3425ffb640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f341406b9e0 0x7f341406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:01:59.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.704+0000 7f342d612640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f341406b9e0 0x7f341406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:01:59.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.704+0000 7f342d612640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f341406b9e0 0x7f341406dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3420007fd0 tx=0x7f3420007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:01:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.717+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f341c057570 con 0x7f3428152010 2024-04-15T00:01:59.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.717+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f341c0594d0 con 0x7f3428152010 2024-04-15T00:01:59.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.903+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f34280c8a10 con 0x7f3428152010 2024-04-15T00:01:59.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.908+0000 7f3425ffb640 1 -- 172.21.15.29:0/1242557165 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f341c05d570 con 0x7f3428152010 2024-04-15T00:01:59.913 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:01:59.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f341406b9e0 msgr2=0x7f341406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f341406b9e0 0x7f341406dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3420007fd0 tx=0x7f3420007e80 comp rx=0 tx=0).stop 2024-04-15T00:01:59.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 msgr2=0x7f3428143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:01:59.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 0x7f3428143d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f341c00e870 tx=0x7f341c00ed30 comp rx=0 tx=0).stop 2024-04-15T00:01:59.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 shutdown_connections 2024-04-15T00:01:59.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f341406b9e0 0x7f341406dea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34281523f0 0x7f34280cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3428152010 0x7f3428143d70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 --2- 172.21.15.29:0/1242557165 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f34280c36a0 0x7f3428143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:01:59.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 >> 172.21.15.29:0/1242557165 conn(0x7f34280707d0 msgr2=0x7f3428071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:01:59.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 shutdown_connections 2024-04-15T00:01:59.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:01:59.911+0000 7f342f876640 1 -- 172.21.15.29:0/1242557165 wait complete. 2024-04-15T00:01:59.927 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T00:02:00.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.027+0000 7ff310e0f640 1 Processor -- start 2024-04-15T00:02:00.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.027+0000 7ff310e0f640 1 -- start start 2024-04-15T00:02:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.028+0000 7ff310e0f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff30c0c8d60 0x7ff30c071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.028+0000 7ff310e0f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c158f50 con 0x7ff30c071a50 2024-04-15T00:02:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.028+0000 7ff310e0f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c0c1f20 con 0x7ff30c0c1b40 2024-04-15T00:02:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.028+0000 7ff310e0f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c0c91c0 con 0x7ff30c0c8d60 2024-04-15T00:02:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.029+0000 7ff30ad9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff30c071a50 0x7ff30c0c64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50128/0 (socket says 172.21.15.29:50128) 2024-04-15T00:02:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.029+0000 7ff30ad9d640 1 -- 172.21.15.29:0/2250238 learned_addr learned my addr 172.21.15.29:0/2250238 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:02:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.029+0000 7ff309d9b640 1 --2- 172.21.15.29:0/2250238 >> v2:172.21.15.37:3300/0 conn(0x7ff30c0c8d60 0x7ff30c071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.031+0000 7ff30959a640 1 -- 172.21.15.29:0/2250238 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907704525 0 0) 0x7ff30c158f50 con 0x7ff30c071a50 2024-04-15T00:02:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.031+0000 7ff30959a640 1 -- 172.21.15.29:0/2250238 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f4003520 con 0x7ff30c071a50 2024-04-15T00:02:00.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.033+0000 7ff309d9b640 1 -- 172.21.15.29:0/2250238 >> v1:172.21.15.37:6789/0 conn(0x7ff30c0c1b40 legacy=0x7ff30c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.033+0000 7ff309d9b640 1 -- 172.21.15.29:0/2250238 >> v1:172.21.15.29:6789/0 conn(0x7ff30c071a50 legacy=0x7ff30c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.033+0000 7ff309d9b640 1 -- 172.21.15.29:0/2250238 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c072030 con 0x7ff30c0c8d60 2024-04-15T00:02:00.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.038+0000 7ff309d9b640 1 --2- 172.21.15.29:0/2250238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c8d60 0x7ff30c071510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff3000097a0 tx=0x7ff30002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491df107f50015e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:00.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.041+0000 7ff30959a640 1 -- 172.21.15.29:0/2250238 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300034070 con 0x7ff30c0c8d60 2024-04-15T00:02:00.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.041+0000 7ff30959a640 1 -- 172.21.15.29:0/2250238 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff300030610 con 0x7ff30c0c8d60 2024-04-15T00:02:00.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.041+0000 7ff30959a640 1 -- 172.21.15.29:0/2250238 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000309e0 con 0x7ff30c0c8d60 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 -- 172.21.15.29:0/2250238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c8d60 msgr2=0x7ff30c071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 --2- 172.21.15.29:0/2250238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c8d60 0x7ff30c071510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff3000097a0 tx=0x7ff30002b960 comp rx=0 tx=0).stop 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 -- 172.21.15.29:0/2250238 shutdown_connections 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 --2- 172.21.15.29:0/2250238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c8d60 0x7ff30c071510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 -- 172.21.15.29:0/2250238 >> 172.21.15.29:0/2250238 conn(0x7ff30c06f100 msgr2=0x7ff30c06f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 -- 172.21.15.29:0/2250238 shutdown_connections 2024-04-15T00:02:00.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.042+0000 7ff310e0f640 1 -- 172.21.15.29:0/2250238 wait complete. 2024-04-15T00:02:00.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.043+0000 7ff310e0f640 1 Processor -- start 2024-04-15T00:02:00.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.043+0000 7ff310e0f640 1 -- start start 2024-04-15T00:02:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff310e0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 0x7ff30c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff310e0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c1b40 0x7ff30c14d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff310e0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff30c0c8d60 0x7ff30c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff310e0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c158470 con 0x7ff30c071a50 2024-04-15T00:02:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff310e0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c072310 con 0x7ff30c0c1b40 2024-04-15T00:02:00.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff310e0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c158750 con 0x7ff30c0c8d60 2024-04-15T00:02:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff30a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 0x7ff30c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff309d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c1b40 0x7ff30c14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.044+0000 7ff30ad9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff30c0c8d60 0x7ff30c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.045+0000 7ff30a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 0x7ff30c14cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52840/0 (socket says 172.21.15.29:52840) 2024-04-15T00:02:00.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.045+0000 7ff30a59c640 1 -- 172.21.15.29:0/495061552 learned_addr learned my addr 172.21.15.29:0/495061552 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:00.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.048+0000 7ff30a59c640 1 -- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff30c0c8d60 msgr2=0x7ff30c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.048+0000 7ff30a59c640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff30c0c8d60 0x7ff30c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.048+0000 7ff30a59c640 1 -- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c1b40 msgr2=0x7ff30c14d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.048+0000 7ff30a59c640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c1b40 0x7ff30c14d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.048+0000 7ff30a59c640 1 -- 172.21.15.29:0/495061552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c0cb830 con 0x7ff30c071a50 2024-04-15T00:02:00.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.050+0000 7ff30a59c640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 0x7ff30c14cbc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c400 tx=0x7ff2fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:00.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.054+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0052d0 con 0x7ff30c071a50 2024-04-15T00:02:00.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.054+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2fc005490 con 0x7ff30c071a50 2024-04-15T00:02:00.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.054+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc007260 con 0x7ff30c071a50 2024-04-15T00:02:00.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.054+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c0cbfc0 con 0x7ff30c071a50 2024-04-15T00:02:00.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.054+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c15bbe0 con 0x7ff30c071a50 2024-04-15T00:02:00.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.055+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c04f540 con 0x7ff30c071a50 2024-04-15T00:02:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.074+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff2fc007400 con 0x7ff30c071a50 2024-04-15T00:02:00.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.074+0000 7ff2faffd640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff2ec06ba10 0x7ff2ec06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.074+0000 7ff309d9b640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff2ec06ba10 0x7ff2ec06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.075+0000 7ff309d9b640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff2ec06ba10 0x7ff2ec06ded0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff300036000 tx=0x7ff30003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:00.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.077+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff2fc056b90 con 0x7ff30c071a50 2024-04-15T00:02:00.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.338+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff2fc058af0 con 0x7ff30c071a50 2024-04-15T00:02:00.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.525+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff30c0c8910 con 0x7ff30c071a50 2024-04-15T00:02:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.530+0000 7ff2faffd640 1 -- 172.21.15.29:0/495061552 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7ff2fc05cb90 con 0x7ff30c071a50 2024-04-15T00:02:00.535 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff2ec06ba10 msgr2=0x7ff2ec06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff2ec06ba10 0x7ff2ec06ded0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff300036000 tx=0x7ff30003b040 comp rx=0 tx=0).stop 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 msgr2=0x7ff30c14cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 0x7ff30c14cbc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c400 tx=0x7ff2fc00c8c0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 shutdown_connections 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff2ec06ba10 0x7ff2ec06ded0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff30c0c8d60 0x7ff30c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff30c0c1b40 0x7ff30c14d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 --2- 172.21.15.29:0/495061552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff30c071a50 0x7ff30c14cbc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 >> 172.21.15.29:0/495061552 conn(0x7ff30c06f100 msgr2=0x7ff30c1e6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:00.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 shutdown_connections 2024-04-15T00:02:00.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.532+0000 7ff310e0f640 1 -- 172.21.15.29:0/495061552 wait complete. 2024-04-15T00:02:00.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T00:02:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.649+0000 7fe8d6484640 1 Processor -- start 2024-04-15T00:02:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.649+0000 7fe8d6484640 1 -- start start 2024-04-15T00:02:00.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.649+0000 7fe8d6484640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.649+0000 7fe8d6484640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8d00c8420 0x7fe8d00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.649+0000 7fe8d6484640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8d00ce220 0x7fe8d00c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8d6484640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d006c310 con 0x7fe8d00ce220 2024-04-15T00:02:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8d6484640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d006d170 con 0x7fe8d00c8420 2024-04-15T00:02:00.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8d6484640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d006c560 con 0x7fe8d01436e0 2024-04-15T00:02:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8d4a21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8d00ce220 0x7fe8d00c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8cf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8d00c8420 0x7fe8d00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8d4a21640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8d00ce220 0x7fe8d00c2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52852/0 (socket says 172.21.15.29:52852) 2024-04-15T00:02:00.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.650+0000 7fe8d4a21640 1 -- 172.21.15.29:0/1704576222 learned_addr learned my addr 172.21.15.29:0/1704576222 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.653+0000 7fe8d4a21640 1 -- 172.21.15.29:0/1704576222 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 msgr2=0x7fe8d015ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.653+0000 7fe8d4a21640 1 --2- 172.21.15.29:0/1704576222 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d015ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.653+0000 7fe8d4a21640 1 -- 172.21.15.29:0/1704576222 >> v2:172.21.15.37:3300/0 conn(0x7fe8d00c8420 msgr2=0x7fe8d00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.653+0000 7fe8d4a21640 1 --2- 172.21.15.29:0/1704576222 >> v2:172.21.15.37:3300/0 conn(0x7fe8d00c8420 0x7fe8d00cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.653+0000 7fe8d4a21640 1 -- 172.21.15.29:0/1704576222 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d006c840 con 0x7fe8d00ce220 2024-04-15T00:02:00.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.653+0000 7fe8cf7fe640 1 --2- 172.21.15.29:0/1704576222 >> v2:172.21.15.37:3300/0 conn(0x7fe8d00c8420 0x7fe8d00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:02:00.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.655+0000 7fe8d4a21640 1 --2- 172.21.15.29:0/1704576222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00ce220 0x7fe8d00c2fd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00ce7c0 tx=0x7fe8c802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa3b9e48d766ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:00.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8ceffd640 1 -- 172.21.15.29:0/1704576222 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c802c9e0 con 0x7fe8d00ce220 2024-04-15T00:02:00.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8ceffd640 1 -- 172.21.15.29:0/1704576222 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c802cb80 con 0x7fe8d00ce220 2024-04-15T00:02:00.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8ceffd640 1 -- 172.21.15.29:0/1704576222 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80343f0 con 0x7fe8d00ce220 2024-04-15T00:02:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 -- 172.21.15.29:0/1704576222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00ce220 msgr2=0x7fe8d00c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 --2- 172.21.15.29:0/1704576222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00ce220 0x7fe8d00c2fd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00ce7c0 tx=0x7fe8c802be40 comp rx=0 tx=0).stop 2024-04-15T00:02:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 -- 172.21.15.29:0/1704576222 shutdown_connections 2024-04-15T00:02:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 --2- 172.21.15.29:0/1704576222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00ce220 0x7fe8d00c2fd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 --2- 172.21.15.29:0/1704576222 >> v2:172.21.15.37:3300/0 conn(0x7fe8d00c8420 0x7fe8d00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 --2- 172.21.15.29:0/1704576222 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d015ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 -- 172.21.15.29:0/1704576222 >> 172.21.15.29:0/1704576222 conn(0x7fe8d0061e00 msgr2=0x7fe8d0062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 -- 172.21.15.29:0/1704576222 shutdown_connections 2024-04-15T00:02:00.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.659+0000 7fe8d6484640 1 -- 172.21.15.29:0/1704576222 wait complete. 2024-04-15T00:02:00.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.661+0000 7fe8d6484640 1 Processor -- start 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.661+0000 7fe8d6484640 1 -- start start 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d6484640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 0x7fe8d01f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d6484640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d00ce220 0x7fe8d0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d6484640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d6484640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0143ac0 con 0x7fe8d00c8420 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d6484640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d006ce00 con 0x7fe8d00ce220 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d6484640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d00c8860 con 0x7fe8d01436e0 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 0x7fe8d01f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d00ce220 0x7fe8d0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.662+0000 7fe8d4a21640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.663+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 0x7fe8d01f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52854/0 (socket says 172.21.15.29:52854) 2024-04-15T00:02:00.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.663+0000 7fe8cffff640 1 -- 172.21.15.29:0/914269902 learned_addr learned my addr 172.21.15.29:0/914269902 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.666+0000 7fe8cffff640 1 -- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 msgr2=0x7fe8d00c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.666+0000 7fe8cffff640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d00c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.666+0000 7fe8cffff640 1 -- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d00ce220 msgr2=0x7fe8d0154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.666+0000 7fe8cffff640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d00ce220 0x7fe8d0154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.666+0000 7fe8cffff640 1 -- 172.21.15.29:0/914269902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d0156fc0 con 0x7fe8d00c8420 2024-04-15T00:02:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.668+0000 7fe8cffff640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 0x7fe8d01f0d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000e870 tx=0x7fe8c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.672+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0017070 con 0x7fe8d00c8420 2024-04-15T00:02:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.672+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c000c940 con 0x7fe8d00c8420 2024-04-15T00:02:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.672+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000cd30 con 0x7fe8d00c8420 2024-04-15T00:02:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.672+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d01572a0 con 0x7fe8d00c8420 2024-04-15T00:02:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.672+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d00c8e40 con 0x7fe8d00c8420 2024-04-15T00:02:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.673+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d0072140 con 0x7fe8d00c8420 2024-04-15T00:02:00.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.940+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe8c001a070 con 0x7fe8d00c8420 2024-04-15T00:02:00.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.940+0000 7fe8ccff9640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe8bc06ba10 0x7fe8bc06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:00.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.940+0000 7fe8cf7fe640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe8bc06ba10 0x7fe8bc06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:00.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.941+0000 7fe8cf7fe640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe8bc06ba10 0x7fe8bc06ded0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009560 tx=0x7fe8c4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:00.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.955+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe8c0057450 con 0x7fe8d00c8420 2024-04-15T00:02:00.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:00.955+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe8d0072140 con 0x7fe8d00c8420 2024-04-15T00:02:01.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.153+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe8d004f540 con 0x7fe8d00c8420 2024-04-15T00:02:01.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.158+0000 7fe8ccff9640 1 -- 172.21.15.29:0/914269902 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fe8c00593b0 con 0x7fe8d00c8420 2024-04-15T00:02:01.163 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe8bc06ba10 msgr2=0x7fe8bc06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe8bc06ba10 0x7fe8bc06ded0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009560 tx=0x7fe8c4009190 comp rx=0 tx=0).stop 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 msgr2=0x7fe8d01f0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 0x7fe8d01f0d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000e870 tx=0x7fe8c000ed30 comp rx=0 tx=0).stop 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 shutdown_connections 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe8bc06ba10 0x7fe8bc06ded0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe8d01436e0 0x7fe8d00c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d00ce220 0x7fe8d0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 --2- 172.21.15.29:0/914269902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8d00c8420 0x7fe8d01f0d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 >> 172.21.15.29:0/914269902 conn(0x7fe8d0061e00 msgr2=0x7fe8d0142970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.160+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 shutdown_connections 2024-04-15T00:02:01.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.161+0000 7fe8d6484640 1 -- 172.21.15.29:0/914269902 wait complete. 2024-04-15T00:02:01.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:02:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.274+0000 7f6c7691e640 1 Processor -- start 2024-04-15T00:02:01.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.274+0000 7f6c7691e640 1 -- start start 2024-04-15T00:02:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.275+0000 7f6c7691e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.275+0000 7f6c7691e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c70143ba0 con 0x7f6c700708f0 2024-04-15T00:02:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.275+0000 7f6c7691e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7015a5b0 con 0x7f6c700704b0 2024-04-15T00:02:01.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.275+0000 7f6c7691e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7015a890 con 0x7f6c701437c0 2024-04-15T00:02:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.275+0000 7f6c74ebb640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6c700708f0 0x7f6c7015bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50142/0 (socket says 172.21.15.29:50142) 2024-04-15T00:02:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.275+0000 7f6c74ebb640 1 -- 172.21.15.29:0/2135004025 learned_addr learned my addr 172.21.15.29:0/2135004025 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:02:01.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.276+0000 7f6c6ffff640 1 --2- 172.21.15.29:0/2135004025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.278+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420038667 0 0) 0x7f6c70143ba0 con 0x7f6c700708f0 2024-04-15T00:02:01.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.278+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c58003520 con 0x7f6c700708f0 2024-04-15T00:02:01.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.278+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406305804 0 0) 0x7f6c7015a5b0 con 0x7f6c700704b0 2024-04-15T00:02:01.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.278+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c70143ba0 con 0x7f6c700704b0 2024-04-15T00:02:01.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.279+0000 7f6c6ffff640 1 -- 172.21.15.29:0/2135004025 >> v1:172.21.15.37:6789/0 conn(0x7f6c700704b0 legacy=0x7f6c700cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.279+0000 7f6c6ffff640 1 -- 172.21.15.29:0/2135004025 >> v1:172.21.15.29:6789/0 conn(0x7f6c700708f0 legacy=0x7f6c7015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.279+0000 7f6c6ffff640 1 -- 172.21.15.29:0/2135004025 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7015ab70 con 0x7f6c701437c0 2024-04-15T00:02:01.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.281+0000 7f6c6ffff640 1 --2- 172.21.15.29:0/2135004025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7006cd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c640097d0 tx=0x7f6c6402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a68649f6dc62fb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:01.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.285+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64034070 con 0x7f6c701437c0 2024-04-15T00:02:01.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.285+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c64030880 con 0x7f6c701437c0 2024-04-15T00:02:01.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.285+0000 7f6c6effd640 1 -- 172.21.15.29:0/2135004025 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64030c50 con 0x7f6c701437c0 2024-04-15T00:02:01.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 -- 172.21.15.29:0/2135004025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 msgr2=0x7f6c7006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 --2- 172.21.15.29:0/2135004025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7006cd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c640097d0 tx=0x7f6c6402b9c0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 -- 172.21.15.29:0/2135004025 shutdown_connections 2024-04-15T00:02:01.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 --2- 172.21.15.29:0/2135004025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7006cd00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 -- 172.21.15.29:0/2135004025 >> 172.21.15.29:0/2135004025 conn(0x7f6c70061e00 msgr2=0x7f6c70062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:01.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 -- 172.21.15.29:0/2135004025 shutdown_connections 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.286+0000 7f6c7691e640 1 -- 172.21.15.29:0/2135004025 wait complete. 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.287+0000 7f6c7691e640 1 Processor -- start 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.287+0000 7f6c7691e640 1 -- start start 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c7691e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 0x7f6c700c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c7691e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c700708f0 0x7f6c700b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c7691e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7013d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c7691e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6c700ce3e0 con 0x7f6c700704b0 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c7691e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7015b130 con 0x7f6c700708f0 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c7691e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f6c700ce560 con 0x7f6c701437c0 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 0x7f6c700c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c6f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c700708f0 0x7f6c700b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.288+0000 7f6c74ebb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7013d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.289+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 0x7f6c700c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52856/0 (socket says 172.21.15.29:52856) 2024-04-15T00:02:01.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.289+0000 7f6c6ffff640 1 -- 172.21.15.29:0/3575152593 learned_addr learned my addr 172.21.15.29:0/3575152593 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:01.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.292+0000 7f6c6ffff640 1 -- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 msgr2=0x7f6c7013d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.292+0000 7f6c6ffff640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7013d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.292+0000 7f6c6ffff640 1 -- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c700708f0 msgr2=0x7f6c700b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.292+0000 7f6c6ffff640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c700708f0 0x7f6c700b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.292+0000 7f6c6ffff640 1 -- 172.21.15.29:0/3575152593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c701f2fc0 con 0x7f6c700704b0 2024-04-15T00:02:01.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.295+0000 7f6c6ffff640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 0x7f6c700c3f10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c64000c00 tx=0x7f6c640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:01.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.298+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64034040 con 0x7f6c700704b0 2024-04-15T00:02:01.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.298+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6403ad20 con 0x7f6c700704b0 2024-04-15T00:02:01.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.298+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64044630 con 0x7f6c700704b0 2024-04-15T00:02:01.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.298+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c701f32a0 con 0x7f6c700704b0 2024-04-15T00:02:01.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.298+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c701f3860 con 0x7f6c700704b0 2024-04-15T00:02:01.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.299+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7004f540 con 0x7f6c700704b0 2024-04-15T00:02:01.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.318+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6c6404b060 con 0x7f6c700704b0 2024-04-15T00:02:01.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.318+0000 7f6c6cff9640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6c5c06b990 0x7f6c5c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.318+0000 7f6c6f7fe640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6c5c06b990 0x7f6c5c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.319+0000 7f6c6f7fe640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6c5c06b990 0x7f6c5c06de50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6c60007fd0 tx=0x7f6c60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:01.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.577+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f6c64079360 con 0x7f6c700704b0 2024-04-15T00:02:01.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.577+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6c6403f070 con 0x7f6c700704b0 2024-04-15T00:02:01.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.799+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c700c84f0 con 0x7f6c700704b0 2024-04-15T00:02:01.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.814+0000 7f6c6cff9640 1 -- 172.21.15.29:0/3575152593 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6912 (secure 0 0 0) 0x7f6c6407b2c0 con 0x7f6c700704b0 2024-04-15T00:02:01.819 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:02:01.820 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:50.947697+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4275,"mds_1":4272,"mds_2":4266,"mds_3":4258,"mds_4":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4266":{"gid":4266,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4272":{"gid":4272,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4246,4272,4258,4266,4275]},"id":1}]} 2024-04-15T00:02:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-15T00:02:01.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6c5c06b990 msgr2=0x7f6c5c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6c5c06b990 0x7f6c5c06de50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6c60007fd0 tx=0x7f6c60009040 comp rx=0 tx=0).stop 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 msgr2=0x7f6c700c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 0x7f6c700c3f10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c64000c00 tx=0x7f6c640046c0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 shutdown_connections 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f6c5c06b990 0x7f6c5c06de50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f6c701437c0 0x7f6c7013d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c700708f0 0x7f6c700b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 --2- 172.21.15.29:0/3575152593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c700704b0 0x7f6c700c3f10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 >> 172.21.15.29:0/3575152593 conn(0x7f6c70061e00 msgr2=0x7f6c70141f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 shutdown_connections 2024-04-15T00:02:01.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.816+0000 7f6c7691e640 1 -- 172.21.15.29:0/3575152593 wait complete. 2024-04-15T00:02:01.833 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T00:02:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.931+0000 7fc98422d640 1 Processor -- start 2024-04-15T00:02:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.931+0000 7fc98422d640 1 -- start start 2024-04-15T00:02:01.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.931+0000 7fc98422d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc97c06cd00 0x7fc97c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.931+0000 7fc98422d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c0ce210 0x7fc97c15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc98422d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc97c070bc0 con 0x7fc97c1437c0 2024-04-15T00:02:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc98422d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc97c143ba0 con 0x7fc97c06cd00 2024-04-15T00:02:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc98422d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc97c15a5b0 con 0x7fc97c0ce210 2024-04-15T00:02:01.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc981fc9640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc97c1437c0 0x7fc97c0704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50144/0 (socket says 172.21.15.29:50144) 2024-04-15T00:02:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc981fc9640 1 -- 172.21.15.29:0/2333829127 learned_addr learned my addr 172.21.15.29:0/2333829127 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:02:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc9817c8640 1 --2- 172.21.15.29:0/2333829127 >> v2:172.21.15.37:3300/0 conn(0x7fc97c06cd00 0x7fc97c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.932+0000 7fc9827ca640 1 --2- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c0ce210 0x7fc97c15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.935+0000 7fc980fc7640 1 -- 172.21.15.29:0/2333829127 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608209922 0 0) 0x7fc974001490 con 0x7fc97c1437c0 2024-04-15T00:02:01.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.935+0000 7fc980fc7640 1 -- 172.21.15.29:0/2333829127 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc968003520 con 0x7fc97c1437c0 2024-04-15T00:02:01.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.935+0000 7fc9817c8640 1 -- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c0ce210 msgr2=0x7fc97c15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:01.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.935+0000 7fc9817c8640 1 --2- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c0ce210 0x7fc97c15bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.935+0000 7fc9817c8640 1 -- 172.21.15.29:0/2333829127 >> v1:172.21.15.29:6789/0 conn(0x7fc97c1437c0 legacy=0x7fc97c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.935+0000 7fc9817c8640 1 -- 172.21.15.29:0/2333829127 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c15a890 con 0x7fc97c06cd00 2024-04-15T00:02:01.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.937+0000 7fc9817c8640 1 --2- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c0cdcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097a0 tx=0x7fc96c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb2e295b3a9aa1f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:01.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc980fc7640 1 -- 172.21.15.29:0/2333829127 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c034070 con 0x7fc97c06cd00 2024-04-15T00:02:01.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc980fc7640 1 -- 172.21.15.29:0/2333829127 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c030610 con 0x7fc97c06cd00 2024-04-15T00:02:01.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc980fc7640 1 -- 172.21.15.29:0/2333829127 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0309e0 con 0x7fc97c06cd00 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 -- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 msgr2=0x7fc97c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 --2- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c0cdcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097a0 tx=0x7fc96c02b960 comp rx=0 tx=0).stop 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 -- 172.21.15.29:0/2333829127 shutdown_connections 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 --2- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c0ce210 0x7fc97c15bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 --2- 172.21.15.29:0/2333829127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c0cdcd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 -- 172.21.15.29:0/2333829127 >> 172.21.15.29:0/2333829127 conn(0x7fc97c061e00 msgr2=0x7fc97c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 -- 172.21.15.29:0/2333829127 shutdown_connections 2024-04-15T00:02:01.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.941+0000 7fc98422d640 1 -- 172.21.15.29:0/2333829127 wait complete. 2024-04-15T00:02:01.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 Processor -- start 2024-04-15T00:02:01.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 -- start start 2024-04-15T00:02:01.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 0x7fc97c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c1437c0 0x7fc97c1f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:01.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c15b130 con 0x7fc97c0ce210 2024-04-15T00:02:01.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c15ae50 con 0x7fc97c06cd00 2024-04-15T00:02:01.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.943+0000 7fc98422d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc97c15c1b0 con 0x7fc97c1437c0 2024-04-15T00:02:01.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.944+0000 7fc9817c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 0x7fc97c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.944+0000 7fc9827ca640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c1437c0 0x7fc97c1f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.944+0000 7fc981fc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:01.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.944+0000 7fc9817c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 0x7fc97c0b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52862/0 (socket says 172.21.15.29:52862) 2024-04-15T00:02:01.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.944+0000 7fc9817c8640 1 -- 172.21.15.29:0/355947277 learned_addr learned my addr 172.21.15.29:0/355947277 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:01.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.947+0000 7fc9817c8640 1 -- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c1437c0 msgr2=0x7fc97c1f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.947+0000 7fc9817c8640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c1437c0 0x7fc97c1f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.947+0000 7fc9817c8640 1 -- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 msgr2=0x7fc97c1f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:01.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.947+0000 7fc9817c8640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c1f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:01.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.947+0000 7fc9817c8640 1 -- 172.21.15.29:0/355947277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c0ca6c0 con 0x7fc97c0ce210 2024-04-15T00:02:01.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.950+0000 7fc9817c8640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 0x7fc97c0b1d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009890 tx=0x7fc96c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.953+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c048070 con 0x7fc97c0ce210 2024-04-15T00:02:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.953+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c030410 con 0x7fc97c0ce210 2024-04-15T00:02:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.953+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c034040 con 0x7fc97c0ce210 2024-04-15T00:02:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.953+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c0ca9a0 con 0x7fc97c0ce210 2024-04-15T00:02:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.953+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1f15a0 con 0x7fc97c0ce210 2024-04-15T00:02:01.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:01.954+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97c143370 con 0x7fc97c0ce210 2024-04-15T00:02:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.222+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc96c04b070 con 0x7fc97c0ce210 2024-04-15T00:02:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.222+0000 7fc9727fc640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc96006ba10 0x7fc96006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:02.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.222+0000 7fc981fc9640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc96006ba10 0x7fc96006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:02.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.223+0000 7fc981fc9640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc96006ba10 0x7fc96006ded0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc974005c00 tx=0x7fc974009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:02.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.235+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc96c078a00 con 0x7fc97c0ce210 2024-04-15T00:02:02.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.235+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc97c143370 con 0x7fc97c0ce210 2024-04-15T00:02:02.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.418+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc97c06c2f0 con 0x7fc97c0ce210 2024-04-15T00:02:02.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.460+0000 7fc9727fc640 1 -- 172.21.15.29:0/355947277 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7fc97c06c2f0 con 0x7fc97c0ce210 2024-04-15T00:02:02.465 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:02:02.466 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T00:02:02.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc96006ba10 msgr2=0x7fc96006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc96006ba10 0x7fc96006ded0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc974005c00 tx=0x7fc974009040 comp rx=0 tx=0).stop 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 msgr2=0x7fc97c0b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 0x7fc97c0b1d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009890 tx=0x7fc96c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 shutdown_connections 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc96006ba10 0x7fc96006ded0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc97c1437c0 0x7fc97c1f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc97c0ce210 0x7fc97c0b1d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 --2- 172.21.15.29:0/355947277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c06cd00 0x7fc97c1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 >> 172.21.15.29:0/355947277 conn(0x7fc97c061e00 msgr2=0x7fc97c0621e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 shutdown_connections 2024-04-15T00:02:02.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.462+0000 7fc98422d640 1 -- 172.21.15.29:0/355947277 wait complete. 2024-04-15T00:02:02.479 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T00:02:02.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.575+0000 7f316bc84640 1 Processor -- start 2024-04-15T00:02:02.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.575+0000 7f316bc84640 1 -- start start 2024-04-15T00:02:02.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.576+0000 7f316bc84640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f316415a530 0x7f31640cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:02.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.576+0000 7f316bc84640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31640ce030 con 0x7f31640cca40 2024-04-15T00:02:02.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.576+0000 7f316bc84640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316415abe0 con 0x7f31640caad0 2024-04-15T00:02:02.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.576+0000 7f316bc84640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3164154cf0 con 0x7f316415a530 2024-04-15T00:02:02.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.577+0000 7f316921f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f316415a530 0x7f31640cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:02.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.577+0000 7f316a221640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f31640cca40 0x7f31640cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50154/0 (socket says 172.21.15.29:50154) 2024-04-15T00:02:02.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.577+0000 7f316a221640 1 -- 172.21.15.29:0/3211279818 learned_addr learned my addr 172.21.15.29:0/3211279818 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:02:02.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.579+0000 7f3168a1e640 1 -- 172.21.15.29:0/3211279818 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750948470 0 0) 0x7f31640ce030 con 0x7f31640cca40 2024-04-15T00:02:02.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.579+0000 7f3168a1e640 1 -- 172.21.15.29:0/3211279818 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f314c003520 con 0x7f31640cca40 2024-04-15T00:02:02.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.580+0000 7f316921f640 1 -- 172.21.15.29:0/3211279818 >> v1:172.21.15.37:6789/0 conn(0x7f31640caad0 legacy=0x7f31640cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.580+0000 7f316921f640 1 -- 172.21.15.29:0/3211279818 >> v1:172.21.15.29:6789/0 conn(0x7f31640cca40 legacy=0x7f31640cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.580+0000 7f316921f640 1 -- 172.21.15.29:0/3211279818 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316415aec0 con 0x7f316415a530 2024-04-15T00:02:02.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.583+0000 7f316921f640 1 --2- 172.21.15.29:0/3211279818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f316415a530 0x7f31640cc500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31580097a0 tx=0x7f315802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f21d3f18f3cde03 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:02.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f3168a1e640 1 -- 172.21.15.29:0/3211279818 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158034070 con 0x7f316415a530 2024-04-15T00:02:02.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f3168a1e640 1 -- 172.21.15.29:0/3211279818 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3158030610 con 0x7f316415a530 2024-04-15T00:02:02.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f3168a1e640 1 -- 172.21.15.29:0/3211279818 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580309e0 con 0x7f316415a530 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 -- 172.21.15.29:0/3211279818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f316415a530 msgr2=0x7f31640cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 --2- 172.21.15.29:0/3211279818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f316415a530 0x7f31640cc500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31580097a0 tx=0x7f315802b960 comp rx=0 tx=0).stop 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 -- 172.21.15.29:0/3211279818 shutdown_connections 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 --2- 172.21.15.29:0/3211279818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f316415a530 0x7f31640cc500 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 -- 172.21.15.29:0/3211279818 >> 172.21.15.29:0/3211279818 conn(0x7f31640cfb20 msgr2=0x7f31640cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 -- 172.21.15.29:0/3211279818 shutdown_connections 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.590+0000 7f316bc84640 1 -- 172.21.15.29:0/3211279818 wait complete. 2024-04-15T00:02:02.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.591+0000 7f316bc84640 1 Processor -- start 2024-04-15T00:02:02.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 -- start start 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f31640caad0 0x7f3164154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31640cca40 0x7f3164156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f316415a530 0x7f3164156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f316415a980 con 0x7f316415a530 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f316415b480 con 0x7f31640cca40 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.592+0000 7f316bc84640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f31640ce3d0 con 0x7f31640caad0 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.593+0000 7f316a221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f316415a530 0x7f3164156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:02.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.593+0000 7f316921f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31640cca40 0x7f3164156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:02.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.593+0000 7f3169a20640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f31640caad0 0x7f3164154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:02.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.593+0000 7f316a221640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f316415a530 0x7f3164156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52874/0 (socket says 172.21.15.29:52874) 2024-04-15T00:02:02.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.593+0000 7f316a221640 1 -- 172.21.15.29:0/4208688176 learned_addr learned my addr 172.21.15.29:0/4208688176 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.596+0000 7f316921f640 1 -- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f31640caad0 msgr2=0x7f3164154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.596+0000 7f316921f640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f31640caad0 0x7f3164154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.596+0000 7f316921f640 1 -- 172.21.15.29:0/4208688176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f316415a530 msgr2=0x7f3164156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.597+0000 7f316921f640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f316415a530 0x7f3164156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:02.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.597+0000 7f316921f640 1 -- 172.21.15.29:0/4208688176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31640b5090 con 0x7f31640cca40 2024-04-15T00:02:02.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.599+0000 7f316921f640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31640cca40 0x7f3164156510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3158033000 tx=0x7f31580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:02.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.603+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158047070 con 0x7f31640cca40 2024-04-15T00:02:02.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.603+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3158030410 con 0x7f31640cca40 2024-04-15T00:02:02.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.603+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158034040 con 0x7f31640cca40 2024-04-15T00:02:02.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.603+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31641f3b00 con 0x7f31640cca40 2024-04-15T00:02:02.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.603+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31641f40c0 con 0x7f31640cca40 2024-04-15T00:02:02.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.604+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3164075800 con 0x7f31640cca40 2024-04-15T00:02:02.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.888+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f315804a070 con 0x7f31640cca40 2024-04-15T00:02:02.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.888+0000 7f31627fc640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f315006b9c0 0x7f315006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:02.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.888+0000 7f3169a20640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f315006b9c0 0x7f315006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:02.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.889+0000 7f3169a20640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f315006b9c0 0x7f315006de80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f315c001e70 tx=0x7f315c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:02.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.892+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f31580305c0 con 0x7f31640cca40 2024-04-15T00:02:02.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:02.906+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3164075800 con 0x7f31640cca40 2024-04-15T00:02:03.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.128+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f316404f540 con 0x7f31640cca40 2024-04-15T00:02:03.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.144+0000 7f31627fc640 1 -- 172.21.15.29:0/4208688176 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6912 (secure 0 0 0) 0x7f315807aa00 con 0x7f31640cca40 2024-04-15T00:02:03.149 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T00:02:03.150 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:50.947697+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4275,"mds_1":4272,"mds_2":4266,"mds_3":4258,"mds_4":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4266":{"gid":4266,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4272":{"gid":4272,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4246,4272,4258,4266,4275]},"id":1}]} 2024-04-15T00:02:03.150 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.146+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f315006b9c0 msgr2=0x7f315006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f315006b9c0 0x7f315006de80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f315c001e70 tx=0x7f315c009040 comp rx=0 tx=0).stop 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31640cca40 msgr2=0x7f3164156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31640cca40 0x7f3164156510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3158033000 tx=0x7f31580046c0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 shutdown_connections 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f315006b9c0 0x7f315006de80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f316415a530 0x7f3164156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31640cca40 0x7f3164156510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 --2- 172.21.15.29:0/4208688176 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f31640caad0 0x7f3164154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 >> 172.21.15.29:0/4208688176 conn(0x7f31640cfb20 msgr2=0x7f31640c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:03.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 shutdown_connections 2024-04-15T00:02:03.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.147+0000 7f316bc84640 1 -- 172.21.15.29:0/4208688176 wait complete. 2024-04-15T00:02:03.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T00:01:12.657999+0000', 'modified': '2024-04-15T00:01:50.947697+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4275, 'mds_1': 4272, 'mds_2': 4266, 'mds_3': 4258, 'mds_4': 4246}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4246': {'gid': 4246, 'name': 'c', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.29:6836/1439171275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6834', 'nonce': 1439171275}, {'type': 'v1', 'addr': '172.21.15.29:6836', 'nonce': 1439171275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4258': {'gid': 4258, 'name': 'd', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.37:6839/2258878813', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 2258878813}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 2258878813}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.29:6833/3178649227', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6832', 'nonce': 3178649227}, {'type': 'v1', 'addr': '172.21.15.29:6833', 'nonce': 3178649227}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4272': {'gid': 4272, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.29:6837/2229372959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6835', 'nonce': 2229372959}, {'type': 'v1', 'addr': '172.21.15.29:6837', 'nonce': 2229372959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4275': {'gid': 4275, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6835/4290142859', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 4290142859}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 4290142859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4275, 'qdb_cluster': [4246, 4272, 4258, 4266, 4275]} 2024-04-15T00:02:03.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-15T00:02:03.767 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-15T00:02:03.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.866+0000 7fda90484640 1 Processor -- start 2024-04-15T00:02:03.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.866+0000 7fda90484640 1 -- start start 2024-04-15T00:02:03.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda90484640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda88070a60 0x7fda8815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda90484640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c36e0 0x7fda880c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda90484640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda880c8c50 con 0x7fda880c8680 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda90484640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fda880c91e0 con 0x7fda88070a60 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda90484640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fda880c9430 con 0x7fda880c36e0 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda8da1f640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fda880c8680 0x7fda8806c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50166/0 (socket says 172.21.15.29:50166) 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda8da1f640 1 -- 172.21.15.29:0/1072703676 learned_addr learned my addr 172.21.15.29:0/1072703676 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.867+0000 7fda8ea21640 1 --2- 172.21.15.29:0/1072703676 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c36e0 0x7fda880c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.868+0000 7fda8e220640 1 --2- 172.21.15.29:0/1072703676 >> v2:172.21.15.37:3300/0 conn(0x7fda88070a60 0x7fda8815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.870+0000 7fda8d21e640 1 -- 172.21.15.29:0/1072703676 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493071317 0 0) 0x7fda880c8c50 con 0x7fda880c8680 2024-04-15T00:02:03.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.870+0000 7fda8d21e640 1 -- 172.21.15.29:0/1072703676 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda74003520 con 0x7fda880c8680 2024-04-15T00:02:03.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.870+0000 7fda8ea21640 1 -- 172.21.15.29:0/1072703676 >> v2:172.21.15.37:3300/0 conn(0x7fda88070a60 msgr2=0x7fda8815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:03.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.870+0000 7fda8ea21640 1 --2- 172.21.15.29:0/1072703676 >> v2:172.21.15.37:3300/0 conn(0x7fda88070a60 0x7fda8815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.870+0000 7fda8ea21640 1 -- 172.21.15.29:0/1072703676 >> v1:172.21.15.29:6789/0 conn(0x7fda880c8680 legacy=0x7fda8806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.870+0000 7fda8ea21640 1 -- 172.21.15.29:0/1072703676 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda880c9710 con 0x7fda880c36e0 2024-04-15T00:02:03.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.872+0000 7fda8ea21640 1 --2- 172.21.15.29:0/1072703676 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c36e0 0x7fda880c3b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda80009d90 tx=0x7fda8002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ebf7f4f6182e9dc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.876+0000 7fda8d21e640 1 -- 172.21.15.29:0/1072703676 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80039070 con 0x7fda880c36e0 2024-04-15T00:02:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.876+0000 7fda8d21e640 1 -- 172.21.15.29:0/1072703676 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8002cbc0 con 0x7fda880c36e0 2024-04-15T00:02:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.876+0000 7fda8d21e640 1 -- 172.21.15.29:0/1072703676 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80034440 con 0x7fda880c36e0 2024-04-15T00:02:03.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 -- 172.21.15.29:0/1072703676 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c36e0 msgr2=0x7fda880c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 --2- 172.21.15.29:0/1072703676 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c36e0 0x7fda880c3b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda80009d90 tx=0x7fda8002be10 comp rx=0 tx=0).stop 2024-04-15T00:02:03.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 -- 172.21.15.29:0/1072703676 shutdown_connections 2024-04-15T00:02:03.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 --2- 172.21.15.29:0/1072703676 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c36e0 0x7fda880c3b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 --2- 172.21.15.29:0/1072703676 >> v2:172.21.15.37:3300/0 conn(0x7fda88070a60 0x7fda8815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 -- 172.21.15.29:0/1072703676 >> 172.21.15.29:0/1072703676 conn(0x7fda880cd900 msgr2=0x7fda880cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:03.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 -- 172.21.15.29:0/1072703676 shutdown_connections 2024-04-15T00:02:03.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.877+0000 7fda90484640 1 -- 172.21.15.29:0/1072703676 wait complete. 2024-04-15T00:02:03.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.878+0000 7fda90484640 1 Processor -- start 2024-04-15T00:02:03.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 -- start start 2024-04-15T00:02:03.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda88070a60 0x7fda881f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 0x7fda881e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c8680 0x7fda881e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fda8806cdc0 con 0x7fda880c36e0 2024-04-15T00:02:03.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda880c9cd0 con 0x7fda88070a60 2024-04-15T00:02:03.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.879+0000 7fda90484640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fda881f4260 con 0x7fda880c8680 2024-04-15T00:02:03.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.880+0000 7fda8da1f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 0x7fda881e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.880+0000 7fda8ea21640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c8680 0x7fda881e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.880+0000 7fda8da1f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 0x7fda881e4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52886/0 (socket says 172.21.15.29:52886) 2024-04-15T00:02:03.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.880+0000 7fda8da1f640 1 -- 172.21.15.29:0/2603965421 learned_addr learned my addr 172.21.15.29:0/2603965421 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:03.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.882+0000 7fda8e220640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda88070a60 0x7fda881f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.883+0000 7fda8da1f640 1 -- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c8680 msgr2=0x7fda881e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.883+0000 7fda8da1f640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c8680 0x7fda881e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.883+0000 7fda8da1f640 1 -- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda88070a60 msgr2=0x7fda881f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.883+0000 7fda8da1f640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda88070a60 0x7fda881f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.883+0000 7fda8da1f640 1 -- 172.21.15.29:0/2603965421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda881596c0 con 0x7fda880c36e0 2024-04-15T00:02:03.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.886+0000 7fda8da1f640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 0x7fda881e4b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c390 tx=0x7fda7800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.889+0000 7fda7effd640 1 -- 172.21.15.29:0/2603965421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78017070 con 0x7fda880c36e0 2024-04-15T00:02:03.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.889+0000 7fda7effd640 1 -- 172.21.15.29:0/2603965421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda78005ce0 con 0x7fda880c36e0 2024-04-15T00:02:03.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.889+0000 7fda7effd640 1 -- 172.21.15.29:0/2603965421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda780072f0 con 0x7fda880c36e0 2024-04-15T00:02:03.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.889+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda881f3f80 con 0x7fda880c36e0 2024-04-15T00:02:03.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.889+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda88154560 con 0x7fda880c36e0 2024-04-15T00:02:03.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.892+0000 7fda93264740 1 Processor -- start 2024-04-15T00:02:03.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.892+0000 7fda93264740 1 -- start start 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 0x55a8bd9894d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd989a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda93264740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd987b50 0x55a8bd9c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda93264740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd8ecf80 con 0x55a8bd987b50 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd8959a0 con 0x55a8bd9d2f70 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55a8bd8e8f30 con 0x55a8bd9890f0 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.893+0000 7fda8ea21640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 0x55a8bd9894d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.894+0000 7fda8e220640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd989a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.894+0000 7fda8ea21640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 0x55a8bd9894d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44398/0 (socket says 172.21.15.29:44398) 2024-04-15T00:02:03.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.894+0000 7fda8ea21640 1 -- 172.21.15.29:0/2791679575 learned_addr learned my addr 172.21.15.29:0/2791679575 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:03.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.896+0000 7fda8ea21640 1 -- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 msgr2=0x55a8bd989a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:03.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.896+0000 7fda8ea21640 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd989a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.896+0000 7fda8ea21640 1 -- 172.21.15.29:0/2791679575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd987b50 msgr2=0x55a8bd9c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:03.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.896+0000 7fda8ea21640 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd987b50 0x55a8bd9c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.896+0000 7fda8ea21640 1 -- 172.21.15.29:0/2791679575 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8bd8b6480 con 0x55a8bd9890f0 2024-04-15T00:02:03.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.898+0000 7fda8ea21640 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 0x55a8bd9894d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda80009d90 tx=0x7fda8002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de1dd367f7d0c863 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda6bfff640 1 -- 172.21.15.29:0/2791679575 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80045070 con 0x55a8bd9890f0 2024-04-15T00:02:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda6bfff640 1 -- 172.21.15.29:0/2791679575 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8003a040 con 0x55a8bd9890f0 2024-04-15T00:02:03.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda6bfff640 1 -- 172.21.15.29:0/2791679575 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80039040 con 0x55a8bd9890f0 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 -- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 msgr2=0x55a8bd9894d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 0x55a8bd9894d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda80009d90 tx=0x7fda8002e000 comp rx=0 tx=0).stop 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 -- 172.21.15.29:0/2791679575 shutdown_connections 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd987b50 0x55a8bd9c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd989a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 --2- 172.21.15.29:0/2791679575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9890f0 0x55a8bd9894d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 -- 172.21.15.29:0/2791679575 >> 172.21.15.29:0/2791679575 conn(0x55a8bd985860 msgr2=0x55a8bd9881a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 -- 172.21.15.29:0/2791679575 shutdown_connections 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.902+0000 7fda93264740 1 -- 172.21.15.29:0/2791679575 wait complete. 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.903+0000 7fda93264740 1 -- start start 2024-04-15T00:02:03.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.903+0000 7fda93264740 1 Processor -- start 2024-04-15T00:02:03.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9ad740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 0x55a8bd9dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9cf8c0 0x55a8bd9dd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd9ae650 con 0x55a8bd9890f0 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd8a8f40 con 0x55a8bd9cf8c0 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55a8bd986a10 con 0x55a8bd9d2f70 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.904+0000 7fda93264740 10 client.0 _ll_register_callbacks cb 0x55a8bd8a39a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.905+0000 7fda8e220640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 0x55a8bd9dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.905+0000 7fda8da1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9cf8c0 0x55a8bd9dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.905+0000 7fda8e220640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 0x55a8bd9dbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44412/0 (socket says 172.21.15.29:44412) 2024-04-15T00:02:03.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.905+0000 7fda8e220640 1 -- 172.21.15.29:0/2527835655 learned_addr learned my addr 172.21.15.29:0/2527835655 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:03.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.908+0000 7fda8e220640 1 -- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9cf8c0 msgr2=0x55a8bd9dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:03.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.908+0000 7fda8e220640 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9cf8c0 0x55a8bd9dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.908+0000 7fda8e220640 1 -- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 msgr2=0x55a8bd9ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:03.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.908+0000 7fda8e220640 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:03.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.908+0000 7fda8e220640 1 -- 172.21.15.29:0/2527835655 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a8bd6012d0 con 0x55a8bd9d2f70 2024-04-15T00:02:03.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.910+0000 7fda8e220640 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 0x55a8bd9dbfb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda840149d0 tx=0x7fda84014e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5cabeb2ac4a846 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:03.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.910+0000 7fda697fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3301/0 2024-04-15T00:02:03.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.910+0000 7fda7effd640 1 -- 172.21.15.29:0/2603965421 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fda7801a070 con 0x7fda880c36e0 2024-04-15T00:02:03.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.911+0000 7fda7effd640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fda6c06b900 0x7fda6c06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.911+0000 7fda8ea21640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fda6c06b900 0x7fda6c06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:03.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.911+0000 7fda8ea21640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fda6c06b900 0x7fda6c06ddc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda8002be50 tx=0x7fda80031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:03.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.914+0000 7fda697fa640 1 -- 172.21.15.29:0/2527835655 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84022060 con 0x55a8bd9d2f70 2024-04-15T00:02:03.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.914+0000 7fda697fa640 1 -- 172.21.15.29:0/2527835655 <== mon.2 v2:172.21.15.37:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fda84012ac0 con 0x55a8bd9d2f70 2024-04-15T00:02:03.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.914+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda8003a040 con 0x55a8bd9d2f70 2024-04-15T00:02:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.915+0000 7fda7effd640 1 -- 172.21.15.29:0/2603965421 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fda78056680 con 0x7fda880c36e0 2024-04-15T00:02:03.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.915+0000 7fda697fa640 1 -- 172.21.15.29:0/2527835655 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda84028050 con 0x55a8bd9d2f70 2024-04-15T00:02:03.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.915+0000 7fda93264740 10 client.4577 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:03.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.915+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a8bd6cb6b0 con 0x55a8bd9d2f70 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda697fa640 1 -- 172.21.15.29:0/2527835655 <== mon.2 v2:172.21.15.37:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8003a040 con 0x55a8bd9d2f70 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda697fa640 1 -- 172.21.15.29:0/2527835655 <== mon.2 v2:172.21.15.37:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fda8402b020 con 0x55a8bd9d2f70 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda93264740 10 client.4577 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda93264740 10 client.4577 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda93264740 20 client.4577 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda93264740 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bd9e7400 0x55a8bd9e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda93264740 4 client.4577 mds_command: new command op to 4246 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:02:03.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.932+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 --> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8bd8fa4c0 con 0x55a8bd9e7400 2024-04-15T00:02:03.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:03.940+0000 7fda8da1f640 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bd9e7400 0x55a8bd9e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.030+0000 7fda697fa640 10 client.4577 ms_handle_connect on v2:172.21.15.29:6834/1439171275 2024-04-15T00:02:04.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.030+0000 7fda8da1f640 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bd9e7400 0x55a8bd9e97f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3ae1bcd288e35af server_cookie=9bae8d5952cc139b in_seq=0 out_seq=0 2024-04-15T00:02:04.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.153+0000 7fda697fa640 1 -- 172.21.15.29:0/2527835655 <== mds.4 v2:172.21.15.29:6834/1439171275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8bd8fa4c0 con 0x55a8bd9e7400 2024-04-15T00:02:04.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.153+0000 7fda697fa640 10 client.4577 handle_command_reply: tid=0 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.153+0000 7fda93264740 1 client.4577 shutdown 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 msgr2=0x55a8bd9dbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 0x55a8bd9dbfb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda840149d0 tx=0x7fda84014e90 comp rx=0 tx=0).stop 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 shutdown_connections 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bd9e7400 0x55a8bd9e97f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9cf8c0 0x55a8bd9dd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9d2f70 0x55a8bd9dbfb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 --2- 172.21.15.29:0/2527835655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda697fa640 0 client.4577 ms_handle_reset on v2:172.21.15.29:6834/1439171275 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 >> 172.21.15.29:0/2527835655 conn(0x55a8bd987b50 msgr2=0x55a8bd9894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 shutdown_connections 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 1 -- 172.21.15.29:0/2527835655 wait complete. 2024-04-15T00:02:04.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.154+0000 7fda93264740 20 client.4577 trim_cache size 0 max 16384 2024-04-15T00:02:04.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 Processor -- start 2024-04-15T00:02:04.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 -- start start 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bd9c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd9ed810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fda881f0ce0 con 0x55a8bd9890f0 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd9adc80 con 0x55a8bd9d2f70 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.173+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55a8bd9cf0f0 con 0x55a8bd9cf8c0 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.174+0000 7fda8e220640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.174+0000 7fda8da1f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bd9c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.174+0000 7fda8ea21640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd9ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.174+0000 7fda8e220640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52922/0 (socket says 172.21.15.29:52922) 2024-04-15T00:02:04.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.174+0000 7fda8e220640 1 -- 172.21.15.29:0/2235868088 learned_addr learned my addr 172.21.15.29:0/2235868088 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.176+0000 7fda8e220640 1 -- 172.21.15.29:0/2235868088 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 msgr2=0x55a8bd9c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.176+0000 7fda8e220640 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bd9c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.176+0000 7fda8e220640 1 -- 172.21.15.29:0/2235868088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 msgr2=0x55a8bd9ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.176+0000 7fda8e220640 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd9ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.177+0000 7fda8e220640 1 -- 172.21.15.29:0/2235868088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8bd9ae7e0 con 0x55a8bd9890f0 2024-04-15T00:02:04.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.178+0000 7fda8e220640 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9c6300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda84006f50 tx=0x7fda84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a604bf206ccdbf server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.182+0000 7fda6b7fe640 1 -- 172.21.15.29:0/2235868088 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84012d60 con 0x55a8bd9890f0 2024-04-15T00:02:04.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.182+0000 7fda6b7fe640 1 -- 172.21.15.29:0/2235868088 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda84004020 con 0x55a8bd9890f0 2024-04-15T00:02:04.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.182+0000 7fda6b7fe640 1 -- 172.21.15.29:0/2235868088 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84004410 con 0x55a8bd9890f0 2024-04-15T00:02:04.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 -- 172.21.15.29:0/2235868088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 msgr2=0x55a8bd9c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9c6300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda84006f50 tx=0x7fda84017000 comp rx=0 tx=0).stop 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 -- 172.21.15.29:0/2235868088 shutdown_connections 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9d2f70 0x55a8bd9ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bd9c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 --2- 172.21.15.29:0/2235868088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9890f0 0x55a8bd9c6300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 -- 172.21.15.29:0/2235868088 >> 172.21.15.29:0/2235868088 conn(0x55a8bd987b50 msgr2=0x55a8bd9dcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 -- 172.21.15.29:0/2235868088 shutdown_connections 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 -- 172.21.15.29:0/2235868088 wait complete. 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.183+0000 7fda93264740 1 -- start start 2024-04-15T00:02:04.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.184+0000 7fda93264740 1 Processor -- start 2024-04-15T00:02:04.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9890f0 0x55a8bd9e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bda48b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 0x55a8bda49040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd9dc820 con 0x55a8bd9d2f70 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8bd9af4a0 con 0x55a8bd9890f0 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55a8bd9c5a90 con 0x55a8bd9cf8c0 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda93264740 10 client.0 _ll_register_callbacks cb 0x7fda840098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda8ea21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 0x55a8bda49040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda8da1f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bda48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda8e220640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9890f0 0x55a8bd9e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda8ea21640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 0x55a8bda49040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52936/0 (socket says 172.21.15.29:52936) 2024-04-15T00:02:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.185+0000 7fda8ea21640 1 -- 172.21.15.29:0/4001808191 learned_addr learned my addr 172.21.15.29:0/4001808191 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.189+0000 7fda8ea21640 1 -- 172.21.15.29:0/4001808191 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 msgr2=0x55a8bda48b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.189+0000 7fda8ea21640 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bda48b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.189+0000 7fda8ea21640 1 -- 172.21.15.29:0/4001808191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9890f0 msgr2=0x55a8bd9e3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.189+0000 7fda8ea21640 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9890f0 0x55a8bd9e3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.189+0000 7fda8ea21640 1 -- 172.21.15.29:0/4001808191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8bd9e0220 con 0x55a8bd9d2f70 2024-04-15T00:02:04.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.191+0000 7fda8ea21640 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 0x55a8bda49040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda80009e80 tx=0x7fda80004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cae18c9413e558 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.191+0000 7fda697fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-15T00:02:04.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.194+0000 7fda697fa640 1 -- 172.21.15.29:0/4001808191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80058070 con 0x55a8bd9d2f70 2024-04-15T00:02:04.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.194+0000 7fda697fa640 1 -- 172.21.15.29:0/4001808191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fda80034640 con 0x55a8bd9d2f70 2024-04-15T00:02:04.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.194+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda84004020 con 0x55a8bd9d2f70 2024-04-15T00:02:04.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.196+0000 7fda697fa640 1 -- 172.21.15.29:0/4001808191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda80063050 con 0x55a8bd9d2f70 2024-04-15T00:02:04.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.196+0000 7fda93264740 10 client.4728 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:04.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.196+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a8bd9e46a0 con 0x55a8bd9d2f70 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.200+0000 7fda697fa640 1 -- 172.21.15.29:0/4001808191 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda84004020 con 0x55a8bd9d2f70 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.200+0000 7fda697fa640 1 -- 172.21.15.29:0/4001808191 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fda80066020 con 0x55a8bd9d2f70 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.200+0000 7fda93264740 10 client.4728 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.200+0000 7fda93264740 10 client.4728 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.200+0000 7fda93264740 20 client.4728 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.200+0000 7fda93264740 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bda3eeb0 0x55a8bda51d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.201+0000 7fda93264740 4 client.4728 mds_command: new command op to 4246 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:02:04.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.201+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 --> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] -- command(tid 0: {"prefix": "status"}) -- 0x55a8bd8f4810 con 0x55a8bda3eeb0 2024-04-15T00:02:04.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.201+0000 7fda8e220640 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bda3eeb0 0x55a8bda51d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.204+0000 7fda697fa640 10 client.4728 ms_handle_connect on v2:172.21.15.29:6834/1439171275 2024-04-15T00:02:04.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.204+0000 7fda8e220640 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bda3eeb0 0x55a8bda51d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ec34e6e7598f14d server_cookie=e10d9f9d06a1335e in_seq=0 out_seq=0 2024-04-15T00:02:04.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda697fa640 1 -- 172.21.15.29:0/4001808191 <== mds.4 v2:172.21.15.29:6834/1439171275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a8bd8f4810 con 0x55a8bda3eeb0 2024-04-15T00:02:04.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda697fa640 10 client.4728 handle_command_reply: tid=0 2024-04-15T00:02:04.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 client.4728 shutdown 2024-04-15T00:02:04.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 msgr2=0x55a8bda49040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 0x55a8bda49040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda80009e80 tx=0x7fda80004ab0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 shutdown_connections 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:6834/1439171275,v1:172.21.15.29:6836/1439171275] conn(0x55a8bda3eeb0 0x55a8bda51d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8bd9d2f70 0x55a8bda49040 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55a8bd9cf8c0 0x55a8bda48b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda697fa640 0 client.4728 ms_handle_reset on v2:172.21.15.29:6834/1439171275 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 --2- 172.21.15.29:0/4001808191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8bd9890f0 0x55a8bd9e3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.222+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 >> 172.21.15.29:0/4001808191 conn(0x55a8bd987b50 msgr2=0x55a8bd9dcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 shutdown_connections 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda93264740 1 -- 172.21.15.29:0/4001808191 wait complete. 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda93264740 20 client.4728 trim_cache size 0 max 16384 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:02:04.229 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "7c8df2c3-f5a8-486a-b508-c448178a0a97", 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 4, 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4246, 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 15.696097065, 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 29, 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 29, 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 61.012078580999997 2024-04-15T00:02:04.230 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:02:04.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fda6c06b900 msgr2=0x7fda6c06ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fda6c06b900 0x7fda6c06ddc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda8002be50 tx=0x7fda80031000 comp rx=0 tx=0).stop 2024-04-15T00:02:04.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 msgr2=0x7fda881e4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 0x7fda881e4b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c390 tx=0x7fda7800c850 comp rx=0 tx=0).stop 2024-04-15T00:02:04.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 shutdown_connections 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fda6c06b900 0x7fda6c06ddc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fda880c8680 0x7fda881e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda880c36e0 0x7fda881e4b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 --2- 172.21.15.29:0/2603965421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda88070a60 0x7fda881f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.223+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 >> 172.21.15.29:0/2603965421 conn(0x7fda880cd900 msgr2=0x7fda8814fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.224+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 shutdown_connections 2024-04-15T00:02:04.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.224+0000 7fda90484640 1 -- 172.21.15.29:0/2603965421 wait complete. 2024-04-15T00:02:04.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-15T00:02:04.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.337+0000 7f0cc2cd5640 1 Processor -- start 2024-04-15T00:02:04.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.337+0000 7f0cc2cd5640 1 -- start start 2024-04-15T00:02:04.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.338+0000 7f0cc2cd5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 0x7f0cbc15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.338+0000 7f0cc2cd5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cbc0c36e0 0x7f0cbc0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.338+0000 7f0cc2cd5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc0c8c50 con 0x7f0cbc070a60 2024-04-15T00:02:04.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.338+0000 7f0cc2cd5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0cbc0c91e0 con 0x7f0cbc0c36e0 2024-04-15T00:02:04.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.338+0000 7f0cc2cd5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc0c9430 con 0x7f0cbc0c8680 2024-04-15T00:02:04.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.338+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 0x7f0cbc15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.339+0000 7f0cc1272640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cbc0c36e0 0x7f0cbc0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.339+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 0x7f0cbc15ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44444/0 (socket says 172.21.15.29:44444) 2024-04-15T00:02:04.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.339+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1005224156 learned_addr learned my addr 172.21.15.29:0/1005224156 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.341+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1005224156 >> v2:172.21.15.37:3300/0 conn(0x7f0cbc0c36e0 msgr2=0x7f0cbc0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.341+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1005224156 >> v2:172.21.15.37:3300/0 conn(0x7f0cbc0c36e0 0x7f0cbc0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.341+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1005224156 >> v1:172.21.15.37:6789/0 conn(0x7f0cbc070a60 legacy=0x7f0cbc06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.341+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1005224156 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc0c9710 con 0x7f0cbc0c8680 2024-04-15T00:02:04.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.344+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1005224156 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 0x7f0cbc15ab60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009870 tx=0x7f0ca802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd19a500c8dc0473 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.347+0000 7f0cbb7fe640 1 -- 172.21.15.29:0/1005224156 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8035020 con 0x7f0cbc0c8680 2024-04-15T00:02:04.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.347+0000 7f0cbb7fe640 1 -- 172.21.15.29:0/1005224156 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8031640 con 0x7f0cbc0c8680 2024-04-15T00:02:04.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.347+0000 7f0cbb7fe640 1 -- 172.21.15.29:0/1005224156 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca802d040 con 0x7f0cbc0c8680 2024-04-15T00:02:04.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1005224156 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 msgr2=0x7f0cbc15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1005224156 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 0x7f0cbc15ab60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009870 tx=0x7f0ca802b8f0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1005224156 shutdown_connections 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1005224156 >> v2:172.21.15.37:3300/0 conn(0x7f0cbc0c36e0 0x7f0cbc0c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1005224156 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc0c8680 0x7f0cbc15ab60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1005224156 >> 172.21.15.29:0/1005224156 conn(0x7f0cbc0cd900 msgr2=0x7f0cbc0cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1005224156 shutdown_connections 2024-04-15T00:02:04.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.348+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1005224156 wait complete. 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.349+0000 7f0cc2cd5640 1 Processor -- start 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.349+0000 7f0cc2cd5640 1 -- start start 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc2cd5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc070a60 0x7f0cbc14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc2cd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cbc0c36e0 0x7f0cbc1e5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc2cd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cbc0c8680 0x7f0cbc1e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc2cd5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc06cdc0 con 0x7f0cbc0c8680 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc2cd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc0c9cd0 con 0x7f0cbc0c36e0 2024-04-15T00:02:04.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc2cd5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc1e34f0 con 0x7f0cbc070a60 2024-04-15T00:02:04.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.350+0000 7f0cc0a71640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc070a60 0x7f0cbc14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.351+0000 7f0cc1272640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cbc0c8680 0x7f0cbc1e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.351+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cbc0c36e0 0x7f0cbc1e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.351+0000 7f0cc0a71640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc070a60 0x7f0cbc14a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44448/0 (socket says 172.21.15.29:44448) 2024-04-15T00:02:04.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.351+0000 7f0cc0a71640 1 -- 172.21.15.29:0/1538794714 learned_addr learned my addr 172.21.15.29:0/1538794714 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.354+0000 7f0cc1272640 1 -- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc070a60 msgr2=0x7f0cbc14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.354+0000 7f0cc1272640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc070a60 0x7f0cbc14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.354+0000 7f0cc1272640 1 -- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cbc0c36e0 msgr2=0x7f0cbc1e5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.354+0000 7f0cc1272640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cbc0c36e0 0x7f0cbc1e5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.354+0000 7f0cc1272640 1 -- 172.21.15.29:0/1538794714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc15d1a0 con 0x7f0cbc0c8680 2024-04-15T00:02:04.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.354+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cbc0c36e0 0x7f0cbc1e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:02:04.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.357+0000 7f0cc1272640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cbc0c8680 0x7f0cbc1e5890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400efc0 tx=0x7f0cb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.360+0000 7f0cb97fa640 1 -- 172.21.15.29:0/1538794714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4018020 con 0x7f0cbc0c8680 2024-04-15T00:02:04.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.360+0000 7f0cb97fa640 1 -- 172.21.15.29:0/1538794714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb4014480 con 0x7f0cbc0c8680 2024-04-15T00:02:04.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.360+0000 7f0cb97fa640 1 -- 172.21.15.29:0/1538794714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4014870 con 0x7f0cbc0c8680 2024-04-15T00:02:04.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.360+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc15d480 con 0x7f0cbc0c8680 2024-04-15T00:02:04.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.360+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc1e3740 con 0x7f0cbc0c8680 2024-04-15T00:02:04.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.363+0000 7f0cc5b98740 1 Processor -- start 2024-04-15T00:02:04.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.363+0000 7f0cc5b98740 1 -- start start 2024-04-15T00:02:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c59aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 0x56127c5d9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56127c4fdf80 con 0x56127c5e3f70 2024-04-15T00:02:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56127c4a69a0 con 0x56127c59a0f0 2024-04-15T00:02:04.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x56127c4f9f30 con 0x56127c598b50 2024-04-15T00:02:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 0x56127c5d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.364+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.365+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 0x56127c5d9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44454/0 (socket says 172.21.15.29:44454) 2024-04-15T00:02:04.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.365+0000 7f0cbbfff640 1 -- 172.21.15.29:0/3460970233 learned_addr learned my addr 172.21.15.29:0/3460970233 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.367+0000 7f0cbbfff640 1 -- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 msgr2=0x56127c59a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.367+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.367+0000 7f0cbbfff640 1 -- 172.21.15.29:0/3460970233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 msgr2=0x56127c59aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.367+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c59aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.367+0000 7f0cbbfff640 1 -- 172.21.15.29:0/3460970233 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127c4c7480 con 0x56127c598b50 2024-04-15T00:02:04.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.369+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 0x56127c5d9950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80090b0 tx=0x7f0ca8030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d5b9b297d1c403 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0ca67fc640 1 -- 172.21.15.29:0/3460970233 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8035040 con 0x56127c598b50 2024-04-15T00:02:04.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0ca67fc640 1 -- 172.21.15.29:0/3460970233 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8004220 con 0x56127c598b50 2024-04-15T00:02:04.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0ca67fc640 1 -- 172.21.15.29:0/3460970233 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8003610 con 0x56127c598b50 2024-04-15T00:02:04.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 -- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 msgr2=0x56127c5d9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 0x56127c5d9950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80090b0 tx=0x7f0ca8030000 comp rx=0 tx=0).stop 2024-04-15T00:02:04.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 -- 172.21.15.29:0/3460970233 shutdown_connections 2024-04-15T00:02:04.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c598b50 0x56127c5d9950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c59aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/3460970233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 -- 172.21.15.29:0/3460970233 >> 172.21.15.29:0/3460970233 conn(0x56127c596860 msgr2=0x56127c5991a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 -- 172.21.15.29:0/3460970233 shutdown_connections 2024-04-15T00:02:04.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.373+0000 7f0cc5b98740 1 -- 172.21.15.29:0/3460970233 wait complete. 2024-04-15T00:02:04.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.374+0000 7f0cc5b98740 1 -- start start 2024-04-15T00:02:04.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.374+0000 7f0cc5b98740 1 Processor -- start 2024-04-15T00:02:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c5bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 0x56127c5d66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5eb9e0 0x56127c5d6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56127c5bf650 con 0x56127c59a0f0 2024-04-15T00:02:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56127c4b9f40 con 0x56127c5eb9e0 2024-04-15T00:02:04.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x56127c597a10 con 0x56127c5e3f70 2024-04-15T00:02:04.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc5b98740 10 client.0 _ll_register_callbacks cb 0x56127c4b49a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:04.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cc0a71640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 0x56127c5d66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.375+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5eb9e0 0x56127c5d6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.376+0000 7f0cc0a71640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 0x56127c5d66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44464/0 (socket says 172.21.15.29:44464) 2024-04-15T00:02:04.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.376+0000 7f0cc0a71640 1 -- 172.21.15.29:0/1506944416 learned_addr learned my addr 172.21.15.29:0/1506944416 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.379+0000 7f0cc0a71640 1 -- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5eb9e0 msgr2=0x56127c5d6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.379+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5eb9e0 0x56127c5d6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.379+0000 7f0cc0a71640 1 -- 172.21.15.29:0/1506944416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 msgr2=0x56127c5bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.379+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c5bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.379+0000 7f0cc0a71640 1 -- 172.21.15.29:0/1506944416 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56127c2122d0 con 0x56127c5e3f70 2024-04-15T00:02:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.381+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 0x56127c5d66f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000f460 tx=0x7f0cb000f920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb7e643c7ff75e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.381+0000 7f0c9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3301/0 2024-04-15T00:02:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.381+0000 7f0cb97fa640 1 -- 172.21.15.29:0/1538794714 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0cb401b020 con 0x7f0cbc0c8680 2024-04-15T00:02:04.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.381+0000 7f0cb97fa640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0ca006b950 0x7f0ca006de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.381+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0ca006b950 0x7f0ca006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.382+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0ca006b950 0x7f0ca006de10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56127c5da9d0 tx=0x7f0ca804a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.383+0000 7f0cb97fa640 1 -- 172.21.15.29:0/1538794714 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0cb4057c80 con 0x7f0cbc0c8680 2024-04-15T00:02:04.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.384+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/1506944416 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00052e0 con 0x56127c5e3f70 2024-04-15T00:02:04.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.384+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/1506944416 <== mon.2 v2:172.21.15.37:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0cb00035f0 con 0x56127c5e3f70 2024-04-15T00:02:04.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.385+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ca8004220 con 0x56127c5e3f70 2024-04-15T00:02:04.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.386+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/1506944416 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0cb0020050 con 0x56127c5e3f70 2024-04-15T00:02:04.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.386+0000 7f0cc5b98740 10 client.4595 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:04.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.386+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56127c2dc6b0 con 0x56127c5e3f70 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/1506944416 <== mon.2 v2:172.21.15.37:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8004220 con 0x56127c5e3f70 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/1506944416 <== mon.2 v2:172.21.15.37:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0cb0023020 con 0x56127c5e3f70 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0cc5b98740 10 client.4595 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0cc5b98740 10 client.4595 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0cc5b98740 20 client.4595 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c5ee7a0 0x56127c5d8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0cc5b98740 4 client.4595 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:02:04.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.390+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 --> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56127c50b4c0 con 0x56127c5ee7a0 2024-04-15T00:02:04.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.399+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c5ee7a0 0x56127c5d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.523+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c5ee7a0 0x56127c5d8020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c3fae4eb89ae0817 server_cookie=7e768785359e470e in_seq=0 out_seq=0 2024-04-15T00:02:04.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.523+0000 7f0c9b7fe640 10 client.4595 ms_handle_connect on v2:172.21.15.37:6838/2258878813 2024-04-15T00:02:04.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.659+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/1506944416 <== mds.3 v2:172.21.15.37:6838/2258878813 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56127c50b4c0 con 0x56127c5ee7a0 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.659+0000 7f0c9b7fe640 10 client.4595 handle_command_reply: tid=0 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.659+0000 7f0cc5b98740 1 client.4595 shutdown 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 msgr2=0x56127c5d66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 0x56127c5d66f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000f460 tx=0x7f0cb000f920 comp rx=0 tx=0).stop 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 shutdown_connections 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c5ee7a0 0x56127c5d8020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5eb9e0 0x56127c5d6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5e3f70 0x56127c5d66f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1506944416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c5bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0c9b7fe640 0 client.4595 ms_handle_reset on v2:172.21.15.37:6838/2258878813 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 >> 172.21.15.29:0/1506944416 conn(0x56127c598b50 msgr2=0x56127c5db3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 shutdown_connections 2024-04-15T00:02:04.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1506944416 wait complete. 2024-04-15T00:02:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.660+0000 7f0cc5b98740 20 client.4595 trim_cache size 0 max 16384 2024-04-15T00:02:04.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.678+0000 7f0cc5b98740 1 Processor -- start 2024-04-15T00:02:04.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.678+0000 7f0cc5b98740 1 -- start start 2024-04-15T00:02:04.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c593680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c593bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc1f44e0 con 0x56127c5e3f70 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56127c5eb4c0 con 0x56127c59a0f0 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x56127c5d7380 con 0x56127c5eb9e0 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c593680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.679+0000 7f0cc1272640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c593bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.680+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c593680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52962/0 (socket says 172.21.15.29:52962) 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.680+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1820449779 learned_addr learned my addr 172.21.15.29:0/1820449779 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.680+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.682+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 msgr2=0x56127c593bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.682+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c593bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.682+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 msgr2=0x56127c59ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.682+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.682+0000 7f0cbbfff640 1 -- 172.21.15.29:0/1820449779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127c599cb0 con 0x56127c5e3f70 2024-04-15T00:02:04.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.684+0000 7f0cbbfff640 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c593680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ca802bf00 tx=0x7f0ca8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0295b14f593897e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.687+0000 7f0ca5ffb640 1 -- 172.21.15.29:0/1820449779 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca805cbc0 con 0x56127c5e3f70 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.687+0000 7f0ca5ffb640 1 -- 172.21.15.29:0/1820449779 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca805c070 con 0x56127c5e3f70 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.687+0000 7f0ca5ffb640 1 -- 172.21.15.29:0/1820449779 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca805c220 con 0x56127c5e3f70 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1820449779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 msgr2=0x56127c593680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c593680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ca802bf00 tx=0x7f0ca8031000 comp rx=0 tx=0).stop 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1820449779 shutdown_connections 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c593bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c5e3f70 0x56127c593680 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/1820449779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c59a0f0 0x56127c59ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1820449779 >> 172.21.15.29:0/1820449779 conn(0x56127c598b50 msgr2=0x56127c597ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1820449779 shutdown_connections 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.688+0000 7f0cc5b98740 1 -- 172.21.15.29:0/1820449779 wait complete. 2024-04-15T00:02:04.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.689+0000 7f0cc5b98740 1 -- start start 2024-04-15T00:02:04.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.689+0000 7f0cc5b98740 1 Processor -- start 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c6502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5e3f70 0x56127c5fdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c5ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56127c5e2f40 con 0x56127c59a0f0 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56127c5e47d0 con 0x56127c5e3f70 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x56127c5eebc0 con 0x56127c5eb9e0 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc5b98740 10 client.0 _ll_register_callbacks cb 0x7f0cb00012e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc0a71640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c6502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.690+0000 7f0cc1272640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c5ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.691+0000 7f0cbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5e3f70 0x56127c5fdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.691+0000 7f0cc0a71640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c6502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52966/0 (socket says 172.21.15.29:52966) 2024-04-15T00:02:04.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.691+0000 7f0cc0a71640 1 -- 172.21.15.29:0/2722021643 learned_addr learned my addr 172.21.15.29:0/2722021643 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.694+0000 7f0cc1272640 1 -- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5e3f70 msgr2=0x56127c5fdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.694+0000 7f0cc1272640 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5e3f70 0x56127c5fdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.694+0000 7f0cc1272640 1 -- 172.21.15.29:0/2722021643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 msgr2=0x56127c6502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.694+0000 7f0cc1272640 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c6502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.694+0000 7f0cc1272640 1 -- 172.21.15.29:0/2722021643 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56127c5d8140 con 0x56127c5eb9e0 2024-04-15T00:02:04.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.694+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c6502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:02:04.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.696+0000 7f0cc1272640 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c5ddf60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4056040 tx=0x7f0cb405dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25d945671f8ef3f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.696+0000 7f0c9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3301/0 2024-04-15T00:02:04.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.700+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/2722021643 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb405ae60 con 0x56127c5eb9e0 2024-04-15T00:02:04.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.700+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/2722021643 <== mon.2 v2:172.21.15.37:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0cb4059300 con 0x56127c5eb9e0 2024-04-15T00:02:04.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.700+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ca805c070 con 0x56127c5eb9e0 2024-04-15T00:02:04.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.702+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/2722021643 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0cb4055930 con 0x56127c5eb9e0 2024-04-15T00:02:04.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.702+0000 7f0cc5b98740 10 client.4601 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:04.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.702+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56127c5d9ad0 con 0x56127c5eb9e0 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/2722021643 <== mon.2 v2:172.21.15.37:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca805c070 con 0x56127c5eb9e0 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/2722021643 <== mon.2 v2:172.21.15.37:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0cb4055ad0 con 0x56127c5eb9e0 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0cc5b98740 10 client.4601 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0cc5b98740 10 client.4601 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0cc5b98740 20 client.4601 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c660890 0x56127c662c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0cc5b98740 4 client.4601 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:02:04.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.707+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 --> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] -- command(tid 0: {"prefix": "status"}) -- 0x56127c505810 con 0x56127c660890 2024-04-15T00:02:04.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.708+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c660890 0x56127c662c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.712+0000 7f0cc0a71640 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c660890 0x56127c662c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=26643560e0487a12 server_cookie=174ea02978afe20e in_seq=0 out_seq=0 2024-04-15T00:02:04.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.712+0000 7f0c9b7fe640 10 client.4601 ms_handle_connect on v2:172.21.15.37:6838/2258878813 2024-04-15T00:02:04.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0c9b7fe640 1 -- 172.21.15.29:0/2722021643 <== mds.3 v2:172.21.15.37:6838/2258878813 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56127c505810 con 0x56127c660890 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0c9b7fe640 10 client.4601 handle_command_reply: tid=0 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 client.4601 shutdown 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 msgr2=0x56127c5ddf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c5ddf60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4056040 tx=0x7f0cb405dd50 comp rx=0 tx=0).stop 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 shutdown_connections 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:6838/2258878813,v1:172.21.15.37:6839/2258878813] conn(0x56127c660890 0x56127c662c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x56127c5eb9e0 0x56127c5ddf60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56127c5e3f70 0x56127c5fdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 --2- 172.21.15.29:0/2722021643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56127c59a0f0 0x56127c6502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0c9b7fe640 0 client.4601 ms_handle_reset on v2:172.21.15.37:6838/2258878813 2024-04-15T00:02:04.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 >> 172.21.15.29:0/2722021643 conn(0x56127c598b50 msgr2=0x56127c597ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 shutdown_connections 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 1 -- 172.21.15.29:0/2722021643 wait complete. 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.731+0000 7f0cc5b98740 20 client.4601 trim_cache size 0 max 16384 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "7c8df2c3-f5a8-486a-b508-c448178a0a97", 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 3, 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4258, 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-15T00:02:04.739 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 18.597334017000001, 2024-04-15T00:02:04.740 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-15T00:02:04.740 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 29, 2024-04-15T00:02:04.740 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 29, 2024-04-15T00:02:04.740 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 61.370274428999998 2024-04-15T00:02:04.740 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0ca006b950 msgr2=0x7f0ca006de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0ca006b950 0x7f0ca006de10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56127c5da9d0 tx=0x7f0ca804a040 comp rx=0 tx=0).stop 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cbc0c8680 msgr2=0x7f0cbc1e5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cbc0c8680 0x7f0cbc1e5890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400efc0 tx=0x7f0cb400c490 comp rx=0 tx=0).stop 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 shutdown_connections 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0ca006b950 0x7f0ca006de10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cbc0c8680 0x7f0cbc1e5890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cbc0c36e0 0x7f0cbc1e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 --2- 172.21.15.29:0/1538794714 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0cbc070a60 0x7f0cbc14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 >> 172.21.15.29:0/1538794714 conn(0x7f0cbc0cd900 msgr2=0x7f0cbc14fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 shutdown_connections 2024-04-15T00:02:04.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.732+0000 7f0cc2cd5640 1 -- 172.21.15.29:0/1538794714 wait complete. 2024-04-15T00:02:04.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-15T00:02:04.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.847+0000 7fe62a311640 1 Processor -- start 2024-04-15T00:02:04.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.847+0000 7fe62a311640 1 -- start start 2024-04-15T00:02:04.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe62a311640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 0x7fe62415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe62a311640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6240c3450 0x7fe624071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe62a311640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62415bd10 con 0x7fe6240cac70 2024-04-15T00:02:04.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe62a311640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe6241590d0 con 0x7fe6240c3450 2024-04-15T00:02:04.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe62a311640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe6240c3900 con 0x7fe624152260 2024-04-15T00:02:04.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe623fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 0x7fe62415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.848+0000 7fe6288ae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6240c3450 0x7fe624071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.849+0000 7fe623fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 0x7fe62415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44474/0 (socket says 172.21.15.29:44474) 2024-04-15T00:02:04.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.849+0000 7fe623fff640 1 -- 172.21.15.29:0/3604261949 learned_addr learned my addr 172.21.15.29:0/3604261949 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.851+0000 7fe623fff640 1 -- 172.21.15.29:0/3604261949 >> v2:172.21.15.37:3300/0 conn(0x7fe6240c3450 msgr2=0x7fe624071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.851+0000 7fe623fff640 1 --2- 172.21.15.29:0/3604261949 >> v2:172.21.15.37:3300/0 conn(0x7fe6240c3450 0x7fe624071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.851+0000 7fe623fff640 1 -- 172.21.15.29:0/3604261949 >> v1:172.21.15.37:6789/0 conn(0x7fe6240cac70 legacy=0x7fe6241589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.851+0000 7fe623fff640 1 -- 172.21.15.29:0/3604261949 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62415bff0 con 0x7fe624152260 2024-04-15T00:02:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.853+0000 7fe623fff640 1 --2- 172.21.15.29:0/3604261949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 0x7fe62415b6a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009870 tx=0x7fe60c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc73ae5f2bae149a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.857+0000 7fe622ffd640 1 -- 172.21.15.29:0/3604261949 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c034070 con 0x7fe624152260 2024-04-15T00:02:04.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.857+0000 7fe622ffd640 1 -- 172.21.15.29:0/3604261949 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c030840 con 0x7fe624152260 2024-04-15T00:02:04.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.857+0000 7fe622ffd640 1 -- 172.21.15.29:0/3604261949 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c030c10 con 0x7fe624152260 2024-04-15T00:02:04.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 -- 172.21.15.29:0/3604261949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 msgr2=0x7fe62415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 --2- 172.21.15.29:0/3604261949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 0x7fe62415b6a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009870 tx=0x7fe60c02b980 comp rx=0 tx=0).stop 2024-04-15T00:02:04.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 -- 172.21.15.29:0/3604261949 shutdown_connections 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 --2- 172.21.15.29:0/3604261949 >> v2:172.21.15.37:3300/0 conn(0x7fe6240c3450 0x7fe624071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 --2- 172.21.15.29:0/3604261949 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe624152260 0x7fe62415b6a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 -- 172.21.15.29:0/3604261949 >> 172.21.15.29:0/3604261949 conn(0x7fe624070810 msgr2=0x7fe62406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 -- 172.21.15.29:0/3604261949 shutdown_connections 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.858+0000 7fe62a311640 1 -- 172.21.15.29:0/3604261949 wait complete. 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.859+0000 7fe62a311640 1 Processor -- start 2024-04-15T00:02:04.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.859+0000 7fe62a311640 1 -- start start 2024-04-15T00:02:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.860+0000 7fe62a311640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 0x7fe6241594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.860+0000 7fe62a311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240cac70 0x7fe62415b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.860+0000 7fe62a311640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe624152260 0x7fe624155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.860+0000 7fe62a311640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe6241581c0 con 0x7fe624152260 2024-04-15T00:02:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.860+0000 7fe62a311640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe62415c5b0 con 0x7fe6240cac70 2024-04-15T00:02:04.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.860+0000 7fe62a311640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe6241584a0 con 0x7fe6240c3450 2024-04-15T00:02:04.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.861+0000 7fe623fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 0x7fe6241594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.861+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240cac70 0x7fe62415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.861+0000 7fe6288ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe624152260 0x7fe624155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.861+0000 7fe623fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 0x7fe6241594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44476/0 (socket says 172.21.15.29:44476) 2024-04-15T00:02:04.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.861+0000 7fe623fff640 1 -- 172.21.15.29:0/1410326829 learned_addr learned my addr 172.21.15.29:0/1410326829 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.864+0000 7fe623fff640 1 -- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240cac70 msgr2=0x7fe62415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.864+0000 7fe623fff640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240cac70 0x7fe62415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.864+0000 7fe623fff640 1 -- 172.21.15.29:0/1410326829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe624152260 msgr2=0x7fe624155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.864+0000 7fe623fff640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe624152260 0x7fe624155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.864+0000 7fe623fff640 1 -- 172.21.15.29:0/1410326829 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6240b14c0 con 0x7fe6240c3450 2024-04-15T00:02:04.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.867+0000 7fe623fff640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 0x7fe6241594e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe60c02b9c0 tx=0x7fe60c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.869+0000 7fe620ff9640 1 -- 172.21.15.29:0/1410326829 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c034040 con 0x7fe6240c3450 2024-04-15T00:02:04.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.869+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6240b1730 con 0x7fe6240c3450 2024-04-15T00:02:04.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.869+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6240b24f0 con 0x7fe6240c3450 2024-04-15T00:02:04.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.871+0000 7fe620ff9640 1 -- 172.21.15.29:0/1410326829 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c030840 con 0x7fe6240c3450 2024-04-15T00:02:04.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.871+0000 7fe620ff9640 1 -- 172.21.15.29:0/1410326829 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c04d450 con 0x7fe6240c3450 2024-04-15T00:02:04.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.872+0000 7fe62d1c6740 1 Processor -- start 2024-04-15T00:02:04.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.872+0000 7fe62d1c6740 1 -- start start 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573080 0x564fab5758e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab577f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab578440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fab4dbf80 con 0x564fab5738c0 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564fab4849a0 con 0x564fab573080 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x564fab4d7f30 con 0x564fab573460 2024-04-15T00:02:04.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.873+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab578440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.874+0000 7fe6288ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573080 0x564fab5758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.874+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab578440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52992/0 (socket says 172.21.15.29:52992) 2024-04-15T00:02:04.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.874+0000 7fe6237fe640 1 -- 172.21.15.29:0/1252439488 learned_addr learned my addr 172.21.15.29:0/1252439488 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.876+0000 7fe6237fe640 1 -- 172.21.15.29:0/1252439488 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 msgr2=0x564fab577f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.876+0000 7fe6237fe640 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab577f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.876+0000 7fe6237fe640 1 -- 172.21.15.29:0/1252439488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573080 msgr2=0x564fab5758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.876+0000 7fe6237fe640 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573080 0x564fab5758e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.876+0000 7fe6237fe640 1 -- 172.21.15.29:0/1252439488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fab4a5480 con 0x564fab5738c0 2024-04-15T00:02:04.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.878+0000 7fe6237fe640 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab578440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe614001790 tx=0x7fe614007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5267154491e6b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.884+0000 7fe619ffb640 1 -- 172.21.15.29:0/1252439488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61401a070 con 0x564fab5738c0 2024-04-15T00:02:04.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.884+0000 7fe619ffb640 1 -- 172.21.15.29:0/1252439488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614005320 con 0x564fab5738c0 2024-04-15T00:02:04.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.884+0000 7fe619ffb640 1 -- 172.21.15.29:0/1252439488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614007290 con 0x564fab5738c0 2024-04-15T00:02:04.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 -- 172.21.15.29:0/1252439488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 msgr2=0x564fab578440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:04.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab578440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe614001790 tx=0x7fe614007e50 comp rx=0 tx=0).stop 2024-04-15T00:02:04.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 -- 172.21.15.29:0/1252439488 shutdown_connections 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab578440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab577f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/1252439488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573080 0x564fab5758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 -- 172.21.15.29:0/1252439488 >> 172.21.15.29:0/1252439488 conn(0x564fab574860 msgr2=0x564fab5771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 -- 172.21.15.29:0/1252439488 shutdown_connections 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 -- 172.21.15.29:0/1252439488 wait complete. 2024-04-15T00:02:04.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.885+0000 7fe62d1c6740 1 -- start start 2024-04-15T00:02:04.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 Processor -- start 2024-04-15T00:02:04.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fab5b78a0 con 0x564fab5738c0 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564fab497f40 con 0x564fab5c2ed0 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x564fab579cc0 con 0x564fab573460 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.886+0000 7fe62d1c6740 10 client.0 _ll_register_callbacks cb 0x564fab4929a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.887+0000 7fe623fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.887+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.887+0000 7fe623fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52994/0 (socket says 172.21.15.29:52994) 2024-04-15T00:02:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.887+0000 7fe623fff640 1 -- 172.21.15.29:0/3421384879 learned_addr learned my addr 172.21.15.29:0/3421384879 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.890+0000 7fe623fff640 1 -- 172.21.15.29:0/3421384879 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 msgr2=0x564fab5c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.890+0000 7fe623fff640 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.890+0000 7fe623fff640 1 -- 172.21.15.29:0/3421384879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 msgr2=0x564fab5c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.890+0000 7fe623fff640 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:04.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.890+0000 7fe623fff640 1 -- 172.21.15.29:0/3421384879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fab1f02d0 con 0x564fab5738c0 2024-04-15T00:02:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.892+0000 7fe623fff640 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5d1990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe60c02bf90 tx=0x7fe60c04deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48d2c5cce84de37 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.892+0000 7fe602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-15T00:02:04.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.893+0000 7fe620ff9640 1 -- 172.21.15.29:0/1410326829 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe60c04b060 con 0x7fe6240c3450 2024-04-15T00:02:04.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.893+0000 7fe620ff9640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe60406b900 0x7fe60406ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.894+0000 7fe6288ae640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe60406b900 0x7fe60406ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:04.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.894+0000 7fe6288ae640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe60406b900 0x7fe60406ddc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009fd0 tx=0x7fe61c009750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.896+0000 7fe602ffd640 1 -- 172.21.15.29:0/3421384879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c07d880 con 0x564fab5738c0 2024-04-15T00:02:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.896+0000 7fe602ffd640 1 -- 172.21.15.29:0/3421384879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe60c07bdb0 con 0x564fab5738c0 2024-04-15T00:02:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.896+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe614005320 con 0x564fab5738c0 2024-04-15T00:02:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.897+0000 7fe620ff9640 1 -- 172.21.15.29:0/1410326829 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe60c0840c0 con 0x7fe6240c3450 2024-04-15T00:02:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.898+0000 7fe602ffd640 1 -- 172.21.15.29:0/3421384879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe60c07d410 con 0x564fab5738c0 2024-04-15T00:02:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.898+0000 7fe62d1c6740 10 client.4746 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.898+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564fab2ba6b0 con 0x564fab5738c0 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe602ffd640 1 -- 172.21.15.29:0/3421384879 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614005320 con 0x564fab5738c0 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe602ffd640 1 -- 172.21.15.29:0/3421384879 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe60c07a120 con 0x564fab5738c0 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe62d1c6740 10 client.4746 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe62d1c6740 10 client.4746 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe62d1c6740 20 client.4746 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab5da650 0x564fab5dca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:04.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe62d1c6740 4 client.4746 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:02:04.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.902+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 --> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fab4e94c0 con 0x564fab5da650 2024-04-15T00:02:04.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:04.910+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab5da650 0x564fab5dca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.001+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab5da650 0x564fab5dca40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a35397d27cdd4f12 server_cookie=34b9c762cebc0500 in_seq=0 out_seq=0 2024-04-15T00:02:05.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.001+0000 7fe602ffd640 10 client.4746 ms_handle_connect on v2:172.21.15.29:6832/3178649227 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe602ffd640 1 -- 172.21.15.29:0/3421384879 <== mds.2 v2:172.21.15.29:6832/3178649227 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564fab4e94c0 con 0x564fab5da650 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe602ffd640 10 client.4746 handle_command_reply: tid=0 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 client.4746 shutdown 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 msgr2=0x564fab5d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5d1990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe60c02bf90 tx=0x7fe60c04deb0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 shutdown_connections 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5d1990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab5da650 0x564fab5dca40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3421384879 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe602ffd640 0 client.4746 ms_handle_reset on v2:172.21.15.29:6832/3178649227 2024-04-15T00:02:05.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 >> 172.21.15.29:0/3421384879 conn(0x564fab573080 msgr2=0x564fab571680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 shutdown_connections 2024-04-15T00:02:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3421384879 wait complete. 2024-04-15T00:02:05.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.123+0000 7fe62d1c6740 20 client.4746 trim_cache size 0 max 16384 2024-04-15T00:02:05.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.141+0000 7fe62d1c6740 1 Processor -- start 2024-04-15T00:02:05.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 -- start start 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe60800c310 con 0x564fab5738c0 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564fab497f40 con 0x564fab5c2ed0 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.142+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x564fab5b78a0 con 0x564fab573460 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.143+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.143+0000 7fe623fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.143+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5dfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53002/0 (socket says 172.21.15.29:53002) 2024-04-15T00:02:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.143+0000 7fe6237fe640 1 -- 172.21.15.29:0/3351733465 learned_addr learned my addr 172.21.15.29:0/3351733465 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.143+0000 7fe6288ae640 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.145+0000 7fe6237fe640 1 -- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 msgr2=0x564fab5c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.145+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.145+0000 7fe6237fe640 1 -- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 msgr2=0x564fab5dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.145+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5dffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.145+0000 7fe6237fe640 1 -- 172.21.15.29:0/3351733465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fab47be30 con 0x564fab5738c0 2024-04-15T00:02:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.147+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5dfa70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe614018040 tx=0x7fe61400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716550dc9fabf1cc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.151+0000 7fe6197fa640 1 -- 172.21.15.29:0/3351733465 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61401a070 con 0x564fab5738c0 2024-04-15T00:02:05.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.151+0000 7fe6197fa640 1 -- 172.21.15.29:0/3351733465 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614026020 con 0x564fab5738c0 2024-04-15T00:02:05.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.151+0000 7fe6197fa640 1 -- 172.21.15.29:0/3351733465 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614007310 con 0x564fab5738c0 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.151+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3351733465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 msgr2=0x564fab5dfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.151+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5dfa70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe614018040 tx=0x7fe61400c000 comp rx=0 tx=0).stop 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3351733465 shutdown_connections 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab5c2ed0 0x564fab5dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5738c0 0x564fab5dfa70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3351733465 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab573460 0x564fab5c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3351733465 >> 172.21.15.29:0/3351733465 conn(0x564fab573080 msgr2=0x564fab576100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3351733465 shutdown_connections 2024-04-15T00:02:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3351733465 wait complete. 2024-04-15T00:02:05.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.152+0000 7fe62d1c6740 1 -- start start 2024-04-15T00:02:05.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 Processor -- start 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573460 0x564fab5d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab5738c0 0x564fab5d6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 0x564fab631d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564fab5bc9c0 con 0x564fab5c2ed0 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564fab5c1740 con 0x564fab573460 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x564fab5ba420 con 0x564fab5738c0 2024-04-15T00:02:05.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.153+0000 7fe62d1c6740 10 client.0 _ll_register_callbacks cb 0x7fe61c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:05.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.154+0000 7fe6237fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab5738c0 0x564fab5d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.154+0000 7fe6288ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 0x564fab631d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.154+0000 7fe623fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573460 0x564fab5d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.154+0000 7fe6288ae640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 0x564fab631d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53010/0 (socket says 172.21.15.29:53010) 2024-04-15T00:02:05.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.154+0000 7fe6288ae640 1 -- 172.21.15.29:0/3066240887 learned_addr learned my addr 172.21.15.29:0/3066240887 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.157+0000 7fe6237fe640 1 -- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573460 msgr2=0x564fab5d7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.157+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573460 0x564fab5d7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.157+0000 7fe6237fe640 1 -- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 msgr2=0x564fab631d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.157+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 0x564fab631d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.157+0000 7fe6237fe640 1 -- 172.21.15.29:0/3066240887 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x564fab5bbc40 con 0x564fab5738c0 2024-04-15T00:02:05.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.157+0000 7fe6288ae640 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 0x564fab631d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T00:02:05.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.160+0000 7fe6237fe640 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab5738c0 0x564fab5d6820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe614001eb0 tx=0x7fe614000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12964de1494d3c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.160+0000 7fe602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3301/0 2024-04-15T00:02:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.164+0000 7fe602ffd640 1 -- 172.21.15.29:0/3066240887 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61401a070 con 0x564fab5738c0 2024-04-15T00:02:05.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.164+0000 7fe602ffd640 1 -- 172.21.15.29:0/3066240887 <== mon.2 v2:172.21.15.37:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe6140069d0 con 0x564fab5738c0 2024-04-15T00:02:05.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.164+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe614026020 con 0x564fab5738c0 2024-04-15T00:02:05.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.166+0000 7fe602ffd640 1 -- 172.21.15.29:0/3066240887 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe614038050 con 0x564fab5738c0 2024-04-15T00:02:05.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.166+0000 7fe62d1c6740 10 client.4613 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:05.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.166+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564fab5b5bc0 con 0x564fab5738c0 2024-04-15T00:02:05.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe602ffd640 1 -- 172.21.15.29:0/3066240887 <== mon.2 v2:172.21.15.37:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614026020 con 0x564fab5738c0 2024-04-15T00:02:05.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe602ffd640 1 -- 172.21.15.29:0/3066240887 <== mon.2 v2:172.21.15.37:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe61403b020 con 0x564fab5738c0 2024-04-15T00:02:05.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe62d1c6740 10 client.4613 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:05.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe62d1c6740 10 client.4613 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-15T00:02:05.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe62d1c6740 20 client.4613 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:05.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab63bd70 0x564fab6449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe62d1c6740 4 client.4613 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:02:05.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 --> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] -- command(tid 0: {"prefix": "status"}) -- 0x564fab4e3810 con 0x564fab63bd70 2024-04-15T00:02:05.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.171+0000 7fe623fff640 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab63bd70 0x564fab6449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.174+0000 7fe623fff640 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab63bd70 0x564fab6449f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36794f55d2aaac09 server_cookie=f3c43215dc5b888a in_seq=0 out_seq=0 2024-04-15T00:02:05.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.174+0000 7fe602ffd640 10 client.4613 ms_handle_connect on v2:172.21.15.29:6832/3178649227 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe602ffd640 1 -- 172.21.15.29:0/3066240887 <== mds.2 v2:172.21.15.29:6832/3178649227 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564fab4e3810 con 0x564fab63bd70 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe602ffd640 10 client.4613 handle_command_reply: tid=0 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 client.4613 shutdown 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab5738c0 msgr2=0x564fab5d6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab5738c0 0x564fab5d6820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe614001eb0 tx=0x7fe614000bc0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 shutdown_connections 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564fab5c2ed0 0x564fab631d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.29:6832/3178649227,v1:172.21.15.29:6833/3178649227] conn(0x564fab63bd70 0x564fab6449f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x564fab5738c0 0x564fab5d6820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe602ffd640 0 client.4613 ms_handle_reset on v2:172.21.15.29:6832/3178649227 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 --2- 172.21.15.29:0/3066240887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fab573460 0x564fab5d7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 >> 172.21.15.29:0/3066240887 conn(0x564fab573080 msgr2=0x564fab575870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 shutdown_connections 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 1 -- 172.21.15.29:0/3066240887 wait complete. 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.194+0000 7fe62d1c6740 20 client.4613 trim_cache size 0 max 16384 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "7c8df2c3-f5a8-486a-b508-c448178a0a97", 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 2, 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4266, 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-15T00:02:05.202 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 21.927238076999998, 2024-04-15T00:02:05.203 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-15T00:02:05.203 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 29, 2024-04-15T00:02:05.203 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 29, 2024-04-15T00:02:05.203 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 62.015629668999999 2024-04-15T00:02:05.203 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:02:05.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe60406b900 msgr2=0x7fe60406ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe60406b900 0x7fe60406ddc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009fd0 tx=0x7fe61c009750 comp rx=0 tx=0).stop 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 msgr2=0x7fe6241594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 0x7fe6241594e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe60c02b9c0 tx=0x7fe60c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 shutdown_connections 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe60406b900 0x7fe60406ddc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe624152260 0x7fe624155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6240cac70 0x7fe62415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 --2- 172.21.15.29:0/1410326829 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe6240c3450 0x7fe6241594e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 >> 172.21.15.29:0/1410326829 conn(0x7fe624070810 msgr2=0x7fe6240c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 shutdown_connections 2024-04-15T00:02:05.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.195+0000 7fe62a311640 1 -- 172.21.15.29:0/1410326829 wait complete. 2024-04-15T00:02:05.213 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-15T00:02:05.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.310+0000 7f54c20d5640 1 Processor -- start 2024-04-15T00:02:05.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.310+0000 7f54c20d5640 1 -- start start 2024-04-15T00:02:05.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.311+0000 7f54c20d5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc154760 0x7f54bc0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.311+0000 7f54c20d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54bc15e470 0x7f54bc15d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.311+0000 7f54c20d5640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f54bc15deb0 0x7f54bc0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.311+0000 7f54c20d5640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0cc370 con 0x7f54bc15deb0 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.311+0000 7f54c20d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc154b40 con 0x7f54bc15e470 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.311+0000 7f54c20d5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0ce630 con 0x7f54bc154760 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.312+0000 7f54bbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f54bc15deb0 0x7f54bc0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.312+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc154760 0x7f54bc0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.312+0000 7f54baffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54bc15e470 0x7f54bc15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.312+0000 7f54bbfff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f54bc15deb0 0x7f54bc0ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53022/0 (socket says 172.21.15.29:53022) 2024-04-15T00:02:05.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.312+0000 7f54bbfff640 1 -- 172.21.15.29:0/1456926222 learned_addr learned my addr 172.21.15.29:0/1456926222 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.314+0000 7f54bbfff640 1 -- 172.21.15.29:0/1456926222 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc154760 msgr2=0x7f54bc0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.314+0000 7f54bbfff640 1 --2- 172.21.15.29:0/1456926222 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc154760 0x7f54bc0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.314+0000 7f54bbfff640 1 -- 172.21.15.29:0/1456926222 >> v2:172.21.15.37:3300/0 conn(0x7f54bc15e470 msgr2=0x7f54bc15d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.314+0000 7f54bbfff640 1 --2- 172.21.15.29:0/1456926222 >> v2:172.21.15.37:3300/0 conn(0x7f54bc15e470 0x7f54bc15d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.314+0000 7f54bbfff640 1 -- 172.21.15.29:0/1456926222 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0ce910 con 0x7f54bc15deb0 2024-04-15T00:02:05.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.316+0000 7f54bbfff640 1 --2- 172.21.15.29:0/1456926222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc15deb0 0x7f54bc0ccb00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54bc08db10 tx=0x7f54b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c997e38aff7c198 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54ba7fc640 1 -- 172.21.15.29:0/1456926222 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b402ca70 con 0x7f54bc15deb0 2024-04-15T00:02:05.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54ba7fc640 1 -- 172.21.15.29:0/1456926222 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b402cc10 con 0x7f54bc15deb0 2024-04-15T00:02:05.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54ba7fc640 1 -- 172.21.15.29:0/1456926222 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b40343f0 con 0x7f54bc15deb0 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 -- 172.21.15.29:0/1456926222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc15deb0 msgr2=0x7f54bc0ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 --2- 172.21.15.29:0/1456926222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc15deb0 0x7f54bc0ccb00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54bc08db10 tx=0x7f54b402bed0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 -- 172.21.15.29:0/1456926222 shutdown_connections 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 --2- 172.21.15.29:0/1456926222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc15deb0 0x7f54bc0ccb00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 --2- 172.21.15.29:0/1456926222 >> v2:172.21.15.37:3300/0 conn(0x7f54bc15e470 0x7f54bc15d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 --2- 172.21.15.29:0/1456926222 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc154760 0x7f54bc0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 -- 172.21.15.29:0/1456926222 >> 172.21.15.29:0/1456926222 conn(0x7f54bc061c20 msgr2=0x7f54bc062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 -- 172.21.15.29:0/1456926222 shutdown_connections 2024-04-15T00:02:05.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.320+0000 7f54c20d5640 1 -- 172.21.15.29:0/1456926222 wait complete. 2024-04-15T00:02:05.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.322+0000 7f54c20d5640 1 Processor -- start 2024-04-15T00:02:05.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.322+0000 7f54c20d5640 1 -- start start 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54c20d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 0x7f54bc0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54c20d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc15deb0 0x7f54bc1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54c20d5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc15e470 0x7f54bc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54c20d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0ceed0 con 0x7f54bc154760 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54c20d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0cc5e0 con 0x7f54bc15deb0 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54c20d5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0cac10 con 0x7f54bc15e470 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 0x7f54bc0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc15e470 0x7f54bc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc15deb0 0x7f54bc1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 0x7f54bc0c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53030/0 (socket says 172.21.15.29:53030) 2024-04-15T00:02:05.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.323+0000 7f54bb7fe640 1 -- 172.21.15.29:0/3886917596 learned_addr learned my addr 172.21.15.29:0/3886917596 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.327+0000 7f54bb7fe640 1 -- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc15e470 msgr2=0x7f54bc0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.327+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc15e470 0x7f54bc0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.327+0000 7f54bb7fe640 1 -- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc15deb0 msgr2=0x7f54bc1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.327+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc15deb0 0x7f54bc1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.327+0000 7f54bb7fe640 1 -- 172.21.15.29:0/3886917596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc155e60 con 0x7f54bc154760 2024-04-15T00:02:05.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.329+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 0x7f54bc0c72c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e8a0 tx=0x7f54ac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.333+0000 7f54a3fff640 1 -- 172.21.15.29:0/3886917596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac017070 con 0x7f54bc154760 2024-04-15T00:02:05.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.333+0000 7f54a3fff640 1 -- 172.21.15.29:0/3886917596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac00c940 con 0x7f54bc154760 2024-04-15T00:02:05.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.333+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc15aae0 con 0x7f54bc154760 2024-04-15T00:02:05.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.333+0000 7f54a3fff640 1 -- 172.21.15.29:0/3886917596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00cd30 con 0x7f54bc154760 2024-04-15T00:02:05.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.333+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc1560d0 con 0x7f54bc154760 2024-04-15T00:02:05.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.335+0000 7f54c4f97740 1 Processor -- start 2024-04-15T00:02:05.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.335+0000 7f54c4f97740 1 -- start start 2024-04-15T00:02:05.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.336+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b3230f0 0x561b9b3234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.336+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b323a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.336+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 0x561b9b362950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.336+0000 7f54c4f97740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561b9b286f80 con 0x561b9b3230f0 2024-04-15T00:02:05.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.336+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b9b22f9a0 con 0x561b9b36cf70 2024-04-15T00:02:05.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.336+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x561b9b282f30 con 0x561b9b321b50 2024-04-15T00:02:05.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.337+0000 7f54baffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 0x561b9b362950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.337+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b323a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.337+0000 7f54baffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 0x561b9b362950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44532/0 (socket says 172.21.15.29:44532) 2024-04-15T00:02:05.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.337+0000 7f54baffd640 1 -- 172.21.15.29:0/1350620952 learned_addr learned my addr 172.21.15.29:0/1350620952 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.339+0000 7f54baffd640 1 -- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 msgr2=0x561b9b323a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.339+0000 7f54baffd640 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b323a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.339+0000 7f54baffd640 1 -- 172.21.15.29:0/1350620952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b3230f0 msgr2=0x561b9b3234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.339+0000 7f54baffd640 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b3230f0 0x561b9b3234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.339+0000 7f54baffd640 1 -- 172.21.15.29:0/1350620952 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b9b250480 con 0x561b9b321b50 2024-04-15T00:02:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.341+0000 7f54baffd640 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 0x561b9b362950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009b60 tx=0x7f54b0011690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7585507330b61cae server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.345+0000 7f54a17fa640 1 -- 172.21.15.29:0/1350620952 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0009e60 con 0x561b9b321b50 2024-04-15T00:02:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.345+0000 7f54a17fa640 1 -- 172.21.15.29:0/1350620952 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b0004030 con 0x561b9b321b50 2024-04-15T00:02:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.345+0000 7f54a17fa640 1 -- 172.21.15.29:0/1350620952 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b00043e0 con 0x561b9b321b50 2024-04-15T00:02:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 -- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 msgr2=0x561b9b362950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 0x561b9b362950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009b60 tx=0x7f54b0011690 comp rx=0 tx=0).stop 2024-04-15T00:02:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 -- 172.21.15.29:0/1350620952 shutdown_connections 2024-04-15T00:02:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b321b50 0x561b9b362950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b323a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1350620952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b3230f0 0x561b9b3234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 -- 172.21.15.29:0/1350620952 >> 172.21.15.29:0/1350620952 conn(0x561b9b31f860 msgr2=0x561b9b3221a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 -- 172.21.15.29:0/1350620952 shutdown_connections 2024-04-15T00:02:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 -- 172.21.15.29:0/1350620952 wait complete. 2024-04-15T00:02:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 -- start start 2024-04-15T00:02:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.346+0000 7f54c4f97740 1 Processor -- start 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b3601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36cf70 0x561b9b346860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 0x561b9b362c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561b9b348650 con 0x561b9b36cf70 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b9b242f40 con 0x561b9b3230f0 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x561b9b320a10 con 0x561b9b36c580 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.347+0000 7f54c4f97740 10 client.0 _ll_register_callbacks cb 0x561b9b23d9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.348+0000 7f54baffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 0x561b9b362c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.348+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b3601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.348+0000 7f54baffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 0x561b9b362c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44548/0 (socket says 172.21.15.29:44548) 2024-04-15T00:02:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.348+0000 7f54baffd640 1 -- 172.21.15.29:0/2192254392 learned_addr learned my addr 172.21.15.29:0/2192254392 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.351+0000 7f54baffd640 1 -- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 msgr2=0x561b9b3601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.351+0000 7f54baffd640 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b3601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.351+0000 7f54baffd640 1 -- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36cf70 msgr2=0x561b9b346860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.351+0000 7f54baffd640 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36cf70 0x561b9b346860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.351+0000 7f54baffd640 1 -- 172.21.15.29:0/2192254392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x561b9af9b2d0 con 0x561b9b36c580 2024-04-15T00:02:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.354+0000 7f54baffd640 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 0x561b9b362c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54b0003840 tx=0x7f54b0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41cb930c3118ef8e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.354+0000 7f549a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3301/0 2024-04-15T00:02:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.355+0000 7f54a3fff640 1 -- 172.21.15.29:0/3886917596 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f54ac01a070 con 0x7f54bc154760 2024-04-15T00:02:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.355+0000 7f54a3fff640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54a806b930 0x7f54a806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.355+0000 7f54bbfff640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54a806b930 0x7f54a806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.356+0000 7f54bbfff640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54a806b930 0x7f54a806ddf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f54b4035000 tx=0x7f54b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.357+0000 7f549a7fc640 1 -- 172.21.15.29:0/2192254392 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b002c060 con 0x561b9b36c580 2024-04-15T00:02:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.357+0000 7f549a7fc640 1 -- 172.21.15.29:0/2192254392 <== mon.2 v2:172.21.15.37:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f54b0003d30 con 0x561b9b36c580 2024-04-15T00:02:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.357+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b0004030 con 0x561b9b36c580 2024-04-15T00:02:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.358+0000 7f54a3fff640 1 -- 172.21.15.29:0/3886917596 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f54ac025e30 con 0x7f54bc154760 2024-04-15T00:02:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.359+0000 7f549a7fc640 1 -- 172.21.15.29:0/2192254392 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f54b0032050 con 0x561b9b36c580 2024-04-15T00:02:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.359+0000 7f54c4f97740 10 client.4625 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.359+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561b9b0656b0 con 0x561b9b36c580 2024-04-15T00:02:05.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f549a7fc640 1 -- 172.21.15.29:0/2192254392 <== mon.2 v2:172.21.15.37:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b0004030 con 0x561b9b36c580 2024-04-15T00:02:05.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f549a7fc640 1 -- 172.21.15.29:0/2192254392 <== mon.2 v2:172.21.15.37:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f54b0026070 con 0x561b9b36c580 2024-04-15T00:02:05.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f54c4f97740 10 client.4625 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:05.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f54c4f97740 10 client.4625 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-15T00:02:05.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f54c4f97740 20 client.4625 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:05.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f54c4f97740 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b380c40 0x561b9b383030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f54c4f97740 4 client.4625 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:02:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.363+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 --> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b9b2944c0 con 0x561b9b380c40 2024-04-15T00:02:05.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.364+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b380c40 0x561b9b383030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.411+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b380c40 0x561b9b383030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f50e138b0a209b9 server_cookie=84801e845ca8b19c in_seq=0 out_seq=0 2024-04-15T00:02:05.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.411+0000 7f549a7fc640 10 client.4625 ms_handle_connect on v2:172.21.15.29:6835/2229372959 2024-04-15T00:02:05.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f549a7fc640 1 -- 172.21.15.29:0/2192254392 <== mds.1 v2:172.21.15.29:6835/2229372959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561b9b2944c0 con 0x561b9b380c40 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f549a7fc640 10 client.4625 handle_command_reply: tid=0 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 client.4625 shutdown 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 msgr2=0x561b9b362c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 0x561b9b362c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54b0003840 tx=0x7f54b0004730 comp rx=0 tx=0).stop 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 shutdown_connections 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b380c40 0x561b9b383030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36c580 0x561b9b362c10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36cf70 0x561b9b346860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 --2- 172.21.15.29:0/2192254392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b3601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f549a7fc640 0 client.4625 ms_handle_reset on v2:172.21.15.29:6835/2229372959 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 >> 172.21.15.29:0/2192254392 conn(0x561b9b321b50 msgr2=0x561b9b3234d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 shutdown_connections 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 1 -- 172.21.15.29:0/2192254392 wait complete. 2024-04-15T00:02:05.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.531+0000 7f54c4f97740 20 client.4625 trim_cache size 0 max 16384 2024-04-15T00:02:05.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.549+0000 7f54c4f97740 1 Processor -- start 2024-04-15T00:02:05.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.549+0000 7f54c4f97740 1 -- start start 2024-04-15T00:02:05.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.550+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b3230f0 0x561b9b318f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.550+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b33b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.550+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b33bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.550+0000 7f54c4f97740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1fdae0 con 0x561b9b36c580 2024-04-15T00:02:05.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.550+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1fe1b0 con 0x561b9b36cf70 2024-04-15T00:02:05.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.550+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x561b9b33fee0 con 0x561b9b3230f0 2024-04-15T00:02:05.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.551+0000 7f54baffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b33b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.551+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b3230f0 0x561b9b318f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.551+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b33bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.551+0000 7f54baffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b33b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53050/0 (socket says 172.21.15.29:53050) 2024-04-15T00:02:05.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.551+0000 7f54baffd640 1 -- 172.21.15.29:0/1336083078 learned_addr learned my addr 172.21.15.29:0/1336083078 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.553+0000 7f54baffd640 1 -- 172.21.15.29:0/1336083078 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b3230f0 msgr2=0x561b9b318f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.553+0000 7f54baffd640 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b3230f0 0x561b9b318f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.553+0000 7f54baffd640 1 -- 172.21.15.29:0/1336083078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 msgr2=0x561b9b33bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.553+0000 7f54baffd640 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b33bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.553+0000 7f54baffd640 1 -- 172.21.15.29:0/1336083078 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b9b3246e0 con 0x561b9b36c580 2024-04-15T00:02:05.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.555+0000 7f54baffd640 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b33b700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54b00116d0 tx=0x7f54b0024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb00dd151f6507ca server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.559+0000 7f54a0ff9640 1 -- 172.21.15.29:0/1336083078 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0009710 con 0x561b9b36c580 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.559+0000 7f54a0ff9640 1 -- 172.21.15.29:0/1336083078 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b0011b90 con 0x561b9b36c580 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.559+0000 7f54a0ff9640 1 -- 172.21.15.29:0/1336083078 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0003b30 con 0x561b9b36c580 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.559+0000 7f54c4f97740 1 -- 172.21.15.29:0/1336083078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 msgr2=0x561b9b33b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.559+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b33b700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54b00116d0 tx=0x7f54b0024000 comp rx=0 tx=0).stop 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 -- 172.21.15.29:0/1336083078 shutdown_connections 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b36cf70 0x561b9b33bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b33b700 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 --2- 172.21.15.29:0/1336083078 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b3230f0 0x561b9b318f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 -- 172.21.15.29:0/1336083078 >> 172.21.15.29:0/1336083078 conn(0x561b9b321b50 msgr2=0x561b9b360d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 -- 172.21.15.29:0/1336083078 shutdown_connections 2024-04-15T00:02:05.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 -- 172.21.15.29:0/1336083078 wait complete. 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.560+0000 7f54c4f97740 1 -- start start 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 Processor -- start 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b347ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b366580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36cf70 0x561b9b3d7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561b9b341510 con 0x561b9b36c580 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b9b3404f0 con 0x561b9b3230f0 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x561b9b35e860 con 0x561b9b36cf70 2024-04-15T00:02:05.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.561+0000 7f54c4f97740 10 client.0 _ll_register_callbacks cb 0x7f54ac01f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:05.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.562+0000 7f54baffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b366580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.562+0000 7f54bbfff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36cf70 0x561b9b3d7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.562+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b347ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.562+0000 7f54baffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b366580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53060/0 (socket says 172.21.15.29:53060) 2024-04-15T00:02:05.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.562+0000 7f54baffd640 1 -- 172.21.15.29:0/3932201076 learned_addr learned my addr 172.21.15.29:0/3932201076 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.565+0000 7f54baffd640 1 -- 172.21.15.29:0/3932201076 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36cf70 msgr2=0x561b9b3d7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.565+0000 7f54baffd640 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36cf70 0x561b9b3d7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.565+0000 7f54baffd640 1 -- 172.21.15.29:0/3932201076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 msgr2=0x561b9b347ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.565+0000 7f54baffd640 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b347ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.565+0000 7f54baffd640 1 -- 172.21.15.29:0/3932201076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b9b31e950 con 0x561b9b36c580 2024-04-15T00:02:05.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.567+0000 7f54baffd640 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b366580 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009160 tx=0x7f54b0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8803efaed4cbeb00 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.567+0000 7f549a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-04-15T00:02:05.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.571+0000 7f549a7fc640 1 -- 172.21.15.29:0/3932201076 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0003b30 con 0x561b9b36c580 2024-04-15T00:02:05.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.571+0000 7f549a7fc640 1 -- 172.21.15.29:0/3932201076 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f54b0003cd0 con 0x561b9b36c580 2024-04-15T00:02:05.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.571+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b0011b90 con 0x561b9b36c580 2024-04-15T00:02:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.573+0000 7f549a7fc640 1 -- 172.21.15.29:0/3932201076 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f54b0047050 con 0x561b9b36c580 2024-04-15T00:02:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.573+0000 7f54c4f97740 10 client.4764 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:05.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.573+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561b9b322730 con 0x561b9b36c580 2024-04-15T00:02:05.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f549a7fc640 1 -- 172.21.15.29:0/3932201076 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b0011b90 con 0x561b9b36c580 2024-04-15T00:02:05.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f549a7fc640 1 -- 172.21.15.29:0/3932201076 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f54b004a020 con 0x561b9b36c580 2024-04-15T00:02:05.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f54c4f97740 10 client.4764 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:05.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f54c4f97740 10 client.4764 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-15T00:02:05.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f54c4f97740 20 client.4764 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f54c4f97740 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b338530 0x561b9b3eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f54c4f97740 4 client.4764 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:02:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.576+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 --> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] -- command(tid 0: {"prefix": "status"}) -- 0x561b9b28e810 con 0x561b9b338530 2024-04-15T00:02:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.577+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b338530 0x561b9b3eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.580+0000 7f54bb7fe640 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b338530 0x561b9b3eaa80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c953a6ca009097b server_cookie=6c17a3d6d7ae1845 in_seq=0 out_seq=0 2024-04-15T00:02:05.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.580+0000 7f549a7fc640 10 client.4764 ms_handle_connect on v2:172.21.15.29:6835/2229372959 2024-04-15T00:02:05.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f549a7fc640 1 -- 172.21.15.29:0/3932201076 <== mds.1 v2:172.21.15.29:6835/2229372959 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x561b9b28e810 con 0x561b9b338530 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f549a7fc640 10 client.4764 handle_command_reply: tid=0 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 client.4764 shutdown 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 msgr2=0x561b9b366580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b366580 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009160 tx=0x7f54b0009190 comp rx=0 tx=0).stop 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 shutdown_connections 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:6835/2229372959,v1:172.21.15.29:6837/2229372959] conn(0x561b9b338530 0x561b9b3eaa80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x561b9b36cf70 0x561b9b3d7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561b9b36c580 0x561b9b366580 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f549a7fc640 0 client.4764 ms_handle_reset on v2:172.21.15.29:6835/2229372959 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 --2- 172.21.15.29:0/3932201076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b9b3230f0 0x561b9b347ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 >> 172.21.15.29:0/3932201076 conn(0x561b9b321b50 msgr2=0x561b9b34c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 shutdown_connections 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 1 -- 172.21.15.29:0/3932201076 wait complete. 2024-04-15T00:02:05.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.599+0000 7f54c4f97740 20 client.4764 trim_cache size 0 max 16384 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "7c8df2c3-f5a8-486a-b508-c448178a0a97", 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 1, 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4272, 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 24.599992065999999, 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-15T00:02:05.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 29, 2024-04-15T00:02:05.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 29, 2024-04-15T00:02:05.608 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 62.385645717999999 2024-04-15T00:02:05.608 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:02:05.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54a806b930 msgr2=0x7f54a806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54a806b930 0x7f54a806ddf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f54b4035000 tx=0x7f54b402e000 comp rx=0 tx=0).stop 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 msgr2=0x7f54bc0c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 0x7f54bc0c72c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e8a0 tx=0x7f54ac00ed60 comp rx=0 tx=0).stop 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 shutdown_connections 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f54a806b930 0x7f54a806ddf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f54bc15e470 0x7f54bc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54bc15deb0 0x7f54bc1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 --2- 172.21.15.29:0/3886917596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54bc154760 0x7f54bc0c72c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 >> 172.21.15.29:0/3886917596 conn(0x7f54bc061c20 msgr2=0x7f54bc15cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 shutdown_connections 2024-04-15T00:02:05.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.600+0000 7f54c20d5640 1 -- 172.21.15.29:0/3886917596 wait complete. 2024-04-15T00:02:05.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-15T00:02:05.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.714+0000 7fc7ca11e640 1 Processor -- start 2024-04-15T00:02:05.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.714+0000 7fc7ca11e640 1 -- start start 2024-04-15T00:02:05.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7ca11e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7ca11e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7c40c36e0 0x7fc7c40c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7ca11e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c40c8c50 con 0x7fc7c4070a60 2024-04-15T00:02:05.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7ca11e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c40c91e0 con 0x7fc7c40c36e0 2024-04-15T00:02:05.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7ca11e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c40c9430 con 0x7fc7c40c8680 2024-04-15T00:02:05.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7c37fe640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc7c4070a60 0x7fc7c406c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50178/0 (socket says 172.21.15.29:50178) 2024-04-15T00:02:05.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7c37fe640 1 -- 172.21.15.29:0/1152255331 learned_addr learned my addr 172.21.15.29:0/1152255331 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T00:02:05.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/1152255331 >> v2:172.21.15.37:3300/0 conn(0x7fc7c40c36e0 0x7fc7c40c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.715+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.718+0000 7fc7c27fc640 1 -- 172.21.15.29:0/1152255331 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294583983 0 0) 0x7fc7c40c8c50 con 0x7fc7c4070a60 2024-04-15T00:02:05.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.718+0000 7fc7c27fc640 1 -- 172.21.15.29:0/1152255331 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7ac003520 con 0x7fc7c4070a60 2024-04-15T00:02:05.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.718+0000 7fc7c3fff640 1 -- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 msgr2=0x7fc7c415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.718+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.718+0000 7fc7c3fff640 1 -- 172.21.15.29:0/1152255331 >> v1:172.21.15.29:6789/0 conn(0x7fc7c4070a60 legacy=0x7fc7c406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.718+0000 7fc7c3fff640 1 -- 172.21.15.29:0/1152255331 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c40c9710 con 0x7fc7c40c36e0 2024-04-15T00:02:05.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.720+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c40c36e0 0x7fc7c40c3b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cd010ef0cd13c01 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7c27fc640 1 -- 172.21.15.29:0/1152255331 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc039070 con 0x7fc7c40c36e0 2024-04-15T00:02:05.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7c27fc640 1 -- 172.21.15.29:0/1152255331 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc02cbc0 con 0x7fc7c40c36e0 2024-04-15T00:02:05.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7c27fc640 1 -- 172.21.15.29:0/1152255331 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc034440 con 0x7fc7c40c36e0 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7ca11e640 1 -- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c40c36e0 msgr2=0x7fc7c40c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c40c36e0 0x7fc7c40c3b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc02be10 comp rx=0 tx=0).stop 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7ca11e640 1 -- 172.21.15.29:0/1152255331 shutdown_connections 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c40c36e0 0x7fc7c40c3b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/1152255331 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.724+0000 7fc7ca11e640 1 -- 172.21.15.29:0/1152255331 >> 172.21.15.29:0/1152255331 conn(0x7fc7c40cd900 msgr2=0x7fc7c40cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.725+0000 7fc7ca11e640 1 -- 172.21.15.29:0/1152255331 shutdown_connections 2024-04-15T00:02:05.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.725+0000 7fc7ca11e640 1 -- 172.21.15.29:0/1152255331 wait complete. 2024-04-15T00:02:05.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 Processor -- start 2024-04-15T00:02:05.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 -- start start 2024-04-15T00:02:05.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c4070a60 0x7fc7c41f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 0x7fc7c4151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c4152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c406cdc0 con 0x7fc7c40c36e0 2024-04-15T00:02:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40c9cd0 con 0x7fc7c4070a60 2024-04-15T00:02:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.726+0000 7fc7ca11e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c41534d0 con 0x7fc7c40c8680 2024-04-15T00:02:05.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.727+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 0x7fc7c4151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.727+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c4152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.727+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c4070a60 0x7fc7c41f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.727+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 0x7fc7c4151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53064/0 (socket says 172.21.15.29:53064) 2024-04-15T00:02:05.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.727+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3931509469 learned_addr learned my addr 172.21.15.29:0/3931509469 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.731+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 msgr2=0x7fc7c4152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.731+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c4152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.731+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c4070a60 msgr2=0x7fc7c41f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.731+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c4070a60 0x7fc7c41f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.731+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3931509469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c4153fb0 con 0x7fc7c40c36e0 2024-04-15T00:02:05.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.733+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 0x7fc7c4151170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800e8a0 tx=0x7fc7b800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.736+0000 7fc7abfff640 1 -- 172.21.15.29:0/3931509469 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8017070 con 0x7fc7c40c36e0 2024-04-15T00:02:05.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.736+0000 7fc7abfff640 1 -- 172.21.15.29:0/3931509469 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b800c940 con 0x7fc7c40c36e0 2024-04-15T00:02:05.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.736+0000 7fc7abfff640 1 -- 172.21.15.29:0/3931509469 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800cd30 con 0x7fc7c40c36e0 2024-04-15T00:02:05.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.736+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c4154250 con 0x7fc7c40c36e0 2024-04-15T00:02:05.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.736+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c41f05b0 con 0x7fc7c40c36e0 2024-04-15T00:02:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.739+0000 7fc7ccffb740 1 Processor -- start 2024-04-15T00:02:05.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.739+0000 7fc7ccffb740 1 -- start start 2024-04-15T00:02:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 0x55f1d20084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d2051f70 0x55f1d2008a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d2006b50 0x55f1d2047950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1d1f6bf80 con 0x55f1d2006b50 2024-04-15T00:02:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f1d1f149a0 con 0x55f1d2051f70 2024-04-15T00:02:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55f1d1f67f30 con 0x55f1d20080f0 2024-04-15T00:02:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.740+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 0x55f1d20084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.741+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d2051f70 0x55f1d2008a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.741+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 0x55f1d20084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44602/0 (socket says 172.21.15.29:44602) 2024-04-15T00:02:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.741+0000 7fc7c3fff640 1 -- 172.21.15.29:0/3962873400 learned_addr learned my addr 172.21.15.29:0/3962873400 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.743+0000 7fc7c3fff640 1 -- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d2051f70 msgr2=0x55f1d2008a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.743+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d2051f70 0x55f1d2008a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.743+0000 7fc7c3fff640 1 -- 172.21.15.29:0/3962873400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d2006b50 msgr2=0x55f1d2047950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.743+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d2006b50 0x55f1d2047950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.743+0000 7fc7c3fff640 1 -- 172.21.15.29:0/3962873400 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d1f35480 con 0x55f1d20080f0 2024-04-15T00:02:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.745+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 0x55f1d20084d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc02e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669b57a026bfe5be server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.749+0000 7fc7a97fa640 1 -- 172.21.15.29:0/3962873400 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc045070 con 0x55f1d20080f0 2024-04-15T00:02:05.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.749+0000 7fc7a97fa640 1 -- 172.21.15.29:0/3962873400 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc03a040 con 0x55f1d20080f0 2024-04-15T00:02:05.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.749+0000 7fc7a97fa640 1 -- 172.21.15.29:0/3962873400 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc039040 con 0x55f1d20080f0 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.749+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 msgr2=0x55f1d20084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.749+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 0x55f1d20084d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc02e000 comp rx=0 tx=0).stop 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3962873400 shutdown_connections 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d2006b50 0x55f1d2047950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d2051f70 0x55f1d2008a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3962873400 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d20080f0 0x55f1d20084d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3962873400 >> 172.21.15.29:0/3962873400 conn(0x55f1d2004860 msgr2=0x55f1d20071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3962873400 shutdown_connections 2024-04-15T00:02:05.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.750+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3962873400 wait complete. 2024-04-15T00:02:05.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.751+0000 7fc7ccffb740 1 -- start start 2024-04-15T00:02:05.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.751+0000 7fc7ccffb740 1 Processor -- start 2024-04-15T00:02:05.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d204c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d202be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d202c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1d202d650 con 0x55f1d20080f0 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f1d1f27f40 con 0x55f1d205c760 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55f1d2005a10 con 0x55f1d2051f70 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7ccffb740 10 client.0 _ll_register_callbacks cb 0x55f1d1f229a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.752+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d202be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.753+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d202c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.753+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d202be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44612/0 (socket says 172.21.15.29:44612) 2024-04-15T00:02:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.753+0000 7fc7c37fe640 1 -- 172.21.15.29:0/2534641056 learned_addr learned my addr 172.21.15.29:0/2534641056 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.756+0000 7fc7c37fe640 1 -- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 msgr2=0x55f1d202c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.756+0000 7fc7c37fe640 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d202c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.756+0000 7fc7c37fe640 1 -- 172.21.15.29:0/2534641056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 msgr2=0x55f1d204c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.756+0000 7fc7c37fe640 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d204c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:05.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.756+0000 7fc7c37fe640 1 -- 172.21.15.29:0/2534641056 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d1c802d0 con 0x55f1d2051f70 2024-04-15T00:02:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.758+0000 7fc7c37fe640 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d202be00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4012550 tx=0x7fc7b4012a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df7c52af38432af6 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.758+0000 7fc7a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3301/0 2024-04-15T00:02:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.759+0000 7fc7abfff640 1 -- 172.21.15.29:0/3931509469 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc7b801a070 con 0x7fc7c40c36e0 2024-04-15T00:02:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.759+0000 7fc7abfff640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc7b006b950 0x7fc7b006de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.760+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc7b006b950 0x7fc7b006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:05.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.760+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc7b006b950 0x7fc7b006de10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc02be50 tx=0x7fc7bc031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:05.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.761+0000 7fc7abfff640 1 -- 172.21.15.29:0/3931509469 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc7b8056f70 con 0x7fc7c40c36e0 2024-04-15T00:02:05.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.762+0000 7fc7a27fc640 1 -- 172.21.15.29:0/2534641056 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4019020 con 0x55f1d2051f70 2024-04-15T00:02:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.762+0000 7fc7a27fc640 1 -- 172.21.15.29:0/2534641056 <== mon.2 v2:172.21.15.37:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc7b4005ac0 con 0x55f1d2051f70 2024-04-15T00:02:05.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.762+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7bc03a040 con 0x55f1d2051f70 2024-04-15T00:02:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.764+0000 7fc7a27fc640 1 -- 172.21.15.29:0/2534641056 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc7b4023050 con 0x55f1d2051f70 2024-04-15T00:02:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.764+0000 7fc7ccffb740 10 client.4643 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:05.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.764+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f1d1d4a6b0 con 0x55f1d2051f70 2024-04-15T00:02:05.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7a27fc640 1 -- 172.21.15.29:0/2534641056 <== mon.2 v2:172.21.15.37:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc03a040 con 0x55f1d2051f70 2024-04-15T00:02:05.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7a27fc640 1 -- 172.21.15.29:0/2534641056 <== mon.2 v2:172.21.15.37:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc7b4026020 con 0x55f1d2051f70 2024-04-15T00:02:05.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7ccffb740 10 client.4643 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:05.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7ccffb740 10 client.4643 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-15T00:02:05.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7ccffb740 20 client.4643 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:05.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d20660c0 0x55f1d20684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:05.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7ccffb740 4 client.4643 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-15T00:02:05.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:05.769+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 --> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1d1f794c0 con 0x55f1d20660c0 2024-04-15T00:02:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:15.776+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d20660c0 msgr2=0x55f1d20684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.37:6834/4290142859, fault. 2024-04-15T00:02:15.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:15.776+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d20660c0 0x55f1d20684b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-15T00:02:23.011 INFO:tasks.ceph.mds.f.smithi037.stderr:2024-04-15T00:02:22.991+0000 f7f1640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-15T00:02:23.051 INFO:tasks.ceph.mds.f.smithi037.stderr:2024-04-15T00:02:22.991+0000 f7f1640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-15T00:02:24.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:24.332+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d20660c0 0x55f1d20684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:24.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:24.340+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d20660c0 0x55f1d20684b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140bf063e776ff1f server_cookie=e1f8288dce7fdb53 in_seq=0 out_seq=0 2024-04-15T00:02:24.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:24.340+0000 7fc7a27fc640 10 client.4643 ms_handle_connect on v2:172.21.15.37:6834/4290142859 2024-04-15T00:02:25.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:02:25.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:02:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7a27fc640 1 -- 172.21.15.29:0/2534641056 <== mds.0 v2:172.21.15.37:6834/4290142859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1d1f794c0 con 0x55f1d20660c0 2024-04-15T00:02:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7a27fc640 10 client.4643 handle_command_reply: tid=0 2024-04-15T00:02:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 client.4643 shutdown 2024-04-15T00:02:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 msgr2=0x55f1d202be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:28.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d202be00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4012550 tx=0x7fc7b4012a10 comp rx=0 tx=0).stop 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 shutdown_connections 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d20660c0 0x55f1d20684b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d202c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d202be00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/2534641056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d204c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7a27fc640 0 client.4643 ms_handle_reset on v2:172.21.15.37:6834/4290142859 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 >> 172.21.15.29:0/2534641056 conn(0x55f1d2006b50 msgr2=0x55f1d20084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 shutdown_connections 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.369+0000 7fc7ccffb740 1 -- 172.21.15.29:0/2534641056 wait complete. 2024-04-15T00:02:28.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.370+0000 7fc7ccffb740 20 client.4643 trim_cache size 0 max 16384 2024-04-15T00:02:28.378 INFO:tasks.ceph.mds.f.smithi037.stderr:2024-04-15T00:02:28.364+0000 f7f1640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-15T00:02:28.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.390+0000 7fc7ccffb740 1 Processor -- start 2024-04-15T00:02:28.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.390+0000 7fc7ccffb740 1 -- start start 2024-04-15T00:02:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.391+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d2001870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.391+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d20023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.391+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d2002900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.391+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c41f4160 con 0x55f1d20080f0 2024-04-15T00:02:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.391+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f1d204e750 con 0x55f1d205c760 2024-04-15T00:02:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.391+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55f1d204ed00 con 0x55f1d2051f70 2024-04-15T00:02:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.392+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d20023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.392+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d2001870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.392+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d2002900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:28.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.392+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d2001870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40670/0 (socket says 172.21.15.29:40670) 2024-04-15T00:02:28.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.392+0000 7fc7c37fe640 1 -- 172.21.15.29:0/3078545423 learned_addr learned my addr 172.21.15.29:0/3078545423 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.395+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 msgr2=0x55f1d2002900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.395+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d2002900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.395+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3078545423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 msgr2=0x55f1d2001870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.395+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d2001870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.395+0000 7fc7c2ffd640 1 -- 172.21.15.29:0/3078545423 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d2046930 con 0x55f1d2051f70 2024-04-15T00:02:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.397+0000 7fc7c2ffd640 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d20023c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8088ea0 tx=0x7fc7b8088da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ce70a43952302e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.401+0000 7fc7a8ff9640 1 -- 172.21.15.29:0/3078545423 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8086020 con 0x55f1d2051f70 2024-04-15T00:02:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.401+0000 7fc7a8ff9640 1 -- 172.21.15.29:0/3078545423 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8061830 con 0x55f1d2051f70 2024-04-15T00:02:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.401+0000 7fc7a8ff9640 1 -- 172.21.15.29:0/3078545423 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8021070 con 0x55f1d2051f70 2024-04-15T00:02:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 msgr2=0x55f1d20023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d20023c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8088ea0 tx=0x7fc7b8088da0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3078545423 shutdown_connections 2024-04-15T00:02:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d2002900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d20023c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/3078545423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d2001870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3078545423 >> 172.21.15.29:0/3078545423 conn(0x55f1d2006b50 msgr2=0x55f1d1ffdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3078545423 shutdown_connections 2024-04-15T00:02:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.402+0000 7fc7ccffb740 1 -- 172.21.15.29:0/3078545423 wait complete. 2024-04-15T00:02:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.403+0000 7fc7ccffb740 1 -- start start 2024-04-15T00:02:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.403+0000 7fc7ccffb740 1 Processor -- start 2024-04-15T00:02:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d20c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d2047c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d20be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55f1d204dbb0 con 0x55f1d20080f0 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2046310 con 0x55f1d205c760 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x55f1d2044a10 con 0x55f1d2051f70 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7ccffb740 10 client.0 _ll_register_callbacks cb 0x7fc7b4001c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d20c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d20be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7c2ffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d2047c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.404+0000 7fc7c37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d20c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40678/0 (socket says 172.21.15.29:40678) 2024-04-15T00:02:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.405+0000 7fc7c37fe640 1 -- 172.21.15.29:0/1420101325 learned_addr learned my addr 172.21.15.29:0/1420101325 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:28.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.408+0000 7fc7c3fff640 1 -- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 msgr2=0x55f1d2047c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:28.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.408+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d2047c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.408+0000 7fc7c3fff640 1 -- 172.21.15.29:0/1420101325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 msgr2=0x55f1d20c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:28.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.408+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d20c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:28.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.408+0000 7fc7c3fff640 1 -- 172.21.15.29:0/1420101325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d204d690 con 0x55f1d205c760 2024-04-15T00:02:28.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.410+0000 7fc7c3fff640 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d20be5f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc037040 tx=0x7fc7bc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb194b3006d44dc server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:28.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.410+0000 7fc7a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-15T00:02:28.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.414+0000 7fc7a27fc640 1 -- 172.21.15.29:0/1420101325 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc058070 con 0x55f1d205c760 2024-04-15T00:02:28.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.414+0000 7fc7a27fc640 1 -- 172.21.15.29:0/1420101325 <== mon.1 v2:172.21.15.37:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc7bc034440 con 0x55f1d205c760 2024-04-15T00:02:28.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.414+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b8061830 con 0x55f1d205c760 2024-04-15T00:02:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.417+0000 7fc7a27fc640 1 -- 172.21.15.29:0/1420101325 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc7bc063050 con 0x55f1d205c760 2024-04-15T00:02:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.417+0000 7fc7ccffb740 10 client.4774 fetch_fsmap learned FSMap version 18 2024-04-15T00:02:28.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.417+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f1d20c48f0 con 0x55f1d205c760 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.426+0000 7fc7a27fc640 1 -- 172.21.15.29:0/1420101325 <== mon.1 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8061830 con 0x55f1d205c760 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.426+0000 7fc7a27fc640 1 -- 172.21.15.29:0/1420101325 <== mon.1 v2:172.21.15.37:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc7bc066020 con 0x55f1d205c760 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.427+0000 7fc7ccffb740 10 client.4774 fetch_fsmap finished waiting for FSMap version 18 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.427+0000 7fc7ccffb740 10 client.4774 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.427+0000 7fc7ccffb740 20 client.4774 populate_metadata read hostname 'smithi029' 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.427+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d2002ce0 0x55f1d20d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:28.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.427+0000 7fc7ccffb740 4 client.4774 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-15T00:02:28.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:28.427+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 --> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] -- command(tid 0: {"prefix": "status"}) -- 0x55f1d1f73810 con 0x55f1d2002ce0 2024-04-15T00:02:29.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:29.379+0000 7fc7c37fe640 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d2002ce0 0x55f1d20d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:29.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:29.388+0000 7fc7c37fe640 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d2002ce0 0x55f1d20d1170 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cde68d707f1a898 server_cookie=d27088f26a9f15f2 in_seq=0 out_seq=0 2024-04-15T00:02:29.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:29.388+0000 7fc7a27fc640 10 client.4774 ms_handle_connect on v2:172.21.15.37:6834/4290142859 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7a27fc640 1 -- 172.21.15.29:0/1420101325 <== mds.0 v2:172.21.15.37:6834/4290142859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f1d1f73810 con 0x55f1d2002ce0 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7a27fc640 10 client.4774 handle_command_reply: tid=0 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 client.4774 shutdown 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 msgr2=0x55f1d20be5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d20be5f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc037040 tx=0x7fc7bc004ab0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 shutdown_connections 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:6834/4290142859,v1:172.21.15.37:6835/4290142859] conn(0x55f1d2002ce0 0x55f1d20d1170 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1d205c760 0x55f1d20be5f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55f1d2051f70 0x55f1d2047c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 --2- 172.21.15.29:0/1420101325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55f1d20080f0 0x55f1d20c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7a27fc640 0 client.4774 ms_handle_reset on v2:172.21.15.37:6834/4290142859 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 >> 172.21.15.29:0/1420101325 conn(0x55f1d2006b50 msgr2=0x55f1d206dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 shutdown_connections 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 1 -- 172.21.15.29:0/1420101325 wait complete. 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ccffb740 20 client.4774 trim_cache size 0 max 16384 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "7c8df2c3-f5a8-486a-b508-c448178a0a97", 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4275, 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-15T00:02:31.404 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-15T00:02:31.405 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 77.986600639000002, 2024-04-15T00:02:31.405 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 18, 2024-04-15T00:02:31.405 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 29, 2024-04-15T00:02:31.405 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 28, 2024-04-15T00:02:31.405 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 88.158366102000002 2024-04-15T00:02:31.405 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc7b006b950 msgr2=0x7fc7b006de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc7b006b950 0x7fc7b006de10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc02be50 tx=0x7fc7bc031000 comp rx=0 tx=0).stop 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 msgr2=0x7fc7c4151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.396+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 0x7fc7c4151170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800e8a0 tx=0x7fc7b800ed60 comp rx=0 tx=0).stop 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 shutdown_connections 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc7b006b950 0x7fc7b006de10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc7c40c8680 0x7fc7c4152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7c40c36e0 0x7fc7c4151170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 --2- 172.21.15.29:0/3931509469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7c4070a60 0x7fc7c41f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 >> 172.21.15.29:0/3931509469 conn(0x7fc7c40cd900 msgr2=0x7fc7c4157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:31.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 shutdown_connections 2024-04-15T00:02:31.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.397+0000 7fc7ca11e640 1 -- 172.21.15.29:0/3931509469 wait complete. 2024-04-15T00:02:31.417 INFO:teuthology.run_tasks:Running task sequential... 2024-04-15T00:02:31.429 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-15T00:02:31.429 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-15T00:02:31.429 INFO:teuthology.task.print:Enabling mgr modules 2024-04-15T00:02:31.429 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-15T00:02:31.499 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-15T00:02:31.499 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-15T00:02:31.499 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-15T00:02:31.499 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T00:02:31.499 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:31.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:31.500 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-15T00:02:31.518 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-15T00:02:31.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:31.519 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-15T00:02:31.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:31.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-04-15T00:02:31.694 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-15T00:02:31.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T00:02:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.795+0000 7f1a3ef64640 1 Processor -- start 2024-04-15T00:02:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.795+0000 7f1a3ef64640 1 -- start start 2024-04-15T00:02:31.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.796+0000 7f1a3ef64640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a381511a0 0x7f1a380c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.796+0000 7f1a3ef64640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a380c4930 0x7f1a380c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.796+0000 7f1a3ef64640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a380c5870 con 0x7f1a38072cd0 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.796+0000 7f1a3ef64640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1a380c5b50 con 0x7f1a381511a0 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.796+0000 7f1a3ef64640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a380c2cf0 con 0x7f1a380c4930 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.797+0000 7f1a3cd00640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a381511a0 0x7f1a380c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.797+0000 7f1a37fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a380c4930 0x7f1a380c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.797+0000 7f1a37fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a380c4930 0x7f1a380c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:38292/0 (socket says 172.21.15.29:38292) 2024-04-15T00:02:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.797+0000 7f1a37fff640 1 -- 172.21.15.29:0/708374018 learned_addr learned my addr 172.21.15.29:0/708374018 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.799+0000 7f1a3cd00640 1 -- 172.21.15.29:0/708374018 >> v2:172.21.15.37:3300/0 conn(0x7f1a380c4930 msgr2=0x7f1a380c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.799+0000 7f1a3cd00640 1 --2- 172.21.15.29:0/708374018 >> v2:172.21.15.37:3300/0 conn(0x7f1a380c4930 0x7f1a380c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.799+0000 7f1a3cd00640 1 -- 172.21.15.29:0/708374018 >> v1:172.21.15.29:6789/0 conn(0x7f1a38072cd0 legacy=0x7f1a38156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T00:02:31.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.799+0000 7f1a3cd00640 1 -- 172.21.15.29:0/708374018 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a380c2fd0 con 0x7f1a381511a0 2024-04-15T00:02:31.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.802+0000 7f1a3cd00640 1 --2- 172.21.15.29:0/708374018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a381511a0 0x7f1a380c4f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a380c4340 tx=0x7f1a2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383e428e9e0ee5ae server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.809+0000 7f1a377fe640 1 -- 172.21.15.29:0/708374018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0315a0 con 0x7f1a381511a0 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.809+0000 7f1a377fe640 1 -- 172.21.15.29:0/708374018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c037070 con 0x7f1a381511a0 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.809+0000 7f1a377fe640 1 -- 172.21.15.29:0/708374018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c031960 con 0x7f1a381511a0 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 -- 172.21.15.29:0/708374018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a381511a0 msgr2=0x7f1a380c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/708374018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a381511a0 0x7f1a380c4f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a380c4340 tx=0x7f1a2c02b840 comp rx=0 tx=0).stop 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 -- 172.21.15.29:0/708374018 shutdown_connections 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/708374018 >> v2:172.21.15.37:3300/0 conn(0x7f1a380c4930 0x7f1a380c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/708374018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a381511a0 0x7f1a380c4f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 -- 172.21.15.29:0/708374018 >> 172.21.15.29:0/708374018 conn(0x7f1a3806fca0 msgr2=0x7f1a3806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:31.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 -- 172.21.15.29:0/708374018 shutdown_connections 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.810+0000 7f1a3ef64640 1 -- 172.21.15.29:0/708374018 wait complete. 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.811+0000 7f1a3ef64640 1 Processor -- start 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.811+0000 7f1a3ef64640 1 -- start start 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.812+0000 7f1a3ef64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a38072cd0 0x7f1a38145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.812+0000 7f1a3ef64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a380c4930 0x7f1a381557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.812+0000 7f1a3ef64640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1a381511a0 0x7f1a38143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.812+0000 7f1a3ef64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1a380c5490 con 0x7f1a380c4930 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.812+0000 7f1a3ef64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a380c3590 con 0x7f1a38072cd0 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.812+0000 7f1a3ef64640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1a380c5610 con 0x7f1a381511a0 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.813+0000 7f1a3cd00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a38072cd0 0x7f1a38145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.813+0000 7f1a3d501640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1a381511a0 0x7f1a38143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.813+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a380c4930 0x7f1a381557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.813+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a380c4930 0x7f1a381557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40702/0 (socket says 172.21.15.29:40702) 2024-04-15T00:02:31.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.813+0000 7f1a37fff640 1 -- 172.21.15.29:0/2898834380 learned_addr learned my addr 172.21.15.29:0/2898834380 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T00:02:31.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.817+0000 7f1a3cd00640 1 -- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1a381511a0 msgr2=0x7f1a38143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:31.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.817+0000 7f1a3cd00640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1a381511a0 0x7f1a38143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.817+0000 7f1a3cd00640 1 -- 172.21.15.29:0/2898834380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a380c4930 msgr2=0x7f1a381557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:31.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.817+0000 7f1a3cd00640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a380c4930 0x7f1a381557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:31.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.817+0000 7f1a3cd00640 1 -- 172.21.15.29:0/2898834380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a38146270 con 0x7f1a38072cd0 2024-04-15T00:02:31.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.819+0000 7f1a3cd00640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a38072cd0 0x7f1a38145d30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c033000 tx=0x7f1a2c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.823+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c032630 con 0x7f1a38072cd0 2024-04-15T00:02:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.823+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c032810 con 0x7f1a38072cd0 2024-04-15T00:02:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.823+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c032c00 con 0x7f1a38072cd0 2024-04-15T00:02:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.823+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a38155d20 con 0x7f1a38072cd0 2024-04-15T00:02:31.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.823+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a381ef590 con 0x7f1a38072cd0 2024-04-15T00:02:31.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:31.824+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3804f540 con 0x7f1a38072cd0 2024-04-15T00:02:32.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.104+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1a2c04e400 con 0x7f1a38072cd0 2024-04-15T00:02:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.104+0000 7f1a357fa640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1a1c06b9e0 0x7f1a1c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T00:02:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.104+0000 7f1a37fff640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1a1c06b9e0 0x7f1a1c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T00:02:32.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.105+0000 7f1a37fff640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1a1c06b9e0 0x7f1a1c06dea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1a380c7140 tx=0x7f1a2400b420 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T00:02:32.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.108+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1a2c02f070 con 0x7f1a38072cd0 2024-04-15T00:02:32.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.120+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1a2c040070 con 0x7f1a38072cd0 2024-04-15T00:02:32.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.384+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1a381509a0 con 0x7f1a38072cd0 2024-04-15T00:02:32.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.390+0000 7f1a357fa640 1 -- 172.21.15.29:0/2898834380 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+88 (secure 0 0 0) 0x7f1a2c07ac40 con 0x7f1a38072cd0 2024-04-15T00:02:32.396 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1a1c06b9e0 msgr2=0x7f1a1c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1a1c06b9e0 0x7f1a1c06dea0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1a380c7140 tx=0x7f1a2400b420 comp rx=0 tx=0).stop 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a38072cd0 msgr2=0x7f1a38145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a38072cd0 0x7f1a38145d30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c033000 tx=0x7f1a2c0046c0 comp rx=0 tx=0).stop 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 shutdown_connections 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1a1c06b9e0 0x7f1a1c06dea0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1a381511a0 0x7f1a38143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a380c4930 0x7f1a381557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 --2- 172.21.15.29:0/2898834380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a38072cd0 0x7f1a38145d30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T00:02:32.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 >> 172.21.15.29:0/2898834380 conn(0x7f1a3806fca0 msgr2=0x7f1a380cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T00:02:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 shutdown_connections 2024-04-15T00:02:32.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32.392+0000 7f1a3ef64640 1 -- 172.21.15.29:0/2898834380 wait complete. 2024-04-15T00:02:32.409 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T00:02:32.410 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T00:02:32.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:32.410 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-04-15T00:02:32.425 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-04-15T00:02:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link noprefixroute 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T00:02:32.427 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-04-15T00:02:32.428 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-04-15T00:02:32.429 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T00:02:32.429 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:02:32.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:02:32.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:02:32.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:32.575 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T00:02:32.600 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-04-15T00:02:32.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:32.602 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-04-15T00:02:32.658 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-04-15T00:02:32.658 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T00:02:32.658 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-15T00:02:32.658 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-15T00:02:32.658 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T00:02:32.659 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:02:32.659 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:02:32.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-15T00:02:32.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-15T00:02:32.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-15T00:02:32.659 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:02:32.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:02:32.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:02:32.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:32.793 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-15T00:02:32.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:32.808 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-04-15T00:02:32.863 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:02:32.863 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:02:32.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:32.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-15T00:02:32.863 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:02:32.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:02:32.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:02:32.985 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-15T00:02:32.985 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:02:32.985 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:02:32.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-15T00:02:32.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T00:02:32.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-15T00:02:32.985 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-15T00:02:32.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-15T00:02:32.986 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:02:33.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:02:33.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:02:33.111 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T00:02:33.111 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-04-15T00:02:33.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-04-15T00:02:33.112 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T00:02:33.112 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-04-15T00:02:33.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T00:02:33.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:02:33.194 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-15T00:02:33.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:02:33.195 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:33.210 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T00:02:33.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T00:02:33.210 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:33.264 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T00:02:33.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:33.332 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:33.387 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:33.387 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:33.387 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:33.388 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:33.389 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:33.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:33.390 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:33.443 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T00:02:33.443 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-15T00:02:33.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:33.513 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:33.571 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:33.571 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:33.571 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:33.571 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:33.571 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:33.572 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:33.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:33.574 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:34.728 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:34.756 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:34.813 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:34.814 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:34.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:34.815 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:35.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:35.997 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:36.053 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:36.054 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:36.055 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:36.055 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:36.055 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:36.055 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:36.055 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:36.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:36.055 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:37.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:37.238 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:37.294 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:37.294 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:37.295 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:37.296 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:37.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:37.297 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:38.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:38.480 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:38.535 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:38.536 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:38.536 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:38.536 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:38.536 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:38.536 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:38.537 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:38.538 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:38.538 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:38.538 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:38.539 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:38.540 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:38.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:38.541 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:39.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-04-15T00:02:39.348+0000 6511100 -1 init, newargv = 0x7c36f60 newargc=15 2024-04-15T00:02:39.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[46478]: starting ceph client 2024-04-15T00:02:39.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:39.719 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:39.775 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:39.775 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:39.775 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:39.775 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:39.775 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:39.777 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:39.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:39.778 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:40.933 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:40.962 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:41.019 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:41.019 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:41.019 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:41.020 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:41.021 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:41.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:41.022 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:42.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:42.213 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:42.275 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:42.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:42.278 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:43.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:43.466 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:43.521 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:43.521 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:43.521 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:43.521 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:43.522 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:43.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:43.524 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:44.678 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:44.712 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:44.770 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:44.770 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:44.770 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:44.771 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:44.772 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:44.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:44.773 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:45.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[46478]: starting fuse 2024-04-15T00:02:45.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-04-15T00:02:45.960 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T00:02:46.015 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-04-15T00:02:46.015 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-04-15T00:02:46.016 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-0 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-1 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-2 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph/osd/ceph-3 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-04-15T00:02:46.017 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:46.018 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T00:02:46.018 INFO:teuthology.orchestra.run.smithi029.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:46.018 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-04-15T00:02:46.070 INFO:teuthology.orchestra.run.smithi029.stdout:43 2024-04-15T00:02:46.071 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-15T00:02:46.071 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> 2024-04-15T00:02:46.072 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-04-15T00:02:46.073 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-04-15T00:02:46.192 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.46478.asok 2024-04-15T00:02:46.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T00:02:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T00:02:46.202 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46478.asok 2024-04-15T00:02:46.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:46.202 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46478.asok status 2024-04-15T00:02:46.442 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T00:02:46.442 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-04-15T00:02:46.442 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "a9a752df26c63acad72e1b3569fd79a515ca0765", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.0.0-2114-ga9a752df (a9a752df26c63acad72e1b3569fd79a515ca0765) squid (dev)", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "46478", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4786, 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 4786 2024-04-15T00:02:46.443 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1756222414 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1756222414 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.4786 172.21.15.29:0/1756222414", 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "172.21.15.29:0/1756222414", 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-04-15T00:02:46.444 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 18, 2024-04-15T00:02:46.445 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 29, 2024-04-15T00:02:46.445 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-04-15T00:02:46.445 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-04-15T00:02:46.445 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-04-15T00:02:46.445 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T00:02:46.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:46.452 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-04-15T00:02:46.452 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.509 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-04-15T00:02:46.509 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T00:02:46.510 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.561 INFO:teuthology.run_tasks:Running task workunit... 2024-04-15T00:02:46.593 INFO:tasks.workunit:Pulling workunits from ref a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:02:46.593 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-15T00:02:46.593 INFO:tasks.workunit:timeout=6h 2024-04-15T00:02:46.593 INFO:tasks.workunit:cleanup=True 2024-04-15T00:02:46.594 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-04-15 00:01:13.723774009 +0000 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-04-15 00:01:28.689811108 +0000 2024-04-15T00:02:46.609 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2024-04-15T00:02:46.610 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-15T00:02:46.610 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-15T00:02:55.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:02:55.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:03:00.187 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T00:03:00.203 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-15T00:03:25.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:03:25.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:03:55.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:03:55.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:04:15.800 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 96% (11975/12473) Updating files: 97% (12099/12473) Updating files: 98% (12224/12473) Updating files: 99% (12349/12473) Updating files: 100% (12473/12473) Updating files: 100% (12473/12473), done. 2024-04-15T00:04:16.548 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to 'a9a752df26c63acad72e1b3569fd79a515ca0765'. 2024-04-15T00:04:16.548 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.548 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T00:04:16.548 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-04-15T00:04:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at a9a752df26c Merge pull request #56871 from zdover23/wip-doc-2024-04-14-backport-56870-to-squid 2024-04-15T00:04:16.552 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-15T00:04:16.587 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-15T00:04:16.588 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T00:04:16.589 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-15T00:04:17.525 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-15T00:04:17.616 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-15T00:04:17.655 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T00:04:17.656 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T00:04:17.656 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-15T00:04:17.696 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T00:04:17.699 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T00:04:17.699 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-15T00:04:17.755 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-15T00:04:17.757 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-15T00:04:17.757 DEBUG:teuthology.orchestra.run.smithi029:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a9a752df26c63acad72e1b3569fd79a515ca0765 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-15T00:04:18.205 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir -p fsstress 2024-04-15T00:04:18.260 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd fsstress 2024-04-15T00:04:18.278 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-15T00:04:18.279 INFO:tasks.workunit.client.0.smithi029.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-15T00:04:25.706 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:04:25.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:04:26.353 INFO:tasks.workunit.client.0.smithi029.stderr:+ tar xzf ltp-full.tgz 2024-04-15T00:04:55.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:04:55.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:05:25.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:05:25.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:05:55.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:05:55.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:06:25.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:06:25.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:06:56.053 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:06:56.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:07:26.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:07:26.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:07:56.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:07:56.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:08:26.273 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:08:26.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:08:56.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:08:56.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:09:25.410 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:55.922 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.470 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:55.982 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.516 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:08:56.008 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.565 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:08:56.058 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.584 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:08:56.076 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.635 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:08:56.127 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.842 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:08:56.354 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:25.984 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:08:56.476 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:26.074 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:08:56.566 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:09:26.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:09:26.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:09:56.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:09:56.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:10:26.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:10:26.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:10:56.593 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:10:56.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:11:26.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:11:26.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:11:53.562 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:24.073 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.567 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:24.079 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.576 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:11:24.068 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.578 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:11:24.071 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.580 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:11:24.073 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.581 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:11:24.074 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.650 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:11:24.162 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.664 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:11:24.156 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:53.666 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:11:24.159 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:11:56.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:11:56.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:12:26.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:12:26.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:12:56.850 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:12:56.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:13:26.927 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:13:26.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:13:57.006 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:13:57.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:14:27.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:14:27.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:14:57.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:14:57.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:15:27.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:15:27.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:15:57.273 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:15:57.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:16:03.628 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:34.139 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.629 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:34.141 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.717 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:15:34.228 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.719 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:15:34.211 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.721 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:15:34.213 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.727 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:15:34.219 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.727 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:15:34.219 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.818 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:15:34.310 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:03.821 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:15:34.313 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:16:27.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:16:27.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:16:57.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:16:57.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:17:27.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:17:27.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:17:46.511 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:17.023 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.513 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:17.025 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.547 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:17:17.059 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.568 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:17:17.060 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.568 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:17:17.060 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.570 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:17:17.062 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.571 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:17:17.064 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.628 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:17:17.120 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:46.628 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:17:17.120 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:17:57.633 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:17:57.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:18:27.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:18:27.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:18:57.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:18:57.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:19:27.857 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:19:27.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:19:57.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:19:57.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:09.709 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:40.220 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.715 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:40.227 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.774 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:19:40.286 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.788 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:19:40.280 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.788 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:19:40.280 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.790 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:19:40.282 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.794 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:19:40.286 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.850 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:19:40.341 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:09.891 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:19:40.382 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:20:28.002 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:28.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:58.068 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:20:58.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:28.133 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:28.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:58.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:21:58.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:28.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:28.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:58.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:22:58.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:28.424 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:28.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:58.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:23:58.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:28.563 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:28.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:47.496 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:18.006 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.547 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:18.058 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.551 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:24:18.043 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.555 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:24:18.046 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.604 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:24:18.095 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.605 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:24:18.096 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.655 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:24:18.147 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.662 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:24:18.173 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:47.724 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:24:18.215 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:24:58.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:24:58.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:28.684 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:28.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:58.763 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:25:58.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:07.687 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:38.198 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.740 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:38.250 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.745 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:25:38.237 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.751 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:25:38.243 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.770 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:25:38.261 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.775 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:25:38.286 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.777 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:25:38.268 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.786 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:25:38.278 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:07.808 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:25:38.300 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:26:28.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:28.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:58.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:26:58.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:29.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:29.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:39.167 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-15T00:27:39.310 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-15T00:27:39.310 INFO:tasks.workunit.client.0.smithi029.stderr:+ make 2024-04-15T00:27:41.357 INFO:tasks.workunit.client.0.smithi029.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-15T00:27:44.546 INFO:tasks.workunit.client.0.smithi029.stderr:++ readlink -f fsstress 2024-04-15T00:27:44.563 INFO:tasks.workunit.client.0.smithi029.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-15T00:27:44.563 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2024-04-15T00:27:44.581 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-15T00:27:44.581 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2024-04-15T00:27:44.592 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-15T00:27:44.592 INFO:tasks.workunit.client.0.smithi029.stderr:++ mktemp -d -p . 2024-04-15T00:27:44.997 INFO:tasks.workunit.client.0.smithi029.stderr:+ T=./tmp.bxzCiMvu91 2024-04-15T00:27:44.998 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.bxzCiMvu91 -l 1 -n 1000 -p 10 -v 2024-04-15T00:27:45.094 INFO:tasks.workunit.client.0.smithi029.stdout:seed = 1713185440 2024-04-15T00:27:45.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/0: chown . 10666194 1 2024-04-15T00:27:45.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/1: fdatasync - no filename 2024-04-15T00:27:45.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/2: truncate - no filename 2024-04-15T00:27:45.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/0: dread - no filename 2024-04-15T00:27:45.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/1: fdatasync - no filename 2024-04-15T00:27:45.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/3: creat f0 x:0 0 0 2024-04-15T00:27:45.424 INFO:tasks.workunit.client.0.smithi029.stdout:1/0: creat f0 x:0 0 0 2024-04-15T00:27:45.430 INFO:tasks.workunit.client.0.smithi029.stdout:0/4: dread - f0 zero size 2024-04-15T00:27:45.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/0: dwrite - no filename 2024-04-15T00:27:45.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/1: write - no filename 2024-04-15T00:27:45.447 INFO:tasks.workunit.client.0.smithi029.stdout:2/2: creat f0 x:0 0 0 2024-04-15T00:27:45.447 INFO:tasks.workunit.client.0.smithi029.stdout:2/3: readlink - no filename 2024-04-15T00:27:45.527 INFO:tasks.workunit.client.0.smithi029.stdout:4/0: dwrite - no filename 2024-04-15T00:27:45.530 INFO:tasks.workunit.client.0.smithi029.stdout:1/1: creat f1 x:0 0 0 2024-04-15T00:27:45.626 INFO:tasks.workunit.client.0.smithi029.stdout:0/5: rename f0 to f1 0 2024-04-15T00:27:45.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/0: dread - no filename 2024-04-15T00:27:45.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/1: dwrite - no filename 2024-04-15T00:27:45.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/2: fdatasync - no filename 2024-04-15T00:27:45.643 INFO:tasks.workunit.client.0.smithi029.stdout:0/6: dread - f1 zero size 2024-04-15T00:27:45.690 INFO:tasks.workunit.client.0.smithi029.stdout:3/2: creat f0 x:0 0 0 2024-04-15T00:27:45.696 INFO:tasks.workunit.client.0.smithi029.stdout:1/2: creat f2 x:0 0 0 2024-04-15T00:27:45.751 INFO:tasks.workunit.client.0.smithi029.stdout:3/3: write f0 [702304,29510] 0 2024-04-15T00:27:45.757 INFO:tasks.workunit.client.0.smithi029.stdout:3/4: stat f0 0 2024-04-15T00:27:46.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/4: fsync f0 0 2024-04-15T00:27:46.133 INFO:tasks.workunit.client.0.smithi029.stdout:0/7: creat f2 x:0 0 0 2024-04-15T00:27:46.146 INFO:tasks.workunit.client.0.smithi029.stdout:4/1: creat f0 x:0 0 0 2024-04-15T00:27:46.161 INFO:tasks.workunit.client.0.smithi029.stdout:3/5: creat f1 x:0 0 0 2024-04-15T00:27:46.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/0: stat - no entries 2024-04-15T00:27:46.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/1: dread - no filename 2024-04-15T00:27:46.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/2: fdatasync - no filename 2024-04-15T00:27:46.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/8: stat f2 0 2024-04-15T00:27:46.228 INFO:tasks.workunit.client.0.smithi029.stdout:5/3: creat f0 x:0 0 0 2024-04-15T00:27:46.229 INFO:tasks.workunit.client.0.smithi029.stdout:1/3: link f1 f3 0 2024-04-15T00:27:46.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/2: creat f1 x:0 0 0 2024-04-15T00:27:46.465 INFO:tasks.workunit.client.0.smithi029.stdout:2/5: rename f0 to f1 0 2024-04-15T00:27:46.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/9: symlink l3 0 2024-04-15T00:27:46.489 INFO:tasks.workunit.client.0.smithi029.stdout:5/4: symlink l1 0 2024-04-15T00:27:46.496 INFO:tasks.workunit.client.0.smithi029.stdout:1/4: symlink l4 0 2024-04-15T00:27:46.515 INFO:tasks.workunit.client.0.smithi029.stdout:6/3: creat f0 x:0 0 0 2024-04-15T00:27:46.531 INFO:tasks.workunit.client.0.smithi029.stdout:4/3: read - f1 zero size 2024-04-15T00:27:46.541 INFO:tasks.workunit.client.0.smithi029.stdout:0/10: fdatasync f2 0 2024-04-15T00:27:46.628 INFO:tasks.workunit.client.0.smithi029.stdout:4/4: chown f0 67750 1 2024-04-15T00:27:46.632 INFO:tasks.workunit.client.0.smithi029.stdout:8/0: readlink - no filename 2024-04-15T00:27:46.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/1: dwrite - no filename 2024-04-15T00:27:46.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/2: dwrite - no filename 2024-04-15T00:27:46.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/3: truncate - no filename 2024-04-15T00:27:46.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/4: link - no file 2024-04-15T00:27:46.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/5: dwrite f0 [0,4194304] 0 2024-04-15T00:27:47.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/5: mknod c5 0 2024-04-15T00:27:47.098 INFO:tasks.workunit.client.0.smithi029.stdout:4/5: fsync f1 0 2024-04-15T00:27:47.113 INFO:tasks.workunit.client.0.smithi029.stdout:3/6: truncate f0 480080 0 2024-04-15T00:27:47.113 INFO:tasks.workunit.client.0.smithi029.stdout:3/7: rmdir - no directory 2024-04-15T00:27:47.125 INFO:tasks.workunit.client.0.smithi029.stdout:2/6: rename f1 to f2 0 2024-04-15T00:27:47.133 INFO:tasks.workunit.client.0.smithi029.stdout:6/4: mkdir d1 0 2024-04-15T00:27:47.146 INFO:tasks.workunit.client.0.smithi029.stdout:6/5: chown d1 806 1 2024-04-15T00:27:47.165 INFO:tasks.workunit.client.0.smithi029.stdout:0/11: creat f4 x:0 0 0 2024-04-15T00:27:47.173 INFO:tasks.workunit.client.0.smithi029.stdout:5/6: mkdir d2 0 2024-04-15T00:27:47.179 INFO:tasks.workunit.client.0.smithi029.stdout:6/6: dread - f0 zero size 2024-04-15T00:27:47.183 INFO:tasks.workunit.client.0.smithi029.stdout:1/6: truncate f1 281172 0 2024-04-15T00:27:47.196 INFO:tasks.workunit.client.0.smithi029.stdout:9/0: dwrite - no filename 2024-04-15T00:27:47.197 INFO:tasks.workunit.client.0.smithi029.stdout:0/12: dread - f4 zero size 2024-04-15T00:27:47.205 INFO:tasks.workunit.client.0.smithi029.stdout:5/7: chown f0 0 1 2024-04-15T00:27:47.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/13: fdatasync f4 0 2024-04-15T00:27:47.234 INFO:tasks.workunit.client.0.smithi029.stdout:1/7: truncate f2 91008 0 2024-04-15T00:27:47.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/14: chown f2 50845029 1 2024-04-15T00:27:47.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/15: fsync f2 0 2024-04-15T00:27:47.276 INFO:tasks.workunit.client.0.smithi029.stdout:1/8: write f0 [433698,128852] 0 2024-04-15T00:27:47.335 INFO:tasks.workunit.client.0.smithi029.stdout:1/9: write f0 [1390065,68946] 0 2024-04-15T00:27:47.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/8: dread f0 [0,4194304] 0 2024-04-15T00:27:47.400 INFO:tasks.workunit.client.0.smithi029.stdout:1/10: chown f0 29173943 1 2024-04-15T00:27:47.436 INFO:tasks.workunit.client.0.smithi029.stdout:1/11: chown c5 11 1 2024-04-15T00:27:47.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/16: dwrite f2 [0,4194304] 0 2024-04-15T00:27:47.537 INFO:tasks.workunit.client.0.smithi029.stdout:7/0: mkdir d0 0 2024-04-15T00:27:47.547 INFO:tasks.workunit.client.0.smithi029.stdout:3/8: creat f2 x:0 0 0 2024-04-15T00:27:47.554 INFO:tasks.workunit.client.0.smithi029.stdout:8/5: creat f0 x:0 0 0 2024-04-15T00:27:47.576 INFO:tasks.workunit.client.0.smithi029.stdout:1/12: symlink l6 0 2024-04-15T00:27:47.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/6: creat f2 x:0 0 0 2024-04-15T00:27:47.681 INFO:tasks.workunit.client.0.smithi029.stdout:2/7: write f2 [26859,99141] 0 2024-04-15T00:27:47.702 INFO:tasks.workunit.client.0.smithi029.stdout:0/17: mkdir d5 0 2024-04-15T00:27:47.730 INFO:tasks.workunit.client.0.smithi029.stdout:8/6: write f0 [592551,19560] 0 2024-04-15T00:27:47.735 INFO:tasks.workunit.client.0.smithi029.stdout:3/9: write f2 [216952,59048] 0 2024-04-15T00:27:47.739 INFO:tasks.workunit.client.0.smithi029.stdout:2/8: stat f2 0 2024-04-15T00:27:47.752 INFO:tasks.workunit.client.0.smithi029.stdout:4/7: truncate f1 954703 0 2024-04-15T00:27:47.782 INFO:tasks.workunit.client.0.smithi029.stdout:9/1: mknod c0 0 2024-04-15T00:27:47.797 INFO:tasks.workunit.client.0.smithi029.stdout:5/9: symlink d2/l3 0 2024-04-15T00:27:47.806 INFO:tasks.workunit.client.0.smithi029.stdout:6/7: creat d1/f2 x:0 0 0 2024-04-15T00:27:47.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/8: chown f2 649026 1 2024-04-15T00:27:47.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/9: readlink - no filename 2024-04-15T00:27:47.901 INFO:tasks.workunit.client.0.smithi029.stdout:8/7: rename f0 to f1 0 2024-04-15T00:27:47.904 INFO:tasks.workunit.client.0.smithi029.stdout:7/1: mkdir d0/d1 0 2024-04-15T00:27:47.961 INFO:tasks.workunit.client.0.smithi029.stdout:6/8: write d1/f2 [633988,1937] 0 2024-04-15T00:27:47.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/2: rename d0 to d0/d1/d2 22 2024-04-15T00:27:47.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/3: readlink - no filename 2024-04-15T00:27:48.008 INFO:tasks.workunit.client.0.smithi029.stdout:1/13: dwrite f2 [0,4194304] 0 2024-04-15T00:27:48.090 INFO:tasks.workunit.client.0.smithi029.stdout:3/10: rename f2 to f3 0 2024-04-15T00:27:48.116 INFO:tasks.workunit.client.0.smithi029.stdout:5/10: creat d2/f4 x:0 0 0 2024-04-15T00:27:48.124 INFO:tasks.workunit.client.0.smithi029.stdout:9/2: rename c0 to c1 0 2024-04-15T00:27:48.133 INFO:tasks.workunit.client.0.smithi029.stdout:4/10: creat f3 x:0 0 0 2024-04-15T00:27:48.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/9: dwrite f2 [0,4194304] 0 2024-04-15T00:27:48.226 INFO:tasks.workunit.client.0.smithi029.stdout:5/11: stat l1 0 2024-04-15T00:27:48.239 INFO:tasks.workunit.client.0.smithi029.stdout:1/14: dread f1 [0,4194304] 0 2024-04-15T00:27:48.242 INFO:tasks.workunit.client.0.smithi029.stdout:6/9: mknod d1/c3 0 2024-04-15T00:27:48.262 INFO:tasks.workunit.client.0.smithi029.stdout:4/11: truncate f0 543252 0 2024-04-15T00:27:48.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/10: write d1/f2 [1353538,71477] 0 2024-04-15T00:27:48.417 INFO:tasks.workunit.client.0.smithi029.stdout:0/18: sync 2024-04-15T00:27:48.419 INFO:tasks.workunit.client.0.smithi029.stdout:8/8: link f1 f2 0 2024-04-15T00:27:48.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/3: creat f2 x:0 0 0 2024-04-15T00:27:48.461 INFO:tasks.workunit.client.0.smithi029.stdout:3/11: stat f0 0 2024-04-15T00:27:48.505 INFO:tasks.workunit.client.0.smithi029.stdout:6/11: dread d1/f2 [0,4194304] 0 2024-04-15T00:27:48.526 INFO:tasks.workunit.client.0.smithi029.stdout:5/12: dwrite d2/f4 [0,4194304] 0 2024-04-15T00:27:48.601 INFO:tasks.workunit.client.0.smithi029.stdout:2/10: mkdir d3 0 2024-04-15T00:27:48.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/15: mknod c7 0 2024-04-15T00:27:48.704 INFO:tasks.workunit.client.0.smithi029.stdout:4/12: rename f1 to f4 0 2024-04-15T00:27:48.730 INFO:tasks.workunit.client.0.smithi029.stdout:9/4: dwrite f2 [0,4194304] 0 2024-04-15T00:27:48.810 INFO:tasks.workunit.client.0.smithi029.stdout:9/5: write f2 [2385184,47159] 0 2024-04-15T00:27:48.824 INFO:tasks.workunit.client.0.smithi029.stdout:0/19: fsync f1 0 2024-04-15T00:27:48.841 INFO:tasks.workunit.client.0.smithi029.stdout:8/9: write f1 [454215,73526] 0 2024-04-15T00:27:48.929 INFO:tasks.workunit.client.0.smithi029.stdout:9/6: dwrite f2 [0,4194304] 0 2024-04-15T00:27:49.084 INFO:tasks.workunit.client.0.smithi029.stdout:5/13: rename l1 to d2/l5 0 2024-04-15T00:27:49.087 INFO:tasks.workunit.client.0.smithi029.stdout:6/12: creat d1/f4 x:0 0 0 2024-04-15T00:27:49.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/16: fdatasync f1 0 2024-04-15T00:27:49.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/13: symlink l5 0 2024-04-15T00:27:49.131 INFO:tasks.workunit.client.0.smithi029.stdout:5/14: chown d2/f4 65203 1 2024-04-15T00:27:49.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/17: write f2 [4395725,93558] 0 2024-04-15T00:27:49.195 INFO:tasks.workunit.client.0.smithi029.stdout:1/18: chown c5 1045864873 1 2024-04-15T00:27:49.257 INFO:tasks.workunit.client.0.smithi029.stdout:4/14: dwrite f2 [0,4194304] 0 2024-04-15T00:27:49.441 INFO:tasks.workunit.client.0.smithi029.stdout:5/15: dwrite d2/f4 [4194304,4194304] 0 2024-04-15T00:27:49.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/12: link f1 f4 0 2024-04-15T00:27:49.665 INFO:tasks.workunit.client.0.smithi029.stdout:2/11: symlink d3/l4 0 2024-04-15T00:27:49.679 INFO:tasks.workunit.client.0.smithi029.stdout:7/4: getdents d0 0 2024-04-15T00:27:49.689 INFO:tasks.workunit.client.0.smithi029.stdout:1/19: creat f8 x:0 0 0 2024-04-15T00:27:49.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/15: fsync f4 0 2024-04-15T00:27:49.738 INFO:tasks.workunit.client.0.smithi029.stdout:4/16: chown f2 193365109 1 2024-04-15T00:27:49.740 INFO:tasks.workunit.client.0.smithi029.stdout:6/13: dread d1/f2 [0,4194304] 0 2024-04-15T00:27:49.751 INFO:tasks.workunit.client.0.smithi029.stdout:4/17: readlink l5 0 2024-04-15T00:27:49.759 INFO:tasks.workunit.client.0.smithi029.stdout:6/14: fdatasync d1/f4 0 2024-04-15T00:27:49.767 INFO:tasks.workunit.client.0.smithi029.stdout:4/18: chown f0 64774 1 2024-04-15T00:27:49.777 INFO:tasks.workunit.client.0.smithi029.stdout:4/19: fsync f2 0 2024-04-15T00:27:49.814 INFO:tasks.workunit.client.0.smithi029.stdout:8/10: rename f2 to f3 0 2024-04-15T00:27:49.827 INFO:tasks.workunit.client.0.smithi029.stdout:0/20: getdents d5 0 2024-04-15T00:27:49.891 INFO:tasks.workunit.client.0.smithi029.stdout:0/21: chown l3 6821 1 2024-04-15T00:27:49.949 INFO:tasks.workunit.client.0.smithi029.stdout:6/15: dwrite d1/f4 [0,4194304] 0 2024-04-15T00:27:50.086 INFO:tasks.workunit.client.0.smithi029.stdout:4/20: dwrite f4 [0,4194304] 0 2024-04-15T00:27:50.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/12: unlink f2 0 2024-04-15T00:27:50.187 INFO:tasks.workunit.client.0.smithi029.stdout:2/13: dread - no filename 2024-04-15T00:27:50.187 INFO:tasks.workunit.client.0.smithi029.stdout:2/14: fsync - no filename 2024-04-15T00:27:50.187 INFO:tasks.workunit.client.0.smithi029.stdout:2/15: dwrite - no filename 2024-04-15T00:27:50.202 INFO:tasks.workunit.client.0.smithi029.stdout:1/20: mknod c9 0 2024-04-15T00:27:50.264 INFO:tasks.workunit.client.0.smithi029.stdout:0/22: dwrite f2 [0,4194304] 0 2024-04-15T00:27:50.331 INFO:tasks.workunit.client.0.smithi029.stdout:6/16: mknod d1/c5 0 2024-04-15T00:27:50.338 INFO:tasks.workunit.client.0.smithi029.stdout:8/11: write f1 [733611,114824] 0 2024-04-15T00:27:50.340 INFO:tasks.workunit.client.0.smithi029.stdout:4/21: symlink l6 0 2024-04-15T00:27:50.356 INFO:tasks.workunit.client.0.smithi029.stdout:1/21: sync 2024-04-15T00:27:50.390 INFO:tasks.workunit.client.0.smithi029.stdout:0/23: write f2 [2136386,127997] 0 2024-04-15T00:27:50.391 INFO:tasks.workunit.client.0.smithi029.stdout:2/16: creat d3/f5 x:0 0 0 2024-04-15T00:27:50.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/12: write f1 [1313600,22191] 0 2024-04-15T00:27:50.425 INFO:tasks.workunit.client.0.smithi029.stdout:4/22: write f2 [1047827,124707] 0 2024-04-15T00:27:50.428 INFO:tasks.workunit.client.0.smithi029.stdout:6/17: read d1/f4 [178090,31911] 0 2024-04-15T00:27:50.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/5: symlink d0/d1/l3 0 2024-04-15T00:27:50.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/6: dwrite - no filename 2024-04-15T00:27:50.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/7: dwrite - no filename 2024-04-15T00:27:50.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/8: dread - no filename 2024-04-15T00:27:50.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/24: chown l3 108516 1 2024-04-15T00:27:50.467 INFO:tasks.workunit.client.0.smithi029.stdout:2/17: read - d3/f5 zero size 2024-04-15T00:27:50.489 INFO:tasks.workunit.client.0.smithi029.stdout:6/18: fdatasync d1/f4 0 2024-04-15T00:27:50.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/25: dread - f1 zero size 2024-04-15T00:27:50.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/7: truncate f2 2064898 0 2024-04-15T00:27:50.522 INFO:tasks.workunit.client.0.smithi029.stdout:2/18: dread - d3/f5 zero size 2024-04-15T00:27:50.526 INFO:tasks.workunit.client.0.smithi029.stdout:5/16: link d2/l3 d2/l6 0 2024-04-15T00:27:50.569 INFO:tasks.workunit.client.0.smithi029.stdout:1/22: symlink la 0 2024-04-15T00:27:50.572 INFO:tasks.workunit.client.0.smithi029.stdout:6/19: chown d1/f2 45415 1 2024-04-15T00:27:50.635 INFO:tasks.workunit.client.0.smithi029.stdout:6/20: fdatasync f0 0 2024-04-15T00:27:50.725 INFO:tasks.workunit.client.0.smithi029.stdout:4/23: dwrite f4 [0,4194304] 0 2024-04-15T00:27:50.726 INFO:tasks.workunit.client.0.smithi029.stdout:7/9: mknod d0/c4 0 2024-04-15T00:27:50.726 INFO:tasks.workunit.client.0.smithi029.stdout:7/10: truncate - no filename 2024-04-15T00:27:50.726 INFO:tasks.workunit.client.0.smithi029.stdout:7/11: dwrite - no filename 2024-04-15T00:27:50.825 INFO:tasks.workunit.client.0.smithi029.stdout:3/13: dwrite f4 [0,4194304] 0 2024-04-15T00:27:50.909 INFO:tasks.workunit.client.0.smithi029.stdout:5/17: creat d2/f7 x:0 0 0 2024-04-15T00:27:50.921 INFO:tasks.workunit.client.0.smithi029.stdout:1/23: creat fb x:0 0 0 2024-04-15T00:27:50.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/24: write f4 [840604,39066] 0 2024-04-15T00:27:50.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/24: dread f3 [0,4194304] 0 2024-04-15T00:27:50.970 INFO:tasks.workunit.client.0.smithi029.stdout:4/25: truncate f0 823348 0 2024-04-15T00:27:50.982 INFO:tasks.workunit.client.0.smithi029.stdout:1/25: truncate f3 1233472 0 2024-04-15T00:27:50.991 INFO:tasks.workunit.client.0.smithi029.stdout:8/13: link f3 f4 0 2024-04-15T00:27:51.028 INFO:tasks.workunit.client.0.smithi029.stdout:6/21: creat d1/f6 x:0 0 0 2024-04-15T00:27:51.067 INFO:tasks.workunit.client.0.smithi029.stdout:0/26: mknod d5/c6 0 2024-04-15T00:27:51.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/19: fsync d3/f5 0 2024-04-15T00:27:51.271 INFO:tasks.workunit.client.0.smithi029.stdout:3/14: symlink l5 0 2024-04-15T00:27:51.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/26: rename f8 to fc 0 2024-04-15T00:27:51.314 INFO:tasks.workunit.client.0.smithi029.stdout:4/26: creat f7 x:0 0 0 2024-04-15T00:27:51.319 INFO:tasks.workunit.client.0.smithi029.stdout:9/8: dread f2 [0,4194304] 0 2024-04-15T00:27:51.341 INFO:tasks.workunit.client.0.smithi029.stdout:6/22: mknod d1/c7 0 2024-04-15T00:27:51.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/27: chown f0 2370949 1 2024-04-15T00:27:51.353 INFO:tasks.workunit.client.0.smithi029.stdout:4/28: fdatasync f7 0 2024-04-15T00:27:51.375 INFO:tasks.workunit.client.0.smithi029.stdout:4/29: dread f0 [0,4194304] 0 2024-04-15T00:27:51.414 INFO:tasks.workunit.client.0.smithi029.stdout:4/30: write f0 [469971,89824] 0 2024-04-15T00:27:51.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/20: rename d3/l4 to d3/l6 0 2024-04-15T00:27:51.513 INFO:tasks.workunit.client.0.smithi029.stdout:4/31: dread f4 [0,4194304] 0 2024-04-15T00:27:51.552 INFO:tasks.workunit.client.0.smithi029.stdout:3/15: rename f4 to f6 0 2024-04-15T00:27:51.597 INFO:tasks.workunit.client.0.smithi029.stdout:5/18: link f0 d2/f8 0 2024-04-15T00:27:51.613 INFO:tasks.workunit.client.0.smithi029.stdout:2/21: dwrite d3/f5 [0,4194304] 0 2024-04-15T00:27:51.694 INFO:tasks.workunit.client.0.smithi029.stdout:1/27: write f1 [1668457,87477] 0 2024-04-15T00:27:51.708 INFO:tasks.workunit.client.0.smithi029.stdout:9/9: fdatasync f2 0 2024-04-15T00:27:51.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/10: fsync f2 0 2024-04-15T00:27:51.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/11: fsync f2 0 2024-04-15T00:27:51.834 INFO:tasks.workunit.client.0.smithi029.stdout:9/12: dread f2 [0,4194304] 0 2024-04-15T00:27:51.845 INFO:tasks.workunit.client.0.smithi029.stdout:8/14: link f1 f5 0 2024-04-15T00:27:51.847 INFO:tasks.workunit.client.0.smithi029.stdout:1/28: dwrite f0 [0,4194304] 0 2024-04-15T00:27:51.923 INFO:tasks.workunit.client.0.smithi029.stdout:6/23: mkdir d1/d8 0 2024-04-15T00:27:51.960 INFO:tasks.workunit.client.0.smithi029.stdout:4/32: creat f8 x:0 0 0 2024-04-15T00:27:52.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/12: link d0/d1/l3 d0/d1/l5 0 2024-04-15T00:27:52.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/13: dwrite - no filename 2024-04-15T00:27:52.131 INFO:tasks.workunit.client.0.smithi029.stdout:2/22: symlink d3/l7 0 2024-04-15T00:27:52.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/29: creat fd x:0 0 0 2024-04-15T00:27:52.244 INFO:tasks.workunit.client.0.smithi029.stdout:3/16: dwrite f1 [4194304,4194304] 0 2024-04-15T00:27:52.386 INFO:tasks.workunit.client.0.smithi029.stdout:6/24: mknod d1/c9 0 2024-04-15T00:27:52.387 INFO:tasks.workunit.client.0.smithi029.stdout:4/33: fdatasync f0 0 2024-04-15T00:27:52.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/34: rmdir - no directory 2024-04-15T00:27:52.401 INFO:tasks.workunit.client.0.smithi029.stdout:7/14: mkdir d0/d6 0 2024-04-15T00:27:52.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/35: dread - f7 zero size 2024-04-15T00:27:52.511 INFO:tasks.workunit.client.0.smithi029.stdout:6/25: dread d1/f4 [0,4194304] 0 2024-04-15T00:27:52.583 INFO:tasks.workunit.client.0.smithi029.stdout:4/36: dwrite f3 [0,4194304] 0 2024-04-15T00:27:52.656 INFO:tasks.workunit.client.0.smithi029.stdout:0/27: getdents d5 0 2024-04-15T00:27:52.680 INFO:tasks.workunit.client.0.smithi029.stdout:3/17: symlink l7 0 2024-04-15T00:27:52.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/30: creat fe x:0 0 0 2024-04-15T00:27:52.700 INFO:tasks.workunit.client.0.smithi029.stdout:9/13: truncate f2 1723569 0 2024-04-15T00:27:52.721 INFO:tasks.workunit.client.0.smithi029.stdout:7/15: readlink d0/d1/l3 0 2024-04-15T00:27:52.721 INFO:tasks.workunit.client.0.smithi029.stdout:7/16: dread - no filename 2024-04-15T00:27:52.994 INFO:tasks.workunit.client.0.smithi029.stdout:4/37: unlink l6 0 2024-04-15T00:27:53.006 INFO:tasks.workunit.client.0.smithi029.stdout:1/31: mkdir df 0 2024-04-15T00:27:53.008 INFO:tasks.workunit.client.0.smithi029.stdout:8/15: link f3 f6 0 2024-04-15T00:27:53.016 INFO:tasks.workunit.client.0.smithi029.stdout:0/28: read - f4 zero size 2024-04-15T00:27:53.027 INFO:tasks.workunit.client.0.smithi029.stdout:8/16: chown f1 291949324 1 2024-04-15T00:27:53.037 INFO:tasks.workunit.client.0.smithi029.stdout:1/32: write fd [412008,97922] 0 2024-04-15T00:27:53.062 INFO:tasks.workunit.client.0.smithi029.stdout:6/26: mknod d1/d8/ca 0 2024-04-15T00:27:53.069 INFO:tasks.workunit.client.0.smithi029.stdout:3/18: symlink l8 0 2024-04-15T00:27:53.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/23: rename d3/l6 to d3/l8 0 2024-04-15T00:27:53.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/19: readlink l8 0 2024-04-15T00:27:53.129 INFO:tasks.workunit.client.0.smithi029.stdout:3/20: write f6 [2212384,9302] 0 2024-04-15T00:27:53.162 INFO:tasks.workunit.client.0.smithi029.stdout:6/27: dread d1/f4 [0,4194304] 0 2024-04-15T00:27:53.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/28: truncate f0 747533 0 2024-04-15T00:27:53.179 INFO:tasks.workunit.client.0.smithi029.stdout:6/29: fsync f0 0 2024-04-15T00:27:53.202 INFO:tasks.workunit.client.0.smithi029.stdout:5/19: getdents d2 0 2024-04-15T00:27:53.216 INFO:tasks.workunit.client.0.smithi029.stdout:8/17: rename f4 to f7 0 2024-04-15T00:27:53.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/20: dread d2/f8 [0,4194304] 0 2024-04-15T00:27:53.476 INFO:tasks.workunit.client.0.smithi029.stdout:7/17: getdents d0/d6 0 2024-04-15T00:27:53.493 INFO:tasks.workunit.client.0.smithi029.stdout:6/30: mkdir d1/d8/db 0 2024-04-15T00:27:53.516 INFO:tasks.workunit.client.0.smithi029.stdout:1/33: creat df/f10 x:0 0 0 2024-04-15T00:27:53.538 INFO:tasks.workunit.client.0.smithi029.stdout:7/18: readlink d0/d1/l5 0 2024-04-15T00:27:53.539 INFO:tasks.workunit.client.0.smithi029.stdout:7/19: dwrite - no filename 2024-04-15T00:27:53.552 INFO:tasks.workunit.client.0.smithi029.stdout:7/20: rename d0/d6 to d0/d6/d7 22 2024-04-15T00:27:53.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/21: mkdir d2/d9 0 2024-04-15T00:27:53.701 INFO:tasks.workunit.client.0.smithi029.stdout:0/29: link f4 d5/f7 0 2024-04-15T00:27:53.758 INFO:tasks.workunit.client.0.smithi029.stdout:0/30: readlink l3 0 2024-04-15T00:27:53.766 INFO:tasks.workunit.client.0.smithi029.stdout:8/18: fsync f1 0 2024-04-15T00:27:53.787 INFO:tasks.workunit.client.0.smithi029.stdout:5/22: dwrite d2/f7 [0,4194304] 0 2024-04-15T00:27:53.869 INFO:tasks.workunit.client.0.smithi029.stdout:1/34: mknod df/c11 0 2024-04-15T00:27:53.922 INFO:tasks.workunit.client.0.smithi029.stdout:6/31: write d1/f4 [827181,100751] 0 2024-04-15T00:27:53.987 INFO:tasks.workunit.client.0.smithi029.stdout:9/14: dwrite f2 [0,4194304] 0 2024-04-15T00:27:54.057 INFO:tasks.workunit.client.0.smithi029.stdout:1/35: chown f2 38542888 1 2024-04-15T00:27:54.066 INFO:tasks.workunit.client.0.smithi029.stdout:2/24: truncate d3/f5 947384 0 2024-04-15T00:27:54.127 INFO:tasks.workunit.client.0.smithi029.stdout:4/38: dwrite f4 [0,4194304] 0 2024-04-15T00:27:54.129 INFO:tasks.workunit.client.0.smithi029.stdout:4/39: rmdir - no directory 2024-04-15T00:27:54.190 INFO:tasks.workunit.client.0.smithi029.stdout:7/21: creat d0/d6/f8 x:0 0 0 2024-04-15T00:27:54.221 INFO:tasks.workunit.client.0.smithi029.stdout:1/36: write f1 [951366,117162] 0 2024-04-15T00:27:54.238 INFO:tasks.workunit.client.0.smithi029.stdout:0/31: rename d5/c6 to d5/c8 0 2024-04-15T00:27:54.325 INFO:tasks.workunit.client.0.smithi029.stdout:6/32: symlink d1/d8/lc 0 2024-04-15T00:27:54.341 INFO:tasks.workunit.client.0.smithi029.stdout:3/21: dwrite f0 [0,4194304] 0 2024-04-15T00:27:54.429 INFO:tasks.workunit.client.0.smithi029.stdout:4/40: symlink l9 0 2024-04-15T00:27:54.486 INFO:tasks.workunit.client.0.smithi029.stdout:0/32: symlink d5/l9 0 2024-04-15T00:27:54.487 INFO:tasks.workunit.client.0.smithi029.stdout:7/22: creat d0/d1/f9 x:0 0 0 2024-04-15T00:27:54.599 INFO:tasks.workunit.client.0.smithi029.stdout:9/15: dwrite f2 [0,4194304] 0 2024-04-15T00:27:54.773 INFO:tasks.workunit.client.0.smithi029.stdout:5/23: rmdir d2/d9 0 2024-04-15T00:27:54.779 INFO:tasks.workunit.client.0.smithi029.stdout:4/41: dwrite f7 [0,4194304] 0 2024-04-15T00:27:54.837 INFO:tasks.workunit.client.0.smithi029.stdout:3/22: dwrite f0 [0,4194304] 0 2024-04-15T00:27:54.907 INFO:tasks.workunit.client.0.smithi029.stdout:6/33: symlink d1/ld 0 2024-04-15T00:27:54.908 INFO:tasks.workunit.client.0.smithi029.stdout:8/19: getdents . 0 2024-04-15T00:27:54.957 INFO:tasks.workunit.client.0.smithi029.stdout:4/42: chown f2 524780807 1 2024-04-15T00:27:54.972 INFO:tasks.workunit.client.0.smithi029.stdout:8/20: chown f5 101142 1 2024-04-15T00:27:54.974 INFO:tasks.workunit.client.0.smithi029.stdout:3/23: write f1 [7471150,79247] 0 2024-04-15T00:27:54.982 INFO:tasks.workunit.client.0.smithi029.stdout:5/24: sync 2024-04-15T00:27:55.039 INFO:tasks.workunit.client.0.smithi029.stdout:9/16: dwrite f2 [0,4194304] 0 2024-04-15T00:27:55.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/23: creat d0/d6/fa x:0 0 0 2024-04-15T00:27:55.051 INFO:tasks.workunit.client.0.smithi029.stdout:0/33: symlink d5/la 0 2024-04-15T00:27:55.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/17: stat f2 0 2024-04-15T00:27:55.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/37: truncate f0 977161 0 2024-04-15T00:27:55.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/38: truncate fb 262968 0 2024-04-15T00:27:55.320 INFO:tasks.workunit.client.0.smithi029.stdout:4/43: creat fa x:0 0 0 2024-04-15T00:27:55.320 INFO:tasks.workunit.client.0.smithi029.stdout:3/24: rename l8 to l9 0 2024-04-15T00:27:55.329 INFO:tasks.workunit.client.0.smithi029.stdout:6/34: rename d1/f2 to d1/d8/db/fe 0 2024-04-15T00:27:55.330 INFO:tasks.workunit.client.0.smithi029.stdout:5/25: readlink d2/l6 0 2024-04-15T00:27:55.366 INFO:tasks.workunit.client.0.smithi029.stdout:4/44: write f4 [1915924,48887] 0 2024-04-15T00:27:55.376 INFO:tasks.workunit.client.0.smithi029.stdout:6/35: write d1/f6 [1017389,123726] 0 2024-04-15T00:27:55.395 INFO:tasks.workunit.client.0.smithi029.stdout:0/34: rmdir d5 39 2024-04-15T00:27:55.417 INFO:tasks.workunit.client.0.smithi029.stdout:0/35: dread - f1 zero size 2024-04-15T00:27:55.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/18: mkdir d3 0 2024-04-15T00:27:55.506 INFO:tasks.workunit.client.0.smithi029.stdout:7/24: fsync d0/d6/fa 0 2024-04-15T00:27:55.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/45: dwrite f4 [0,4194304] 0 2024-04-15T00:27:55.676 INFO:tasks.workunit.client.0.smithi029.stdout:4/46: dwrite f2 [0,4194304] 0 2024-04-15T00:27:55.759 INFO:tasks.workunit.client.0.smithi029.stdout:1/39: rename fb to df/f12 0 2024-04-15T00:27:55.770 INFO:tasks.workunit.client.0.smithi029.stdout:3/25: creat fa x:0 0 0 2024-04-15T00:27:55.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/21: getdents . 0 2024-04-15T00:27:55.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/36: unlink f0 0 2024-04-15T00:27:55.779 INFO:tasks.workunit.client.0.smithi029.stdout:5/26: creat d2/fa x:0 0 0 2024-04-15T00:27:55.842 INFO:tasks.workunit.client.0.smithi029.stdout:6/37: write d1/f6 [1077773,8231] 0 2024-04-15T00:27:55.920 INFO:tasks.workunit.client.0.smithi029.stdout:8/22: dread f3 [0,4194304] 0 2024-04-15T00:27:55.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/27: dread f0 [0,4194304] 0 2024-04-15T00:27:55.959 INFO:tasks.workunit.client.0.smithi029.stdout:2/25: truncate d3/f5 1724979 0 2024-04-15T00:27:55.979 INFO:tasks.workunit.client.0.smithi029.stdout:7/25: rmdir d0/d6 39 2024-04-15T00:27:56.024 INFO:tasks.workunit.client.0.smithi029.stdout:7/26: fsync d0/d1/f9 0 2024-04-15T00:27:56.053 INFO:tasks.workunit.client.0.smithi029.stdout:4/47: symlink lb 0 2024-04-15T00:27:56.070 INFO:tasks.workunit.client.0.smithi029.stdout:6/38: dwrite d1/f4 [4194304,4194304] 0 2024-04-15T00:27:56.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/39: dread d1/d8/db/fe [0,4194304] 0 2024-04-15T00:27:56.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/40: unlink f2 0 2024-04-15T00:27:56.204 INFO:tasks.workunit.client.0.smithi029.stdout:3/26: unlink f6 0 2024-04-15T00:27:56.226 INFO:tasks.workunit.client.0.smithi029.stdout:3/27: write fa [829640,118890] 0 2024-04-15T00:27:56.242 INFO:tasks.workunit.client.0.smithi029.stdout:3/28: fsync fa 0 2024-04-15T00:27:56.291 INFO:tasks.workunit.client.0.smithi029.stdout:3/29: dread f0 [0,4194304] 0 2024-04-15T00:27:56.310 INFO:tasks.workunit.client.0.smithi029.stdout:3/30: dread f3 [0,4194304] 0 2024-04-15T00:27:56.315 INFO:tasks.workunit.client.0.smithi029.stdout:3/31: readlink l5 0 2024-04-15T00:27:56.356 INFO:tasks.workunit.client.0.smithi029.stdout:0/36: mkdir d5/db 0 2024-04-15T00:27:56.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/23: mkdir d8 0 2024-04-15T00:27:56.402 INFO:tasks.workunit.client.0.smithi029.stdout:9/19: symlink d3/l4 0 2024-04-15T00:27:56.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/20: stat d3/l4 0 2024-04-15T00:27:56.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/28: creat d2/fb x:0 0 0 2024-04-15T00:27:56.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/26: creat d3/f9 x:0 0 0 2024-04-15T00:27:56.575 INFO:tasks.workunit.client.0.smithi029.stdout:4/48: mknod cc 0 2024-04-15T00:27:56.583 INFO:tasks.workunit.client.0.smithi029.stdout:4/49: fsync fa 0 2024-04-15T00:27:56.596 INFO:tasks.workunit.client.0.smithi029.stdout:4/50: write fa [566622,113676] 0 2024-04-15T00:27:56.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/51: stat f3 0 2024-04-15T00:27:56.709 INFO:tasks.workunit.client.0.smithi029.stdout:6/40: creat d1/d8/db/ff x:0 0 0 2024-04-15T00:27:56.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/41: write d1/d8/db/ff [711310,38126] 0 2024-04-15T00:27:56.823 INFO:tasks.workunit.client.0.smithi029.stdout:1/41: rename df/f10 to df/f13 0 2024-04-15T00:27:56.839 INFO:tasks.workunit.client.0.smithi029.stdout:9/21: symlink d3/l5 0 2024-04-15T00:27:56.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/29: unlink d2/l6 0 2024-04-15T00:27:56.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/24: fsync f6 0 2024-04-15T00:27:56.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/52: creat fd x:0 0 0 2024-04-15T00:27:56.986 INFO:tasks.workunit.client.0.smithi029.stdout:4/53: chown f2 70 1 2024-04-15T00:27:56.997 INFO:tasks.workunit.client.0.smithi029.stdout:9/22: dwrite f2 [4194304,4194304] 0 2024-04-15T00:27:57.064 INFO:tasks.workunit.client.0.smithi029.stdout:4/54: chown l9 31 1 2024-04-15T00:27:57.065 INFO:tasks.workunit.client.0.smithi029.stdout:9/23: read f2 [4012916,28701] 0 2024-04-15T00:27:57.117 INFO:tasks.workunit.client.0.smithi029.stdout:9/24: dread f2 [4194304,4194304] 0 2024-04-15T00:27:57.162 INFO:tasks.workunit.client.0.smithi029.stdout:6/42: rmdir d1 39 2024-04-15T00:27:57.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/37: mknod d5/db/cc 0 2024-04-15T00:27:57.176 INFO:tasks.workunit.client.0.smithi029.stdout:1/42: symlink df/l14 0 2024-04-15T00:27:57.211 INFO:tasks.workunit.client.0.smithi029.stdout:1/43: dread f1 [0,4194304] 0 2024-04-15T00:27:57.221 INFO:tasks.workunit.client.0.smithi029.stdout:1/44: chown df/f13 12203 1 2024-04-15T00:27:57.233 INFO:tasks.workunit.client.0.smithi029.stdout:1/45: write f1 [713547,107245] 0 2024-04-15T00:27:57.357 INFO:tasks.workunit.client.0.smithi029.stdout:2/27: chown d3/f5 1990 1 2024-04-15T00:27:57.367 INFO:tasks.workunit.client.0.smithi029.stdout:2/28: chown d3 22695 1 2024-04-15T00:27:57.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/29: readlink d3/l7 0 2024-04-15T00:27:57.404 INFO:tasks.workunit.client.0.smithi029.stdout:8/25: rename f3 to d8/f9 0 2024-04-15T00:27:57.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/27: creat d0/fb x:0 0 0 2024-04-15T00:27:57.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/30: dread d2/f4 [0,4194304] 0 2024-04-15T00:27:57.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/30: chown d3/l7 155657861 1 2024-04-15T00:27:57.517 INFO:tasks.workunit.client.0.smithi029.stdout:5/31: dread d2/f7 [0,4194304] 0 2024-04-15T00:27:57.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/55: unlink fa 0 2024-04-15T00:27:57.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/25: mkdir d3/d6 0 2024-04-15T00:27:57.583 INFO:tasks.workunit.client.0.smithi029.stdout:4/56: chown f4 41810 1 2024-04-15T00:27:57.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/57: dread f3 [0,4194304] 0 2024-04-15T00:27:57.693 INFO:tasks.workunit.client.0.smithi029.stdout:6/43: dread d1/f6 [0,4194304] 0 2024-04-15T00:27:57.706 INFO:tasks.workunit.client.0.smithi029.stdout:1/46: creat df/f15 x:0 0 0 2024-04-15T00:27:57.733 INFO:tasks.workunit.client.0.smithi029.stdout:6/44: dread d1/f6 [0,4194304] 0 2024-04-15T00:27:57.753 INFO:tasks.workunit.client.0.smithi029.stdout:7/28: dread - d0/d6/fa zero size 2024-04-15T00:27:57.761 INFO:tasks.workunit.client.0.smithi029.stdout:7/29: readlink d0/d1/l5 0 2024-04-15T00:27:57.858 INFO:tasks.workunit.client.0.smithi029.stdout:3/32: truncate f0 1966392 0 2024-04-15T00:27:57.945 INFO:tasks.workunit.client.0.smithi029.stdout:2/31: rename d3/l7 to d3/la 0 2024-04-15T00:27:58.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/58: mkdir de 0 2024-04-15T00:27:58.330 INFO:tasks.workunit.client.0.smithi029.stdout:1/47: creat df/f16 x:0 0 0 2024-04-15T00:27:58.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/45: creat d1/d8/f10 x:0 0 0 2024-04-15T00:27:58.390 INFO:tasks.workunit.client.0.smithi029.stdout:7/30: creat d0/d1/fc x:0 0 0 2024-04-15T00:27:58.405 INFO:tasks.workunit.client.0.smithi029.stdout:7/31: write d0/d1/f9 [184674,81511] 0 2024-04-15T00:27:58.421 INFO:tasks.workunit.client.0.smithi029.stdout:7/32: read - d0/d6/f8 zero size 2024-04-15T00:27:58.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/33: truncate d0/d6/fa 836557 0 2024-04-15T00:27:58.512 INFO:tasks.workunit.client.0.smithi029.stdout:2/32: symlink d3/lb 0 2024-04-15T00:27:58.549 INFO:tasks.workunit.client.0.smithi029.stdout:9/26: mknod d3/d6/c7 0 2024-04-15T00:27:58.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/32: dwrite d2/f8 [0,4194304] 0 2024-04-15T00:27:58.686 INFO:tasks.workunit.client.0.smithi029.stdout:0/38: write f4 [691781,82434] 0 2024-04-15T00:27:58.700 INFO:tasks.workunit.client.0.smithi029.stdout:5/33: readlink d2/l5 0 2024-04-15T00:27:58.718 INFO:tasks.workunit.client.0.smithi029.stdout:6/46: creat d1/d8/db/f11 x:0 0 0 2024-04-15T00:27:58.770 INFO:tasks.workunit.client.0.smithi029.stdout:1/48: rename df/f12 to df/f17 0 2024-04-15T00:27:58.822 INFO:tasks.workunit.client.0.smithi029.stdout:3/33: link fa fb 0 2024-04-15T00:27:58.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/47: dwrite d1/d8/db/f11 [0,4194304] 0 2024-04-15T00:27:58.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/34: creat d0/d1/fd x:0 0 0 2024-04-15T00:27:58.971 INFO:tasks.workunit.client.0.smithi029.stdout:3/34: dread fb [0,4194304] 0 2024-04-15T00:27:59.056 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:59.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:27:59.079 INFO:tasks.workunit.client.0.smithi029.stdout:9/27: symlink d3/l8 0 2024-04-15T00:27:59.082 INFO:tasks.workunit.client.0.smithi029.stdout:4/59: mkdir de/df 0 2024-04-15T00:27:59.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/28: readlink d3/l8 0 2024-04-15T00:27:59.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/60: chown f2 31 1 2024-04-15T00:27:59.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/39: symlink d5/ld 0 2024-04-15T00:27:59.115 INFO:tasks.workunit.client.0.smithi029.stdout:8/26: getdents d8 0 2024-04-15T00:27:59.133 INFO:tasks.workunit.client.0.smithi029.stdout:0/40: stat d5/l9 0 2024-04-15T00:27:59.148 INFO:tasks.workunit.client.0.smithi029.stdout:0/41: write f1 [993182,90503] 0 2024-04-15T00:27:59.159 INFO:tasks.workunit.client.0.smithi029.stdout:0/42: readlink d5/la 0 2024-04-15T00:27:59.196 INFO:tasks.workunit.client.0.smithi029.stdout:1/49: creat df/f18 x:0 0 0 2024-04-15T00:27:59.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/43: dread f1 [0,4194304] 0 2024-04-15T00:27:59.439 INFO:tasks.workunit.client.0.smithi029.stdout:9/29: mkdir d3/d6/d9 0 2024-04-15T00:27:59.467 INFO:tasks.workunit.client.0.smithi029.stdout:1/50: write fc [453051,71411] 0 2024-04-15T00:27:59.493 INFO:tasks.workunit.client.0.smithi029.stdout:0/44: mknod d5/ce 0 2024-04-15T00:27:59.618 INFO:tasks.workunit.client.0.smithi029.stdout:6/48: link d1/d8/f10 d1/f12 0 2024-04-15T00:27:59.624 INFO:tasks.workunit.client.0.smithi029.stdout:6/49: readlink d1/d8/lc 0 2024-04-15T00:27:59.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/51: rename df/f17 to df/f19 0 2024-04-15T00:27:59.855 INFO:tasks.workunit.client.0.smithi029.stdout:2/33: dwrite d3/f5 [0,4194304] 0 2024-04-15T00:27:59.931 INFO:tasks.workunit.client.0.smithi029.stdout:5/34: write d2/f4 [4457549,93738] 0 2024-04-15T00:27:59.954 INFO:tasks.workunit.client.0.smithi029.stdout:2/34: fdatasync d3/f9 0 2024-04-15T00:27:59.966 INFO:tasks.workunit.client.0.smithi029.stdout:1/52: write df/f18 [205041,131030] 0 2024-04-15T00:28:00.028 INFO:tasks.workunit.client.0.smithi029.stdout:5/35: dread d2/f8 [0,4194304] 0 2024-04-15T00:28:00.036 INFO:tasks.workunit.client.0.smithi029.stdout:5/36: fdatasync f0 0 2024-04-15T00:28:00.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/37: readlink d2/l5 0 2024-04-15T00:28:00.047 INFO:tasks.workunit.client.0.smithi029.stdout:5/38: chown f0 268201075 1 2024-04-15T00:28:00.156 INFO:tasks.workunit.client.0.smithi029.stdout:4/61: write f8 [899369,61231] 0 2024-04-15T00:28:00.267 INFO:tasks.workunit.client.0.smithi029.stdout:8/27: write d8/f9 [2332090,36380] 0 2024-04-15T00:28:00.268 INFO:tasks.workunit.client.0.smithi029.stdout:3/35: chown f0 567460460 1 2024-04-15T00:28:00.268 INFO:tasks.workunit.client.0.smithi029.stdout:8/28: fsync f5 0 2024-04-15T00:28:00.268 INFO:tasks.workunit.client.0.smithi029.stdout:1/53: symlink df/l1a 0 2024-04-15T00:28:00.268 INFO:tasks.workunit.client.0.smithi029.stdout:7/35: getdents d0/d6 0 2024-04-15T00:28:00.280 INFO:tasks.workunit.client.0.smithi029.stdout:5/39: mknod d2/cc 0 2024-04-15T00:28:00.309 INFO:tasks.workunit.client.0.smithi029.stdout:9/30: dwrite f2 [0,4194304] 0 2024-04-15T00:28:00.474 INFO:tasks.workunit.client.0.smithi029.stdout:2/35: write d3/f5 [5223287,33552] 0 2024-04-15T00:28:00.474 INFO:tasks.workunit.client.0.smithi029.stdout:8/29: unlink f1 0 2024-04-15T00:28:00.510 INFO:tasks.workunit.client.0.smithi029.stdout:3/36: chown l9 116492021 1 2024-04-15T00:28:00.742 INFO:tasks.workunit.client.0.smithi029.stdout:0/45: unlink f1 0 2024-04-15T00:28:00.765 INFO:tasks.workunit.client.0.smithi029.stdout:4/62: mkdir de/df/d10 0 2024-04-15T00:28:00.798 INFO:tasks.workunit.client.0.smithi029.stdout:3/37: symlink lc 0 2024-04-15T00:28:00.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/46: chown f4 5721 1 2024-04-15T00:28:00.858 INFO:tasks.workunit.client.0.smithi029.stdout:9/31: mknod d3/d6/d9/ca 0 2024-04-15T00:28:00.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/40: dwrite d2/f8 [0,4194304] 0 2024-04-15T00:28:01.025 INFO:tasks.workunit.client.0.smithi029.stdout:6/50: link d1/c5 d1/c13 0 2024-04-15T00:28:01.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/47: dwrite d5/f7 [0,4194304] 0 2024-04-15T00:28:01.205 INFO:tasks.workunit.client.0.smithi029.stdout:8/30: getdents d8 0 2024-04-15T00:28:01.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/54: link c9 df/c1b 0 2024-04-15T00:28:01.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/41: mknod d2/cd 0 2024-04-15T00:28:01.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/51: read d1/f6 [842592,84312] 0 2024-04-15T00:28:01.259 INFO:tasks.workunit.client.0.smithi029.stdout:7/36: getdents d0 0 2024-04-15T00:28:01.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/42: fdatasync d2/f4 0 2024-04-15T00:28:01.305 INFO:tasks.workunit.client.0.smithi029.stdout:9/32: dwrite f2 [4194304,4194304] 0 2024-04-15T00:28:01.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/33: write f2 [6929269,115920] 0 2024-04-15T00:28:01.578 INFO:tasks.workunit.client.0.smithi029.stdout:4/63: getdents de/df/d10 0 2024-04-15T00:28:01.588 INFO:tasks.workunit.client.0.smithi029.stdout:3/38: write f0 [2020367,96123] 0 2024-04-15T00:28:01.593 INFO:tasks.workunit.client.0.smithi029.stdout:7/37: dwrite d0/d6/fa [0,4194304] 0 2024-04-15T00:28:01.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/55: creat df/f1c x:0 0 0 2024-04-15T00:28:01.687 INFO:tasks.workunit.client.0.smithi029.stdout:5/43: mkdir d2/de 0 2024-04-15T00:28:01.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/38: dread - d0/d1/fd zero size 2024-04-15T00:28:01.761 INFO:tasks.workunit.client.0.smithi029.stdout:9/34: dwrite f2 [8388608,4194304] 0 2024-04-15T00:28:01.830 INFO:tasks.workunit.client.0.smithi029.stdout:2/36: link d3/l8 d3/lc 0 2024-04-15T00:28:01.951 INFO:tasks.workunit.client.0.smithi029.stdout:8/31: mkdir d8/da 0 2024-04-15T00:28:01.960 INFO:tasks.workunit.client.0.smithi029.stdout:3/39: mknod cd 0 2024-04-15T00:28:01.966 INFO:tasks.workunit.client.0.smithi029.stdout:1/56: mknod df/c1d 0 2024-04-15T00:28:01.970 INFO:tasks.workunit.client.0.smithi029.stdout:6/52: truncate d1/d8/db/fe 1203200 0 2024-04-15T00:28:02.030 INFO:tasks.workunit.client.0.smithi029.stdout:1/57: write df/f16 [267815,79496] 0 2024-04-15T00:28:02.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/44: sync 2024-04-15T00:28:02.139 INFO:tasks.workunit.client.0.smithi029.stdout:4/64: dwrite f4 [0,4194304] 0 2024-04-15T00:28:02.270 INFO:tasks.workunit.client.0.smithi029.stdout:2/37: mkdir d3/dd 0 2024-04-15T00:28:02.273 INFO:tasks.workunit.client.0.smithi029.stdout:9/35: creat d3/fb x:0 0 0 2024-04-15T00:28:02.298 INFO:tasks.workunit.client.0.smithi029.stdout:3/40: rename l9 to le 0 2024-04-15T00:28:02.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/39: dwrite d0/d6/fa [4194304,4194304] 0 2024-04-15T00:28:02.450 INFO:tasks.workunit.client.0.smithi029.stdout:7/40: write d0/d1/fc [271385,41536] 0 2024-04-15T00:28:02.484 INFO:tasks.workunit.client.0.smithi029.stdout:4/65: dwrite f4 [0,4194304] 0 2024-04-15T00:28:02.630 INFO:tasks.workunit.client.0.smithi029.stdout:9/36: fsync d3/fb 0 2024-04-15T00:28:02.641 INFO:tasks.workunit.client.0.smithi029.stdout:1/58: rename df/f18 to df/f1e 0 2024-04-15T00:28:02.643 INFO:tasks.workunit.client.0.smithi029.stdout:6/53: write d1/f12 [527264,65736] 0 2024-04-15T00:28:02.644 INFO:tasks.workunit.client.0.smithi029.stdout:0/48: getdents d5/db 0 2024-04-15T00:28:02.670 INFO:tasks.workunit.client.0.smithi029.stdout:2/38: symlink d3/le 0 2024-04-15T00:28:02.679 INFO:tasks.workunit.client.0.smithi029.stdout:3/41: truncate f3 97178 0 2024-04-15T00:28:02.679 INFO:tasks.workunit.client.0.smithi029.stdout:8/32: fdatasync d8/f9 0 2024-04-15T00:28:02.851 INFO:tasks.workunit.client.0.smithi029.stdout:7/41: creat d0/d1/fe x:0 0 0 2024-04-15T00:28:02.856 INFO:tasks.workunit.client.0.smithi029.stdout:5/45: symlink d2/de/lf 0 2024-04-15T00:28:02.876 INFO:tasks.workunit.client.0.smithi029.stdout:5/46: chown d2/fb 56210 1 2024-04-15T00:28:03.010 INFO:tasks.workunit.client.0.smithi029.stdout:0/49: symlink d5/lf 0 2024-04-15T00:28:03.027 INFO:tasks.workunit.client.0.smithi029.stdout:1/59: mknod df/c1f 0 2024-04-15T00:28:03.029 INFO:tasks.workunit.client.0.smithi029.stdout:8/33: chown f6 63617384 1 2024-04-15T00:28:03.049 INFO:tasks.workunit.client.0.smithi029.stdout:3/42: creat ff x:0 0 0 2024-04-15T00:28:03.053 INFO:tasks.workunit.client.0.smithi029.stdout:2/39: symlink d3/lf 0 2024-04-15T00:28:03.062 INFO:tasks.workunit.client.0.smithi029.stdout:9/37: symlink d3/d6/d9/lc 0 2024-04-15T00:28:03.077 INFO:tasks.workunit.client.0.smithi029.stdout:6/54: write d1/d8/db/ff [987727,28872] 0 2024-04-15T00:28:03.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/40: readlink d3/le 0 2024-04-15T00:28:03.127 INFO:tasks.workunit.client.0.smithi029.stdout:6/55: read d1/d8/db/f11 [2675134,125450] 0 2024-04-15T00:28:03.178 INFO:tasks.workunit.client.0.smithi029.stdout:6/56: chown d1/f12 7501 1 2024-04-15T00:28:03.191 INFO:tasks.workunit.client.0.smithi029.stdout:4/66: creat de/df/d10/f11 x:0 0 0 2024-04-15T00:28:03.210 INFO:tasks.workunit.client.0.smithi029.stdout:5/47: dread - d2/fa zero size 2024-04-15T00:28:03.217 INFO:tasks.workunit.client.0.smithi029.stdout:1/60: creat df/f20 x:0 0 0 2024-04-15T00:28:03.256 INFO:tasks.workunit.client.0.smithi029.stdout:8/34: symlink d8/lb 0 2024-04-15T00:28:03.272 INFO:tasks.workunit.client.0.smithi029.stdout:9/38: dwrite d3/fb [0,4194304] 0 2024-04-15T00:28:03.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/57: fsync d1/d8/db/f11 0 2024-04-15T00:28:03.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/42: rename d0/d1 to d0/d6/df 0 2024-04-15T00:28:03.392 INFO:tasks.workunit.client.0.smithi029.stdout:1/61: dread - df/f15 zero size 2024-04-15T00:28:03.404 INFO:tasks.workunit.client.0.smithi029.stdout:2/41: chown d3/la 43089389 1 2024-04-15T00:28:03.434 INFO:tasks.workunit.client.0.smithi029.stdout:0/50: dread f2 [0,4194304] 0 2024-04-15T00:28:03.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/67: creat de/df/f12 x:0 0 0 2024-04-15T00:28:03.532 INFO:tasks.workunit.client.0.smithi029.stdout:0/51: dwrite f4 [0,4194304] 0 2024-04-15T00:28:03.610 INFO:tasks.workunit.client.0.smithi029.stdout:3/43: rename le to l10 0 2024-04-15T00:28:03.631 INFO:tasks.workunit.client.0.smithi029.stdout:3/44: chown f0 1 1 2024-04-15T00:28:03.641 INFO:tasks.workunit.client.0.smithi029.stdout:3/45: chown f0 178 1 2024-04-15T00:28:03.719 INFO:tasks.workunit.client.0.smithi029.stdout:5/48: creat d2/de/f10 x:0 0 0 2024-04-15T00:28:03.730 INFO:tasks.workunit.client.0.smithi029.stdout:8/35: write d8/f9 [2200921,122329] 0 2024-04-15T00:28:03.737 INFO:tasks.workunit.client.0.smithi029.stdout:5/49: fsync d2/f4 0 2024-04-15T00:28:03.769 INFO:tasks.workunit.client.0.smithi029.stdout:2/42: stat d3/lc 0 2024-04-15T00:28:03.771 INFO:tasks.workunit.client.0.smithi029.stdout:5/50: dread - d2/fa zero size 2024-04-15T00:28:03.856 INFO:tasks.workunit.client.0.smithi029.stdout:1/62: creat df/f21 x:0 0 0 2024-04-15T00:28:04.024 INFO:tasks.workunit.client.0.smithi029.stdout:4/68: symlink de/df/l13 0 2024-04-15T00:28:04.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/52: rename f4 to d5/db/f10 0 2024-04-15T00:28:04.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/53: dread f2 [0,4194304] 0 2024-04-15T00:28:04.204 INFO:tasks.workunit.client.0.smithi029.stdout:3/46: mknod c11 0 2024-04-15T00:28:04.211 INFO:tasks.workunit.client.0.smithi029.stdout:8/36: mkdir d8/dc 0 2024-04-15T00:28:04.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/47: readlink lc 0 2024-04-15T00:28:04.268 INFO:tasks.workunit.client.0.smithi029.stdout:2/43: mknod d3/c10 0 2024-04-15T00:28:04.319 INFO:tasks.workunit.client.0.smithi029.stdout:0/54: sync 2024-04-15T00:28:04.321 INFO:tasks.workunit.client.0.smithi029.stdout:2/44: dread d3/f5 [4194304,4194304] 0 2024-04-15T00:28:04.557 INFO:tasks.workunit.client.0.smithi029.stdout:1/63: creat df/f22 x:0 0 0 2024-04-15T00:28:04.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/51: link f0 d2/f11 0 2024-04-15T00:28:04.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/55: creat d5/f11 x:0 0 0 2024-04-15T00:28:04.646 INFO:tasks.workunit.client.0.smithi029.stdout:4/69: dread f0 [0,4194304] 0 2024-04-15T00:28:04.672 INFO:tasks.workunit.client.0.smithi029.stdout:0/56: stat d5/f11 0 2024-04-15T00:28:04.696 INFO:tasks.workunit.client.0.smithi029.stdout:2/45: rename d3/c10 to d3/dd/c11 0 2024-04-15T00:28:04.703 INFO:tasks.workunit.client.0.smithi029.stdout:9/39: getdents d3 0 2024-04-15T00:28:04.773 INFO:tasks.workunit.client.0.smithi029.stdout:2/46: write d3/f9 [398753,52139] 0 2024-04-15T00:28:04.814 INFO:tasks.workunit.client.0.smithi029.stdout:8/37: dwrite f5 [0,4194304] 0 2024-04-15T00:28:04.977 INFO:tasks.workunit.client.0.smithi029.stdout:1/64: rename df/l1a to df/l23 0 2024-04-15T00:28:04.983 INFO:tasks.workunit.client.0.smithi029.stdout:6/58: write d1/d8/db/fe [154567,2592] 0 2024-04-15T00:28:05.011 INFO:tasks.workunit.client.0.smithi029.stdout:6/59: write d1/f12 [328175,73968] 0 2024-04-15T00:28:05.116 INFO:tasks.workunit.client.0.smithi029.stdout:6/60: dwrite d1/d8/f10 [0,4194304] 0 2024-04-15T00:28:05.182 INFO:tasks.workunit.client.0.smithi029.stdout:5/52: mknod d2/de/c12 0 2024-04-15T00:28:05.194 INFO:tasks.workunit.client.0.smithi029.stdout:7/43: rename d0/d6/df/l5 to d0/d6/l10 0 2024-04-15T00:28:05.210 INFO:tasks.workunit.client.0.smithi029.stdout:3/48: write fb [1526422,122069] 0 2024-04-15T00:28:05.226 INFO:tasks.workunit.client.0.smithi029.stdout:9/40: creat d3/d6/d9/fd x:0 0 0 2024-04-15T00:28:05.279 INFO:tasks.workunit.client.0.smithi029.stdout:8/38: creat d8/fd x:0 0 0 2024-04-15T00:28:05.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/47: dread d3/f5 [4194304,4194304] 0 2024-04-15T00:28:05.306 INFO:tasks.workunit.client.0.smithi029.stdout:9/41: write d3/fb [2645596,86773] 0 2024-04-15T00:28:05.312 INFO:tasks.workunit.client.0.smithi029.stdout:2/48: stat d3/dd 0 2024-04-15T00:28:05.643 INFO:tasks.workunit.client.0.smithi029.stdout:7/44: mkdir d0/d6/df/d11 0 2024-04-15T00:28:05.688 INFO:tasks.workunit.client.0.smithi029.stdout:8/39: dwrite f7 [0,4194304] 0 2024-04-15T00:28:05.773 INFO:tasks.workunit.client.0.smithi029.stdout:9/42: creat d3/d6/fe x:0 0 0 2024-04-15T00:28:05.789 INFO:tasks.workunit.client.0.smithi029.stdout:7/45: truncate d0/d6/df/fe 697159 0 2024-04-15T00:28:05.795 INFO:tasks.workunit.client.0.smithi029.stdout:2/49: symlink d3/dd/l12 0 2024-04-15T00:28:05.801 INFO:tasks.workunit.client.0.smithi029.stdout:9/43: chown d3/l5 130972332 1 2024-04-15T00:28:05.947 INFO:tasks.workunit.client.0.smithi029.stdout:4/70: dwrite f3 [0,4194304] 0 2024-04-15T00:28:06.051 INFO:tasks.workunit.client.0.smithi029.stdout:2/50: mkdir d3/d13 0 2024-04-15T00:28:06.052 INFO:tasks.workunit.client.0.smithi029.stdout:1/65: link f3 df/f24 0 2024-04-15T00:28:06.133 INFO:tasks.workunit.client.0.smithi029.stdout:7/46: readlink d0/d6/df/l3 0 2024-04-15T00:28:06.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/57: mknod d5/c12 0 2024-04-15T00:28:06.173 INFO:tasks.workunit.client.0.smithi029.stdout:9/44: unlink d3/d6/c7 0 2024-04-15T00:28:06.178 INFO:tasks.workunit.client.0.smithi029.stdout:3/49: link cd c12 0 2024-04-15T00:28:06.203 INFO:tasks.workunit.client.0.smithi029.stdout:5/53: write d2/fa [289574,79220] 0 2024-04-15T00:28:06.233 INFO:tasks.workunit.client.0.smithi029.stdout:8/40: creat d8/da/fe x:0 0 0 2024-04-15T00:28:06.371 INFO:tasks.workunit.client.0.smithi029.stdout:1/66: rename df/f20 to df/f25 0 2024-04-15T00:28:06.424 INFO:tasks.workunit.client.0.smithi029.stdout:7/47: symlink d0/d6/df/l12 0 2024-04-15T00:28:06.460 INFO:tasks.workunit.client.0.smithi029.stdout:4/71: link f4 de/f14 0 2024-04-15T00:28:06.501 INFO:tasks.workunit.client.0.smithi029.stdout:0/58: creat d5/f13 x:0 0 0 2024-04-15T00:28:06.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/59: chown d5/db/cc 168 1 2024-04-15T00:28:06.536 INFO:tasks.workunit.client.0.smithi029.stdout:3/50: mknod c13 0 2024-04-15T00:28:06.581 INFO:tasks.workunit.client.0.smithi029.stdout:9/45: rename d3/l4 to d3/lf 0 2024-04-15T00:28:06.648 INFO:tasks.workunit.client.0.smithi029.stdout:8/41: creat d8/da/ff x:0 0 0 2024-04-15T00:28:06.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/42: dread - d8/da/fe zero size 2024-04-15T00:28:06.676 INFO:tasks.workunit.client.0.smithi029.stdout:8/43: write d8/da/ff [649393,72927] 0 2024-04-15T00:28:06.805 INFO:tasks.workunit.client.0.smithi029.stdout:1/67: symlink df/l26 0 2024-04-15T00:28:06.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/72: rmdir de 39 2024-04-15T00:28:06.881 INFO:tasks.workunit.client.0.smithi029.stdout:6/61: creat d1/d8/f14 x:0 0 0 2024-04-15T00:28:06.959 INFO:tasks.workunit.client.0.smithi029.stdout:3/51: mknod c14 0 2024-04-15T00:28:06.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/46: mknod d3/d6/c10 0 2024-04-15T00:28:07.034 INFO:tasks.workunit.client.0.smithi029.stdout:6/62: dwrite d1/d8/db/fe [0,4194304] 0 2024-04-15T00:28:07.145 INFO:tasks.workunit.client.0.smithi029.stdout:9/47: dread - d3/d6/fe zero size 2024-04-15T00:28:07.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/68: rename df/f1e to df/f27 0 2024-04-15T00:28:07.243 INFO:tasks.workunit.client.0.smithi029.stdout:0/60: dwrite d5/f7 [4194304,4194304] 0 2024-04-15T00:28:07.337 INFO:tasks.workunit.client.0.smithi029.stdout:3/52: creat f15 x:0 0 0 2024-04-15T00:28:07.360 INFO:tasks.workunit.client.0.smithi029.stdout:2/51: getdents d3 0 2024-04-15T00:28:07.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/53: write fb [183644,127979] 0 2024-04-15T00:28:07.428 INFO:tasks.workunit.client.0.smithi029.stdout:0/61: sync 2024-04-15T00:28:07.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/52: dread d3/f5 [0,4194304] 0 2024-04-15T00:28:07.457 INFO:tasks.workunit.client.0.smithi029.stdout:0/62: write d5/f13 [701993,11530] 0 2024-04-15T00:28:07.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/53: dwrite d3/f9 [0,4194304] 0 2024-04-15T00:28:07.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/63: rename d1/d8/f10 to d1/d8/db/f15 0 2024-04-15T00:28:07.666 INFO:tasks.workunit.client.0.smithi029.stdout:9/48: creat d3/d6/d9/f11 x:0 0 0 2024-04-15T00:28:07.678 INFO:tasks.workunit.client.0.smithi029.stdout:7/48: write d0/d6/f8 [86370,92124] 0 2024-04-15T00:28:07.718 INFO:tasks.workunit.client.0.smithi029.stdout:5/54: getdents d2/de 0 2024-04-15T00:28:07.749 INFO:tasks.workunit.client.0.smithi029.stdout:1/69: dread fd [0,4194304] 0 2024-04-15T00:28:07.762 INFO:tasks.workunit.client.0.smithi029.stdout:7/49: stat d0/d6/df/l3 0 2024-04-15T00:28:07.860 INFO:tasks.workunit.client.0.smithi029.stdout:3/54: rename fb to f16 0 2024-04-15T00:28:07.866 INFO:tasks.workunit.client.0.smithi029.stdout:3/55: dread - ff zero size 2024-04-15T00:28:07.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/44: truncate f7 2516152 0 2024-04-15T00:28:08.066 INFO:tasks.workunit.client.0.smithi029.stdout:4/73: write de/f14 [2325461,33034] 0 2024-04-15T00:28:08.203 INFO:tasks.workunit.client.0.smithi029.stdout:0/63: rename d5/la to d5/db/l14 0 2024-04-15T00:28:08.226 INFO:tasks.workunit.client.0.smithi029.stdout:6/64: fdatasync d1/d8/db/f11 0 2024-04-15T00:28:08.326 INFO:tasks.workunit.client.0.smithi029.stdout:0/64: dwrite d5/f13 [0,4194304] 0 2024-04-15T00:28:08.401 INFO:tasks.workunit.client.0.smithi029.stdout:9/49: creat d3/d6/f12 x:0 0 0 2024-04-15T00:28:08.416 INFO:tasks.workunit.client.0.smithi029.stdout:7/50: mknod d0/d6/df/c13 0 2024-04-15T00:28:08.520 INFO:tasks.workunit.client.0.smithi029.stdout:4/74: rename l9 to de/l15 0 2024-04-15T00:28:08.523 INFO:tasks.workunit.client.0.smithi029.stdout:2/54: mkdir d3/d13/d14 0 2024-04-15T00:28:08.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/65: mkdir d5/d15 0 2024-04-15T00:28:08.680 INFO:tasks.workunit.client.0.smithi029.stdout:0/66: chown l3 40664 1 2024-04-15T00:28:08.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/65: write d1/d8/db/f11 [2090248,111925] 0 2024-04-15T00:28:08.778 INFO:tasks.workunit.client.0.smithi029.stdout:5/55: truncate d2/f4 6559171 0 2024-04-15T00:28:08.815 INFO:tasks.workunit.client.0.smithi029.stdout:6/66: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:28:08.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/67: chown d1/c9 249214 1 2024-04-15T00:28:08.960 INFO:tasks.workunit.client.0.smithi029.stdout:3/56: fsync f3 0 2024-04-15T00:28:08.969 INFO:tasks.workunit.client.0.smithi029.stdout:8/45: fdatasync f6 0 2024-04-15T00:28:08.996 INFO:tasks.workunit.client.0.smithi029.stdout:2/55: write d3/f5 [300163,62790] 0 2024-04-15T00:28:09.187 INFO:tasks.workunit.client.0.smithi029.stdout:5/56: fdatasync f0 0 2024-04-15T00:28:09.315 INFO:tasks.workunit.client.0.smithi029.stdout:6/68: truncate d1/d8/db/ff 1122445 0 2024-04-15T00:28:09.334 INFO:tasks.workunit.client.0.smithi029.stdout:3/57: chown cd 1 1 2024-04-15T00:28:09.335 INFO:tasks.workunit.client.0.smithi029.stdout:6/69: readlink d1/d8/lc 0 2024-04-15T00:28:09.401 INFO:tasks.workunit.client.0.smithi029.stdout:8/46: symlink d8/l10 0 2024-04-15T00:28:09.456 INFO:tasks.workunit.client.0.smithi029.stdout:2/56: symlink d3/l15 0 2024-04-15T00:28:09.460 INFO:tasks.workunit.client.0.smithi029.stdout:0/67: getdents d5/d15 0 2024-04-15T00:28:09.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/57: mkdir d2/de/d13 0 2024-04-15T00:28:09.580 INFO:tasks.workunit.client.0.smithi029.stdout:1/70: getdents df 0 2024-04-15T00:28:09.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/51: rmdir d0/d6/df/d11 0 2024-04-15T00:28:09.664 INFO:tasks.workunit.client.0.smithi029.stdout:3/58: mkdir d17 0 2024-04-15T00:28:09.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/70: creat d1/d8/f16 x:0 0 0 2024-04-15T00:28:09.710 INFO:tasks.workunit.client.0.smithi029.stdout:6/71: write d1/d8/db/fe [832512,84755] 0 2024-04-15T00:28:09.723 INFO:tasks.workunit.client.0.smithi029.stdout:6/72: stat d1/c7 0 2024-04-15T00:28:09.804 INFO:tasks.workunit.client.0.smithi029.stdout:3/59: sync 2024-04-15T00:28:09.808 INFO:tasks.workunit.client.0.smithi029.stdout:3/60: chown f16 1940 1 2024-04-15T00:28:09.819 INFO:tasks.workunit.client.0.smithi029.stdout:3/61: write f15 [847096,5100] 0 2024-04-15T00:28:09.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/47: mknod d8/da/c11 0 2024-04-15T00:28:09.877 INFO:tasks.workunit.client.0.smithi029.stdout:1/71: rmdir df 39 2024-04-15T00:28:09.900 INFO:tasks.workunit.client.0.smithi029.stdout:9/50: getdents d3/d6 0 2024-04-15T00:28:09.913 INFO:tasks.workunit.client.0.smithi029.stdout:5/58: write d2/f7 [2901587,12593] 0 2024-04-15T00:28:09.919 INFO:tasks.workunit.client.0.smithi029.stdout:8/48: chown d8/da/fe 2424 1 2024-04-15T00:28:10.031 INFO:tasks.workunit.client.0.smithi029.stdout:5/59: dwrite d2/f7 [4194304,4194304] 0 2024-04-15T00:28:10.113 INFO:tasks.workunit.client.0.smithi029.stdout:5/60: sync 2024-04-15T00:28:10.128 INFO:tasks.workunit.client.0.smithi029.stdout:5/61: write d2/f7 [1124287,39324] 0 2024-04-15T00:28:10.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/75: getdents de/df/d10 0 2024-04-15T00:28:10.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/68: symlink d5/d15/l16 0 2024-04-15T00:28:10.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/57: unlink d3/dd/c11 0 2024-04-15T00:28:10.642 INFO:tasks.workunit.client.0.smithi029.stdout:9/51: creat d3/d6/f13 x:0 0 0 2024-04-15T00:28:10.662 INFO:tasks.workunit.client.0.smithi029.stdout:3/62: dwrite f16 [0,4194304] 0 2024-04-15T00:28:10.770 INFO:tasks.workunit.client.0.smithi029.stdout:8/49: mknod d8/da/c12 0 2024-04-15T00:28:10.791 INFO:tasks.workunit.client.0.smithi029.stdout:7/52: dwrite d0/d6/df/fc [0,4194304] 0 2024-04-15T00:28:10.875 INFO:tasks.workunit.client.0.smithi029.stdout:6/73: write d1/f6 [366145,92158] 0 2024-04-15T00:28:10.895 INFO:tasks.workunit.client.0.smithi029.stdout:4/76: readlink de/l15 0 2024-04-15T00:28:11.063 INFO:tasks.workunit.client.0.smithi029.stdout:2/58: dwrite d3/f5 [0,4194304] 0 2024-04-15T00:28:11.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/72: creat df/f28 x:0 0 0 2024-04-15T00:28:11.172 INFO:tasks.workunit.client.0.smithi029.stdout:9/52: mknod d3/c14 0 2024-04-15T00:28:11.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/63: rename c14 to d17/c18 0 2024-04-15T00:28:11.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/53: dread d0/d6/df/fc [0,4194304] 0 2024-04-15T00:28:11.290 INFO:tasks.workunit.client.0.smithi029.stdout:3/64: dread - ff zero size 2024-04-15T00:28:11.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/50: dwrite d8/da/ff [0,4194304] 0 2024-04-15T00:28:11.467 INFO:tasks.workunit.client.0.smithi029.stdout:6/74: dwrite d1/d8/db/f11 [4194304,4194304] 0 2024-04-15T00:28:11.555 INFO:tasks.workunit.client.0.smithi029.stdout:8/51: dread - d8/da/fe zero size 2024-04-15T00:28:11.555 INFO:tasks.workunit.client.0.smithi029.stdout:2/59: creat d3/d13/f16 x:0 0 0 2024-04-15T00:28:11.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/69: truncate d5/db/f10 6539527 0 2024-04-15T00:28:11.629 INFO:tasks.workunit.client.0.smithi029.stdout:4/77: write de/df/d10/f11 [880980,45320] 0 2024-04-15T00:28:11.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/62: dwrite d2/fb [0,4194304] 0 2024-04-15T00:28:11.727 INFO:tasks.workunit.client.0.smithi029.stdout:0/70: chown d5/f13 47609 1 2024-04-15T00:28:11.732 INFO:tasks.workunit.client.0.smithi029.stdout:1/73: truncate fc 1030832 0 2024-04-15T00:28:11.734 INFO:tasks.workunit.client.0.smithi029.stdout:9/53: rmdir d3/d6 39 2024-04-15T00:28:11.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/65: rmdir d17 39 2024-04-15T00:28:11.783 INFO:tasks.workunit.client.0.smithi029.stdout:5/63: rename d2 to d2/de/d14 22 2024-04-15T00:28:11.790 INFO:tasks.workunit.client.0.smithi029.stdout:6/75: creat d1/f17 x:0 0 0 2024-04-15T00:28:11.827 INFO:tasks.workunit.client.0.smithi029.stdout:8/52: creat d8/da/f13 x:0 0 0 2024-04-15T00:28:11.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/53: write f6 [821697,104745] 0 2024-04-15T00:28:11.930 INFO:tasks.workunit.client.0.smithi029.stdout:7/54: dwrite d0/d6/fa [4194304,4194304] 0 2024-04-15T00:28:12.074 INFO:tasks.workunit.client.0.smithi029.stdout:4/78: mknod de/df/d10/c16 0 2024-04-15T00:28:12.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/71: symlink d5/d15/l17 0 2024-04-15T00:28:12.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/66: readlink l10 0 2024-04-15T00:28:12.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/64: mknod d2/de/c15 0 2024-04-15T00:28:12.109 INFO:tasks.workunit.client.0.smithi029.stdout:6/76: creat d1/f18 x:0 0 0 2024-04-15T00:28:12.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/54: creat d8/da/f14 x:0 0 0 2024-04-15T00:28:12.170 INFO:tasks.workunit.client.0.smithi029.stdout:7/55: mknod d0/d6/df/c14 0 2024-04-15T00:28:12.182 INFO:tasks.workunit.client.0.smithi029.stdout:2/60: symlink d3/d13/d14/l17 0 2024-04-15T00:28:12.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/65: read d2/f7 [7857266,33487] 0 2024-04-15T00:28:12.227 INFO:tasks.workunit.client.0.smithi029.stdout:8/55: write f7 [1795684,91911] 0 2024-04-15T00:28:12.258 INFO:tasks.workunit.client.0.smithi029.stdout:9/54: dread d3/fb [0,4194304] 0 2024-04-15T00:28:12.263 INFO:tasks.workunit.client.0.smithi029.stdout:2/61: readlink d3/lf 0 2024-04-15T00:28:12.304 INFO:tasks.workunit.client.0.smithi029.stdout:4/79: mkdir de/d17 0 2024-04-15T00:28:12.346 INFO:tasks.workunit.client.0.smithi029.stdout:6/77: fsync d1/d8/db/f15 0 2024-04-15T00:28:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:1/74: dwrite df/f13 [0,4194304] 0 2024-04-15T00:28:12.458 INFO:tasks.workunit.client.0.smithi029.stdout:1/75: readlink l4 0 2024-04-15T00:28:12.587 INFO:tasks.workunit.client.0.smithi029.stdout:4/80: dwrite de/df/d10/f11 [0,4194304] 0 2024-04-15T00:28:12.673 INFO:tasks.workunit.client.0.smithi029.stdout:4/81: write de/f14 [3138463,44216] 0 2024-04-15T00:28:12.786 INFO:tasks.workunit.client.0.smithi029.stdout:8/56: creat d8/f15 x:0 0 0 2024-04-15T00:28:12.789 INFO:tasks.workunit.client.0.smithi029.stdout:0/72: unlink d5/c8 0 2024-04-15T00:28:12.790 INFO:tasks.workunit.client.0.smithi029.stdout:9/55: fdatasync f2 0 2024-04-15T00:28:12.800 INFO:tasks.workunit.client.0.smithi029.stdout:2/62: symlink d3/l18 0 2024-04-15T00:28:12.813 INFO:tasks.workunit.client.0.smithi029.stdout:7/56: mknod d0/c15 0 2024-04-15T00:28:12.826 INFO:tasks.workunit.client.0.smithi029.stdout:3/67: mknod d17/c19 0 2024-04-15T00:28:12.834 INFO:tasks.workunit.client.0.smithi029.stdout:5/66: rename d2/de/c15 to d2/de/d13/c16 0 2024-04-15T00:28:12.889 INFO:tasks.workunit.client.0.smithi029.stdout:4/82: dread - de/df/f12 zero size 2024-04-15T00:28:12.993 INFO:tasks.workunit.client.0.smithi029.stdout:2/63: dwrite d3/d13/f16 [0,4194304] 0 2024-04-15T00:28:13.229 INFO:tasks.workunit.client.0.smithi029.stdout:0/73: dread - d5/f11 zero size 2024-04-15T00:28:13.252 INFO:tasks.workunit.client.0.smithi029.stdout:8/57: dread - d8/fd zero size 2024-04-15T00:28:13.272 INFO:tasks.workunit.client.0.smithi029.stdout:5/67: fsync d2/de/f10 0 2024-04-15T00:28:13.285 INFO:tasks.workunit.client.0.smithi029.stdout:4/83: creat de/df/f18 x:0 0 0 2024-04-15T00:28:13.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/64: write d3/f9 [1201836,26954] 0 2024-04-15T00:28:13.454 INFO:tasks.workunit.client.0.smithi029.stdout:8/58: dwrite f6 [0,4194304] 0 2024-04-15T00:28:13.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/74: symlink d5/db/l18 0 2024-04-15T00:28:13.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/57: mkdir d0/d6/d16 0 2024-04-15T00:28:13.639 INFO:tasks.workunit.client.0.smithi029.stdout:5/68: truncate d2/fa 769860 0 2024-04-15T00:28:13.684 INFO:tasks.workunit.client.0.smithi029.stdout:2/65: symlink d3/d13/l19 0 2024-04-15T00:28:13.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/66: readlink d3/d13/d14/l17 0 2024-04-15T00:28:13.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/78: link d1/c13 d1/d8/db/c19 0 2024-04-15T00:28:13.761 INFO:tasks.workunit.client.0.smithi029.stdout:8/59: mknod d8/c16 0 2024-04-15T00:28:13.837 INFO:tasks.workunit.client.0.smithi029.stdout:0/75: creat d5/db/f19 x:0 0 0 2024-04-15T00:28:13.876 INFO:tasks.workunit.client.0.smithi029.stdout:7/58: mknod d0/d6/df/c17 0 2024-04-15T00:28:13.932 INFO:tasks.workunit.client.0.smithi029.stdout:5/69: creat d2/f17 x:0 0 0 2024-04-15T00:28:13.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/76: dwrite f3 [0,4194304] 0 2024-04-15T00:28:13.955 INFO:tasks.workunit.client.0.smithi029.stdout:6/79: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:28:13.956 INFO:tasks.workunit.client.0.smithi029.stdout:3/68: getdents d17 0 2024-04-15T00:28:14.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/67: mknod d3/c1a 0 2024-04-15T00:28:14.046 INFO:tasks.workunit.client.0.smithi029.stdout:9/56: write d3/d6/d9/fd [642849,68578] 0 2024-04-15T00:28:14.090 INFO:tasks.workunit.client.0.smithi029.stdout:8/60: symlink d8/da/l17 0 2024-04-15T00:28:14.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/57: chown d3/l5 6 1 2024-04-15T00:28:14.150 INFO:tasks.workunit.client.0.smithi029.stdout:0/76: mkdir d5/db/d1a 0 2024-04-15T00:28:14.183 INFO:tasks.workunit.client.0.smithi029.stdout:7/59: fdatasync d0/d6/df/fc 0 2024-04-15T00:28:14.261 INFO:tasks.workunit.client.0.smithi029.stdout:8/61: dwrite d8/da/f14 [0,4194304] 0 2024-04-15T00:28:14.340 INFO:tasks.workunit.client.0.smithi029.stdout:2/68: symlink d3/l1b 0 2024-04-15T00:28:14.383 INFO:tasks.workunit.client.0.smithi029.stdout:5/70: truncate d2/f8 1118815 0 2024-04-15T00:28:14.402 INFO:tasks.workunit.client.0.smithi029.stdout:7/60: write d0/d6/df/fc [2444205,54109] 0 2024-04-15T00:28:14.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/80: mknod d1/d8/db/c1a 0 2024-04-15T00:28:14.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/69: chown d3/f5 3147225 1 2024-04-15T00:28:14.453 INFO:tasks.workunit.client.0.smithi029.stdout:5/71: chown d2/f7 5 1 2024-04-15T00:28:14.463 INFO:tasks.workunit.client.0.smithi029.stdout:4/84: dwrite f2 [0,4194304] 0 2024-04-15T00:28:14.534 INFO:tasks.workunit.client.0.smithi029.stdout:9/58: mkdir d3/d6/d9/d15 0 2024-04-15T00:28:14.544 INFO:tasks.workunit.client.0.smithi029.stdout:0/77: mknod d5/c1b 0 2024-04-15T00:28:14.573 INFO:tasks.workunit.client.0.smithi029.stdout:2/70: chown d3/l15 0 1 2024-04-15T00:28:14.600 INFO:tasks.workunit.client.0.smithi029.stdout:2/71: write d3/d13/f16 [1066581,9339] 0 2024-04-15T00:28:14.616 INFO:tasks.workunit.client.0.smithi029.stdout:2/72: fdatasync d3/d13/f16 0 2024-04-15T00:28:14.627 INFO:tasks.workunit.client.0.smithi029.stdout:8/62: unlink d8/da/l17 0 2024-04-15T00:28:14.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/77: dwrite df/f21 [0,4194304] 0 2024-04-15T00:28:15.126 INFO:tasks.workunit.client.0.smithi029.stdout:3/69: truncate fa 3388473 0 2024-04-15T00:28:15.132 INFO:tasks.workunit.client.0.smithi029.stdout:6/81: mknod d1/d8/c1b 0 2024-04-15T00:28:15.161 INFO:tasks.workunit.client.0.smithi029.stdout:9/59: creat d3/d6/f16 x:0 0 0 2024-04-15T00:28:15.174 INFO:tasks.workunit.client.0.smithi029.stdout:6/82: dread - d1/f18 zero size 2024-04-15T00:28:15.263 INFO:tasks.workunit.client.0.smithi029.stdout:2/73: rmdir d3 39 2024-04-15T00:28:15.268 INFO:tasks.workunit.client.0.smithi029.stdout:8/63: symlink d8/da/l18 0 2024-04-15T00:28:15.276 INFO:tasks.workunit.client.0.smithi029.stdout:5/72: fsync f0 0 2024-04-15T00:28:15.291 INFO:tasks.workunit.client.0.smithi029.stdout:1/78: dread - fe zero size 2024-04-15T00:28:15.301 INFO:tasks.workunit.client.0.smithi029.stdout:5/73: chown d2 14483017 1 2024-04-15T00:28:15.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/64: write f7 [2985052,4363] 0 2024-04-15T00:28:15.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/65: dread - d8/fd zero size 2024-04-15T00:28:15.419 INFO:tasks.workunit.client.0.smithi029.stdout:3/70: fdatasync f3 0 2024-04-15T00:28:15.420 INFO:tasks.workunit.client.0.smithi029.stdout:0/78: fsync d5/f7 0 2024-04-15T00:28:15.439 INFO:tasks.workunit.client.0.smithi029.stdout:6/83: creat d1/f1c x:0 0 0 2024-04-15T00:28:15.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/74: fsync d3/f5 0 2024-04-15T00:28:15.588 INFO:tasks.workunit.client.0.smithi029.stdout:2/75: dwrite d3/f5 [0,4194304] 0 2024-04-15T00:28:15.639 INFO:tasks.workunit.client.0.smithi029.stdout:8/66: sync 2024-04-15T00:28:15.679 INFO:tasks.workunit.client.0.smithi029.stdout:2/76: chown d3/dd 11664031 1 2024-04-15T00:28:15.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/84: sync 2024-04-15T00:28:15.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/79: dwrite df/f27 [0,4194304] 0 2024-04-15T00:28:15.907 INFO:tasks.workunit.client.0.smithi029.stdout:0/79: creat d5/d15/f1c x:0 0 0 2024-04-15T00:28:15.912 INFO:tasks.workunit.client.0.smithi029.stdout:2/77: dread d3/d13/f16 [0,4194304] 0 2024-04-15T00:28:15.945 INFO:tasks.workunit.client.0.smithi029.stdout:2/78: fdatasync d3/f5 0 2024-04-15T00:28:15.976 INFO:tasks.workunit.client.0.smithi029.stdout:2/79: readlink d3/d13/l19 0 2024-04-15T00:28:16.007 INFO:tasks.workunit.client.0.smithi029.stdout:4/85: getdents de/df/d10 0 2024-04-15T00:28:16.012 INFO:tasks.workunit.client.0.smithi029.stdout:0/80: dread d5/f7 [0,4194304] 0 2024-04-15T00:28:16.026 INFO:tasks.workunit.client.0.smithi029.stdout:8/67: unlink d8/da/fe 0 2024-04-15T00:28:16.084 INFO:tasks.workunit.client.0.smithi029.stdout:2/80: dread d3/f9 [0,4194304] 0 2024-04-15T00:28:16.097 INFO:tasks.workunit.client.0.smithi029.stdout:6/85: symlink d1/d8/db/l1d 0 2024-04-15T00:28:16.155 INFO:tasks.workunit.client.0.smithi029.stdout:2/81: dread d3/d13/f16 [0,4194304] 0 2024-04-15T00:28:16.201 INFO:tasks.workunit.client.0.smithi029.stdout:5/74: link d2/f7 d2/de/f18 0 2024-04-15T00:28:16.274 INFO:tasks.workunit.client.0.smithi029.stdout:7/61: truncate d0/d6/df/fc 1305689 0 2024-04-15T00:28:16.385 INFO:tasks.workunit.client.0.smithi029.stdout:9/60: dwrite d3/d6/f12 [0,4194304] 0 2024-04-15T00:28:16.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/82: creat d3/d13/d14/f1c x:0 0 0 2024-04-15T00:28:16.539 INFO:tasks.workunit.client.0.smithi029.stdout:2/83: stat d3/lf 0 2024-04-15T00:28:16.583 INFO:tasks.workunit.client.0.smithi029.stdout:0/81: unlink d5/c1b 0 2024-04-15T00:28:16.591 INFO:tasks.workunit.client.0.smithi029.stdout:0/82: chown d5/db/cc 4145 1 2024-04-15T00:28:16.629 INFO:tasks.workunit.client.0.smithi029.stdout:5/75: creat d2/de/d13/f19 x:0 0 0 2024-04-15T00:28:16.790 INFO:tasks.workunit.client.0.smithi029.stdout:3/71: dwrite f0 [0,4194304] 0 2024-04-15T00:28:16.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/68: symlink d8/dc/l19 0 2024-04-15T00:28:16.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/86: truncate d1/d8/db/f15 222862 0 2024-04-15T00:28:17.068 INFO:tasks.workunit.client.0.smithi029.stdout:9/61: creat d3/d6/f17 x:0 0 0 2024-04-15T00:28:17.078 INFO:tasks.workunit.client.0.smithi029.stdout:9/62: dread - d3/d6/f17 zero size 2024-04-15T00:28:17.323 INFO:tasks.workunit.client.0.smithi029.stdout:3/72: mknod d17/c1a 0 2024-04-15T00:28:17.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/69: rename d8/c16 to d8/c1a 0 2024-04-15T00:28:17.437 INFO:tasks.workunit.client.0.smithi029.stdout:6/87: write d1/f6 [1597179,79927] 0 2024-04-15T00:28:17.528 INFO:tasks.workunit.client.0.smithi029.stdout:0/83: symlink d5/db/d1a/l1d 0 2024-04-15T00:28:17.562 INFO:tasks.workunit.client.0.smithi029.stdout:4/86: dwrite de/df/d10/f11 [4194304,4194304] 0 2024-04-15T00:28:17.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/76: unlink d2/de/d13/c16 0 2024-04-15T00:28:17.650 INFO:tasks.workunit.client.0.smithi029.stdout:5/77: fdatasync d2/f8 0 2024-04-15T00:28:17.716 INFO:tasks.workunit.client.0.smithi029.stdout:1/80: truncate df/f27 2398278 0 2024-04-15T00:28:17.724 INFO:tasks.workunit.client.0.smithi029.stdout:3/73: creat d17/f1b x:0 0 0 2024-04-15T00:28:17.728 INFO:tasks.workunit.client.0.smithi029.stdout:2/84: link d3/c1a d3/dd/c1d 0 2024-04-15T00:28:17.738 INFO:tasks.workunit.client.0.smithi029.stdout:3/74: stat c11 0 2024-04-15T00:28:17.754 INFO:tasks.workunit.client.0.smithi029.stdout:3/75: fdatasync f0 0 2024-04-15T00:28:17.759 INFO:tasks.workunit.client.0.smithi029.stdout:8/70: read - d8/da/f13 zero size 2024-04-15T00:28:17.898 INFO:tasks.workunit.client.0.smithi029.stdout:3/76: sync 2024-04-15T00:28:17.901 INFO:tasks.workunit.client.0.smithi029.stdout:8/71: dwrite f5 [4194304,4194304] 0 2024-04-15T00:28:17.968 INFO:tasks.workunit.client.0.smithi029.stdout:6/88: truncate d1/d8/db/fe 2443204 0 2024-04-15T00:28:17.994 INFO:tasks.workunit.client.0.smithi029.stdout:7/62: write d0/fb [34338,54914] 0 2024-04-15T00:28:17.997 INFO:tasks.workunit.client.0.smithi029.stdout:3/77: readlink lc 0 2024-04-15T00:28:18.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/63: creat d3/d6/d9/d15/f18 x:0 0 0 2024-04-15T00:28:18.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/85: rmdir d3/dd 39 2024-04-15T00:28:18.062 INFO:tasks.workunit.client.0.smithi029.stdout:9/64: dread - d3/d6/d9/d15/f18 zero size 2024-04-15T00:28:18.072 INFO:tasks.workunit.client.0.smithi029.stdout:9/65: readlink d3/l8 0 2024-04-15T00:28:18.183 INFO:tasks.workunit.client.0.smithi029.stdout:1/81: truncate df/f15 1043079 0 2024-04-15T00:28:18.502 INFO:tasks.workunit.client.0.smithi029.stdout:3/78: mknod d17/c1c 0 2024-04-15T00:28:18.647 INFO:tasks.workunit.client.0.smithi029.stdout:7/63: fdatasync d0/d6/df/fe 0 2024-04-15T00:28:18.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/86: creat d3/d13/d14/f1e x:0 0 0 2024-04-15T00:28:18.702 INFO:tasks.workunit.client.0.smithi029.stdout:1/82: dread f0 [0,4194304] 0 2024-04-15T00:28:18.819 INFO:tasks.workunit.client.0.smithi029.stdout:4/87: rmdir de/d17 0 2024-04-15T00:28:18.905 INFO:tasks.workunit.client.0.smithi029.stdout:3/79: read f1 [7184283,88314] 0 2024-04-15T00:28:18.930 INFO:tasks.workunit.client.0.smithi029.stdout:8/72: rename d8/c1a to d8/da/c1b 0 2024-04-15T00:28:18.946 INFO:tasks.workunit.client.0.smithi029.stdout:9/66: rename d3/d6 to d3/d6/d9/d15/d19 22 2024-04-15T00:28:18.948 INFO:tasks.workunit.client.0.smithi029.stdout:0/84: dwrite d5/f13 [0,4194304] 0 2024-04-15T00:28:19.056 INFO:tasks.workunit.client.0.smithi029.stdout:7/64: creat d0/d6/f18 x:0 0 0 2024-04-15T00:28:19.110 INFO:tasks.workunit.client.0.smithi029.stdout:1/83: mkdir df/d29 0 2024-04-15T00:28:19.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/78: write d2/f7 [5598152,86955] 0 2024-04-15T00:28:19.293 INFO:tasks.workunit.client.0.smithi029.stdout:3/80: creat d17/f1d x:0 0 0 2024-04-15T00:28:19.345 INFO:tasks.workunit.client.0.smithi029.stdout:8/73: fsync d8/f15 0 2024-04-15T00:28:19.410 INFO:tasks.workunit.client.0.smithi029.stdout:3/81: dwrite d17/f1d [0,4194304] 0 2024-04-15T00:28:19.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/87: unlink d3/c1a 0 2024-04-15T00:28:19.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/67: rename f2 to d3/d6/f1a 0 2024-04-15T00:28:19.544 INFO:tasks.workunit.client.0.smithi029.stdout:2/88: write d3/f5 [1034538,92262] 0 2024-04-15T00:28:19.570 INFO:tasks.workunit.client.0.smithi029.stdout:6/89: write d1/f12 [226316,103136] 0 2024-04-15T00:28:19.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/68: dread d3/d6/f12 [0,4194304] 0 2024-04-15T00:28:19.637 INFO:tasks.workunit.client.0.smithi029.stdout:5/79: mkdir d2/d1a 0 2024-04-15T00:28:19.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/88: dwrite f3 [0,4194304] 0 2024-04-15T00:28:19.948 INFO:tasks.workunit.client.0.smithi029.stdout:7/65: mknod d0/d6/d16/c19 0 2024-04-15T00:28:19.958 INFO:tasks.workunit.client.0.smithi029.stdout:1/84: mknod df/d29/c2a 0 2024-04-15T00:28:20.109 INFO:tasks.workunit.client.0.smithi029.stdout:6/90: mkdir d1/d1e 0 2024-04-15T00:28:20.124 INFO:tasks.workunit.client.0.smithi029.stdout:0/85: write d5/f7 [1445821,103091] 0 2024-04-15T00:28:20.146 INFO:tasks.workunit.client.0.smithi029.stdout:0/86: write d5/d15/f1c [830719,25381] 0 2024-04-15T00:28:20.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/89: dwrite d3/f9 [0,4194304] 0 2024-04-15T00:28:20.681 INFO:tasks.workunit.client.0.smithi029.stdout:2/90: write d3/f5 [5717977,117805] 0 2024-04-15T00:28:20.700 INFO:tasks.workunit.client.0.smithi029.stdout:1/85: fsync fe 0 2024-04-15T00:28:20.714 INFO:tasks.workunit.client.0.smithi029.stdout:7/66: mknod d0/d6/df/c1a 0 2024-04-15T00:28:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:4/89: dread f4 [0,4194304] 0 2024-04-15T00:28:20.765 INFO:tasks.workunit.client.0.smithi029.stdout:4/90: chown f2 240742 1 2024-04-15T00:28:20.811 INFO:tasks.workunit.client.0.smithi029.stdout:5/80: rename d2/de/f18 to d2/d1a/f1b 0 2024-04-15T00:28:21.013 INFO:tasks.workunit.client.0.smithi029.stdout:8/74: truncate f7 8258182 0 2024-04-15T00:28:21.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/86: truncate f1 1429724 0 2024-04-15T00:28:21.149 INFO:tasks.workunit.client.0.smithi029.stdout:7/67: truncate d0/d6/f8 1058267 0 2024-04-15T00:28:21.228 INFO:tasks.workunit.client.0.smithi029.stdout:4/91: unlink f0 0 2024-04-15T00:28:21.328 INFO:tasks.workunit.client.0.smithi029.stdout:0/87: rename d5/f11 to d5/d15/f1e 0 2024-04-15T00:28:21.520 INFO:tasks.workunit.client.0.smithi029.stdout:3/82: getdents d17 0 2024-04-15T00:28:21.614 INFO:tasks.workunit.client.0.smithi029.stdout:7/68: creat d0/d6/df/f1b x:0 0 0 2024-04-15T00:28:21.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/92: rename de/f14 to de/f19 0 2024-04-15T00:28:21.696 INFO:tasks.workunit.client.0.smithi029.stdout:9/69: write d3/d6/f1a [13040843,92533] 0 2024-04-15T00:28:21.838 INFO:tasks.workunit.client.0.smithi029.stdout:0/88: mkdir d5/d15/d1f 0 2024-04-15T00:28:22.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/69: dread - d0/d6/df/fd zero size 2024-04-15T00:28:22.066 INFO:tasks.workunit.client.0.smithi029.stdout:0/89: sync 2024-04-15T00:28:22.078 INFO:tasks.workunit.client.0.smithi029.stdout:0/90: chown d5/db/cc 59739816 1 2024-04-15T00:28:22.102 INFO:tasks.workunit.client.0.smithi029.stdout:6/91: link d1/d8/db/ff d1/f1f 0 2024-04-15T00:28:22.130 INFO:tasks.workunit.client.0.smithi029.stdout:5/81: link d2/de/f10 d2/d1a/f1c 0 2024-04-15T00:28:22.304 INFO:tasks.workunit.client.0.smithi029.stdout:2/91: mknod d3/dd/c1f 0 2024-04-15T00:28:22.311 INFO:tasks.workunit.client.0.smithi029.stdout:0/91: unlink d5/l9 0 2024-04-15T00:28:22.621 INFO:tasks.workunit.client.0.smithi029.stdout:5/82: mknod d2/d1a/c1d 0 2024-04-15T00:28:22.628 INFO:tasks.workunit.client.0.smithi029.stdout:7/70: rename d0/d6/df to d0/d6/d1c 0 2024-04-15T00:28:22.666 INFO:tasks.workunit.client.0.smithi029.stdout:1/87: write df/f15 [1790785,14860] 0 2024-04-15T00:28:22.669 INFO:tasks.workunit.client.0.smithi029.stdout:4/93: write fd [356369,42861] 0 2024-04-15T00:28:22.747 INFO:tasks.workunit.client.0.smithi029.stdout:7/71: dread d0/d6/d1c/fe [0,4194304] 0 2024-04-15T00:28:22.760 INFO:tasks.workunit.client.0.smithi029.stdout:5/83: truncate d2/d1a/f1b 9227047 0 2024-04-15T00:28:22.802 INFO:tasks.workunit.client.0.smithi029.stdout:9/70: creat d3/f1b x:0 0 0 2024-04-15T00:28:22.815 INFO:tasks.workunit.client.0.smithi029.stdout:0/92: mknod d5/db/d1a/c20 0 2024-04-15T00:28:22.850 INFO:tasks.workunit.client.0.smithi029.stdout:3/83: dwrite f3 [0,4194304] 0 2024-04-15T00:28:22.926 INFO:tasks.workunit.client.0.smithi029.stdout:1/88: symlink df/l2b 0 2024-04-15T00:28:22.977 INFO:tasks.workunit.client.0.smithi029.stdout:6/92: link d1/d8/f16 d1/f20 0 2024-04-15T00:28:22.986 INFO:tasks.workunit.client.0.smithi029.stdout:9/71: readlink d3/lf 0 2024-04-15T00:28:22.987 INFO:tasks.workunit.client.0.smithi029.stdout:5/84: chown d2/l3 337600 1 2024-04-15T00:28:23.395 INFO:tasks.workunit.client.0.smithi029.stdout:0/93: fdatasync d5/db/f19 0 2024-04-15T00:28:23.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/72: truncate d0/d6/d1c/fe 1187582 0 2024-04-15T00:28:23.410 INFO:tasks.workunit.client.0.smithi029.stdout:5/85: unlink d2/cc 0 2024-04-15T00:28:23.423 INFO:tasks.workunit.client.0.smithi029.stdout:6/93: dread - d1/f1c zero size 2024-04-15T00:28:23.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/72: mknod d3/d6/d9/c1c 0 2024-04-15T00:28:23.541 INFO:tasks.workunit.client.0.smithi029.stdout:2/92: getdents d3 0 2024-04-15T00:28:23.643 INFO:tasks.workunit.client.0.smithi029.stdout:3/84: truncate f16 3059287 0 2024-04-15T00:28:23.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/75: dread d8/f9 [0,4194304] 0 2024-04-15T00:28:23.672 INFO:tasks.workunit.client.0.smithi029.stdout:4/94: dwrite de/f19 [4194304,4194304] 0 2024-04-15T00:28:23.679 INFO:tasks.workunit.client.0.smithi029.stdout:2/93: write d3/f5 [6230804,96331] 0 2024-04-15T00:28:23.830 INFO:tasks.workunit.client.0.smithi029.stdout:3/85: write d17/f1d [2511536,85470] 0 2024-04-15T00:28:23.851 INFO:tasks.workunit.client.0.smithi029.stdout:0/94: truncate d5/db/f19 11614 0 2024-04-15T00:28:23.903 INFO:tasks.workunit.client.0.smithi029.stdout:2/94: dread - d3/d13/d14/f1e zero size 2024-04-15T00:28:24.064 INFO:tasks.workunit.client.0.smithi029.stdout:8/76: creat d8/dc/f1c x:0 0 0 2024-04-15T00:28:24.149 INFO:tasks.workunit.client.0.smithi029.stdout:3/86: dread - ff zero size 2024-04-15T00:28:24.197 INFO:tasks.workunit.client.0.smithi029.stdout:0/95: mknod d5/c21 0 2024-04-15T00:28:24.200 INFO:tasks.workunit.client.0.smithi029.stdout:1/89: dwrite df/f24 [0,4194304] 0 2024-04-15T00:28:24.241 INFO:tasks.workunit.client.0.smithi029.stdout:7/73: rename d0/d6/d1c/c14 to d0/c1d 0 2024-04-15T00:28:24.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/94: truncate d1/d8/db/ff 1331366 0 2024-04-15T00:28:24.384 INFO:tasks.workunit.client.0.smithi029.stdout:5/86: dwrite d2/f7 [0,4194304] 0 2024-04-15T00:28:24.415 INFO:tasks.workunit.client.0.smithi029.stdout:4/95: dwrite fd [0,4194304] 0 2024-04-15T00:28:24.488 INFO:tasks.workunit.client.0.smithi029.stdout:8/77: mknod d8/da/c1d 0 2024-04-15T00:28:24.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/95: write d3/d13/d14/f1c [592013,90690] 0 2024-04-15T00:28:24.544 INFO:tasks.workunit.client.0.smithi029.stdout:9/73: dwrite d3/d6/f12 [4194304,4194304] 0 2024-04-15T00:28:24.550 INFO:tasks.workunit.client.0.smithi029.stdout:5/87: sync 2024-04-15T00:28:24.634 INFO:tasks.workunit.client.0.smithi029.stdout:3/87: rename d17/c1a to d17/c1e 0 2024-04-15T00:28:24.641 INFO:tasks.workunit.client.0.smithi029.stdout:5/88: chown d2 62 1 2024-04-15T00:28:24.648 INFO:tasks.workunit.client.0.smithi029.stdout:0/96: rmdir d5/db/d1a 39 2024-04-15T00:28:24.683 INFO:tasks.workunit.client.0.smithi029.stdout:7/74: chown d0/c1d 1 1 2024-04-15T00:28:24.686 INFO:tasks.workunit.client.0.smithi029.stdout:0/97: readlink d5/ld 0 2024-04-15T00:28:24.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/90: link df/f24 df/d29/f2c 0 2024-04-15T00:28:24.802 INFO:tasks.workunit.client.0.smithi029.stdout:1/91: fdatasync df/f15 0 2024-04-15T00:28:24.811 INFO:tasks.workunit.client.0.smithi029.stdout:1/92: chown df/l14 54485122 1 2024-04-15T00:28:24.980 INFO:tasks.workunit.client.0.smithi029.stdout:4/96: rename de/df/d10/c16 to de/c1a 0 2024-04-15T00:28:25.033 INFO:tasks.workunit.client.0.smithi029.stdout:9/74: truncate d3/d6/d9/d15/f18 25619 0 2024-04-15T00:28:25.053 INFO:tasks.workunit.client.0.smithi029.stdout:5/89: rename d2/de to d2/de/d1e 22 2024-04-15T00:28:25.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/96: link d3/f5 d3/d13/d14/f20 0 2024-04-15T00:28:25.130 INFO:tasks.workunit.client.0.smithi029.stdout:9/75: read - d3/f1b zero size 2024-04-15T00:28:25.179 INFO:tasks.workunit.client.0.smithi029.stdout:2/97: stat d3/d13/f16 0 2024-04-15T00:28:25.227 INFO:tasks.workunit.client.0.smithi029.stdout:6/95: dwrite d1/f20 [0,4194304] 0 2024-04-15T00:28:25.397 INFO:tasks.workunit.client.0.smithi029.stdout:1/93: dwrite df/f25 [0,4194304] 0 2024-04-15T00:28:25.480 INFO:tasks.workunit.client.0.smithi029.stdout:4/97: dwrite fd [0,4194304] 0 2024-04-15T00:28:25.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/75: unlink d0/c4 0 2024-04-15T00:28:25.559 INFO:tasks.workunit.client.0.smithi029.stdout:0/98: fdatasync d5/db/f19 0 2024-04-15T00:28:25.676 INFO:tasks.workunit.client.0.smithi029.stdout:7/76: sync 2024-04-15T00:28:25.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/90: rmdir d2/de 39 2024-04-15T00:28:25.746 INFO:tasks.workunit.client.0.smithi029.stdout:9/76: dread - d3/d6/f13 zero size 2024-04-15T00:28:25.771 INFO:tasks.workunit.client.0.smithi029.stdout:3/88: truncate d17/f1d 153757 0 2024-04-15T00:28:25.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/89: read f1 [1262482,56108] 0 2024-04-15T00:28:25.881 INFO:tasks.workunit.client.0.smithi029.stdout:6/96: mknod d1/c21 0 2024-04-15T00:28:25.946 INFO:tasks.workunit.client.0.smithi029.stdout:8/78: getdents d8/da 0 2024-04-15T00:28:26.010 INFO:tasks.workunit.client.0.smithi029.stdout:4/98: mknod de/df/c1b 0 2024-04-15T00:28:26.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/99: fsync f4 0 2024-04-15T00:28:26.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/100: read de/f19 [1038445,25795] 0 2024-04-15T00:28:26.052 INFO:tasks.workunit.client.0.smithi029.stdout:0/99: rename d5/db/l18 to d5/d15/l22 0 2024-04-15T00:28:26.081 INFO:tasks.workunit.client.0.smithi029.stdout:7/77: dread - d0/d6/f18 zero size 2024-04-15T00:28:26.126 INFO:tasks.workunit.client.0.smithi029.stdout:5/91: stat d2/de/c12 0 2024-04-15T00:28:26.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/78: dread d0/d6/d1c/f9 [0,4194304] 0 2024-04-15T00:28:26.576 INFO:tasks.workunit.client.0.smithi029.stdout:5/92: fsync d2/f8 0 2024-04-15T00:28:26.662 INFO:tasks.workunit.client.0.smithi029.stdout:2/98: dwrite d3/d13/f16 [0,4194304] 0 2024-04-15T00:28:26.735 INFO:tasks.workunit.client.0.smithi029.stdout:6/97: fdatasync d1/f1f 0 2024-04-15T00:28:26.744 INFO:tasks.workunit.client.0.smithi029.stdout:0/100: mknod d5/db/d1a/c23 0 2024-04-15T00:28:26.904 INFO:tasks.workunit.client.0.smithi029.stdout:7/79: rename d0/d6/d16/c19 to d0/d6/d1c/c1e 0 2024-04-15T00:28:26.917 INFO:tasks.workunit.client.0.smithi029.stdout:8/79: dwrite d8/da/f13 [0,4194304] 0 2024-04-15T00:28:26.987 INFO:tasks.workunit.client.0.smithi029.stdout:5/93: mkdir d2/de/d1f 0 2024-04-15T00:28:26.988 INFO:tasks.workunit.client.0.smithi029.stdout:7/80: chown d0/d6 2290 1 2024-04-15T00:28:27.006 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:57.517 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.011 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:57.522 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.019 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:27:57.510 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.021 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:27:57.513 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.024 INFO:tasks.workunit.client.0.smithi029.stdout:1/94: getdents df 0 2024-04-15T00:28:27.025 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:27:57.516 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.030 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:27:57.519 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.072 INFO:tasks.workunit.client.0.smithi029.stdout:2/99: mknod d3/d13/c21 0 2024-04-15T00:28:27.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/95: chown f3 169 1 2024-04-15T00:28:27.083 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:27:57.594 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.083 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:27:57.574 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.088 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:27:57.580 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:28:27.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/101: chown d5/db/l14 7 1 2024-04-15T00:28:27.152 INFO:tasks.workunit.client.0.smithi029.stdout:9/77: getdents d3/d6/d9/d15 0 2024-04-15T00:28:27.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/101: dwrite de/df/d10/f11 [4194304,4194304] 0 2024-04-15T00:28:27.312 INFO:tasks.workunit.client.0.smithi029.stdout:4/102: stat f3 0 2024-04-15T00:28:27.318 INFO:tasks.workunit.client.0.smithi029.stdout:4/103: fsync f4 0 2024-04-15T00:28:27.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/94: stat d2/f4 0 2024-04-15T00:28:27.480 INFO:tasks.workunit.client.0.smithi029.stdout:7/81: dread d0/d6/fa [4194304,4194304] 0 2024-04-15T00:28:27.491 INFO:tasks.workunit.client.0.smithi029.stdout:7/82: readlink d0/d6/d1c/l12 0 2024-04-15T00:28:27.568 INFO:tasks.workunit.client.0.smithi029.stdout:0/102: symlink d5/db/d1a/l24 0 2024-04-15T00:28:27.568 INFO:tasks.workunit.client.0.smithi029.stdout:1/96: creat df/f2d x:0 0 0 2024-04-15T00:28:27.601 INFO:tasks.workunit.client.0.smithi029.stdout:6/98: mkdir d1/d1e/d22 0 2024-04-15T00:28:27.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/99: chown d1/d8/db/f15 1 1 2024-04-15T00:28:27.680 INFO:tasks.workunit.client.0.smithi029.stdout:8/80: dwrite f6 [4194304,4194304] 0 2024-04-15T00:28:27.756 INFO:tasks.workunit.client.0.smithi029.stdout:4/104: rename de/l15 to de/df/d10/l1c 0 2024-04-15T00:28:27.766 INFO:tasks.workunit.client.0.smithi029.stdout:8/81: fsync f5 0 2024-04-15T00:28:27.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/95: creat d2/d1a/f20 x:0 0 0 2024-04-15T00:28:27.773 INFO:tasks.workunit.client.0.smithi029.stdout:9/78: dread - d3/d6/d9/f11 zero size 2024-04-15T00:28:27.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/105: write de/f19 [4172660,59256] 0 2024-04-15T00:28:27.826 INFO:tasks.workunit.client.0.smithi029.stdout:1/97: mkdir df/d29/d2e 0 2024-04-15T00:28:27.832 INFO:tasks.workunit.client.0.smithi029.stdout:9/79: chown d3/d6/fe 1563955 1 2024-04-15T00:28:27.854 INFO:tasks.workunit.client.0.smithi029.stdout:1/98: truncate df/f19 490565 0 2024-04-15T00:28:27.869 INFO:tasks.workunit.client.0.smithi029.stdout:0/103: mknod d5/d15/c25 0 2024-04-15T00:28:27.884 INFO:tasks.workunit.client.0.smithi029.stdout:6/100: read - d1/d8/f14 zero size 2024-04-15T00:28:27.887 INFO:tasks.workunit.client.0.smithi029.stdout:3/90: dread d17/f1d [0,4194304] 0 2024-04-15T00:28:27.903 INFO:tasks.workunit.client.0.smithi029.stdout:0/104: chown d5/c21 7778 1 2024-04-15T00:28:28.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/96: mknod d2/d1a/c21 0 2024-04-15T00:28:28.056 INFO:tasks.workunit.client.0.smithi029.stdout:5/97: readlink d2/l5 0 2024-04-15T00:28:28.153 INFO:tasks.workunit.client.0.smithi029.stdout:4/106: rmdir de/df 39 2024-04-15T00:28:28.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/91: mknod d17/c1f 0 2024-04-15T00:28:28.175 INFO:tasks.workunit.client.0.smithi029.stdout:0/105: stat d5/d15/l22 0 2024-04-15T00:28:28.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/106: chown d5/d15/c25 2091342785 1 2024-04-15T00:28:28.200 INFO:tasks.workunit.client.0.smithi029.stdout:2/100: getdents d3/dd 0 2024-04-15T00:28:28.319 INFO:tasks.workunit.client.0.smithi029.stdout:4/107: sync 2024-04-15T00:28:28.325 INFO:tasks.workunit.client.0.smithi029.stdout:5/98: mkdir d2/de/d13/d22 0 2024-04-15T00:28:28.330 INFO:tasks.workunit.client.0.smithi029.stdout:4/108: fdatasync f4 0 2024-04-15T00:28:28.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/83: creat d0/f1f x:0 0 0 2024-04-15T00:28:28.439 INFO:tasks.workunit.client.0.smithi029.stdout:8/82: write d8/da/f14 [551400,59661] 0 2024-04-15T00:28:28.471 INFO:tasks.workunit.client.0.smithi029.stdout:3/92: read f16 [958177,31292] 0 2024-04-15T00:28:28.489 INFO:tasks.workunit.client.0.smithi029.stdout:8/83: write d8/dc/f1c [221048,98223] 0 2024-04-15T00:28:28.503 INFO:tasks.workunit.client.0.smithi029.stdout:7/84: chown d0/d6/d1c/c17 3519877 1 2024-04-15T00:28:28.520 INFO:tasks.workunit.client.0.smithi029.stdout:0/107: symlink d5/l26 0 2024-04-15T00:28:28.688 INFO:tasks.workunit.client.0.smithi029.stdout:9/80: dwrite d3/d6/f16 [0,4194304] 0 2024-04-15T00:28:28.690 INFO:tasks.workunit.client.0.smithi029.stdout:1/99: dwrite f1 [0,4194304] 0 2024-04-15T00:28:28.831 INFO:tasks.workunit.client.0.smithi029.stdout:5/99: creat d2/de/f23 x:0 0 0 2024-04-15T00:28:28.833 INFO:tasks.workunit.client.0.smithi029.stdout:6/101: link d1/f1f d1/d8/db/f23 0 2024-04-15T00:28:28.932 INFO:tasks.workunit.client.0.smithi029.stdout:7/85: write d0/fb [1067797,29332] 0 2024-04-15T00:28:28.932 INFO:tasks.workunit.client.0.smithi029.stdout:2/101: getdents d3/dd 0 2024-04-15T00:28:29.011 INFO:tasks.workunit.client.0.smithi029.stdout:8/84: link d8/da/f13 d8/da/f1e 0 2024-04-15T00:28:29.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:29.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:29.189 INFO:tasks.workunit.client.0.smithi029.stdout:9/81: mknod d3/d6/d9/c1d 0 2024-04-15T00:28:29.202 INFO:tasks.workunit.client.0.smithi029.stdout:6/102: fsync d1/f6 0 2024-04-15T00:28:29.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/100: dread - d2/de/f10 zero size 2024-04-15T00:28:29.226 INFO:tasks.workunit.client.0.smithi029.stdout:4/109: dwrite f7 [0,4194304] 0 2024-04-15T00:28:29.310 INFO:tasks.workunit.client.0.smithi029.stdout:7/86: rmdir d0/d6/d1c 39 2024-04-15T00:28:29.321 INFO:tasks.workunit.client.0.smithi029.stdout:3/93: dwrite d17/f1b [0,4194304] 0 2024-04-15T00:28:29.356 INFO:tasks.workunit.client.0.smithi029.stdout:2/102: rmdir d3/d13/d14 39 2024-04-15T00:28:29.388 INFO:tasks.workunit.client.0.smithi029.stdout:1/100: rmdir df/d29/d2e 0 2024-04-15T00:28:29.391 INFO:tasks.workunit.client.0.smithi029.stdout:8/85: mknod d8/c1f 0 2024-04-15T00:28:29.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/108: dwrite d5/d15/f1c [0,4194304] 0 2024-04-15T00:28:29.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/101: chown d2/l3 0 1 2024-04-15T00:28:29.535 INFO:tasks.workunit.client.0.smithi029.stdout:6/103: chown d1/d8/ca 266 1 2024-04-15T00:28:29.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/104: write d1/d8/f16 [193777,80070] 0 2024-04-15T00:28:29.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/94: dread f0 [0,4194304] 0 2024-04-15T00:28:29.693 INFO:tasks.workunit.client.0.smithi029.stdout:9/82: truncate d3/fb 2058655 0 2024-04-15T00:28:29.700 INFO:tasks.workunit.client.0.smithi029.stdout:1/101: creat df/f2f x:0 0 0 2024-04-15T00:28:29.818 INFO:tasks.workunit.client.0.smithi029.stdout:1/102: dwrite df/f24 [0,4194304] 0 2024-04-15T00:28:29.968 INFO:tasks.workunit.client.0.smithi029.stdout:5/102: write d2/de/f10 [242623,54761] 0 2024-04-15T00:28:29.969 INFO:tasks.workunit.client.0.smithi029.stdout:1/103: dwrite df/f25 [0,4194304] 0 2024-04-15T00:28:29.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/87: write d0/d6/d1c/f9 [163955,37029] 0 2024-04-15T00:28:30.075 INFO:tasks.workunit.client.0.smithi029.stdout:2/103: rmdir d3/d13/d14 39 2024-04-15T00:28:30.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/104: fdatasync f1 0 2024-04-15T00:28:30.133 INFO:tasks.workunit.client.0.smithi029.stdout:6/105: write d1/f18 [11740,94915] 0 2024-04-15T00:28:30.194 INFO:tasks.workunit.client.0.smithi029.stdout:3/95: dread f15 [0,4194304] 0 2024-04-15T00:28:30.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/96: stat f1 0 2024-04-15T00:28:30.263 INFO:tasks.workunit.client.0.smithi029.stdout:9/83: dwrite d3/d6/f1a [4194304,4194304] 0 2024-04-15T00:28:30.272 INFO:tasks.workunit.client.0.smithi029.stdout:2/104: sync 2024-04-15T00:28:30.615 INFO:tasks.workunit.client.0.smithi029.stdout:1/105: creat df/f30 x:0 0 0 2024-04-15T00:28:30.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/105: mknod d3/dd/c22 0 2024-04-15T00:28:30.640 INFO:tasks.workunit.client.0.smithi029.stdout:9/84: symlink d3/d6/d9/d15/l1e 0 2024-04-15T00:28:30.644 INFO:tasks.workunit.client.0.smithi029.stdout:7/88: dread d0/d6/f8 [0,4194304] 0 2024-04-15T00:28:30.721 INFO:tasks.workunit.client.0.smithi029.stdout:0/109: getdents d5 0 2024-04-15T00:28:30.759 INFO:tasks.workunit.client.0.smithi029.stdout:8/86: getdents d8/da 0 2024-04-15T00:28:30.771 INFO:tasks.workunit.client.0.smithi029.stdout:6/106: dread d1/d8/db/f11 [4194304,4194304] 0 2024-04-15T00:28:30.801 INFO:tasks.workunit.client.0.smithi029.stdout:1/106: dread df/f13 [0,4194304] 0 2024-04-15T00:28:30.809 INFO:tasks.workunit.client.0.smithi029.stdout:8/87: write f5 [196482,46552] 0 2024-04-15T00:28:30.826 INFO:tasks.workunit.client.0.smithi029.stdout:1/107: chown c7 11016164 1 2024-04-15T00:28:30.839 INFO:tasks.workunit.client.0.smithi029.stdout:8/88: write d8/f9 [4050857,13102] 0 2024-04-15T00:28:30.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/110: rename de/df/d10/l1c to de/l1d 0 2024-04-15T00:28:30.858 INFO:tasks.workunit.client.0.smithi029.stdout:8/89: read f5 [7670163,68256] 0 2024-04-15T00:28:30.874 INFO:tasks.workunit.client.0.smithi029.stdout:8/90: chown d8/da 7 1 2024-04-15T00:28:30.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/111: write f7 [490247,33995] 0 2024-04-15T00:28:30.895 INFO:tasks.workunit.client.0.smithi029.stdout:4/112: chown lb 2 1 2024-04-15T00:28:31.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/85: creat d3/d6/d9/d15/f1f x:0 0 0 2024-04-15T00:28:31.097 INFO:tasks.workunit.client.0.smithi029.stdout:0/110: rmdir d5/d15 39 2024-04-15T00:28:31.132 INFO:tasks.workunit.client.0.smithi029.stdout:6/107: creat d1/d8/db/f24 x:0 0 0 2024-04-15T00:28:31.169 INFO:tasks.workunit.client.0.smithi029.stdout:0/111: dread d5/db/f19 [0,4194304] 0 2024-04-15T00:28:31.225 INFO:tasks.workunit.client.0.smithi029.stdout:3/97: write d17/f1d [623287,71096] 0 2024-04-15T00:28:31.258 INFO:tasks.workunit.client.0.smithi029.stdout:4/113: mkdir de/df/d1e 0 2024-04-15T00:28:31.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/103: mkdir d2/d24 0 2024-04-15T00:28:31.324 INFO:tasks.workunit.client.0.smithi029.stdout:6/108: dwrite d1/d8/db/f24 [0,4194304] 0 2024-04-15T00:28:31.472 INFO:tasks.workunit.client.0.smithi029.stdout:4/114: dwrite f7 [0,4194304] 0 2024-04-15T00:28:31.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/86: symlink d3/d6/d9/l20 0 2024-04-15T00:28:31.657 INFO:tasks.workunit.client.0.smithi029.stdout:3/98: creat d17/f20 x:0 0 0 2024-04-15T00:28:31.757 INFO:tasks.workunit.client.0.smithi029.stdout:7/89: dwrite d0/d6/d1c/f1b [0,4194304] 0 2024-04-15T00:28:31.805 INFO:tasks.workunit.client.0.smithi029.stdout:3/99: sync 2024-04-15T00:28:31.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/109: symlink d1/d1e/l25 0 2024-04-15T00:28:31.876 INFO:tasks.workunit.client.0.smithi029.stdout:0/112: mkdir d5/d15/d27 0 2024-04-15T00:28:31.968 INFO:tasks.workunit.client.0.smithi029.stdout:9/87: unlink d3/d6/fe 0 2024-04-15T00:28:31.974 INFO:tasks.workunit.client.0.smithi029.stdout:9/88: chown d3/c14 217035 1 2024-04-15T00:28:31.993 INFO:tasks.workunit.client.0.smithi029.stdout:9/89: dread d3/d6/d9/d15/f18 [0,4194304] 0 2024-04-15T00:28:32.063 INFO:tasks.workunit.client.0.smithi029.stdout:5/104: creat d2/de/d1f/f25 x:0 0 0 2024-04-15T00:28:32.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/108: write fc [2060988,75349] 0 2024-04-15T00:28:32.140 INFO:tasks.workunit.client.0.smithi029.stdout:3/100: creat d17/f21 x:0 0 0 2024-04-15T00:28:32.148 INFO:tasks.workunit.client.0.smithi029.stdout:2/106: symlink d3/l23 0 2024-04-15T00:28:32.241 INFO:tasks.workunit.client.0.smithi029.stdout:6/110: dread d1/d8/db/f23 [0,4194304] 0 2024-04-15T00:28:32.250 INFO:tasks.workunit.client.0.smithi029.stdout:8/91: getdents d8/dc 0 2024-04-15T00:28:32.267 INFO:tasks.workunit.client.0.smithi029.stdout:8/92: chown d8/dc/l19 6365907 1 2024-04-15T00:28:32.277 INFO:tasks.workunit.client.0.smithi029.stdout:9/90: mkdir d3/d6/d9/d15/d21 0 2024-04-15T00:28:32.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/109: symlink df/l31 0 2024-04-15T00:28:32.413 INFO:tasks.workunit.client.0.smithi029.stdout:1/110: sync 2024-04-15T00:28:32.470 INFO:tasks.workunit.client.0.smithi029.stdout:2/107: mknod d3/c24 0 2024-04-15T00:28:32.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/113: mkdir d5/d15/d27/d28 0 2024-04-15T00:28:32.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/115: truncate f7 892718 0 2024-04-15T00:28:32.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/101: fsync d17/f21 0 2024-04-15T00:28:32.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/114: dread d5/d15/f1c [0,4194304] 0 2024-04-15T00:28:32.715 INFO:tasks.workunit.client.0.smithi029.stdout:5/105: mkdir d2/de/d13/d22/d26 0 2024-04-15T00:28:32.716 INFO:tasks.workunit.client.0.smithi029.stdout:9/91: creat d3/d6/d9/f22 x:0 0 0 2024-04-15T00:28:32.731 INFO:tasks.workunit.client.0.smithi029.stdout:9/92: chown d3/d6/d9/f11 22973397 1 2024-04-15T00:28:32.754 INFO:tasks.workunit.client.0.smithi029.stdout:1/111: mkdir df/d32 0 2024-04-15T00:28:32.765 INFO:tasks.workunit.client.0.smithi029.stdout:7/90: write d0/d6/d1c/fe [31865,16482] 0 2024-04-15T00:28:32.784 INFO:tasks.workunit.client.0.smithi029.stdout:7/91: write d0/f1f [990243,50009] 0 2024-04-15T00:28:32.932 INFO:tasks.workunit.client.0.smithi029.stdout:6/111: write d1/d8/f14 [621106,23095] 0 2024-04-15T00:28:32.969 INFO:tasks.workunit.client.0.smithi029.stdout:3/102: fdatasync f15 0 2024-04-15T00:28:32.975 INFO:tasks.workunit.client.0.smithi029.stdout:3/103: stat f3 0 2024-04-15T00:28:33.234 INFO:tasks.workunit.client.0.smithi029.stdout:8/93: link d8/da/l18 d8/l20 0 2024-04-15T00:28:33.253 INFO:tasks.workunit.client.0.smithi029.stdout:5/106: chown d2/fa 15 1 2024-04-15T00:28:33.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/107: rename d2/de/d13 to d2/de/d13/d22/d26/d27 22 2024-04-15T00:28:33.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/108: dwrite d3/f9 [4194304,4194304] 0 2024-04-15T00:28:33.455 INFO:tasks.workunit.client.0.smithi029.stdout:4/116: symlink de/df/d1e/l1f 0 2024-04-15T00:28:33.460 INFO:tasks.workunit.client.0.smithi029.stdout:3/104: rmdir d17 39 2024-04-15T00:28:33.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/115: write d5/f7 [3964944,38957] 0 2024-04-15T00:28:33.488 INFO:tasks.workunit.client.0.smithi029.stdout:9/93: symlink d3/d6/d9/d15/d21/l23 0 2024-04-15T00:28:33.499 INFO:tasks.workunit.client.0.smithi029.stdout:3/105: readlink lc 0 2024-04-15T00:28:33.593 INFO:tasks.workunit.client.0.smithi029.stdout:9/94: dread - d3/d6/f13 zero size 2024-04-15T00:28:33.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/108: rmdir d2/d1a 39 2024-04-15T00:28:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:0/116: dread d5/db/f10 [4194304,4194304] 0 2024-04-15T00:28:33.740 INFO:tasks.workunit.client.0.smithi029.stdout:1/112: dwrite f0 [0,4194304] 0 2024-04-15T00:28:33.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/92: dwrite d0/d6/f8 [0,4194304] 0 2024-04-15T00:28:33.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/117: truncate f4 3221845 0 2024-04-15T00:28:33.906 INFO:tasks.workunit.client.0.smithi029.stdout:1/113: readlink df/l23 0 2024-04-15T00:28:33.924 INFO:tasks.workunit.client.0.smithi029.stdout:8/94: write d8/fd [905057,31383] 0 2024-04-15T00:28:33.950 INFO:tasks.workunit.client.0.smithi029.stdout:7/93: read d0/d6/d1c/f9 [119054,116778] 0 2024-04-15T00:28:33.954 INFO:tasks.workunit.client.0.smithi029.stdout:4/118: chown de/df/l13 2 1 2024-04-15T00:28:33.985 INFO:tasks.workunit.client.0.smithi029.stdout:7/94: fdatasync d0/d6/f8 0 2024-04-15T00:28:34.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/109: write d2/d1a/f1c [1289774,110844] 0 2024-04-15T00:28:34.041 INFO:tasks.workunit.client.0.smithi029.stdout:5/110: chown d2/de/d13 16 1 2024-04-15T00:28:34.056 INFO:tasks.workunit.client.0.smithi029.stdout:6/112: truncate d1/f20 4135847 0 2024-04-15T00:28:34.098 INFO:tasks.workunit.client.0.smithi029.stdout:7/95: dread d0/fb [0,4194304] 0 2024-04-15T00:28:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:9/95: write d3/d6/f12 [2062987,58540] 0 2024-04-15T00:28:34.144 INFO:tasks.workunit.client.0.smithi029.stdout:2/109: truncate d3/d13/d14/f1c 373801 0 2024-04-15T00:28:34.186 INFO:tasks.workunit.client.0.smithi029.stdout:9/96: write d3/d6/f1a [502235,130233] 0 2024-04-15T00:28:34.204 INFO:tasks.workunit.client.0.smithi029.stdout:9/97: chown d3/d6/d9/l20 1965674 1 2024-04-15T00:28:34.283 INFO:tasks.workunit.client.0.smithi029.stdout:8/95: mknod d8/dc/c21 0 2024-04-15T00:28:34.295 INFO:tasks.workunit.client.0.smithi029.stdout:3/106: link c12 d17/c22 0 2024-04-15T00:28:34.337 INFO:tasks.workunit.client.0.smithi029.stdout:9/98: dwrite d3/d6/d9/d15/f1f [0,4194304] 0 2024-04-15T00:28:34.439 INFO:tasks.workunit.client.0.smithi029.stdout:8/96: sync 2024-04-15T00:28:34.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/111: truncate f0 1577706 0 2024-04-15T00:28:34.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/113: symlink d1/d8/db/l26 0 2024-04-15T00:28:34.466 INFO:tasks.workunit.client.0.smithi029.stdout:7/96: creat d0/d6/d16/f20 x:0 0 0 2024-04-15T00:28:34.670 INFO:tasks.workunit.client.0.smithi029.stdout:1/114: symlink df/d32/l33 0 2024-04-15T00:28:34.678 INFO:tasks.workunit.client.0.smithi029.stdout:1/115: chown df/f1c 45853224 1 2024-04-15T00:28:34.853 INFO:tasks.workunit.client.0.smithi029.stdout:0/117: creat d5/db/f29 x:0 0 0 2024-04-15T00:28:34.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/99: symlink d3/d6/l24 0 2024-04-15T00:28:34.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/97: symlink d8/l22 0 2024-04-15T00:28:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:8/98: stat f6 0 2024-04-15T00:28:34.914 INFO:tasks.workunit.client.0.smithi029.stdout:5/112: dread - d2/de/f23 zero size 2024-04-15T00:28:34.920 INFO:tasks.workunit.client.0.smithi029.stdout:5/113: stat d2/f7 0 2024-04-15T00:28:34.928 INFO:tasks.workunit.client.0.smithi029.stdout:5/114: chown d2/de/d13/d22 45577 1 2024-04-15T00:28:35.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/116: mknod df/d29/c34 0 2024-04-15T00:28:35.071 INFO:tasks.workunit.client.0.smithi029.stdout:4/119: rename de/df/d1e/l1f to de/l20 0 2024-04-15T00:28:35.103 INFO:tasks.workunit.client.0.smithi029.stdout:1/117: write df/f24 [2657576,128551] 0 2024-04-15T00:28:35.225 INFO:tasks.workunit.client.0.smithi029.stdout:9/100: symlink d3/d6/d9/l25 0 2024-04-15T00:28:35.250 INFO:tasks.workunit.client.0.smithi029.stdout:9/101: truncate d3/d6/d9/f22 78886 0 2024-04-15T00:28:35.358 INFO:tasks.workunit.client.0.smithi029.stdout:7/97: mknod d0/c21 0 2024-04-15T00:28:35.370 INFO:tasks.workunit.client.0.smithi029.stdout:2/110: write d3/d13/d14/f20 [7207001,52056] 0 2024-04-15T00:28:35.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/115: symlink d2/de/l28 0 2024-04-15T00:28:35.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/120: creat de/df/d10/f21 x:0 0 0 2024-04-15T00:28:35.693 INFO:tasks.workunit.client.0.smithi029.stdout:1/118: creat df/d32/f35 x:0 0 0 2024-04-15T00:28:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:6/114: getdents d1/d1e/d22 0 2024-04-15T00:28:35.714 INFO:tasks.workunit.client.0.smithi029.stdout:1/119: chown c7 2218435 1 2024-04-15T00:28:35.724 INFO:tasks.workunit.client.0.smithi029.stdout:6/115: chown d1/d8/db/f24 330336 1 2024-04-15T00:28:35.738 INFO:tasks.workunit.client.0.smithi029.stdout:6/116: fsync d1/d8/db/f24 0 2024-04-15T00:28:35.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/118: dwrite d5/db/f19 [0,4194304] 0 2024-04-15T00:28:36.002 INFO:tasks.workunit.client.0.smithi029.stdout:8/99: write f6 [4461087,48323] 0 2024-04-15T00:28:36.080 INFO:tasks.workunit.client.0.smithi029.stdout:3/107: dwrite f1 [0,4194304] 0 2024-04-15T00:28:36.092 INFO:tasks.workunit.client.0.smithi029.stdout:4/121: creat de/df/d1e/f22 x:0 0 0 2024-04-15T00:28:36.214 INFO:tasks.workunit.client.0.smithi029.stdout:0/119: truncate d5/db/f29 1216 0 2024-04-15T00:28:36.570 INFO:tasks.workunit.client.0.smithi029.stdout:5/116: fdatasync d2/f8 0 2024-04-15T00:28:36.757 INFO:tasks.workunit.client.0.smithi029.stdout:3/108: symlink d17/l23 0 2024-04-15T00:28:36.759 INFO:tasks.workunit.client.0.smithi029.stdout:8/100: fsync d8/f15 0 2024-04-15T00:28:36.800 INFO:tasks.workunit.client.0.smithi029.stdout:6/117: dwrite d1/f1c [0,4194304] 0 2024-04-15T00:28:36.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/101: stat d8/fd 0 2024-04-15T00:28:36.874 INFO:tasks.workunit.client.0.smithi029.stdout:9/102: rename d3/d6/l24 to d3/l26 0 2024-04-15T00:28:36.905 INFO:tasks.workunit.client.0.smithi029.stdout:8/102: readlink d8/dc/l19 0 2024-04-15T00:28:36.923 INFO:tasks.workunit.client.0.smithi029.stdout:9/103: fsync d3/d6/f12 0 2024-04-15T00:28:36.935 INFO:tasks.workunit.client.0.smithi029.stdout:0/120: creat d5/d15/d27/f2a x:0 0 0 2024-04-15T00:28:36.979 INFO:tasks.workunit.client.0.smithi029.stdout:4/122: dread f2 [0,4194304] 0 2024-04-15T00:28:37.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/103: dread f5 [4194304,4194304] 0 2024-04-15T00:28:37.042 INFO:tasks.workunit.client.0.smithi029.stdout:8/104: chown d8/dc 31 1 2024-04-15T00:28:37.062 INFO:tasks.workunit.client.0.smithi029.stdout:3/109: fsync f3 0 2024-04-15T00:28:37.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/110: read f3 [138607,125970] 0 2024-04-15T00:28:37.125 INFO:tasks.workunit.client.0.smithi029.stdout:2/111: truncate d3/d13/d14/f1c 132607 0 2024-04-15T00:28:37.543 INFO:tasks.workunit.client.0.smithi029.stdout:9/104: creat d3/d6/d9/f27 x:0 0 0 2024-04-15T00:28:37.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/120: getdents df/d29 0 2024-04-15T00:28:37.554 INFO:tasks.workunit.client.0.smithi029.stdout:4/123: mknod de/df/d10/c23 0 2024-04-15T00:28:37.569 INFO:tasks.workunit.client.0.smithi029.stdout:3/111: creat d17/f24 x:0 0 0 2024-04-15T00:28:37.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/112: chown d17/c18 2508073 1 2024-04-15T00:28:37.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/105: chown d3/d6/d9/d15/f18 1509412165 1 2024-04-15T00:28:37.635 INFO:tasks.workunit.client.0.smithi029.stdout:3/113: stat d17/c19 0 2024-04-15T00:28:37.670 INFO:tasks.workunit.client.0.smithi029.stdout:1/121: dread f1 [0,4194304] 0 2024-04-15T00:28:37.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/121: mknod d5/d15/d27/d28/c2b 0 2024-04-15T00:28:37.765 INFO:tasks.workunit.client.0.smithi029.stdout:1/122: dwrite f0 [0,4194304] 0 2024-04-15T00:28:37.833 INFO:tasks.workunit.client.0.smithi029.stdout:7/98: rename d0/d6/d1c/fd to d0/f22 0 2024-04-15T00:28:37.869 INFO:tasks.workunit.client.0.smithi029.stdout:8/105: write d8/f15 [985847,1540] 0 2024-04-15T00:28:37.885 INFO:tasks.workunit.client.0.smithi029.stdout:8/106: truncate d8/f15 1776010 0 2024-04-15T00:28:37.897 INFO:tasks.workunit.client.0.smithi029.stdout:6/118: link d1/f1f d1/d1e/f27 0 2024-04-15T00:28:37.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/114: mknod d17/c25 0 2024-04-15T00:28:38.009 INFO:tasks.workunit.client.0.smithi029.stdout:5/117: getdents d2/de/d13 0 2024-04-15T00:28:38.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/122: truncate f2 3700275 0 2024-04-15T00:28:38.142 INFO:tasks.workunit.client.0.smithi029.stdout:1/123: dread - df/f2d zero size 2024-04-15T00:28:38.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/124: readlink df/l2b 0 2024-04-15T00:28:38.273 INFO:tasks.workunit.client.0.smithi029.stdout:2/112: rename d3/dd/c1f to d3/d13/d14/c25 0 2024-04-15T00:28:38.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/113: chown d3/la 7 1 2024-04-15T00:28:38.351 INFO:tasks.workunit.client.0.smithi029.stdout:3/115: creat d17/f26 x:0 0 0 2024-04-15T00:28:38.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/118: dread d2/f8 [0,4194304] 0 2024-04-15T00:28:38.448 INFO:tasks.workunit.client.0.smithi029.stdout:0/123: write d5/f7 [4063703,65254] 0 2024-04-15T00:28:38.471 INFO:tasks.workunit.client.0.smithi029.stdout:9/106: write d3/d6/d9/f11 [65649,79470] 0 2024-04-15T00:28:38.635 INFO:tasks.workunit.client.0.smithi029.stdout:9/107: dread d3/d6/f1a [8388608,4194304] 0 2024-04-15T00:28:38.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/99: rename d0 to d0/d6/d23 22 2024-04-15T00:28:38.759 INFO:tasks.workunit.client.0.smithi029.stdout:4/124: dwrite f7 [0,4194304] 0 2024-04-15T00:28:38.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/107: getdents d8/da 0 2024-04-15T00:28:38.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/116: creat d17/f27 x:0 0 0 2024-04-15T00:28:38.881 INFO:tasks.workunit.client.0.smithi029.stdout:5/119: fdatasync d2/fa 0 2024-04-15T00:28:38.923 INFO:tasks.workunit.client.0.smithi029.stdout:0/124: mknod d5/db/d1a/c2c 0 2024-04-15T00:28:38.968 INFO:tasks.workunit.client.0.smithi029.stdout:0/125: readlink d5/d15/l22 0 2024-04-15T00:28:38.990 INFO:tasks.workunit.client.0.smithi029.stdout:1/125: dwrite fe [0,4194304] 0 2024-04-15T00:28:39.074 INFO:tasks.workunit.client.0.smithi029.stdout:9/108: creat d3/d6/d9/d15/d21/f28 x:0 0 0 2024-04-15T00:28:39.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/114: dwrite d3/d13/d14/f1e [0,4194304] 0 2024-04-15T00:28:39.270 INFO:tasks.workunit.client.0.smithi029.stdout:4/125: rmdir de/df/d10 39 2024-04-15T00:28:39.363 INFO:tasks.workunit.client.0.smithi029.stdout:3/117: mknod d17/c28 0 2024-04-15T00:28:39.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/108: read d8/da/f14 [2690136,100650] 0 2024-04-15T00:28:39.388 INFO:tasks.workunit.client.0.smithi029.stdout:6/119: getdents d1/d1e 0 2024-04-15T00:28:39.399 INFO:tasks.workunit.client.0.smithi029.stdout:0/126: truncate d5/f13 3120273 0 2024-04-15T00:28:39.432 INFO:tasks.workunit.client.0.smithi029.stdout:1/126: dread df/f19 [0,4194304] 0 2024-04-15T00:28:39.440 INFO:tasks.workunit.client.0.smithi029.stdout:0/127: fsync d5/f7 0 2024-04-15T00:28:39.459 INFO:tasks.workunit.client.0.smithi029.stdout:0/128: write d5/f7 [6387462,69228] 0 2024-04-15T00:28:39.480 INFO:tasks.workunit.client.0.smithi029.stdout:0/129: read d5/db/f29 [259,88621] 0 2024-04-15T00:28:39.802 INFO:tasks.workunit.client.0.smithi029.stdout:5/120: mknod d2/c29 0 2024-04-15T00:28:39.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/126: unlink cc 0 2024-04-15T00:28:39.803 INFO:tasks.workunit.client.0.smithi029.stdout:3/118: rmdir d17 39 2024-04-15T00:28:39.824 INFO:tasks.workunit.client.0.smithi029.stdout:5/121: dread - d2/de/d13/f19 zero size 2024-04-15T00:28:39.918 INFO:tasks.workunit.client.0.smithi029.stdout:6/120: unlink d1/c3 0 2024-04-15T00:28:40.006 INFO:tasks.workunit.client.0.smithi029.stdout:0/130: write d5/d15/f1c [1419565,81247] 0 2024-04-15T00:28:40.073 INFO:tasks.workunit.client.0.smithi029.stdout:8/109: dread f6 [0,4194304] 0 2024-04-15T00:28:40.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/119: write d17/f24 [470929,96513] 0 2024-04-15T00:28:40.180 INFO:tasks.workunit.client.0.smithi029.stdout:9/109: dwrite d3/d6/f13 [0,4194304] 0 2024-04-15T00:28:40.188 INFO:tasks.workunit.client.0.smithi029.stdout:8/110: read d8/da/f1e [1285731,44829] 0 2024-04-15T00:28:40.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/122: write d2/f11 [1923455,21462] 0 2024-04-15T00:28:40.374 INFO:tasks.workunit.client.0.smithi029.stdout:4/127: dwrite f3 [0,4194304] 0 2024-04-15T00:28:40.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/131: creat d5/d15/d27/f2d x:0 0 0 2024-04-15T00:28:40.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/100: link d0/f22 d0/f24 0 2024-04-15T00:28:40.535 INFO:tasks.workunit.client.0.smithi029.stdout:0/132: truncate d5/f7 7499351 0 2024-04-15T00:28:40.706 INFO:tasks.workunit.client.0.smithi029.stdout:9/110: stat d3/fb 0 2024-04-15T00:28:40.879 INFO:tasks.workunit.client.0.smithi029.stdout:8/111: truncate d8/fd 1026133 0 2024-04-15T00:28:40.879 INFO:tasks.workunit.client.0.smithi029.stdout:5/123: creat d2/de/d13/f2a x:0 0 0 2024-04-15T00:28:40.885 INFO:tasks.workunit.client.0.smithi029.stdout:6/121: getdents d1/d1e/d22 0 2024-04-15T00:28:40.956 INFO:tasks.workunit.client.0.smithi029.stdout:5/124: dread d2/f11 [0,4194304] 0 2024-04-15T00:28:41.007 INFO:tasks.workunit.client.0.smithi029.stdout:4/128: creat de/df/d1e/f24 x:0 0 0 2024-04-15T00:28:41.038 INFO:tasks.workunit.client.0.smithi029.stdout:1/127: getdents df 0 2024-04-15T00:28:41.080 INFO:tasks.workunit.client.0.smithi029.stdout:8/112: dwrite d8/f15 [0,4194304] 0 2024-04-15T00:28:41.172 INFO:tasks.workunit.client.0.smithi029.stdout:2/115: creat d3/d13/f26 x:0 0 0 2024-04-15T00:28:41.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/122: fsync d1/f18 0 2024-04-15T00:28:41.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/113: mkdir d8/dc/d23 0 2024-04-15T00:28:41.557 INFO:tasks.workunit.client.0.smithi029.stdout:3/120: dwrite d17/f1b [0,4194304] 0 2024-04-15T00:28:41.834 INFO:tasks.workunit.client.0.smithi029.stdout:0/133: rename d5/d15/l22 to d5/d15/d1f/l2e 0 2024-04-15T00:28:41.836 INFO:tasks.workunit.client.0.smithi029.stdout:7/101: write d0/d6/fa [4405658,45126] 0 2024-04-15T00:28:41.860 INFO:tasks.workunit.client.0.smithi029.stdout:5/125: creat d2/de/d13/d22/d26/f2b x:0 0 0 2024-04-15T00:28:41.874 INFO:tasks.workunit.client.0.smithi029.stdout:9/111: write d3/d6/f16 [4079845,108202] 0 2024-04-15T00:28:41.875 INFO:tasks.workunit.client.0.smithi029.stdout:0/134: stat d5/db/f19 0 2024-04-15T00:28:41.888 INFO:tasks.workunit.client.0.smithi029.stdout:7/102: readlink d0/d6/d1c/l3 0 2024-04-15T00:28:41.924 INFO:tasks.workunit.client.0.smithi029.stdout:8/114: unlink f5 0 2024-04-15T00:28:41.928 INFO:tasks.workunit.client.0.smithi029.stdout:8/115: readlink d8/lb 0 2024-04-15T00:28:42.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/129: creat de/f25 x:0 0 0 2024-04-15T00:28:42.150 INFO:tasks.workunit.client.0.smithi029.stdout:5/126: fdatasync d2/de/f23 0 2024-04-15T00:28:42.156 INFO:tasks.workunit.client.0.smithi029.stdout:0/135: mkdir d5/d15/d27/d2f 0 2024-04-15T00:28:42.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/123: getdents d1/d1e/d22 0 2024-04-15T00:28:42.204 INFO:tasks.workunit.client.0.smithi029.stdout:9/112: mkdir d3/d6/d9/d29 0 2024-04-15T00:28:42.227 INFO:tasks.workunit.client.0.smithi029.stdout:7/103: dread d0/d6/d1c/f9 [0,4194304] 0 2024-04-15T00:28:42.238 INFO:tasks.workunit.client.0.smithi029.stdout:7/104: readlink d0/d6/d1c/l3 0 2024-04-15T00:28:42.292 INFO:tasks.workunit.client.0.smithi029.stdout:1/128: link df/f2f df/d32/f36 0 2024-04-15T00:28:42.314 INFO:tasks.workunit.client.0.smithi029.stdout:1/129: readlink la 0 2024-04-15T00:28:42.375 INFO:tasks.workunit.client.0.smithi029.stdout:4/130: chown de/l20 79696 1 2024-04-15T00:28:42.436 INFO:tasks.workunit.client.0.smithi029.stdout:6/124: mknod d1/d8/db/c28 0 2024-04-15T00:28:42.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/116: write d3/d13/d14/f1c [862881,60112] 0 2024-04-15T00:28:42.502 INFO:tasks.workunit.client.0.smithi029.stdout:2/117: chown d3/d13/d14/f20 4176868 1 2024-04-15T00:28:42.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/113: creat d3/d6/d9/d15/d21/f2a x:0 0 0 2024-04-15T00:28:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:3/121: dwrite f3 [0,4194304] 0 2024-04-15T00:28:42.833 INFO:tasks.workunit.client.0.smithi029.stdout:8/116: fsync f6 0 2024-04-15T00:28:42.876 INFO:tasks.workunit.client.0.smithi029.stdout:4/131: symlink de/df/d1e/l26 0 2024-04-15T00:28:42.884 INFO:tasks.workunit.client.0.smithi029.stdout:6/125: creat d1/d8/f29 x:0 0 0 2024-04-15T00:28:42.920 INFO:tasks.workunit.client.0.smithi029.stdout:9/114: truncate d3/d6/f1a 9711313 0 2024-04-15T00:28:42.920 INFO:tasks.workunit.client.0.smithi029.stdout:2/118: creat d3/dd/f27 x:0 0 0 2024-04-15T00:28:42.928 INFO:tasks.workunit.client.0.smithi029.stdout:3/122: creat d17/f29 x:0 0 0 2024-04-15T00:28:42.951 INFO:tasks.workunit.client.0.smithi029.stdout:9/115: fsync d3/d6/f13 0 2024-04-15T00:28:42.968 INFO:tasks.workunit.client.0.smithi029.stdout:9/116: write d3/d6/f13 [3645679,128668] 0 2024-04-15T00:28:42.981 INFO:tasks.workunit.client.0.smithi029.stdout:9/117: readlink d3/d6/d9/l25 0 2024-04-15T00:28:43.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/136: write d5/d15/f1e [161111,56356] 0 2024-04-15T00:28:43.088 INFO:tasks.workunit.client.0.smithi029.stdout:7/105: write d0/f24 [974503,13645] 0 2024-04-15T00:28:43.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/127: link d2/f7 d2/d1a/f2c 0 2024-04-15T00:28:43.345 INFO:tasks.workunit.client.0.smithi029.stdout:3/123: mkdir d17/d2a 0 2024-04-15T00:28:43.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/118: rename d3/l5 to d3/d6/d9/d15/l2b 0 2024-04-15T00:28:43.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/137: rmdir d5/db 39 2024-04-15T00:28:43.370 INFO:tasks.workunit.client.0.smithi029.stdout:5/128: readlink d2/l3 0 2024-04-15T00:28:43.508 INFO:tasks.workunit.client.0.smithi029.stdout:8/117: mknod d8/dc/d23/c24 0 2024-04-15T00:28:43.512 INFO:tasks.workunit.client.0.smithi029.stdout:8/118: readlink d8/l22 0 2024-04-15T00:28:43.620 INFO:tasks.workunit.client.0.smithi029.stdout:4/132: write f8 [1618529,38304] 0 2024-04-15T00:28:43.753 INFO:tasks.workunit.client.0.smithi029.stdout:6/126: dwrite d1/f18 [0,4194304] 0 2024-04-15T00:28:43.850 INFO:tasks.workunit.client.0.smithi029.stdout:5/129: mkdir d2/d1a/d2d 0 2024-04-15T00:28:43.854 INFO:tasks.workunit.client.0.smithi029.stdout:1/130: link df/c1b df/d29/c37 0 2024-04-15T00:28:43.933 INFO:tasks.workunit.client.0.smithi029.stdout:2/119: creat d3/d13/f28 x:0 0 0 2024-04-15T00:28:43.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/106: creat d0/d6/f25 x:0 0 0 2024-04-15T00:28:44.100 INFO:tasks.workunit.client.0.smithi029.stdout:3/124: dwrite d17/f21 [0,4194304] 0 2024-04-15T00:28:44.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/138: rename d5/db/cc to d5/d15/c30 0 2024-04-15T00:28:44.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/130: creat d2/de/f2e x:0 0 0 2024-04-15T00:28:44.370 INFO:tasks.workunit.client.0.smithi029.stdout:0/139: chown d5/d15/d27 311326 1 2024-04-15T00:28:44.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/133: write de/df/d1e/f22 [919071,45489] 0 2024-04-15T00:28:44.497 INFO:tasks.workunit.client.0.smithi029.stdout:8/119: write d8/fd [656686,40715] 0 2024-04-15T00:28:44.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/125: symlink d17/d2a/l2b 0 2024-04-15T00:28:44.777 INFO:tasks.workunit.client.0.smithi029.stdout:1/131: dwrite fc [0,4194304] 0 2024-04-15T00:28:44.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/127: dwrite d1/f17 [0,4194304] 0 2024-04-15T00:28:44.865 INFO:tasks.workunit.client.0.smithi029.stdout:0/140: rename d5/l26 to d5/d15/d27/l31 0 2024-04-15T00:28:44.868 INFO:tasks.workunit.client.0.smithi029.stdout:7/107: dwrite d0/d6/d1c/fe [0,4194304] 0 2024-04-15T00:28:45.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/120: getdents d3 0 2024-04-15T00:28:45.264 INFO:tasks.workunit.client.0.smithi029.stdout:7/108: dread d0/d6/fa [4194304,4194304] 0 2024-04-15T00:28:45.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/141: mkdir d5/d15/d1f/d32 0 2024-04-15T00:28:45.309 INFO:tasks.workunit.client.0.smithi029.stdout:4/134: creat de/f27 x:0 0 0 2024-04-15T00:28:45.325 INFO:tasks.workunit.client.0.smithi029.stdout:9/119: dread d3/d6/f1a [0,4194304] 0 2024-04-15T00:28:45.399 INFO:tasks.workunit.client.0.smithi029.stdout:0/142: fsync d5/d15/d27/f2d 0 2024-04-15T00:28:45.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/131: dwrite d2/d1a/f1c [0,4194304] 0 2024-04-15T00:28:45.536 INFO:tasks.workunit.client.0.smithi029.stdout:3/126: dwrite f16 [0,4194304] 0 2024-04-15T00:28:45.624 INFO:tasks.workunit.client.0.smithi029.stdout:8/120: truncate d8/f15 1799702 0 2024-04-15T00:28:45.759 INFO:tasks.workunit.client.0.smithi029.stdout:3/127: chown d17/c18 0 1 2024-04-15T00:28:45.825 INFO:tasks.workunit.client.0.smithi029.stdout:7/109: dwrite d0/d6/f25 [0,4194304] 0 2024-04-15T00:28:45.911 INFO:tasks.workunit.client.0.smithi029.stdout:2/121: mknod d3/d13/c29 0 2024-04-15T00:28:45.914 INFO:tasks.workunit.client.0.smithi029.stdout:0/143: dread d5/f7 [4194304,4194304] 0 2024-04-15T00:28:45.940 INFO:tasks.workunit.client.0.smithi029.stdout:8/121: symlink d8/dc/l25 0 2024-04-15T00:28:45.962 INFO:tasks.workunit.client.0.smithi029.stdout:1/132: dwrite df/f22 [0,4194304] 0 2024-04-15T00:28:46.032 INFO:tasks.workunit.client.0.smithi029.stdout:4/135: unlink de/df/d10/f11 0 2024-04-15T00:28:46.124 INFO:tasks.workunit.client.0.smithi029.stdout:3/128: creat d17/d2a/f2c x:0 0 0 2024-04-15T00:28:46.180 INFO:tasks.workunit.client.0.smithi029.stdout:7/110: mkdir d0/d6/d16/d26 0 2024-04-15T00:28:46.203 INFO:tasks.workunit.client.0.smithi029.stdout:0/144: rmdir d5/d15/d27/d28 39 2024-04-15T00:28:46.227 INFO:tasks.workunit.client.0.smithi029.stdout:7/111: stat d0/d6/f18 0 2024-04-15T00:28:46.246 INFO:tasks.workunit.client.0.smithi029.stdout:6/128: dwrite d1/d8/db/f23 [0,4194304] 0 2024-04-15T00:28:46.357 INFO:tasks.workunit.client.0.smithi029.stdout:8/122: symlink d8/dc/d23/l26 0 2024-04-15T00:28:46.365 INFO:tasks.workunit.client.0.smithi029.stdout:1/133: rename f0 to df/f38 0 2024-04-15T00:28:46.417 INFO:tasks.workunit.client.0.smithi029.stdout:3/129: symlink d17/l2d 0 2024-04-15T00:28:46.424 INFO:tasks.workunit.client.0.smithi029.stdout:1/134: stat la 0 2024-04-15T00:28:46.525 INFO:tasks.workunit.client.0.smithi029.stdout:4/136: sync 2024-04-15T00:28:46.529 INFO:tasks.workunit.client.0.smithi029.stdout:1/135: chown c5 3 1 2024-04-15T00:28:46.562 INFO:tasks.workunit.client.0.smithi029.stdout:6/129: dwrite d1/d1e/f27 [0,4194304] 0 2024-04-15T00:28:46.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/130: sync 2024-04-15T00:28:46.680 INFO:tasks.workunit.client.0.smithi029.stdout:4/137: chown fd 2671 1 2024-04-15T00:28:46.699 INFO:tasks.workunit.client.0.smithi029.stdout:1/136: chown df/d29/c37 95 1 2024-04-15T00:28:46.713 INFO:tasks.workunit.client.0.smithi029.stdout:9/120: dwrite d3/d6/d9/f11 [0,4194304] 0 2024-04-15T00:28:46.813 INFO:tasks.workunit.client.0.smithi029.stdout:7/112: symlink d0/d6/l27 0 2024-04-15T00:28:46.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/132: dwrite d2/f11 [0,4194304] 0 2024-04-15T00:28:46.930 INFO:tasks.workunit.client.0.smithi029.stdout:0/145: truncate f2 1448651 0 2024-04-15T00:28:46.943 INFO:tasks.workunit.client.0.smithi029.stdout:3/131: rmdir d17 39 2024-04-15T00:28:46.968 INFO:tasks.workunit.client.0.smithi029.stdout:6/130: dread d1/d1e/f27 [0,4194304] 0 2024-04-15T00:28:47.001 INFO:tasks.workunit.client.0.smithi029.stdout:2/122: getdents d3 0 2024-04-15T00:28:47.034 INFO:tasks.workunit.client.0.smithi029.stdout:1/137: creat df/d32/f39 x:0 0 0 2024-04-15T00:28:47.041 INFO:tasks.workunit.client.0.smithi029.stdout:1/138: chown c9 513151531 1 2024-04-15T00:28:47.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/138: creat de/df/d1e/f28 x:0 0 0 2024-04-15T00:28:47.307 INFO:tasks.workunit.client.0.smithi029.stdout:9/121: rename d3/fb to d3/d6/d9/f2c 0 2024-04-15T00:28:47.356 INFO:tasks.workunit.client.0.smithi029.stdout:5/133: creat d2/de/d13/f2f x:0 0 0 2024-04-15T00:28:47.363 INFO:tasks.workunit.client.0.smithi029.stdout:5/134: readlink d2/de/lf 0 2024-04-15T00:28:47.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/131: mknod d1/d8/db/c2a 0 2024-04-15T00:28:47.500 INFO:tasks.workunit.client.0.smithi029.stdout:2/123: mkdir d3/d2a 0 2024-04-15T00:28:47.552 INFO:tasks.workunit.client.0.smithi029.stdout:4/139: creat de/df/d1e/f29 x:0 0 0 2024-04-15T00:28:47.598 INFO:tasks.workunit.client.0.smithi029.stdout:3/132: mknod d17/d2a/c2e 0 2024-04-15T00:28:47.618 INFO:tasks.workunit.client.0.smithi029.stdout:4/140: dread f8 [0,4194304] 0 2024-04-15T00:28:47.633 INFO:tasks.workunit.client.0.smithi029.stdout:7/113: creat d0/d6/d16/d26/f28 x:0 0 0 2024-04-15T00:28:47.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/141: fdatasync de/df/d1e/f28 0 2024-04-15T00:28:47.686 INFO:tasks.workunit.client.0.smithi029.stdout:9/122: mknod d3/d6/d9/d15/c2d 0 2024-04-15T00:28:47.717 INFO:tasks.workunit.client.0.smithi029.stdout:0/146: mknod d5/d15/d27/c33 0 2024-04-15T00:28:47.739 INFO:tasks.workunit.client.0.smithi029.stdout:7/114: write d0/d6/d16/d26/f28 [4131,98516] 0 2024-04-15T00:28:47.773 INFO:tasks.workunit.client.0.smithi029.stdout:9/123: chown d3/d6/d9/d15/d21 282575638 1 2024-04-15T00:28:47.775 INFO:tasks.workunit.client.0.smithi029.stdout:5/135: truncate d2/fb 4106687 0 2024-04-15T00:28:47.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/123: dwrite d8/da/f13 [0,4194304] 0 2024-04-15T00:28:47.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/136: dread - d2/de/d13/f2f zero size 2024-04-15T00:28:47.894 INFO:tasks.workunit.client.0.smithi029.stdout:8/124: truncate d8/da/f1e 5209565 0 2024-04-15T00:28:47.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/125: fsync d8/fd 0 2024-04-15T00:28:47.966 INFO:tasks.workunit.client.0.smithi029.stdout:2/124: rmdir d3/d13/d14 39 2024-04-15T00:28:48.085 INFO:tasks.workunit.client.0.smithi029.stdout:6/132: dwrite d1/d8/db/f23 [0,4194304] 0 2024-04-15T00:28:48.150 INFO:tasks.workunit.client.0.smithi029.stdout:3/133: mkdir d17/d2f 0 2024-04-15T00:28:48.170 INFO:tasks.workunit.client.0.smithi029.stdout:1/139: write df/f30 [730725,82343] 0 2024-04-15T00:28:48.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/147: dread d5/db/f29 [0,4194304] 0 2024-04-15T00:28:48.235 INFO:tasks.workunit.client.0.smithi029.stdout:4/142: dread de/f19 [0,4194304] 0 2024-04-15T00:28:48.276 INFO:tasks.workunit.client.0.smithi029.stdout:7/115: unlink d0/d6/fa 0 2024-04-15T00:28:48.281 INFO:tasks.workunit.client.0.smithi029.stdout:9/124: unlink d3/d6/d9/f27 0 2024-04-15T00:28:48.306 INFO:tasks.workunit.client.0.smithi029.stdout:9/125: dread d3/d6/d9/d15/f18 [0,4194304] 0 2024-04-15T00:28:48.429 INFO:tasks.workunit.client.0.smithi029.stdout:5/137: rename d2/de/l28 to d2/de/d1f/l30 0 2024-04-15T00:28:48.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/138: stat d2/de/lf 0 2024-04-15T00:28:48.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/126: creat d8/da/f27 x:0 0 0 2024-04-15T00:28:48.559 INFO:tasks.workunit.client.0.smithi029.stdout:2/125: mkdir d3/d2b 0 2024-04-15T00:28:48.623 INFO:tasks.workunit.client.0.smithi029.stdout:6/133: symlink d1/d8/l2b 0 2024-04-15T00:28:48.735 INFO:tasks.workunit.client.0.smithi029.stdout:4/143: creat de/df/d10/f2a x:0 0 0 2024-04-15T00:28:48.775 INFO:tasks.workunit.client.0.smithi029.stdout:6/134: sync 2024-04-15T00:28:48.888 INFO:tasks.workunit.client.0.smithi029.stdout:0/148: dread d5/db/f10 [0,4194304] 0 2024-04-15T00:28:48.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/126: dread d3/d6/d9/fd [0,4194304] 0 2024-04-15T00:28:49.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/140: rename l4 to df/l3a 0 2024-04-15T00:28:49.264 INFO:tasks.workunit.client.0.smithi029.stdout:8/127: mkdir d8/dc/d23/d28 0 2024-04-15T00:28:49.368 INFO:tasks.workunit.client.0.smithi029.stdout:3/134: symlink d17/d2f/l30 0 2024-04-15T00:28:49.410 INFO:tasks.workunit.client.0.smithi029.stdout:4/144: chown de/l1d 127103110 1 2024-04-15T00:28:49.466 INFO:tasks.workunit.client.0.smithi029.stdout:6/135: read d1/d8/db/f15 [20458,117657] 0 2024-04-15T00:28:49.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/145: chown de/df/d1e/l26 3482610 1 2024-04-15T00:28:49.537 INFO:tasks.workunit.client.0.smithi029.stdout:7/116: dwrite d0/d6/d1c/f9 [0,4194304] 0 2024-04-15T00:28:49.628 INFO:tasks.workunit.client.0.smithi029.stdout:1/141: fsync df/d29/f2c 0 2024-04-15T00:28:49.682 INFO:tasks.workunit.client.0.smithi029.stdout:6/136: dread d1/f1f [0,4194304] 0 2024-04-15T00:28:49.760 INFO:tasks.workunit.client.0.smithi029.stdout:1/142: dwrite df/f22 [0,4194304] 0 2024-04-15T00:28:49.826 INFO:tasks.workunit.client.0.smithi029.stdout:1/143: fsync df/f30 0 2024-04-15T00:28:49.832 INFO:tasks.workunit.client.0.smithi029.stdout:5/139: truncate d2/f7 4857567 0 2024-04-15T00:28:49.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/128: fdatasync f6 0 2024-04-15T00:28:49.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/127: write d3/d6/f13 [1412236,111483] 0 2024-04-15T00:28:49.967 INFO:tasks.workunit.client.0.smithi029.stdout:5/140: sync 2024-04-15T00:28:50.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/149: dwrite d5/db/f10 [0,4194304] 0 2024-04-15T00:28:50.035 INFO:tasks.workunit.client.0.smithi029.stdout:2/126: dwrite d3/f9 [4194304,4194304] 0 2024-04-15T00:28:50.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/117: symlink d0/d6/d16/d26/l29 0 2024-04-15T00:28:50.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/137: symlink d1/d1e/l2c 0 2024-04-15T00:28:50.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/141: mkdir d2/d1a/d31 0 2024-04-15T00:28:50.234 INFO:tasks.workunit.client.0.smithi029.stdout:0/150: stat f2 0 2024-04-15T00:28:50.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/151: chown d5/db/d1a/l24 35946 1 2024-04-15T00:28:50.332 INFO:tasks.workunit.client.0.smithi029.stdout:3/135: dwrite d17/f1b [4194304,4194304] 0 2024-04-15T00:28:50.394 INFO:tasks.workunit.client.0.smithi029.stdout:0/152: chown d5/d15/d1f 1 1 2024-04-15T00:28:50.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/138: mknod d1/d1e/d22/c2d 0 2024-04-15T00:28:50.962 INFO:tasks.workunit.client.0.smithi029.stdout:9/128: link d3/c14 d3/d6/d9/d29/c2e 0 2024-04-15T00:28:50.971 INFO:tasks.workunit.client.0.smithi029.stdout:9/129: chown d3/d6/d9/f11 16753 1 2024-04-15T00:28:51.585 INFO:tasks.workunit.client.0.smithi029.stdout:8/129: getdents d8/dc 0 2024-04-15T00:28:51.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/139: truncate d1/d8/db/f23 2384168 0 2024-04-15T00:28:51.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/142: creat d2/de/d13/f32 x:0 0 0 2024-04-15T00:28:51.617 INFO:tasks.workunit.client.0.smithi029.stdout:2/127: mkdir d3/d13/d2c 0 2024-04-15T00:28:51.754 INFO:tasks.workunit.client.0.smithi029.stdout:3/136: dwrite d17/f27 [0,4194304] 0 2024-04-15T00:28:51.830 INFO:tasks.workunit.client.0.smithi029.stdout:9/130: mknod d3/c2f 0 2024-04-15T00:28:51.838 INFO:tasks.workunit.client.0.smithi029.stdout:6/140: creat d1/d8/db/f2e x:0 0 0 2024-04-15T00:28:51.972 INFO:tasks.workunit.client.0.smithi029.stdout:7/118: mknod d0/d6/c2a 0 2024-04-15T00:28:51.982 INFO:tasks.workunit.client.0.smithi029.stdout:7/119: chown d0/d6/d1c/c17 751 1 2024-04-15T00:28:52.135 INFO:tasks.workunit.client.0.smithi029.stdout:4/146: rename de/df/d10 to de/d2b 0 2024-04-15T00:28:52.263 INFO:tasks.workunit.client.0.smithi029.stdout:9/131: fdatasync d3/d6/d9/d15/d21/f28 0 2024-04-15T00:28:52.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/143: link d2/de/d13/f32 d2/d1a/f33 0 2024-04-15T00:28:52.277 INFO:tasks.workunit.client.0.smithi029.stdout:7/120: truncate d0/f22 734122 0 2024-04-15T00:28:52.336 INFO:tasks.workunit.client.0.smithi029.stdout:7/121: chown d0/d6/c2a 308568124 1 2024-04-15T00:28:52.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/144: stat d2/de/d13/d22 0 2024-04-15T00:28:52.389 INFO:tasks.workunit.client.0.smithi029.stdout:1/144: rename fe to df/d32/f3b 0 2024-04-15T00:28:52.399 INFO:tasks.workunit.client.0.smithi029.stdout:8/130: dwrite f7 [4194304,4194304] 0 2024-04-15T00:28:52.467 INFO:tasks.workunit.client.0.smithi029.stdout:4/147: truncate f3 2988481 0 2024-04-15T00:28:52.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/132: mkdir d3/d6/d30 0 2024-04-15T00:28:52.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/145: dread - d2/de/f2e zero size 2024-04-15T00:28:52.776 INFO:tasks.workunit.client.0.smithi029.stdout:8/131: unlink d8/l20 0 2024-04-15T00:28:52.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/128: dwrite d3/d13/d14/f20 [4194304,4194304] 0 2024-04-15T00:28:52.826 INFO:tasks.workunit.client.0.smithi029.stdout:3/137: dwrite ff [0,4194304] 0 2024-04-15T00:28:52.946 INFO:tasks.workunit.client.0.smithi029.stdout:8/132: fdatasync d8/da/f27 0 2024-04-15T00:28:52.960 INFO:tasks.workunit.client.0.smithi029.stdout:4/148: creat de/d2b/f2c x:0 0 0 2024-04-15T00:28:52.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/133: mknod d3/d6/c31 0 2024-04-15T00:28:52.973 INFO:tasks.workunit.client.0.smithi029.stdout:0/153: rename d5/d15/d27/l31 to d5/d15/d27/d28/l34 0 2024-04-15T00:28:52.996 INFO:tasks.workunit.client.0.smithi029.stdout:2/129: chown d3/lc 479568615 1 2024-04-15T00:28:53.027 INFO:tasks.workunit.client.0.smithi029.stdout:8/133: truncate d8/f9 9372375 0 2024-04-15T00:28:53.201 INFO:tasks.workunit.client.0.smithi029.stdout:0/154: dwrite d5/db/f10 [0,4194304] 0 2024-04-15T00:28:53.270 INFO:tasks.workunit.client.0.smithi029.stdout:4/149: dwrite de/df/d1e/f29 [0,4194304] 0 2024-04-15T00:28:53.373 INFO:tasks.workunit.client.0.smithi029.stdout:5/146: write d2/d1a/f20 [641298,44470] 0 2024-04-15T00:28:53.402 INFO:tasks.workunit.client.0.smithi029.stdout:6/141: write d1/f1f [3124359,118431] 0 2024-04-15T00:28:53.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/147: chown d2/de/d1f 0 1 2024-04-15T00:28:53.471 INFO:tasks.workunit.client.0.smithi029.stdout:3/138: symlink d17/l31 0 2024-04-15T00:28:53.543 INFO:tasks.workunit.client.0.smithi029.stdout:9/134: fsync d3/f1b 0 2024-04-15T00:28:53.544 INFO:tasks.workunit.client.0.smithi029.stdout:8/134: mknod d8/da/c29 0 2024-04-15T00:28:53.565 INFO:tasks.workunit.client.0.smithi029.stdout:7/122: dwrite d0/d6/d16/f20 [0,4194304] 0 2024-04-15T00:28:53.571 INFO:tasks.workunit.client.0.smithi029.stdout:0/155: fsync f2 0 2024-04-15T00:28:53.682 INFO:tasks.workunit.client.0.smithi029.stdout:4/150: fdatasync de/f27 0 2024-04-15T00:28:53.722 INFO:tasks.workunit.client.0.smithi029.stdout:1/145: dread df/d32/f3b [0,4194304] 0 2024-04-15T00:28:53.768 INFO:tasks.workunit.client.0.smithi029.stdout:6/142: dread d1/d8/db/f24 [0,4194304] 0 2024-04-15T00:28:53.836 INFO:tasks.workunit.client.0.smithi029.stdout:3/139: read f3 [2781147,91751] 0 2024-04-15T00:28:54.036 INFO:tasks.workunit.client.0.smithi029.stdout:0/156: dread - d5/d15/d27/f2a zero size 2024-04-15T00:28:54.057 INFO:tasks.workunit.client.0.smithi029.stdout:2/130: dwrite d3/d13/f26 [0,4194304] 0 2024-04-15T00:28:54.130 INFO:tasks.workunit.client.0.smithi029.stdout:9/135: truncate d3/d6/f1a 239590 0 2024-04-15T00:28:54.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/146: creat df/f3c x:0 0 0 2024-04-15T00:28:54.161 INFO:tasks.workunit.client.0.smithi029.stdout:6/143: creat d1/f2f x:0 0 0 2024-04-15T00:28:54.248 INFO:tasks.workunit.client.0.smithi029.stdout:2/131: write d3/d13/d14/f20 [7101112,57865] 0 2024-04-15T00:28:54.252 INFO:tasks.workunit.client.0.smithi029.stdout:3/140: chown cd 18067 1 2024-04-15T00:28:54.307 INFO:tasks.workunit.client.0.smithi029.stdout:3/141: readlink l5 0 2024-04-15T00:28:54.308 INFO:tasks.workunit.client.0.smithi029.stdout:5/148: creat d2/f34 x:0 0 0 2024-04-15T00:28:54.311 INFO:tasks.workunit.client.0.smithi029.stdout:9/136: chown d3/d6/d9/d15/d21/l23 8 1 2024-04-15T00:28:54.358 INFO:tasks.workunit.client.0.smithi029.stdout:4/151: dread fd [0,4194304] 0 2024-04-15T00:28:54.378 INFO:tasks.workunit.client.0.smithi029.stdout:0/157: dread d5/d15/f1e [0,4194304] 0 2024-04-15T00:28:54.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/158: chown d5/d15/f1c 160139873 1 2024-04-15T00:28:54.433 INFO:tasks.workunit.client.0.smithi029.stdout:1/147: fdatasync df/f24 0 2024-04-15T00:28:54.474 INFO:tasks.workunit.client.0.smithi029.stdout:2/132: mkdir d3/dd/d2d 0 2024-04-15T00:28:54.474 INFO:tasks.workunit.client.0.smithi029.stdout:1/148: stat df/c1d 0 2024-04-15T00:28:54.499 INFO:tasks.workunit.client.0.smithi029.stdout:3/142: unlink d17/c22 0 2024-04-15T00:28:54.551 INFO:tasks.workunit.client.0.smithi029.stdout:7/123: dwrite d0/d6/d1c/fe [0,4194304] 0 2024-04-15T00:28:54.640 INFO:tasks.workunit.client.0.smithi029.stdout:9/137: creat d3/d6/d9/d15/d21/f32 x:0 0 0 2024-04-15T00:28:54.650 INFO:tasks.workunit.client.0.smithi029.stdout:5/149: dread - d2/de/d1f/f25 zero size 2024-04-15T00:28:54.751 INFO:tasks.workunit.client.0.smithi029.stdout:2/133: sync 2024-04-15T00:28:54.755 INFO:tasks.workunit.client.0.smithi029.stdout:0/159: symlink d5/d15/d27/d28/l35 0 2024-04-15T00:28:54.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/134: write d3/f9 [5809818,24904] 0 2024-04-15T00:28:54.798 INFO:tasks.workunit.client.0.smithi029.stdout:8/135: getdents d8/da 0 2024-04-15T00:28:54.830 INFO:tasks.workunit.client.0.smithi029.stdout:2/135: stat d3/la 0 2024-04-15T00:28:54.919 INFO:tasks.workunit.client.0.smithi029.stdout:2/136: sync 2024-04-15T00:28:54.923 INFO:tasks.workunit.client.0.smithi029.stdout:6/144: dwrite d1/d8/f29 [0,4194304] 0 2024-04-15T00:28:55.007 INFO:tasks.workunit.client.0.smithi029.stdout:7/124: creat d0/d6/d16/d26/f2b x:0 0 0 2024-04-15T00:28:55.020 INFO:tasks.workunit.client.0.smithi029.stdout:9/138: chown c1 10 1 2024-04-15T00:28:55.102 INFO:tasks.workunit.client.0.smithi029.stdout:7/125: dread d0/d6/d16/f20 [0,4194304] 0 2024-04-15T00:28:55.218 INFO:tasks.workunit.client.0.smithi029.stdout:3/143: write f1 [2784797,108490] 0 2024-04-15T00:28:55.320 INFO:tasks.workunit.client.0.smithi029.stdout:4/152: write f3 [1706733,32630] 0 2024-04-15T00:28:55.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/150: write d2/fa [1085177,5544] 0 2024-04-15T00:28:55.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/137: write d3/d13/d14/f1e [2054640,67015] 0 2024-04-15T00:28:55.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/138: truncate d3/f9 8600992 0 2024-04-15T00:28:55.644 INFO:tasks.workunit.client.0.smithi029.stdout:9/139: symlink d3/d6/d9/l33 0 2024-04-15T00:28:55.716 INFO:tasks.workunit.client.0.smithi029.stdout:7/126: fdatasync d0/f1f 0 2024-04-15T00:28:55.728 INFO:tasks.workunit.client.0.smithi029.stdout:7/127: dread - d0/d6/f18 zero size 2024-04-15T00:28:55.843 INFO:tasks.workunit.client.0.smithi029.stdout:3/144: read d17/f21 [231525,19078] 0 2024-04-15T00:28:55.854 INFO:tasks.workunit.client.0.smithi029.stdout:3/145: chown d17/f1d 0 1 2024-04-15T00:28:55.931 INFO:tasks.workunit.client.0.smithi029.stdout:4/153: rename fd to de/df/d1e/f2d 0 2024-04-15T00:28:56.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/136: truncate f7 4968651 0 2024-04-15T00:28:56.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/139: read d3/d13/f16 [4118272,36477] 0 2024-04-15T00:28:56.262 INFO:tasks.workunit.client.0.smithi029.stdout:2/140: write d3/d13/d14/f1e [1914564,14415] 0 2024-04-15T00:28:56.273 INFO:tasks.workunit.client.0.smithi029.stdout:2/141: chown d3/d2b 137328 1 2024-04-15T00:28:56.282 INFO:tasks.workunit.client.0.smithi029.stdout:2/142: readlink d3/l23 0 2024-04-15T00:28:56.287 INFO:tasks.workunit.client.0.smithi029.stdout:7/128: write d0/d6/d16/f20 [4544971,125047] 0 2024-04-15T00:28:56.410 INFO:tasks.workunit.client.0.smithi029.stdout:7/129: dread d0/d6/d1c/fe [0,4194304] 0 2024-04-15T00:28:56.422 INFO:tasks.workunit.client.0.smithi029.stdout:2/143: dwrite d3/f5 [4194304,4194304] 0 2024-04-15T00:28:56.435 INFO:tasks.workunit.client.0.smithi029.stdout:1/149: getdents df/d29 0 2024-04-15T00:28:56.504 INFO:tasks.workunit.client.0.smithi029.stdout:3/146: creat d17/d2a/f32 x:0 0 0 2024-04-15T00:28:56.512 INFO:tasks.workunit.client.0.smithi029.stdout:6/145: truncate d1/f1f 1203137 0 2024-04-15T00:28:56.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/147: sync 2024-04-15T00:28:56.802 INFO:tasks.workunit.client.0.smithi029.stdout:0/160: getdents d5/d15/d27/d28 0 2024-04-15T00:28:56.912 INFO:tasks.workunit.client.0.smithi029.stdout:5/151: truncate d2/fa 1068235 0 2024-04-15T00:28:56.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/154: write f2 [4763077,2204] 0 2024-04-15T00:28:56.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/137: write d8/da/f14 [2046101,128275] 0 2024-04-15T00:28:57.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/146: mknod d1/c30 0 2024-04-15T00:28:57.126 INFO:tasks.workunit.client.0.smithi029.stdout:2/144: symlink d3/d13/d14/l2e 0 2024-04-15T00:28:57.140 INFO:tasks.workunit.client.0.smithi029.stdout:1/150: truncate fd 690065 0 2024-04-15T00:28:57.146 INFO:tasks.workunit.client.0.smithi029.stdout:3/148: fsync d17/f24 0 2024-04-15T00:28:57.148 INFO:tasks.workunit.client.0.smithi029.stdout:9/140: link d3/d6/d9/d15/d21/f32 d3/f34 0 2024-04-15T00:28:57.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/161: readlink d5/d15/d1f/l2e 0 2024-04-15T00:28:57.239 INFO:tasks.workunit.client.0.smithi029.stdout:2/145: dread d3/d13/d14/f1e [0,4194304] 0 2024-04-15T00:28:57.257 INFO:tasks.workunit.client.0.smithi029.stdout:2/146: write d3/d13/d14/f1e [1040584,36721] 0 2024-04-15T00:28:57.277 INFO:tasks.workunit.client.0.smithi029.stdout:2/147: write d3/f9 [8657519,88185] 0 2024-04-15T00:28:57.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/138: truncate d8/da/ff 4734054 0 2024-04-15T00:28:57.351 INFO:tasks.workunit.client.0.smithi029.stdout:5/152: creat d2/de/d13/d22/d26/f35 x:0 0 0 2024-04-15T00:28:57.443 INFO:tasks.workunit.client.0.smithi029.stdout:6/147: creat d1/f31 x:0 0 0 2024-04-15T00:28:57.457 INFO:tasks.workunit.client.0.smithi029.stdout:6/148: chown d1/d1e/l25 61807673 1 2024-04-15T00:28:57.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/149: readlink d1/d1e/l2c 0 2024-04-15T00:28:57.538 INFO:tasks.workunit.client.0.smithi029.stdout:1/151: symlink df/d32/l3d 0 2024-04-15T00:28:57.544 INFO:tasks.workunit.client.0.smithi029.stdout:1/152: chown df/c1f 1770 1 2024-04-15T00:28:57.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/141: mkdir d3/d6/d9/d35 0 2024-04-15T00:28:57.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/148: truncate d3/d13/f28 1008892 0 2024-04-15T00:28:57.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/149: write d3/f5 [3486857,88329] 0 2024-04-15T00:28:57.706 INFO:tasks.workunit.client.0.smithi029.stdout:2/150: stat d3/d13/d14/l17 0 2024-04-15T00:28:57.795 INFO:tasks.workunit.client.0.smithi029.stdout:7/130: creat d0/d6/f2c x:0 0 0 2024-04-15T00:28:57.817 INFO:tasks.workunit.client.0.smithi029.stdout:7/131: stat d0/c1d 0 2024-04-15T00:28:57.898 INFO:tasks.workunit.client.0.smithi029.stdout:3/149: dwrite f15 [0,4194304] 0 2024-04-15T00:28:58.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/153: creat df/f3e x:0 0 0 2024-04-15T00:28:58.116 INFO:tasks.workunit.client.0.smithi029.stdout:0/162: symlink d5/d15/d27/l36 0 2024-04-15T00:28:58.130 INFO:tasks.workunit.client.0.smithi029.stdout:4/155: creat de/f2e x:0 0 0 2024-04-15T00:28:58.145 INFO:tasks.workunit.client.0.smithi029.stdout:0/163: fsync d5/db/f10 0 2024-04-15T00:28:58.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/156: chown de/l20 3019047 1 2024-04-15T00:28:58.187 INFO:tasks.workunit.client.0.smithi029.stdout:3/150: mkdir d17/d2a/d33 0 2024-04-15T00:28:58.203 INFO:tasks.workunit.client.0.smithi029.stdout:3/151: write d17/d2a/f32 [1000961,20766] 0 2024-04-15T00:28:58.246 INFO:tasks.workunit.client.0.smithi029.stdout:9/142: creat d3/d6/d9/d35/f36 x:0 0 0 2024-04-15T00:28:58.407 INFO:tasks.workunit.client.0.smithi029.stdout:1/154: creat df/d32/f3f x:0 0 0 2024-04-15T00:28:58.436 INFO:tasks.workunit.client.0.smithi029.stdout:9/143: fdatasync d3/d6/d9/d15/f1f 0 2024-04-15T00:28:58.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/152: read - d17/f26 zero size 2024-04-15T00:28:58.634 INFO:tasks.workunit.client.0.smithi029.stdout:6/150: write d1/f6 [890788,54849] 0 2024-04-15T00:28:58.787 INFO:tasks.workunit.client.0.smithi029.stdout:2/151: creat d3/d13/f2f x:0 0 0 2024-04-15T00:28:58.837 INFO:tasks.workunit.client.0.smithi029.stdout:4/157: mknod de/c2f 0 2024-04-15T00:28:58.845 INFO:tasks.workunit.client.0.smithi029.stdout:1/155: symlink df/l40 0 2024-04-15T00:28:58.849 INFO:tasks.workunit.client.0.smithi029.stdout:5/153: dwrite d2/f17 [0,4194304] 0 2024-04-15T00:28:58.935 INFO:tasks.workunit.client.0.smithi029.stdout:3/153: creat d17/d2a/f34 x:0 0 0 2024-04-15T00:28:58.955 INFO:tasks.workunit.client.0.smithi029.stdout:9/144: rename d3/d6/d9/lc to d3/d6/d9/d29/l37 0 2024-04-15T00:28:58.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/139: dwrite d8/f15 [0,4194304] 0 2024-04-15T00:28:59.052 INFO:tasks.workunit.client.0.smithi029.stdout:5/154: chown d2/l3 850 1 2024-04-15T00:28:59.060 INFO:tasks.workunit.client.0.smithi029.stdout:5/155: readlink d2/l3 0 2024-04-15T00:28:59.125 INFO:tasks.workunit.client.0.smithi029.stdout:0/164: write d5/f13 [2289101,109115] 0 2024-04-15T00:28:59.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/132: getdents d0/d6/d16/d26 0 2024-04-15T00:28:59.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:59.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:28:59.439 INFO:tasks.workunit.client.0.smithi029.stdout:1/156: rmdir df/d29 39 2024-04-15T00:28:59.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/154: creat d17/d2a/f35 x:0 0 0 2024-04-15T00:28:59.457 INFO:tasks.workunit.client.0.smithi029.stdout:9/145: symlink d3/d6/l38 0 2024-04-15T00:28:59.475 INFO:tasks.workunit.client.0.smithi029.stdout:5/156: rename d2/d1a/d31 to d2/de/d13/d22/d26/d36 0 2024-04-15T00:28:59.480 INFO:tasks.workunit.client.0.smithi029.stdout:8/140: creat d8/dc/f2a x:0 0 0 2024-04-15T00:28:59.514 INFO:tasks.workunit.client.0.smithi029.stdout:8/141: stat d8/dc/l19 0 2024-04-15T00:28:59.555 INFO:tasks.workunit.client.0.smithi029.stdout:3/155: dread d17/d2a/f32 [0,4194304] 0 2024-04-15T00:28:59.678 INFO:tasks.workunit.client.0.smithi029.stdout:7/133: mknod d0/d6/d16/c2d 0 2024-04-15T00:28:59.706 INFO:tasks.workunit.client.0.smithi029.stdout:3/156: sync 2024-04-15T00:28:59.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/151: truncate d1/d8/f29 3509305 0 2024-04-15T00:28:59.961 INFO:tasks.workunit.client.0.smithi029.stdout:8/142: creat d8/f2b x:0 0 0 2024-04-15T00:29:00.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/157: truncate d17/f1b 5508423 0 2024-04-15T00:29:00.079 INFO:tasks.workunit.client.0.smithi029.stdout:9/146: mknod d3/c39 0 2024-04-15T00:29:00.085 INFO:tasks.workunit.client.0.smithi029.stdout:1/157: mkdir df/d29/d41 0 2024-04-15T00:29:00.125 INFO:tasks.workunit.client.0.smithi029.stdout:3/158: chown d17/f1d 4079 1 2024-04-15T00:29:00.157 INFO:tasks.workunit.client.0.smithi029.stdout:1/158: chown df/d32/f35 26 1 2024-04-15T00:29:00.160 INFO:tasks.workunit.client.0.smithi029.stdout:2/152: getdents d3/d13 0 2024-04-15T00:29:00.191 INFO:tasks.workunit.client.0.smithi029.stdout:4/158: getdents de/df/d1e 0 2024-04-15T00:29:00.245 INFO:tasks.workunit.client.0.smithi029.stdout:6/152: dread d1/d8/db/fe [0,4194304] 0 2024-04-15T00:29:00.277 INFO:tasks.workunit.client.0.smithi029.stdout:4/159: chown de/df/d1e/f28 1235504 1 2024-04-15T00:29:00.327 INFO:tasks.workunit.client.0.smithi029.stdout:4/160: stat de/df/d1e/l26 0 2024-04-15T00:29:00.370 INFO:tasks.workunit.client.0.smithi029.stdout:8/143: creat d8/f2c x:0 0 0 2024-04-15T00:29:00.407 INFO:tasks.workunit.client.0.smithi029.stdout:0/165: creat d5/db/f37 x:0 0 0 2024-04-15T00:29:00.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/134: mknod d0/c2e 0 2024-04-15T00:29:00.418 INFO:tasks.workunit.client.0.smithi029.stdout:2/153: dread d3/d13/f16 [0,4194304] 0 2024-04-15T00:29:00.429 INFO:tasks.workunit.client.0.smithi029.stdout:4/161: chown de/df/d1e/f22 384960177 1 2024-04-15T00:29:00.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/135: stat d0/c15 0 2024-04-15T00:29:00.547 INFO:tasks.workunit.client.0.smithi029.stdout:9/147: creat d3/d6/d9/d35/f3a x:0 0 0 2024-04-15T00:29:00.620 INFO:tasks.workunit.client.0.smithi029.stdout:3/159: creat d17/d2a/f36 x:0 0 0 2024-04-15T00:29:00.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/159: truncate df/d32/f39 497406 0 2024-04-15T00:29:00.715 INFO:tasks.workunit.client.0.smithi029.stdout:1/160: readlink df/l26 0 2024-04-15T00:29:00.773 INFO:tasks.workunit.client.0.smithi029.stdout:5/157: write d2/d1a/f2c [75008,114247] 0 2024-04-15T00:29:00.787 INFO:tasks.workunit.client.0.smithi029.stdout:5/158: chown d2/f34 118 1 2024-04-15T00:29:00.794 INFO:tasks.workunit.client.0.smithi029.stdout:0/166: symlink d5/d15/d1f/l38 0 2024-04-15T00:29:00.885 INFO:tasks.workunit.client.0.smithi029.stdout:4/162: creat de/d2b/f30 x:0 0 0 2024-04-15T00:29:00.988 INFO:tasks.workunit.client.0.smithi029.stdout:9/148: rmdir d3 39 2024-04-15T00:29:01.203 INFO:tasks.workunit.client.0.smithi029.stdout:5/159: fdatasync d2/d1a/f33 0 2024-04-15T00:29:01.307 INFO:tasks.workunit.client.0.smithi029.stdout:7/136: fsync d0/f22 0 2024-04-15T00:29:01.317 INFO:tasks.workunit.client.0.smithi029.stdout:7/137: stat d0/d6/f2c 0 2024-04-15T00:29:01.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/138: readlink d0/d6/l27 0 2024-04-15T00:29:01.330 INFO:tasks.workunit.client.0.smithi029.stdout:7/139: stat d0/d6/d1c/fe 0 2024-04-15T00:29:01.350 INFO:tasks.workunit.client.0.smithi029.stdout:4/163: symlink de/df/d1e/l31 0 2024-04-15T00:29:01.475 INFO:tasks.workunit.client.0.smithi029.stdout:3/160: mkdir d17/d2a/d33/d37 0 2024-04-15T00:29:01.484 INFO:tasks.workunit.client.0.smithi029.stdout:3/161: fsync d17/d2a/f34 0 2024-04-15T00:29:01.689 INFO:tasks.workunit.client.0.smithi029.stdout:5/160: dread d2/f11 [0,4194304] 0 2024-04-15T00:29:01.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/153: dwrite d1/f1c [0,4194304] 0 2024-04-15T00:29:01.852 INFO:tasks.workunit.client.0.smithi029.stdout:3/162: fsync d17/f20 0 2024-04-15T00:29:01.944 INFO:tasks.workunit.client.0.smithi029.stdout:7/140: dread d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:29:01.944 INFO:tasks.workunit.client.0.smithi029.stdout:5/161: creat d2/de/d13/d22/d26/d36/f37 x:0 0 0 2024-04-15T00:29:01.970 INFO:tasks.workunit.client.0.smithi029.stdout:9/149: dread d3/d6/f13 [0,4194304] 0 2024-04-15T00:29:02.014 INFO:tasks.workunit.client.0.smithi029.stdout:7/141: dread - d0/d6/f18 zero size 2024-04-15T00:29:02.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/142: stat d0/f22 0 2024-04-15T00:29:02.046 INFO:tasks.workunit.client.0.smithi029.stdout:2/154: dwrite d3/d13/f26 [0,4194304] 0 2024-04-15T00:29:02.112 INFO:tasks.workunit.client.0.smithi029.stdout:8/144: symlink d8/l2d 0 2024-04-15T00:29:02.117 INFO:tasks.workunit.client.0.smithi029.stdout:3/163: truncate f0 1969655 0 2024-04-15T00:29:02.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/150: fsync d3/d6/f17 0 2024-04-15T00:29:02.173 INFO:tasks.workunit.client.0.smithi029.stdout:7/143: stat d0/d6/d16/d26/f28 0 2024-04-15T00:29:02.184 INFO:tasks.workunit.client.0.smithi029.stdout:3/164: dread - d17/d2a/f35 zero size 2024-04-15T00:29:02.233 INFO:tasks.workunit.client.0.smithi029.stdout:8/145: dread d8/f15 [0,4194304] 0 2024-04-15T00:29:02.247 INFO:tasks.workunit.client.0.smithi029.stdout:0/167: write d5/d15/d27/f2d [1013765,123121] 0 2024-04-15T00:29:02.260 INFO:tasks.workunit.client.0.smithi029.stdout:7/144: dread d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:29:02.279 INFO:tasks.workunit.client.0.smithi029.stdout:7/145: readlink d0/d6/l10 0 2024-04-15T00:29:02.381 INFO:tasks.workunit.client.0.smithi029.stdout:0/168: dwrite d5/db/f37 [0,4194304] 0 2024-04-15T00:29:02.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/146: sync 2024-04-15T00:29:02.448 INFO:tasks.workunit.client.0.smithi029.stdout:5/162: rename d2/d1a/f33 to d2/de/d13/d22/d26/d36/f38 0 2024-04-15T00:29:02.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/169: chown d5/db/f19 506083 1 2024-04-15T00:29:02.544 INFO:tasks.workunit.client.0.smithi029.stdout:2/155: creat d3/dd/f30 x:0 0 0 2024-04-15T00:29:02.547 INFO:tasks.workunit.client.0.smithi029.stdout:9/151: dread - d3/f1b zero size 2024-04-15T00:29:02.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/164: write de/d2b/f2c [112265,9936] 0 2024-04-15T00:29:02.577 INFO:tasks.workunit.client.0.smithi029.stdout:9/152: chown d3/d6/f17 3494 1 2024-04-15T00:29:02.673 INFO:tasks.workunit.client.0.smithi029.stdout:8/147: mknod d8/da/c2e 0 2024-04-15T00:29:02.697 INFO:tasks.workunit.client.0.smithi029.stdout:9/153: dread - d3/d6/d9/d15/d21/f28 zero size 2024-04-15T00:29:02.744 INFO:tasks.workunit.client.0.smithi029.stdout:5/163: mknod d2/de/d13/d22/d26/c39 0 2024-04-15T00:29:02.778 INFO:tasks.workunit.client.0.smithi029.stdout:9/154: stat d3/d6/d9/d15 0 2024-04-15T00:29:02.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/156: dread d3/f9 [0,4194304] 0 2024-04-15T00:29:02.797 INFO:tasks.workunit.client.0.smithi029.stdout:3/165: mknod d17/d2a/d33/d37/c38 0 2024-04-15T00:29:02.806 INFO:tasks.workunit.client.0.smithi029.stdout:9/155: read - d3/f34 zero size 2024-04-15T00:29:02.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/161: creat df/f42 x:0 0 0 2024-04-15T00:29:02.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/165: mknod de/d2b/c32 0 2024-04-15T00:29:03.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/148: mkdir d8/da/d2f 0 2024-04-15T00:29:03.103 INFO:tasks.workunit.client.0.smithi029.stdout:6/154: rmdir d1 39 2024-04-15T00:29:03.137 INFO:tasks.workunit.client.0.smithi029.stdout:5/164: symlink d2/de/d1f/l3a 0 2024-04-15T00:29:03.147 INFO:tasks.workunit.client.0.smithi029.stdout:5/165: fdatasync d2/d1a/f1b 0 2024-04-15T00:29:03.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/166: write d2/de/d13/d22/d26/d36/f37 [255503,33897] 0 2024-04-15T00:29:03.405 INFO:tasks.workunit.client.0.smithi029.stdout:1/162: truncate df/f15 842539 0 2024-04-15T00:29:03.406 INFO:tasks.workunit.client.0.smithi029.stdout:0/170: write f2 [1698916,124089] 0 2024-04-15T00:29:03.437 INFO:tasks.workunit.client.0.smithi029.stdout:4/166: rename de/d2b/c23 to de/d2b/c33 0 2024-04-15T00:29:03.521 INFO:tasks.workunit.client.0.smithi029.stdout:7/146: rename d0/d6/d16/f20 to d0/d6/f2f 0 2024-04-15T00:29:03.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/155: dread d1/f6 [0,4194304] 0 2024-04-15T00:29:03.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/156: chown d1/d8 547 1 2024-04-15T00:29:03.764 INFO:tasks.workunit.client.0.smithi029.stdout:9/156: mkdir d3/d6/d30/d3b 0 2024-04-15T00:29:03.818 INFO:tasks.workunit.client.0.smithi029.stdout:1/163: unlink df/l23 0 2024-04-15T00:29:03.819 INFO:tasks.workunit.client.0.smithi029.stdout:1/164: readlink df/l40 0 2024-04-15T00:29:03.987 INFO:tasks.workunit.client.0.smithi029.stdout:7/147: fdatasync d0/d6/f8 0 2024-04-15T00:29:04.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/149: mkdir d8/dc/d23/d28/d30 0 2024-04-15T00:29:04.064 INFO:tasks.workunit.client.0.smithi029.stdout:7/148: chown d0/d6/d1c/f1b 58833872 1 2024-04-15T00:29:04.124 INFO:tasks.workunit.client.0.smithi029.stdout:3/166: dwrite f16 [4194304,4194304] 0 2024-04-15T00:29:04.289 INFO:tasks.workunit.client.0.smithi029.stdout:2/157: rmdir d3/d13/d2c 0 2024-04-15T00:29:04.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/167: truncate d2/fb 1853191 0 2024-04-15T00:29:04.318 INFO:tasks.workunit.client.0.smithi029.stdout:1/165: fsync df/f3c 0 2024-04-15T00:29:04.386 INFO:tasks.workunit.client.0.smithi029.stdout:4/167: symlink de/df/l34 0 2024-04-15T00:29:04.606 INFO:tasks.workunit.client.0.smithi029.stdout:3/167: rmdir d17/d2a 39 2024-04-15T00:29:04.644 INFO:tasks.workunit.client.0.smithi029.stdout:9/157: mkdir d3/d6/d30/d3b/d3c 0 2024-04-15T00:29:04.741 INFO:tasks.workunit.client.0.smithi029.stdout:3/168: sync 2024-04-15T00:29:04.797 INFO:tasks.workunit.client.0.smithi029.stdout:5/168: creat d2/de/d1f/f3b x:0 0 0 2024-04-15T00:29:04.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/166: mkdir df/d32/d43 0 2024-04-15T00:29:04.898 INFO:tasks.workunit.client.0.smithi029.stdout:4/168: rmdir de/df 39 2024-04-15T00:29:04.966 INFO:tasks.workunit.client.0.smithi029.stdout:9/158: symlink d3/d6/l3d 0 2024-04-15T00:29:05.162 INFO:tasks.workunit.client.0.smithi029.stdout:3/169: rmdir d17/d2f 39 2024-04-15T00:29:05.231 INFO:tasks.workunit.client.0.smithi029.stdout:5/169: dread d2/f17 [0,4194304] 0 2024-04-15T00:29:05.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/169: mkdir de/d2b/d35 0 2024-04-15T00:29:05.402 INFO:tasks.workunit.client.0.smithi029.stdout:0/171: truncate d5/db/f37 537557 0 2024-04-15T00:29:05.442 INFO:tasks.workunit.client.0.smithi029.stdout:0/172: dread - d5/d15/d27/f2a zero size 2024-04-15T00:29:05.488 INFO:tasks.workunit.client.0.smithi029.stdout:5/170: mkdir d2/de/d13/d22/d3c 0 2024-04-15T00:29:05.541 INFO:tasks.workunit.client.0.smithi029.stdout:7/149: write d0/d6/d1c/fe [1566164,128720] 0 2024-04-15T00:29:05.694 INFO:tasks.workunit.client.0.smithi029.stdout:3/170: creat d17/d2f/f39 x:0 0 0 2024-04-15T00:29:05.706 INFO:tasks.workunit.client.0.smithi029.stdout:8/150: dwrite d8/da/f14 [0,4194304] 0 2024-04-15T00:29:05.787 INFO:tasks.workunit.client.0.smithi029.stdout:2/158: rename d3/d13/d14/f1c to d3/dd/f31 0 2024-04-15T00:29:05.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/173: unlink d5/db/d1a/l1d 0 2024-04-15T00:29:05.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/157: dwrite d1/d8/db/f23 [0,4194304] 0 2024-04-15T00:29:05.935 INFO:tasks.workunit.client.0.smithi029.stdout:5/171: symlink d2/de/d13/d22/d26/l3d 0 2024-04-15T00:29:06.032 INFO:tasks.workunit.client.0.smithi029.stdout:7/150: symlink d0/d6/d16/d26/l30 0 2024-04-15T00:29:06.338 INFO:tasks.workunit.client.0.smithi029.stdout:9/159: dwrite d3/d6/d9/d15/d21/f32 [0,4194304] 0 2024-04-15T00:29:06.400 INFO:tasks.workunit.client.0.smithi029.stdout:3/171: unlink f16 0 2024-04-15T00:29:06.414 INFO:tasks.workunit.client.0.smithi029.stdout:2/159: creat d3/f32 x:0 0 0 2024-04-15T00:29:06.428 INFO:tasks.workunit.client.0.smithi029.stdout:3/172: dread - d17/f26 zero size 2024-04-15T00:29:06.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/160: stat d3/d13/d14/l2e 0 2024-04-15T00:29:06.489 INFO:tasks.workunit.client.0.smithi029.stdout:8/151: unlink d8/da/f27 0 2024-04-15T00:29:06.536 INFO:tasks.workunit.client.0.smithi029.stdout:0/174: truncate d5/d15/f1e 731009 0 2024-04-15T00:29:06.575 INFO:tasks.workunit.client.0.smithi029.stdout:5/172: creat d2/d1a/f3e x:0 0 0 2024-04-15T00:29:06.954 INFO:tasks.workunit.client.0.smithi029.stdout:8/152: symlink d8/da/l31 0 2024-04-15T00:29:06.997 INFO:tasks.workunit.client.0.smithi029.stdout:6/158: unlink d1/d8/f29 0 2024-04-15T00:29:07.114 INFO:tasks.workunit.client.0.smithi029.stdout:5/173: fdatasync d2/de/f23 0 2024-04-15T00:29:07.169 INFO:tasks.workunit.client.0.smithi029.stdout:1/167: dread df/f15 [0,4194304] 0 2024-04-15T00:29:07.403 INFO:tasks.workunit.client.0.smithi029.stdout:2/161: symlink d3/d2a/l33 0 2024-04-15T00:29:07.488 INFO:tasks.workunit.client.0.smithi029.stdout:6/159: write d1/f1f [4420331,54919] 0 2024-04-15T00:29:07.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/174: truncate d2/de/d13/f2f 939891 0 2024-04-15T00:29:07.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/170: getdents de/df 0 2024-04-15T00:29:07.844 INFO:tasks.workunit.client.0.smithi029.stdout:3/173: link lc d17/d2f/l3a 0 2024-04-15T00:29:07.845 INFO:tasks.workunit.client.0.smithi029.stdout:9/160: creat d3/f3e x:0 0 0 2024-04-15T00:29:08.000 INFO:tasks.workunit.client.0.smithi029.stdout:7/151: link d0/d6/d1c/l3 d0/d6/l31 0 2024-04-15T00:29:08.151 INFO:tasks.workunit.client.0.smithi029.stdout:0/175: dwrite d5/db/f29 [0,4194304] 0 2024-04-15T00:29:08.305 INFO:tasks.workunit.client.0.smithi029.stdout:9/161: dread - d3/d6/d9/d15/d21/f2a zero size 2024-04-15T00:29:08.543 INFO:tasks.workunit.client.0.smithi029.stdout:3/174: rename d17/f27 to d17/d2a/d33/f3b 0 2024-04-15T00:29:08.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/162: creat d3/d6/d9/d29/f3f x:0 0 0 2024-04-15T00:29:08.779 INFO:tasks.workunit.client.0.smithi029.stdout:8/153: write d8/da/f1e [620202,103060] 0 2024-04-15T00:29:08.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/152: write d0/d6/d16/d26/f2b [321766,111949] 0 2024-04-15T00:29:08.830 INFO:tasks.workunit.client.0.smithi029.stdout:5/175: write d2/f8 [5056082,93363] 0 2024-04-15T00:29:08.835 INFO:tasks.workunit.client.0.smithi029.stdout:1/168: write df/d32/f39 [184545,29595] 0 2024-04-15T00:29:08.841 INFO:tasks.workunit.client.0.smithi029.stdout:4/171: write de/f19 [3904311,77669] 0 2024-04-15T00:29:08.843 INFO:tasks.workunit.client.0.smithi029.stdout:3/175: mkdir d17/d2f/d3c 0 2024-04-15T00:29:08.858 INFO:tasks.workunit.client.0.smithi029.stdout:2/162: write d3/d13/f16 [150662,75129] 0 2024-04-15T00:29:08.950 INFO:tasks.workunit.client.0.smithi029.stdout:2/163: readlink d3/la 0 2024-04-15T00:29:08.987 INFO:tasks.workunit.client.0.smithi029.stdout:4/172: dread - de/df/d1e/f24 zero size 2024-04-15T00:29:09.024 INFO:tasks.workunit.client.0.smithi029.stdout:6/160: dwrite d1/d8/db/f11 [4194304,4194304] 0 2024-04-15T00:29:09.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/176: truncate d5/db/f37 377483 0 2024-04-15T00:29:09.117 INFO:tasks.workunit.client.0.smithi029.stdout:2/164: sync 2024-04-15T00:29:09.119 INFO:tasks.workunit.client.0.smithi029.stdout:5/176: creat d2/de/d13/d22/f3f x:0 0 0 2024-04-15T00:29:09.139 INFO:tasks.workunit.client.0.smithi029.stdout:9/163: link d3/d6/d9/ca d3/d6/d30/d3b/d3c/c40 0 2024-04-15T00:29:09.287 INFO:tasks.workunit.client.0.smithi029.stdout:8/154: mknod d8/dc/d23/d28/d30/c32 0 2024-04-15T00:29:09.289 INFO:tasks.workunit.client.0.smithi029.stdout:3/176: fdatasync fa 0 2024-04-15T00:29:09.331 INFO:tasks.workunit.client.0.smithi029.stdout:1/169: creat df/d32/d43/f44 x:0 0 0 2024-04-15T00:29:09.491 INFO:tasks.workunit.client.0.smithi029.stdout:2/165: dread - d3/d13/f2f zero size 2024-04-15T00:29:09.633 INFO:tasks.workunit.client.0.smithi029.stdout:6/161: rename d1/d8/db/ff to d1/d1e/f32 0 2024-04-15T00:29:09.676 INFO:tasks.workunit.client.0.smithi029.stdout:9/164: dread d3/d6/f1a [0,4194304] 0 2024-04-15T00:29:09.780 INFO:tasks.workunit.client.0.smithi029.stdout:7/153: dwrite d0/d6/d16/d26/f28 [0,4194304] 0 2024-04-15T00:29:09.851 INFO:tasks.workunit.client.0.smithi029.stdout:4/173: mknod de/d2b/d35/c36 0 2024-04-15T00:29:09.971 INFO:tasks.workunit.client.0.smithi029.stdout:2/166: truncate d3/dd/f30 813138 0 2024-04-15T00:29:10.007 INFO:tasks.workunit.client.0.smithi029.stdout:6/162: creat d1/d1e/f33 x:0 0 0 2024-04-15T00:29:10.087 INFO:tasks.workunit.client.0.smithi029.stdout:0/177: dwrite d5/db/f19 [4194304,4194304] 0 2024-04-15T00:29:10.161 INFO:tasks.workunit.client.0.smithi029.stdout:8/155: write d8/f15 [4592530,116453] 0 2024-04-15T00:29:10.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/170: creat df/d29/d41/f45 x:0 0 0 2024-04-15T00:29:10.186 INFO:tasks.workunit.client.0.smithi029.stdout:4/174: symlink de/df/d1e/l37 0 2024-04-15T00:29:10.224 INFO:tasks.workunit.client.0.smithi029.stdout:8/156: fsync d8/da/f14 0 2024-04-15T00:29:10.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/178: read d5/db/f19 [8004517,69252] 0 2024-04-15T00:29:10.281 INFO:tasks.workunit.client.0.smithi029.stdout:1/171: dread df/f15 [0,4194304] 0 2024-04-15T00:29:10.305 INFO:tasks.workunit.client.0.smithi029.stdout:8/157: chown d8/dc/d23/d28/d30/c32 628997313 1 2024-04-15T00:29:10.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/163: dread d1/f6 [0,4194304] 0 2024-04-15T00:29:10.332 INFO:tasks.workunit.client.0.smithi029.stdout:3/177: link d17/d2a/l2b d17/d2a/l3d 0 2024-04-15T00:29:10.375 INFO:tasks.workunit.client.0.smithi029.stdout:0/179: sync 2024-04-15T00:29:10.417 INFO:tasks.workunit.client.0.smithi029.stdout:9/165: unlink d3/c14 0 2024-04-15T00:29:10.464 INFO:tasks.workunit.client.0.smithi029.stdout:5/177: getdents d2 0 2024-04-15T00:29:10.950 INFO:tasks.workunit.client.0.smithi029.stdout:2/167: fdatasync d3/d13/f28 0 2024-04-15T00:29:11.306 INFO:tasks.workunit.client.0.smithi029.stdout:1/172: truncate df/f1c 806963 0 2024-04-15T00:29:11.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/158: mknod d8/da/c33 0 2024-04-15T00:29:11.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/178: unlink d2/de/d1f/f25 0 2024-04-15T00:29:11.345 INFO:tasks.workunit.client.0.smithi029.stdout:9/166: readlink d3/d6/d9/d29/l37 0 2024-04-15T00:29:11.391 INFO:tasks.workunit.client.0.smithi029.stdout:3/178: dread d17/f24 [0,4194304] 0 2024-04-15T00:29:11.401 INFO:tasks.workunit.client.0.smithi029.stdout:9/167: read d3/d6/f1a [227865,106691] 0 2024-04-15T00:29:11.909 INFO:tasks.workunit.client.0.smithi029.stdout:4/175: link de/df/d1e/l26 de/df/l38 0 2024-04-15T00:29:11.943 INFO:tasks.workunit.client.0.smithi029.stdout:2/168: creat d3/dd/d2d/f34 x:0 0 0 2024-04-15T00:29:11.979 INFO:tasks.workunit.client.0.smithi029.stdout:6/164: link d1/f31 d1/d1e/d22/f34 0 2024-04-15T00:29:12.080 INFO:tasks.workunit.client.0.smithi029.stdout:8/159: truncate d8/da/f14 820856 0 2024-04-15T00:29:12.200 INFO:tasks.workunit.client.0.smithi029.stdout:9/168: mkdir d3/d41 0 2024-04-15T00:29:12.225 INFO:tasks.workunit.client.0.smithi029.stdout:0/180: dwrite d5/d15/f1c [0,4194304] 0 2024-04-15T00:29:12.292 INFO:tasks.workunit.client.0.smithi029.stdout:4/176: symlink de/d2b/d35/l39 0 2024-04-15T00:29:12.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/165: creat d1/d8/db/f35 x:0 0 0 2024-04-15T00:29:12.349 INFO:tasks.workunit.client.0.smithi029.stdout:2/169: write d3/f32 [434486,113767] 0 2024-04-15T00:29:12.376 INFO:tasks.workunit.client.0.smithi029.stdout:8/160: dread - d8/f2c zero size 2024-04-15T00:29:12.442 INFO:tasks.workunit.client.0.smithi029.stdout:9/169: rmdir d3/d6/d30/d3b/d3c 39 2024-04-15T00:29:12.557 INFO:tasks.workunit.client.0.smithi029.stdout:7/154: symlink d0/d6/l32 0 2024-04-15T00:29:12.644 INFO:tasks.workunit.client.0.smithi029.stdout:1/173: getdents df/d29/d41 0 2024-04-15T00:29:12.701 INFO:tasks.workunit.client.0.smithi029.stdout:2/170: stat d3/d13/l19 0 2024-04-15T00:29:12.701 INFO:tasks.workunit.client.0.smithi029.stdout:6/166: unlink d1/d8/db/f35 0 2024-04-15T00:29:12.730 INFO:tasks.workunit.client.0.smithi029.stdout:8/161: symlink d8/dc/d23/d28/l34 0 2024-04-15T00:29:12.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/167: dread d1/d8/db/f11 [0,4194304] 0 2024-04-15T00:29:12.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/155: creat d0/d6/d16/d26/f33 x:0 0 0 2024-04-15T00:29:13.056 INFO:tasks.workunit.client.0.smithi029.stdout:5/179: dwrite d2/de/d13/f2a [0,4194304] 0 2024-04-15T00:29:13.130 INFO:tasks.workunit.client.0.smithi029.stdout:8/162: symlink d8/l35 0 2024-04-15T00:29:13.142 INFO:tasks.workunit.client.0.smithi029.stdout:6/168: rmdir d1/d1e/d22 39 2024-04-15T00:29:13.267 INFO:tasks.workunit.client.0.smithi029.stdout:2/171: dread d3/dd/f31 [0,4194304] 0 2024-04-15T00:29:13.307 INFO:tasks.workunit.client.0.smithi029.stdout:3/179: dwrite d17/d2a/f36 [0,4194304] 0 2024-04-15T00:29:13.392 INFO:tasks.workunit.client.0.smithi029.stdout:5/180: creat d2/de/d13/d22/f40 x:0 0 0 2024-04-15T00:29:13.433 INFO:tasks.workunit.client.0.smithi029.stdout:6/169: mknod d1/c36 0 2024-04-15T00:29:13.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/170: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:29:13.517 INFO:tasks.workunit.client.0.smithi029.stdout:7/156: mknod d0/d6/c34 0 2024-04-15T00:29:13.636 INFO:tasks.workunit.client.0.smithi029.stdout:2/172: creat d3/dd/f35 x:0 0 0 2024-04-15T00:29:13.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/181: write d5/db/f10 [1113333,49246] 0 2024-04-15T00:29:13.668 INFO:tasks.workunit.client.0.smithi029.stdout:7/157: sync 2024-04-15T00:29:13.680 INFO:tasks.workunit.client.0.smithi029.stdout:8/163: unlink f6 0 2024-04-15T00:29:13.815 INFO:tasks.workunit.client.0.smithi029.stdout:3/180: truncate d17/d2a/f32 2049505 0 2024-04-15T00:29:13.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/171: creat d1/d8/db/f37 x:0 0 0 2024-04-15T00:29:13.903 INFO:tasks.workunit.client.0.smithi029.stdout:9/170: dwrite d3/d6/f12 [0,4194304] 0 2024-04-15T00:29:13.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/158: mknod d0/d6/d1c/c35 0 2024-04-15T00:29:14.024 INFO:tasks.workunit.client.0.smithi029.stdout:5/181: mkdir d2/de/d13/d22/d3c/d41 0 2024-04-15T00:29:14.045 INFO:tasks.workunit.client.0.smithi029.stdout:5/182: rename d2/de/d13/d22 to d2/de/d13/d22/d3c/d42 22 2024-04-15T00:29:14.078 INFO:tasks.workunit.client.0.smithi029.stdout:4/177: write de/df/f12 [782838,113824] 0 2024-04-15T00:29:14.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/178: stat de/f19 0 2024-04-15T00:29:14.134 INFO:tasks.workunit.client.0.smithi029.stdout:5/183: sync 2024-04-15T00:29:14.199 INFO:tasks.workunit.client.0.smithi029.stdout:3/181: mknod d17/d2a/c3e 0 2024-04-15T00:29:14.201 INFO:tasks.workunit.client.0.smithi029.stdout:1/174: dwrite df/f2f [0,4194304] 0 2024-04-15T00:29:14.352 INFO:tasks.workunit.client.0.smithi029.stdout:9/171: truncate d3/d6/d9/d15/f1f 826107 0 2024-04-15T00:29:14.360 INFO:tasks.workunit.client.0.smithi029.stdout:9/172: chown d3/d6/f12 166052 1 2024-04-15T00:29:14.437 INFO:tasks.workunit.client.0.smithi029.stdout:4/179: dread - de/f25 zero size 2024-04-15T00:29:14.511 INFO:tasks.workunit.client.0.smithi029.stdout:2/173: write d3/d13/d14/f20 [2041451,89298] 0 2024-04-15T00:29:14.716 INFO:tasks.workunit.client.0.smithi029.stdout:3/182: truncate fa 6208890 0 2024-04-15T00:29:14.723 INFO:tasks.workunit.client.0.smithi029.stdout:7/159: unlink d0/d6/l10 0 2024-04-15T00:29:14.731 INFO:tasks.workunit.client.0.smithi029.stdout:9/173: truncate d3/d6/d9/d15/d21/f28 911027 0 2024-04-15T00:29:14.840 INFO:tasks.workunit.client.0.smithi029.stdout:3/183: chown d17/d2a/f34 109 1 2024-04-15T00:29:14.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/174: mkdir d3/d36 0 2024-04-15T00:29:14.886 INFO:tasks.workunit.client.0.smithi029.stdout:8/164: dwrite d8/dc/f1c [0,4194304] 0 2024-04-15T00:29:14.990 INFO:tasks.workunit.client.0.smithi029.stdout:5/184: symlink d2/d24/l43 0 2024-04-15T00:29:14.994 INFO:tasks.workunit.client.0.smithi029.stdout:0/182: truncate d5/d15/f1c 3415089 0 2024-04-15T00:29:15.006 INFO:tasks.workunit.client.0.smithi029.stdout:5/185: readlink d2/de/lf 0 2024-04-15T00:29:15.047 INFO:tasks.workunit.client.0.smithi029.stdout:4/180: mkdir de/d3a 0 2024-04-15T00:29:15.056 INFO:tasks.workunit.client.0.smithi029.stdout:4/181: chown de/d3a 83583 1 2024-04-15T00:29:15.145 INFO:tasks.workunit.client.0.smithi029.stdout:1/175: dwrite df/f27 [0,4194304] 0 2024-04-15T00:29:15.381 INFO:tasks.workunit.client.0.smithi029.stdout:0/183: rename l3 to d5/d15/d1f/l39 0 2024-04-15T00:29:15.381 INFO:tasks.workunit.client.0.smithi029.stdout:9/174: dread - d3/d6/d9/d35/f36 zero size 2024-04-15T00:29:15.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/175: stat d3/d13/d14/c25 0 2024-04-15T00:29:15.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/172: getdents d1 0 2024-04-15T00:29:15.490 INFO:tasks.workunit.client.0.smithi029.stdout:6/173: chown d1/d8/db/f37 1209 1 2024-04-15T00:29:15.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/184: creat d17/d2f/d3c/f3f x:0 0 0 2024-04-15T00:29:15.612 INFO:tasks.workunit.client.0.smithi029.stdout:3/185: readlink d17/d2f/l30 0 2024-04-15T00:29:15.914 INFO:tasks.workunit.client.0.smithi029.stdout:0/184: creat d5/d15/d1f/f3a x:0 0 0 2024-04-15T00:29:15.917 INFO:tasks.workunit.client.0.smithi029.stdout:2/176: fdatasync d3/d13/f28 0 2024-04-15T00:29:15.934 INFO:tasks.workunit.client.0.smithi029.stdout:0/185: stat d5/d15/d27/d28/l34 0 2024-04-15T00:29:15.945 INFO:tasks.workunit.client.0.smithi029.stdout:0/186: chown d5/d15/d27/d28/l34 0 1 2024-04-15T00:29:16.025 INFO:tasks.workunit.client.0.smithi029.stdout:8/165: rename d8/dc/f2a to d8/da/d2f/f36 0 2024-04-15T00:29:16.027 INFO:tasks.workunit.client.0.smithi029.stdout:4/182: rmdir de/df/d1e 39 2024-04-15T00:29:16.144 INFO:tasks.workunit.client.0.smithi029.stdout:3/186: mknod d17/d2a/d33/c40 0 2024-04-15T00:29:16.353 INFO:tasks.workunit.client.0.smithi029.stdout:7/160: write d0/d6/d1c/f1b [174922,115912] 0 2024-04-15T00:29:16.408 INFO:tasks.workunit.client.0.smithi029.stdout:0/187: read d5/db/f29 [669577,45385] 0 2024-04-15T00:29:16.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/177: dread d3/f9 [4194304,4194304] 0 2024-04-15T00:29:16.547 INFO:tasks.workunit.client.0.smithi029.stdout:4/183: fdatasync de/f25 0 2024-04-15T00:29:16.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/166: mknod d8/da/c37 0 2024-04-15T00:29:16.679 INFO:tasks.workunit.client.0.smithi029.stdout:1/176: rename df/f2f to df/f46 0 2024-04-15T00:29:16.696 INFO:tasks.workunit.client.0.smithi029.stdout:5/186: getdents d2/de/d13 0 2024-04-15T00:29:16.719 INFO:tasks.workunit.client.0.smithi029.stdout:4/184: sync 2024-04-15T00:29:16.819 INFO:tasks.workunit.client.0.smithi029.stdout:9/175: unlink d3/d6/d9/d29/f3f 0 2024-04-15T00:29:16.849 INFO:tasks.workunit.client.0.smithi029.stdout:7/161: truncate d0/d6/d1c/fc 1171328 0 2024-04-15T00:29:16.948 INFO:tasks.workunit.client.0.smithi029.stdout:2/178: creat d3/dd/d2d/f37 x:0 0 0 2024-04-15T00:29:16.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/167: truncate d8/f2b 555074 0 2024-04-15T00:29:17.174 INFO:tasks.workunit.client.0.smithi029.stdout:6/174: dwrite d1/f18 [4194304,4194304] 0 2024-04-15T00:29:17.184 INFO:tasks.workunit.client.0.smithi029.stdout:4/185: symlink de/d2b/l3b 0 2024-04-15T00:29:17.280 INFO:tasks.workunit.client.0.smithi029.stdout:9/176: mknod d3/d6/d9/d35/c42 0 2024-04-15T00:29:17.357 INFO:tasks.workunit.client.0.smithi029.stdout:2/179: write d3/d13/f28 [1070961,108405] 0 2024-04-15T00:29:17.495 INFO:tasks.workunit.client.0.smithi029.stdout:4/186: rmdir de 39 2024-04-15T00:29:17.652 INFO:tasks.workunit.client.0.smithi029.stdout:9/177: fsync d3/d6/f16 0 2024-04-15T00:29:17.946 INFO:tasks.workunit.client.0.smithi029.stdout:3/187: dwrite d17/f1d [0,4194304] 0 2024-04-15T00:29:18.134 INFO:tasks.workunit.client.0.smithi029.stdout:2/180: link d3/d13/f2f d3/f38 0 2024-04-15T00:29:18.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/177: dwrite df/d32/f39 [0,4194304] 0 2024-04-15T00:29:18.348 INFO:tasks.workunit.client.0.smithi029.stdout:1/178: chown df/f22 29307 1 2024-04-15T00:29:18.384 INFO:tasks.workunit.client.0.smithi029.stdout:5/187: dwrite d2/de/d13/f19 [0,4194304] 0 2024-04-15T00:29:18.467 INFO:tasks.workunit.client.0.smithi029.stdout:7/162: dwrite d0/d6/f8 [0,4194304] 0 2024-04-15T00:29:18.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/181: rmdir d3/dd/d2d 39 2024-04-15T00:29:18.553 INFO:tasks.workunit.client.0.smithi029.stdout:6/175: truncate d1/f18 7172243 0 2024-04-15T00:29:18.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/168: write d8/da/d2f/f36 [972288,50569] 0 2024-04-15T00:29:18.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/187: write de/f27 [974776,102892] 0 2024-04-15T00:29:18.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/188: write d17/f1d [5213005,101718] 0 2024-04-15T00:29:18.607 INFO:tasks.workunit.client.0.smithi029.stdout:1/179: creat df/d29/d41/f47 x:0 0 0 2024-04-15T00:29:18.616 INFO:tasks.workunit.client.0.smithi029.stdout:5/188: mkdir d2/de/d44 0 2024-04-15T00:29:18.737 INFO:tasks.workunit.client.0.smithi029.stdout:3/189: chown d17/d2a/f34 1572653233 1 2024-04-15T00:29:18.773 INFO:tasks.workunit.client.0.smithi029.stdout:9/178: dwrite d3/d6/f17 [0,4194304] 0 2024-04-15T00:29:18.901 INFO:tasks.workunit.client.0.smithi029.stdout:2/182: mknod d3/c39 0 2024-04-15T00:29:18.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/169: creat d8/f38 x:0 0 0 2024-04-15T00:29:18.915 INFO:tasks.workunit.client.0.smithi029.stdout:0/188: truncate d5/d15/f1c 228665 0 2024-04-15T00:29:18.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/180: creat df/d29/d41/f48 x:0 0 0 2024-04-15T00:29:18.942 INFO:tasks.workunit.client.0.smithi029.stdout:0/189: chown d5 10 1 2024-04-15T00:29:18.967 INFO:tasks.workunit.client.0.smithi029.stdout:1/181: readlink df/l31 0 2024-04-15T00:29:19.037 INFO:tasks.workunit.client.0.smithi029.stdout:6/176: dwrite d1/d1e/f32 [0,4194304] 0 2024-04-15T00:29:19.463 INFO:tasks.workunit.client.0.smithi029.stdout:7/163: creat d0/f36 x:0 0 0 2024-04-15T00:29:19.486 INFO:tasks.workunit.client.0.smithi029.stdout:0/190: rmdir d5 39 2024-04-15T00:29:19.496 INFO:tasks.workunit.client.0.smithi029.stdout:8/170: unlink d8/l22 0 2024-04-15T00:29:19.501 INFO:tasks.workunit.client.0.smithi029.stdout:2/183: dread - d3/dd/f27 zero size 2024-04-15T00:29:19.611 INFO:tasks.workunit.client.0.smithi029.stdout:6/177: write d1/d8/db/f24 [372250,421] 0 2024-04-15T00:29:19.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/188: creat de/f3c x:0 0 0 2024-04-15T00:29:19.792 INFO:tasks.workunit.client.0.smithi029.stdout:6/178: readlink d1/d8/l2b 0 2024-04-15T00:29:19.825 INFO:tasks.workunit.client.0.smithi029.stdout:3/190: dwrite d17/f26 [0,4194304] 0 2024-04-15T00:29:19.916 INFO:tasks.workunit.client.0.smithi029.stdout:5/189: dwrite d2/de/d13/d22/f3f [0,4194304] 0 2024-04-15T00:29:19.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/179: dwrite d3/d6/f16 [0,4194304] 0 2024-04-15T00:29:19.960 INFO:tasks.workunit.client.0.smithi029.stdout:8/171: truncate d8/f2c 694649 0 2024-04-15T00:29:20.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/184: chown d3/dd/d2d/f37 57635891 1 2024-04-15T00:29:20.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/182: getdents df/d32 0 2024-04-15T00:29:20.092 INFO:tasks.workunit.client.0.smithi029.stdout:7/164: dread d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:29:20.096 INFO:tasks.workunit.client.0.smithi029.stdout:4/189: creat de/d2b/d35/f3d x:0 0 0 2024-04-15T00:29:20.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/191: chown c13 26934586 1 2024-04-15T00:29:20.124 INFO:tasks.workunit.client.0.smithi029.stdout:9/180: rename d3/d6 to d3/d6/d9/d35/d43 22 2024-04-15T00:29:20.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/181: chown d3/d6/d9/d15/f18 40505 1 2024-04-15T00:29:20.158 INFO:tasks.workunit.client.0.smithi029.stdout:9/182: dread d3/d6/d9/d15/f18 [0,4194304] 0 2024-04-15T00:29:20.267 INFO:tasks.workunit.client.0.smithi029.stdout:8/172: mkdir d8/dc/d23/d28/d30/d39 0 2024-04-15T00:29:20.268 INFO:tasks.workunit.client.0.smithi029.stdout:2/185: fdatasync d3/dd/f35 0 2024-04-15T00:29:20.311 INFO:tasks.workunit.client.0.smithi029.stdout:7/165: sync 2024-04-15T00:29:20.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/166: fdatasync d0/d6/d1c/f1b 0 2024-04-15T00:29:20.360 INFO:tasks.workunit.client.0.smithi029.stdout:3/192: sync 2024-04-15T00:29:20.468 INFO:tasks.workunit.client.0.smithi029.stdout:5/190: write d2/f7 [5571790,78966] 0 2024-04-15T00:29:20.570 INFO:tasks.workunit.client.0.smithi029.stdout:6/179: dwrite d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:29:20.637 INFO:tasks.workunit.client.0.smithi029.stdout:9/183: truncate d3/d6/d9/d15/f18 983544 0 2024-04-15T00:29:20.642 INFO:tasks.workunit.client.0.smithi029.stdout:0/191: creat d5/db/f3b x:0 0 0 2024-04-15T00:29:20.647 INFO:tasks.workunit.client.0.smithi029.stdout:4/190: mknod de/d3a/c3e 0 2024-04-15T00:29:20.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/173: mkdir d8/dc/d23/d28/d3a 0 2024-04-15T00:29:20.669 INFO:tasks.workunit.client.0.smithi029.stdout:2/186: dread - d3/dd/d2d/f34 zero size 2024-04-15T00:29:20.701 INFO:tasks.workunit.client.0.smithi029.stdout:0/192: chown d5/d15/d27/f2d 2 1 2024-04-15T00:29:20.706 INFO:tasks.workunit.client.0.smithi029.stdout:8/174: chown d8/da/c2e 0 1 2024-04-15T00:29:20.761 INFO:tasks.workunit.client.0.smithi029.stdout:1/183: write f3 [4654819,96700] 0 2024-04-15T00:29:20.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/175: dread d8/da/d2f/f36 [0,4194304] 0 2024-04-15T00:29:21.056 INFO:tasks.workunit.client.0.smithi029.stdout:6/180: mkdir d1/d8/db/d38 0 2024-04-15T00:29:21.069 INFO:tasks.workunit.client.0.smithi029.stdout:6/181: chown d1/d8/db/f11 109912020 1 2024-04-15T00:29:21.091 INFO:tasks.workunit.client.0.smithi029.stdout:2/187: creat d3/d2a/f3a x:0 0 0 2024-04-15T00:29:21.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/193: dread d5/d15/f1c [0,4194304] 0 2024-04-15T00:29:21.390 INFO:tasks.workunit.client.0.smithi029.stdout:8/176: unlink d8/dc/l19 0 2024-04-15T00:29:21.543 INFO:tasks.workunit.client.0.smithi029.stdout:7/167: mkdir d0/d6/d16/d37 0 2024-04-15T00:29:21.729 INFO:tasks.workunit.client.0.smithi029.stdout:6/182: rename d1/f4 to d1/d8/db/d38/f39 0 2024-04-15T00:29:21.740 INFO:tasks.workunit.client.0.smithi029.stdout:5/191: write d2/f4 [2115285,111029] 0 2024-04-15T00:29:21.839 INFO:tasks.workunit.client.0.smithi029.stdout:9/184: write d3/d6/f13 [646822,2715] 0 2024-04-15T00:29:22.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/192: rename d2/de/d13/d22/d26/f2b to d2/de/d13/d22/d26/d36/f45 0 2024-04-15T00:29:22.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/193: getdents d17 0 2024-04-15T00:29:22.356 INFO:tasks.workunit.client.0.smithi029.stdout:5/193: readlink d2/l5 0 2024-04-15T00:29:22.367 INFO:tasks.workunit.client.0.smithi029.stdout:3/194: chown d17/f21 10593 1 2024-04-15T00:29:22.577 INFO:tasks.workunit.client.0.smithi029.stdout:0/194: rmdir d5/d15/d27/d2f 0 2024-04-15T00:29:22.586 INFO:tasks.workunit.client.0.smithi029.stdout:6/183: creat d1/d1e/d22/f3a x:0 0 0 2024-04-15T00:29:22.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/195: stat d5/d15/l17 0 2024-04-15T00:29:22.636 INFO:tasks.workunit.client.0.smithi029.stdout:1/184: unlink df/l3a 0 2024-04-15T00:29:22.641 INFO:tasks.workunit.client.0.smithi029.stdout:1/185: chown c7 43945781 1 2024-04-15T00:29:22.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/194: unlink d2/d1a/c21 0 2024-04-15T00:29:22.735 INFO:tasks.workunit.client.0.smithi029.stdout:3/195: dread fa [4194304,4194304] 0 2024-04-15T00:29:22.745 INFO:tasks.workunit.client.0.smithi029.stdout:4/191: link de/l20 de/df/d1e/l3f 0 2024-04-15T00:29:22.774 INFO:tasks.workunit.client.0.smithi029.stdout:2/188: link d3/d13/d14/l17 d3/d13/l3b 0 2024-04-15T00:29:23.001 INFO:tasks.workunit.client.0.smithi029.stdout:7/168: write d0/d6/d16/d26/f33 [427742,46126] 0 2024-04-15T00:29:23.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/186: symlink df/l49 0 2024-04-15T00:29:23.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/196: rename d5/d15/d1f/l38 to d5/db/l3c 0 2024-04-15T00:29:23.265 INFO:tasks.workunit.client.0.smithi029.stdout:9/185: dwrite d3/d6/f12 [4194304,4194304] 0 2024-04-15T00:29:23.356 INFO:tasks.workunit.client.0.smithi029.stdout:7/169: creat d0/d6/d16/d26/f38 x:0 0 0 2024-04-15T00:29:23.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/187: creat df/d32/d43/f4a x:0 0 0 2024-04-15T00:29:23.451 INFO:tasks.workunit.client.0.smithi029.stdout:8/177: dwrite f7 [4194304,4194304] 0 2024-04-15T00:29:23.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/196: write d17/d2a/f2c [676115,2430] 0 2024-04-15T00:29:23.541 INFO:tasks.workunit.client.0.smithi029.stdout:4/192: write de/df/d1e/f22 [616873,2906] 0 2024-04-15T00:29:23.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/189: write d3/dd/d2d/f34 [458071,119002] 0 2024-04-15T00:29:23.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/184: dwrite d1/f1c [0,4194304] 0 2024-04-15T00:29:23.717 INFO:tasks.workunit.client.0.smithi029.stdout:5/195: rename d2/de/c12 to d2/d24/c46 0 2024-04-15T00:29:23.756 INFO:tasks.workunit.client.0.smithi029.stdout:4/193: dread - de/f2e zero size 2024-04-15T00:29:23.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/186: dread d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:29:23.777 INFO:tasks.workunit.client.0.smithi029.stdout:1/188: read df/f38 [2352986,62059] 0 2024-04-15T00:29:23.802 INFO:tasks.workunit.client.0.smithi029.stdout:1/189: chown df/d32 104 1 2024-04-15T00:29:23.813 INFO:tasks.workunit.client.0.smithi029.stdout:1/190: dread - df/f2d zero size 2024-04-15T00:29:23.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/178: write d8/fd [189273,49950] 0 2024-04-15T00:29:23.866 INFO:tasks.workunit.client.0.smithi029.stdout:8/179: chown d8/da/c1b 5 1 2024-04-15T00:29:23.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/197: creat d5/d15/d1f/d32/f3d x:0 0 0 2024-04-15T00:29:24.006 INFO:tasks.workunit.client.0.smithi029.stdout:7/170: mkdir d0/d6/d39 0 2024-04-15T00:29:24.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/190: rename d3/lc to d3/d36/l3c 0 2024-04-15T00:29:24.035 INFO:tasks.workunit.client.0.smithi029.stdout:1/191: creat df/d29/f4b x:0 0 0 2024-04-15T00:29:24.055 INFO:tasks.workunit.client.0.smithi029.stdout:2/191: read - d3/dd/f35 zero size 2024-04-15T00:29:24.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/171: truncate d0/d6/d16/d26/f38 721601 0 2024-04-15T00:29:24.139 INFO:tasks.workunit.client.0.smithi029.stdout:0/198: rmdir d5/d15/d1f 39 2024-04-15T00:29:24.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/192: mkdir df/d32/d43/d4c 0 2024-04-15T00:29:24.329 INFO:tasks.workunit.client.0.smithi029.stdout:1/193: write df/d29/f2c [96049,99201] 0 2024-04-15T00:29:24.346 INFO:tasks.workunit.client.0.smithi029.stdout:1/194: fdatasync df/d29/f2c 0 2024-04-15T00:29:24.436 INFO:tasks.workunit.client.0.smithi029.stdout:9/187: link d3/d6/d9/d35/f3a d3/d6/d9/d15/f44 0 2024-04-15T00:29:24.441 INFO:tasks.workunit.client.0.smithi029.stdout:3/197: rename d17/d2a/d33/f3b to d17/d2a/d33/d37/f41 0 2024-04-15T00:29:24.455 INFO:tasks.workunit.client.0.smithi029.stdout:0/199: fdatasync d5/d15/d1f/d32/f3d 0 2024-04-15T00:29:24.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/192: creat d3/d2b/f3d x:0 0 0 2024-04-15T00:29:24.566 INFO:tasks.workunit.client.0.smithi029.stdout:2/193: write d3/dd/d2d/f34 [1223367,58156] 0 2024-04-15T00:29:24.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/194: dread d3/dd/d2d/f34 [0,4194304] 0 2024-04-15T00:29:24.694 INFO:tasks.workunit.client.0.smithi029.stdout:6/185: rename d1/d8/f14 to d1/d8/db/f3b 0 2024-04-15T00:29:24.786 INFO:tasks.workunit.client.0.smithi029.stdout:3/198: symlink d17/d2f/l42 0 2024-04-15T00:29:24.836 INFO:tasks.workunit.client.0.smithi029.stdout:9/188: mknod d3/d6/d9/d15/d21/c45 0 2024-04-15T00:29:24.854 INFO:tasks.workunit.client.0.smithi029.stdout:7/172: link d0/d6/d1c/c1a d0/d6/d16/c3a 0 2024-04-15T00:29:24.935 INFO:tasks.workunit.client.0.smithi029.stdout:2/195: chown d3/d13/c21 115562 1 2024-04-15T00:29:25.069 INFO:tasks.workunit.client.0.smithi029.stdout:5/196: rename d2/d1a/f1b to d2/de/d13/d22/f47 0 2024-04-15T00:29:25.105 INFO:tasks.workunit.client.0.smithi029.stdout:6/186: mknod d1/d8/db/d38/c3c 0 2024-04-15T00:29:25.109 INFO:tasks.workunit.client.0.smithi029.stdout:3/199: mknod d17/d2f/d3c/c43 0 2024-04-15T00:29:25.200 INFO:tasks.workunit.client.0.smithi029.stdout:1/195: creat df/f4d x:0 0 0 2024-04-15T00:29:25.210 INFO:tasks.workunit.client.0.smithi029.stdout:4/194: write de/df/f12 [1713376,126433] 0 2024-04-15T00:29:25.251 INFO:tasks.workunit.client.0.smithi029.stdout:1/196: truncate df/d29/f4b 163102 0 2024-04-15T00:29:25.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/180: rename d8/da/f13 to d8/dc/f3b 0 2024-04-15T00:29:25.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/200: mkdir d17/d2f/d44 0 2024-04-15T00:29:25.781 INFO:tasks.workunit.client.0.smithi029.stdout:6/187: truncate d1/d8/db/f37 988795 0 2024-04-15T00:29:25.787 INFO:tasks.workunit.client.0.smithi029.stdout:9/189: unlink d3/d6/d9/d15/f18 0 2024-04-15T00:29:25.818 INFO:tasks.workunit.client.0.smithi029.stdout:4/195: fdatasync de/df/d1e/f29 0 2024-04-15T00:29:25.852 INFO:tasks.workunit.client.0.smithi029.stdout:6/188: dread d1/f6 [0,4194304] 0 2024-04-15T00:29:25.852 INFO:tasks.workunit.client.0.smithi029.stdout:2/196: fsync d3/d13/d14/f20 0 2024-04-15T00:29:25.888 INFO:tasks.workunit.client.0.smithi029.stdout:0/200: getdents d5/db 0 2024-04-15T00:29:25.910 INFO:tasks.workunit.client.0.smithi029.stdout:4/196: read - de/df/d1e/f28 zero size 2024-04-15T00:29:26.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/197: fsync d2/f7 0 2024-04-15T00:29:26.116 INFO:tasks.workunit.client.0.smithi029.stdout:5/198: readlink d2/l3 0 2024-04-15T00:29:26.347 INFO:tasks.workunit.client.0.smithi029.stdout:5/199: sync 2024-04-15T00:29:26.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/200: chown d2/de/d13/f2a 24 1 2024-04-15T00:29:26.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/201: write d2/f4 [4094013,112856] 0 2024-04-15T00:29:26.398 INFO:tasks.workunit.client.0.smithi029.stdout:1/197: truncate f3 3740847 0 2024-04-15T00:29:26.408 INFO:tasks.workunit.client.0.smithi029.stdout:1/198: chown c9 28912082 1 2024-04-15T00:29:26.415 INFO:tasks.workunit.client.0.smithi029.stdout:1/199: dread - df/f4d zero size 2024-04-15T00:29:26.494 INFO:tasks.workunit.client.0.smithi029.stdout:7/173: creat d0/d6/f3b x:0 0 0 2024-04-15T00:29:26.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/189: read d1/f20 [3248808,121198] 0 2024-04-15T00:29:26.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/190: fdatasync d1/f1c 0 2024-04-15T00:29:26.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/197: symlink d3/d2b/l3e 0 2024-04-15T00:29:26.729 INFO:tasks.workunit.client.0.smithi029.stdout:3/201: write d17/f21 [4031066,60916] 0 2024-04-15T00:29:26.750 INFO:tasks.workunit.client.0.smithi029.stdout:9/190: truncate d3/d6/d9/fd 1703605 0 2024-04-15T00:29:26.761 INFO:tasks.workunit.client.0.smithi029.stdout:9/191: stat d3/d6/d9/d15/d21/l23 0 2024-04-15T00:29:26.946 INFO:tasks.workunit.client.0.smithi029.stdout:4/197: read f2 [50924,105749] 0 2024-04-15T00:29:27.157 INFO:tasks.workunit.client.0.smithi029.stdout:5/202: rename d2/de/f23 to d2/d1a/d2d/f48 0 2024-04-15T00:29:27.177 INFO:tasks.workunit.client.0.smithi029.stdout:5/203: chown d2/de/d13/d22/d26 625784592 1 2024-04-15T00:29:27.368 INFO:tasks.workunit.client.0.smithi029.stdout:3/202: fdatasync f1 0 2024-04-15T00:29:27.422 INFO:tasks.workunit.client.0.smithi029.stdout:2/198: rmdir d3/d36 39 2024-04-15T00:29:27.501 INFO:tasks.workunit.client.0.smithi029.stdout:8/181: dwrite d8/da/ff [0,4194304] 0 2024-04-15T00:29:27.581 INFO:tasks.workunit.client.0.smithi029.stdout:5/204: truncate d2/de/d1f/f3b 423714 0 2024-04-15T00:29:27.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/203: read - d17/d2a/f34 zero size 2024-04-15T00:29:27.718 INFO:tasks.workunit.client.0.smithi029.stdout:0/201: dwrite d5/db/f29 [4194304,4194304] 0 2024-04-15T00:29:27.818 INFO:tasks.workunit.client.0.smithi029.stdout:6/191: creat d1/d8/f3d x:0 0 0 2024-04-15T00:29:27.895 INFO:tasks.workunit.client.0.smithi029.stdout:1/200: rename f1 to df/d29/d41/f4e 0 2024-04-15T00:29:27.902 INFO:tasks.workunit.client.0.smithi029.stdout:3/204: creat d17/f45 x:0 0 0 2024-04-15T00:29:27.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/205: truncate d2/d1a/f20 1196937 0 2024-04-15T00:29:27.940 INFO:tasks.workunit.client.0.smithi029.stdout:7/174: write d0/d6/d16/d26/f2b [506424,126799] 0 2024-04-15T00:29:27.969 INFO:tasks.workunit.client.0.smithi029.stdout:5/206: read d2/f7 [2388318,129076] 0 2024-04-15T00:29:28.028 INFO:tasks.workunit.client.0.smithi029.stdout:4/198: link de/c2f de/d3a/c40 0 2024-04-15T00:29:28.244 INFO:tasks.workunit.client.0.smithi029.stdout:2/199: symlink d3/d36/l3f 0 2024-04-15T00:29:28.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/202: rmdir d5/db 39 2024-04-15T00:29:28.261 INFO:tasks.workunit.client.0.smithi029.stdout:9/192: rename d3/d6/d9/d15/l1e to d3/d6/l46 0 2024-04-15T00:29:28.269 INFO:tasks.workunit.client.0.smithi029.stdout:1/201: mkdir df/d29/d41/d4f 0 2024-04-15T00:29:28.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/175: mkdir d0/d6/d39/d3c 0 2024-04-15T00:29:28.704 INFO:tasks.workunit.client.0.smithi029.stdout:2/200: creat d3/d13/d14/f40 x:0 0 0 2024-04-15T00:29:28.714 INFO:tasks.workunit.client.0.smithi029.stdout:4/199: mknod de/c41 0 2024-04-15T00:29:28.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/193: rename d3/d6/c31 to d3/d6/d30/c47 0 2024-04-15T00:29:28.772 INFO:tasks.workunit.client.0.smithi029.stdout:1/202: truncate df/d32/f3b 2466384 0 2024-04-15T00:29:28.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/182: write d8/da/f1e [4779979,17399] 0 2024-04-15T00:29:28.792 INFO:tasks.workunit.client.0.smithi029.stdout:6/192: write d1/d1e/f33 [732491,19687] 0 2024-04-15T00:29:28.811 INFO:tasks.workunit.client.0.smithi029.stdout:0/203: mkdir d5/d3e 0 2024-04-15T00:29:28.818 INFO:tasks.workunit.client.0.smithi029.stdout:8/183: chown d8/dc/d23 961717604 1 2024-04-15T00:29:28.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/203: chown df/d29/c37 1 1 2024-04-15T00:29:28.848 INFO:tasks.workunit.client.0.smithi029.stdout:1/204: chown df/f15 406 1 2024-04-15T00:29:28.889 INFO:tasks.workunit.client.0.smithi029.stdout:8/184: dread d8/da/ff [0,4194304] 0 2024-04-15T00:29:28.911 INFO:tasks.workunit.client.0.smithi029.stdout:5/207: write d2/de/d13/f19 [4690272,4310] 0 2024-04-15T00:29:28.980 INFO:tasks.workunit.client.0.smithi029.stdout:3/205: dread d17/d2a/f2c [0,4194304] 0 2024-04-15T00:29:29.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/193: creat d1/f3e x:0 0 0 2024-04-15T00:29:29.150 INFO:tasks.workunit.client.0.smithi029.stdout:7/176: mknod d0/d6/c3d 0 2024-04-15T00:29:29.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/185: creat d8/dc/d23/d28/f3c x:0 0 0 2024-04-15T00:29:29.214 INFO:tasks.workunit.client.0.smithi029.stdout:5/208: creat d2/de/d13/d22/d26/f49 x:0 0 0 2024-04-15T00:29:29.223 INFO:tasks.workunit.client.0.smithi029.stdout:3/206: mkdir d17/d2a/d46 0 2024-04-15T00:29:29.248 INFO:tasks.workunit.client.0.smithi029.stdout:8/186: chown d8/da/d2f/f36 154346 1 2024-04-15T00:29:29.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:29.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:29.457 INFO:tasks.workunit.client.0.smithi029.stdout:9/194: symlink d3/l48 0 2024-04-15T00:29:29.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/194: creat d1/f3f x:0 0 0 2024-04-15T00:29:29.513 INFO:tasks.workunit.client.0.smithi029.stdout:6/195: chown d1/d1e/f33 63090539 1 2024-04-15T00:29:29.562 INFO:tasks.workunit.client.0.smithi029.stdout:0/204: rename d5/db/d1a/l24 to d5/d15/d1f/l3f 0 2024-04-15T00:29:29.626 INFO:tasks.workunit.client.0.smithi029.stdout:6/196: dwrite d1/f3e [0,4194304] 0 2024-04-15T00:29:29.691 INFO:tasks.workunit.client.0.smithi029.stdout:1/205: truncate df/d29/d41/f4e 3841158 0 2024-04-15T00:29:29.895 INFO:tasks.workunit.client.0.smithi029.stdout:3/207: mknod d17/d2a/d33/d37/c47 0 2024-04-15T00:29:29.902 INFO:tasks.workunit.client.0.smithi029.stdout:5/209: mknod d2/de/d13/d22/d3c/c4a 0 2024-04-15T00:29:29.911 INFO:tasks.workunit.client.0.smithi029.stdout:4/200: link f7 de/d3a/f42 0 2024-04-15T00:29:29.955 INFO:tasks.workunit.client.0.smithi029.stdout:9/195: creat d3/d6/d9/f49 x:0 0 0 2024-04-15T00:29:30.177 INFO:tasks.workunit.client.0.smithi029.stdout:6/197: dread - d1/d8/db/f2e zero size 2024-04-15T00:29:30.195 INFO:tasks.workunit.client.0.smithi029.stdout:2/201: write d3/d13/f16 [3479348,121066] 0 2024-04-15T00:29:30.245 INFO:tasks.workunit.client.0.smithi029.stdout:2/202: read - d3/d13/d14/f40 zero size 2024-04-15T00:29:30.272 INFO:tasks.workunit.client.0.smithi029.stdout:3/208: dread d17/f21 [0,4194304] 0 2024-04-15T00:29:30.278 INFO:tasks.workunit.client.0.smithi029.stdout:2/203: chown d3/d2a/l33 37826 1 2024-04-15T00:29:30.308 INFO:tasks.workunit.client.0.smithi029.stdout:5/210: creat d2/de/d13/d22/d3c/f4b x:0 0 0 2024-04-15T00:29:30.323 INFO:tasks.workunit.client.0.smithi029.stdout:9/196: rmdir d3/d6/d9/d29 39 2024-04-15T00:29:30.333 INFO:tasks.workunit.client.0.smithi029.stdout:9/197: chown d3/d6/d9/l33 3 1 2024-04-15T00:29:30.353 INFO:tasks.workunit.client.0.smithi029.stdout:9/198: truncate d3/d6/d9/f49 992788 0 2024-04-15T00:29:30.385 INFO:tasks.workunit.client.0.smithi029.stdout:0/205: symlink d5/d15/l40 0 2024-04-15T00:29:30.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/198: dread d1/f18 [4194304,4194304] 0 2024-04-15T00:29:30.723 INFO:tasks.workunit.client.0.smithi029.stdout:1/206: unlink f3 0 2024-04-15T00:29:30.774 INFO:tasks.workunit.client.0.smithi029.stdout:9/199: mkdir d3/d6/d9/d15/d4a 0 2024-04-15T00:29:30.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/177: dwrite d0/d6/d16/d26/f33 [0,4194304] 0 2024-04-15T00:29:31.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/204: dread d3/f5 [0,4194304] 0 2024-04-15T00:29:31.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/187: write d8/f15 [1978395,126958] 0 2024-04-15T00:29:31.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/201: write de/f3c [925205,106877] 0 2024-04-15T00:29:31.253 INFO:tasks.workunit.client.0.smithi029.stdout:9/200: chown d3/d6/d30/c47 723038788 1 2024-04-15T00:29:31.268 INFO:tasks.workunit.client.0.smithi029.stdout:9/201: read d3/d6/d9/f22 [33453,29054] 0 2024-04-15T00:29:31.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/178: readlink d0/d6/d1c/l3 0 2024-04-15T00:29:31.629 INFO:tasks.workunit.client.0.smithi029.stdout:5/211: write d2/f34 [584035,38163] 0 2024-04-15T00:29:31.646 INFO:tasks.workunit.client.0.smithi029.stdout:5/212: readlink d2/de/d13/d22/d26/l3d 0 2024-04-15T00:29:31.660 INFO:tasks.workunit.client.0.smithi029.stdout:5/213: read d2/d1a/f2c [569341,62321] 0 2024-04-15T00:29:31.753 INFO:tasks.workunit.client.0.smithi029.stdout:3/209: creat d17/d2f/d44/f48 x:0 0 0 2024-04-15T00:29:31.758 INFO:tasks.workunit.client.0.smithi029.stdout:6/199: creat d1/d8/db/f40 x:0 0 0 2024-04-15T00:29:31.813 INFO:tasks.workunit.client.0.smithi029.stdout:8/188: mkdir d8/da/d3d 0 2024-04-15T00:29:31.869 INFO:tasks.workunit.client.0.smithi029.stdout:9/202: rmdir d3/d6/d30 39 2024-04-15T00:29:31.920 INFO:tasks.workunit.client.0.smithi029.stdout:3/210: dread f1 [4194304,4194304] 0 2024-04-15T00:29:32.071 INFO:tasks.workunit.client.0.smithi029.stdout:6/200: truncate d1/d8/db/f2e 42288 0 2024-04-15T00:29:32.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/211: creat d17/d2a/d33/f49 x:0 0 0 2024-04-15T00:29:32.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/214: creat d2/de/d13/d22/d3c/d41/f4c x:0 0 0 2024-04-15T00:29:32.260 INFO:tasks.workunit.client.0.smithi029.stdout:5/215: readlink d2/d24/l43 0 2024-04-15T00:29:32.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/206: dwrite d5/db/f3b [0,4194304] 0 2024-04-15T00:29:32.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/201: truncate d1/d1e/f32 4218202 0 2024-04-15T00:29:32.456 INFO:tasks.workunit.client.0.smithi029.stdout:5/216: dread - d2/de/d13/d22/d3c/d41/f4c zero size 2024-04-15T00:29:32.481 INFO:tasks.workunit.client.0.smithi029.stdout:6/202: fdatasync d1/f3f 0 2024-04-15T00:29:32.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/217: stat f0 0 2024-04-15T00:29:32.501 INFO:tasks.workunit.client.0.smithi029.stdout:1/207: dwrite df/f38 [0,4194304] 0 2024-04-15T00:29:32.564 INFO:tasks.workunit.client.0.smithi029.stdout:0/207: chown d5/db/f3b 62 1 2024-04-15T00:29:32.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/208: chown df/d29/c37 57 1 2024-04-15T00:29:32.601 INFO:tasks.workunit.client.0.smithi029.stdout:1/209: readlink df/l49 0 2024-04-15T00:29:32.829 INFO:tasks.workunit.client.0.smithi029.stdout:0/208: fdatasync d5/db/f10 0 2024-04-15T00:29:32.876 INFO:tasks.workunit.client.0.smithi029.stdout:9/203: rename d3/d6/d9/d15/f44 to d3/d6/d9/d15/d4a/f4b 0 2024-04-15T00:29:32.936 INFO:tasks.workunit.client.0.smithi029.stdout:5/218: mkdir d2/de/d13/d22/d26/d36/d4d 0 2024-04-15T00:29:32.948 INFO:tasks.workunit.client.0.smithi029.stdout:5/219: stat d2/de/d13/d22/d26/d36/d4d 0 2024-04-15T00:29:33.054 INFO:tasks.workunit.client.0.smithi029.stdout:0/209: symlink d5/db/d1a/l41 0 2024-04-15T00:29:33.089 INFO:tasks.workunit.client.0.smithi029.stdout:4/202: dwrite f3 [0,4194304] 0 2024-04-15T00:29:33.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/205: write d3/d13/f28 [885027,12108] 0 2024-04-15T00:29:33.213 INFO:tasks.workunit.client.0.smithi029.stdout:2/206: dread - d3/dd/f35 zero size 2024-04-15T00:29:33.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/210: creat df/d32/f50 x:0 0 0 2024-04-15T00:29:33.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/189: dwrite d8/f9 [4194304,4194304] 0 2024-04-15T00:29:33.469 INFO:tasks.workunit.client.0.smithi029.stdout:3/212: write d17/f21 [3150846,3544] 0 2024-04-15T00:29:33.475 INFO:tasks.workunit.client.0.smithi029.stdout:7/179: mknod d0/d6/d16/c3e 0 2024-04-15T00:29:33.537 INFO:tasks.workunit.client.0.smithi029.stdout:6/203: mknod d1/c41 0 2024-04-15T00:29:33.842 INFO:tasks.workunit.client.0.smithi029.stdout:2/207: truncate d3/dd/f31 419589 0 2024-04-15T00:29:33.845 INFO:tasks.workunit.client.0.smithi029.stdout:2/208: stat d3/d36 0 2024-04-15T00:29:34.021 INFO:tasks.workunit.client.0.smithi029.stdout:5/220: write d2/de/d13/d22/d26/d36/f45 [404149,99453] 0 2024-04-15T00:29:34.025 INFO:tasks.workunit.client.0.smithi029.stdout:0/210: write d5/d15/d1f/d32/f3d [139111,95383] 0 2024-04-15T00:29:34.062 INFO:tasks.workunit.client.0.smithi029.stdout:5/221: stat d2/de/d13/d22/d26/d36 0 2024-04-15T00:29:34.088 INFO:tasks.workunit.client.0.smithi029.stdout:8/190: mknod d8/dc/d23/c3e 0 2024-04-15T00:29:34.103 INFO:tasks.workunit.client.0.smithi029.stdout:9/204: getdents d3/d6/d9/d35 0 2024-04-15T00:29:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:3/213: read - d17/d2f/f39 zero size 2024-04-15T00:29:34.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/203: rename de/df/c1b to de/df/d1e/c43 0 2024-04-15T00:29:34.148 INFO:tasks.workunit.client.0.smithi029.stdout:4/204: read - de/f2e zero size 2024-04-15T00:29:34.269 INFO:tasks.workunit.client.0.smithi029.stdout:9/205: dwrite d3/d6/d9/f49 [0,4194304] 0 2024-04-15T00:29:34.278 INFO:tasks.workunit.client.0.smithi029.stdout:1/211: symlink df/l51 0 2024-04-15T00:29:34.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/222: fdatasync d2/de/d13/f2f 0 2024-04-15T00:29:34.359 INFO:tasks.workunit.client.0.smithi029.stdout:6/204: fdatasync d1/f1f 0 2024-04-15T00:29:34.391 INFO:tasks.workunit.client.0.smithi029.stdout:6/205: chown d1 3 1 2024-04-15T00:29:34.414 INFO:tasks.workunit.client.0.smithi029.stdout:5/223: readlink d2/de/d13/d22/d26/l3d 0 2024-04-15T00:29:34.417 INFO:tasks.workunit.client.0.smithi029.stdout:6/206: chown d1/d8/lc 615 1 2024-04-15T00:29:34.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/224: fsync d2/de/d13/d22/f47 0 2024-04-15T00:29:34.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/225: readlink d2/de/d1f/l3a 0 2024-04-15T00:29:34.638 INFO:tasks.workunit.client.0.smithi029.stdout:8/191: getdents d8/dc/d23/d28/d3a 0 2024-04-15T00:29:34.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/211: write d5/db/f10 [7768328,7883] 0 2024-04-15T00:29:34.685 INFO:tasks.workunit.client.0.smithi029.stdout:9/206: fdatasync d3/d6/f13 0 2024-04-15T00:29:34.698 INFO:tasks.workunit.client.0.smithi029.stdout:0/212: truncate d5/d15/d1f/d32/f3d 1025684 0 2024-04-15T00:29:34.709 INFO:tasks.workunit.client.0.smithi029.stdout:3/214: truncate d17/d2a/f32 2175199 0 2024-04-15T00:29:34.757 INFO:tasks.workunit.client.0.smithi029.stdout:6/207: symlink d1/d8/l42 0 2024-04-15T00:29:34.907 INFO:tasks.workunit.client.0.smithi029.stdout:5/226: mknod d2/d1a/d2d/c4e 0 2024-04-15T00:29:34.914 INFO:tasks.workunit.client.0.smithi029.stdout:2/209: creat d3/f41 x:0 0 0 2024-04-15T00:29:34.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/180: rename d0/fb to d0/d6/f3f 0 2024-04-15T00:29:34.979 INFO:tasks.workunit.client.0.smithi029.stdout:1/212: write df/f21 [784342,78257] 0 2024-04-15T00:29:35.003 INFO:tasks.workunit.client.0.smithi029.stdout:7/181: readlink d0/d6/d16/d26/l29 0 2024-04-15T00:29:35.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/213: creat d5/db/f42 x:0 0 0 2024-04-15T00:29:35.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/205: dwrite de/d2b/f2a [0,4194304] 0 2024-04-15T00:29:35.328 INFO:tasks.workunit.client.0.smithi029.stdout:5/227: mknod d2/de/d13/d22/d3c/d41/c4f 0 2024-04-15T00:29:35.330 INFO:tasks.workunit.client.0.smithi029.stdout:8/192: creat d8/dc/d23/d28/d30/d39/f3f x:0 0 0 2024-04-15T00:29:35.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/182: truncate d0/d6/d1c/f9 2256486 0 2024-04-15T00:29:35.456 INFO:tasks.workunit.client.0.smithi029.stdout:3/215: fdatasync d17/f20 0 2024-04-15T00:29:35.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/206: mknod de/d2b/c44 0 2024-04-15T00:29:35.500 INFO:tasks.workunit.client.0.smithi029.stdout:0/214: creat d5/d15/d1f/d32/f43 x:0 0 0 2024-04-15T00:29:35.509 INFO:tasks.workunit.client.0.smithi029.stdout:0/215: readlink d5/d15/d1f/l2e 0 2024-04-15T00:29:35.621 INFO:tasks.workunit.client.0.smithi029.stdout:5/228: unlink d2/d24/l43 0 2024-04-15T00:29:35.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/183: truncate d0/d6/d1c/fe 5089434 0 2024-04-15T00:29:35.834 INFO:tasks.workunit.client.0.smithi029.stdout:9/207: creat d3/d6/d9/d29/f4c x:0 0 0 2024-04-15T00:29:36.056 INFO:tasks.workunit.client.0.smithi029.stdout:3/216: unlink d17/l31 0 2024-04-15T00:29:36.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/208: dwrite d1/f20 [0,4194304] 0 2024-04-15T00:29:36.356 INFO:tasks.workunit.client.0.smithi029.stdout:7/184: creat d0/d6/d16/d26/f40 x:0 0 0 2024-04-15T00:29:36.363 INFO:tasks.workunit.client.0.smithi029.stdout:1/213: write df/d29/d41/f48 [467055,77904] 0 2024-04-15T00:29:36.366 INFO:tasks.workunit.client.0.smithi029.stdout:2/210: getdents d3/d36 0 2024-04-15T00:29:36.397 INFO:tasks.workunit.client.0.smithi029.stdout:7/185: read d0/d6/d1c/fc [271685,88260] 0 2024-04-15T00:29:36.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/216: write d5/d15/f1c [222843,92163] 0 2024-04-15T00:29:36.710 INFO:tasks.workunit.client.0.smithi029.stdout:8/193: write d8/f2b [1464014,1694] 0 2024-04-15T00:29:36.722 INFO:tasks.workunit.client.0.smithi029.stdout:8/194: stat d8/da/f1e 0 2024-04-15T00:29:36.825 INFO:tasks.workunit.client.0.smithi029.stdout:2/211: dread - d3/f38 zero size 2024-04-15T00:29:36.833 INFO:tasks.workunit.client.0.smithi029.stdout:2/212: dread - d3/f41 zero size 2024-04-15T00:29:36.941 INFO:tasks.workunit.client.0.smithi029.stdout:3/217: creat d17/d2f/d3c/f4a x:0 0 0 2024-04-15T00:29:37.019 INFO:tasks.workunit.client.0.smithi029.stdout:4/207: dwrite de/d3a/f42 [0,4194304] 0 2024-04-15T00:29:37.169 INFO:tasks.workunit.client.0.smithi029.stdout:6/209: rename d1/d8/db/f2e to d1/d1e/d22/f43 0 2024-04-15T00:29:37.312 INFO:tasks.workunit.client.0.smithi029.stdout:7/186: symlink d0/d6/d39/d3c/l41 0 2024-04-15T00:29:37.400 INFO:tasks.workunit.client.0.smithi029.stdout:5/229: getdents d2/d1a/d2d 0 2024-04-15T00:29:37.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/195: creat d8/dc/d23/d28/d3a/f40 x:0 0 0 2024-04-15T00:29:37.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/213: mkdir d3/dd/d42 0 2024-04-15T00:29:37.543 INFO:tasks.workunit.client.0.smithi029.stdout:6/210: dread - d1/d8/f3d zero size 2024-04-15T00:29:37.570 INFO:tasks.workunit.client.0.smithi029.stdout:9/208: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:29:37.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/211: chown d1/c36 18642 1 2024-04-15T00:29:37.690 INFO:tasks.workunit.client.0.smithi029.stdout:0/217: dwrite d5/db/f10 [0,4194304] 0 2024-04-15T00:29:37.766 INFO:tasks.workunit.client.0.smithi029.stdout:0/218: chown d5/d3e 43 1 2024-04-15T00:29:37.830 INFO:tasks.workunit.client.0.smithi029.stdout:3/218: mknod d17/d2a/d33/c4b 0 2024-04-15T00:29:37.984 INFO:tasks.workunit.client.0.smithi029.stdout:8/196: symlink d8/da/d2f/l41 0 2024-04-15T00:29:38.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/214: read - d3/d13/f2f zero size 2024-04-15T00:29:38.101 INFO:tasks.workunit.client.0.smithi029.stdout:7/187: getdents d0/d6/d16/d37 0 2024-04-15T00:29:38.220 INFO:tasks.workunit.client.0.smithi029.stdout:3/219: mkdir d17/d2a/d4c 0 2024-04-15T00:29:38.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/209: dread d3/d6/d9/f2c [0,4194304] 0 2024-04-15T00:29:38.267 INFO:tasks.workunit.client.0.smithi029.stdout:1/214: dwrite df/d29/d41/f4e [0,4194304] 0 2024-04-15T00:29:38.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/197: mkdir d8/da/d2f/d42 0 2024-04-15T00:29:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:9/210: readlink d3/lf 0 2024-04-15T00:29:38.306 INFO:tasks.workunit.client.0.smithi029.stdout:3/220: chown d17/d2a/d46 18856 1 2024-04-15T00:29:38.438 INFO:tasks.workunit.client.0.smithi029.stdout:0/219: dread f2 [0,4194304] 0 2024-04-15T00:29:38.452 INFO:tasks.workunit.client.0.smithi029.stdout:7/188: mkdir d0/d6/d39/d3c/d42 0 2024-04-15T00:29:38.459 INFO:tasks.workunit.client.0.smithi029.stdout:8/198: fdatasync d8/dc/d23/d28/d3a/f40 0 2024-04-15T00:29:38.482 INFO:tasks.workunit.client.0.smithi029.stdout:8/199: chown d8/dc 0 1 2024-04-15T00:29:38.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/220: dread f2 [0,4194304] 0 2024-04-15T00:29:38.519 INFO:tasks.workunit.client.0.smithi029.stdout:4/208: getdents de/d2b/d35 0 2024-04-15T00:29:38.722 INFO:tasks.workunit.client.0.smithi029.stdout:5/230: link d2/de/f10 d2/de/d13/d22/d3c/f50 0 2024-04-15T00:29:38.782 INFO:tasks.workunit.client.0.smithi029.stdout:1/215: creat df/d29/f52 x:0 0 0 2024-04-15T00:29:38.794 INFO:tasks.workunit.client.0.smithi029.stdout:2/215: write d3/d13/d14/f20 [9188891,73324] 0 2024-04-15T00:29:39.010 INFO:tasks.workunit.client.0.smithi029.stdout:9/211: truncate d3/d6/f12 5006983 0 2024-04-15T00:29:39.017 INFO:tasks.workunit.client.0.smithi029.stdout:6/212: truncate d1/d8/f16 446835 0 2024-04-15T00:29:39.030 INFO:tasks.workunit.client.0.smithi029.stdout:7/189: fdatasync d0/d6/f2c 0 2024-04-15T00:29:39.043 INFO:tasks.workunit.client.0.smithi029.stdout:8/200: fsync d8/da/ff 0 2024-04-15T00:29:39.055 INFO:tasks.workunit.client.0.smithi029.stdout:0/221: creat d5/d15/d1f/f44 x:0 0 0 2024-04-15T00:29:39.059 INFO:tasks.workunit.client.0.smithi029.stdout:4/209: creat de/d3a/f45 x:0 0 0 2024-04-15T00:29:39.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/216: truncate df/f30 583660 0 2024-04-15T00:29:39.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/201: read f7 [2489547,72914] 0 2024-04-15T00:29:39.125 INFO:tasks.workunit.client.0.smithi029.stdout:1/217: chown df/d32/f35 206 1 2024-04-15T00:29:39.279 INFO:tasks.workunit.client.0.smithi029.stdout:3/221: creat d17/f4d x:0 0 0 2024-04-15T00:29:39.290 INFO:tasks.workunit.client.0.smithi029.stdout:5/231: creat d2/de/d13/d22/d26/d36/d4d/f51 x:0 0 0 2024-04-15T00:29:39.341 INFO:tasks.workunit.client.0.smithi029.stdout:4/210: fdatasync f3 0 2024-04-15T00:29:39.387 INFO:tasks.workunit.client.0.smithi029.stdout:2/216: mkdir d3/d13/d43 0 2024-04-15T00:29:39.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/202: creat d8/da/f43 x:0 0 0 2024-04-15T00:29:39.635 INFO:tasks.workunit.client.0.smithi029.stdout:1/218: sync 2024-04-15T00:29:39.747 INFO:tasks.workunit.client.0.smithi029.stdout:6/213: fsync d1/d8/f16 0 2024-04-15T00:29:39.768 INFO:tasks.workunit.client.0.smithi029.stdout:3/222: readlink d17/d2a/l3d 0 2024-04-15T00:29:39.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/232: rmdir d2/de/d13/d22/d26 39 2024-04-15T00:29:39.939 INFO:tasks.workunit.client.0.smithi029.stdout:2/217: chown d3/d13/d14/l17 43917290 1 2024-04-15T00:29:40.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/203: truncate d8/da/ff 5277105 0 2024-04-15T00:29:40.142 INFO:tasks.workunit.client.0.smithi029.stdout:6/214: creat d1/d8/db/f44 x:0 0 0 2024-04-15T00:29:40.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/190: dwrite d0/f1f [0,4194304] 0 2024-04-15T00:29:40.283 INFO:tasks.workunit.client.0.smithi029.stdout:2/218: mknod d3/d2a/c44 0 2024-04-15T00:29:40.332 INFO:tasks.workunit.client.0.smithi029.stdout:0/222: creat d5/db/f45 x:0 0 0 2024-04-15T00:29:40.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/204: creat d8/dc/d23/d28/f44 x:0 0 0 2024-04-15T00:29:40.468 INFO:tasks.workunit.client.0.smithi029.stdout:0/223: write d5/d15/d1f/d32/f43 [216449,71584] 0 2024-04-15T00:29:40.484 INFO:tasks.workunit.client.0.smithi029.stdout:5/233: dread d2/de/f10 [0,4194304] 0 2024-04-15T00:29:40.546 INFO:tasks.workunit.client.0.smithi029.stdout:6/215: unlink d1/d8/db/c2a 0 2024-04-15T00:29:40.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/234: sync 2024-04-15T00:29:40.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/211: write de/df/d1e/f2d [2722113,81641] 0 2024-04-15T00:29:40.688 INFO:tasks.workunit.client.0.smithi029.stdout:4/212: stat f4 0 2024-04-15T00:29:40.787 INFO:tasks.workunit.client.0.smithi029.stdout:2/219: truncate d3/dd/d2d/f37 235449 0 2024-04-15T00:29:40.805 INFO:tasks.workunit.client.0.smithi029.stdout:9/212: write d3/d6/d9/d15/d21/f28 [1885897,66705] 0 2024-04-15T00:29:40.824 INFO:tasks.workunit.client.0.smithi029.stdout:2/220: write d3/d13/d14/f20 [2759520,39405] 0 2024-04-15T00:29:40.869 INFO:tasks.workunit.client.0.smithi029.stdout:1/219: write df/f28 [454462,75706] 0 2024-04-15T00:29:41.271 INFO:tasks.workunit.client.0.smithi029.stdout:4/213: creat de/d3a/f46 x:0 0 0 2024-04-15T00:29:41.274 INFO:tasks.workunit.client.0.smithi029.stdout:5/235: read - d2/de/d13/d22/d3c/f4b zero size 2024-04-15T00:29:41.289 INFO:tasks.workunit.client.0.smithi029.stdout:4/214: chown de/df/f12 93420822 1 2024-04-15T00:29:41.418 INFO:tasks.workunit.client.0.smithi029.stdout:8/205: fsync d8/da/ff 0 2024-04-15T00:29:41.419 INFO:tasks.workunit.client.0.smithi029.stdout:2/221: fdatasync d3/f32 0 2024-04-15T00:29:41.453 INFO:tasks.workunit.client.0.smithi029.stdout:9/213: creat d3/d6/d9/d15/d4a/f4d x:0 0 0 2024-04-15T00:29:41.504 INFO:tasks.workunit.client.0.smithi029.stdout:9/214: chown d3/d6/d9/l25 42992 1 2024-04-15T00:29:41.512 INFO:tasks.workunit.client.0.smithi029.stdout:3/223: dwrite d17/f1b [0,4194304] 0 2024-04-15T00:29:41.524 INFO:tasks.workunit.client.0.smithi029.stdout:8/206: sync 2024-04-15T00:29:41.577 INFO:tasks.workunit.client.0.smithi029.stdout:0/224: symlink d5/db/d1a/l46 0 2024-04-15T00:29:41.611 INFO:tasks.workunit.client.0.smithi029.stdout:1/220: rename df/d32/l33 to df/d29/d41/d4f/l53 0 2024-04-15T00:29:41.628 INFO:tasks.workunit.client.0.smithi029.stdout:0/225: chown d5/db/d1a/l41 23140883 1 2024-04-15T00:29:42.054 INFO:tasks.workunit.client.0.smithi029.stdout:3/224: truncate f15 4718111 0 2024-04-15T00:29:42.186 INFO:tasks.workunit.client.0.smithi029.stdout:6/216: dwrite d1/d1e/f33 [0,4194304] 0 2024-04-15T00:29:42.287 INFO:tasks.workunit.client.0.smithi029.stdout:2/222: symlink d3/d13/d43/l45 0 2024-04-15T00:29:42.295 INFO:tasks.workunit.client.0.smithi029.stdout:2/223: dread - d3/dd/f35 zero size 2024-04-15T00:29:42.459 INFO:tasks.workunit.client.0.smithi029.stdout:6/217: symlink d1/d8/db/l45 0 2024-04-15T00:29:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/226: write d5/db/f19 [1028670,115420] 0 2024-04-15T00:29:42.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/218: chown d1/d8/db/f23 1001 1 2024-04-15T00:29:42.495 INFO:tasks.workunit.client.0.smithi029.stdout:2/224: rmdir d3/d13/d14 39 2024-04-15T00:29:42.914 INFO:tasks.workunit.client.0.smithi029.stdout:6/219: dread d1/d1e/d22/f43 [0,4194304] 0 2024-04-15T00:29:43.355 INFO:tasks.workunit.client.0.smithi029.stdout:7/191: symlink d0/l43 0 2024-04-15T00:29:43.366 INFO:tasks.workunit.client.0.smithi029.stdout:8/207: write f7 [8785368,60266] 0 2024-04-15T00:29:43.381 INFO:tasks.workunit.client.0.smithi029.stdout:1/221: symlink df/l54 0 2024-04-15T00:29:43.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/215: write d3/d6/d9/f22 [301090,20844] 0 2024-04-15T00:29:43.396 INFO:tasks.workunit.client.0.smithi029.stdout:3/225: write d17/f26 [3646786,116174] 0 2024-04-15T00:29:43.441 INFO:tasks.workunit.client.0.smithi029.stdout:2/225: write d3/dd/f27 [361170,62727] 0 2024-04-15T00:29:43.459 INFO:tasks.workunit.client.0.smithi029.stdout:1/222: stat df/d32/l3d 0 2024-04-15T00:29:43.476 INFO:tasks.workunit.client.0.smithi029.stdout:1/223: stat df/f15 0 2024-04-15T00:29:43.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/226: sync 2024-04-15T00:29:43.576 INFO:tasks.workunit.client.0.smithi029.stdout:4/215: rename de/f27 to de/d2b/f47 0 2024-04-15T00:29:43.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/220: dwrite d1/d1e/d22/f34 [0,4194304] 0 2024-04-15T00:29:43.784 INFO:tasks.workunit.client.0.smithi029.stdout:3/227: creat d17/d2a/f4e x:0 0 0 2024-04-15T00:29:43.800 INFO:tasks.workunit.client.0.smithi029.stdout:6/221: readlink d1/d8/db/l26 0 2024-04-15T00:29:43.802 INFO:tasks.workunit.client.0.smithi029.stdout:2/226: chown d3/dd/d2d/f37 46629717 1 2024-04-15T00:29:43.867 INFO:tasks.workunit.client.0.smithi029.stdout:0/227: link d5/c21 d5/db/c47 0 2024-04-15T00:29:43.872 INFO:tasks.workunit.client.0.smithi029.stdout:5/236: link d2/f7 d2/f52 0 2024-04-15T00:29:43.879 INFO:tasks.workunit.client.0.smithi029.stdout:8/208: rename d8/da/c2e to d8/dc/d23/d28/d30/c45 0 2024-04-15T00:29:43.906 INFO:tasks.workunit.client.0.smithi029.stdout:0/228: dread - d5/db/f45 zero size 2024-04-15T00:29:44.110 INFO:tasks.workunit.client.0.smithi029.stdout:6/222: mknod d1/d8/db/c46 0 2024-04-15T00:29:44.117 INFO:tasks.workunit.client.0.smithi029.stdout:3/228: read - d17/d2f/d44/f48 zero size 2024-04-15T00:29:44.192 INFO:tasks.workunit.client.0.smithi029.stdout:3/229: stat d17/d2f/l30 0 2024-04-15T00:29:44.268 INFO:tasks.workunit.client.0.smithi029.stdout:3/230: readlink d17/d2f/l42 0 2024-04-15T00:29:44.301 INFO:tasks.workunit.client.0.smithi029.stdout:2/227: rename d3/d2b to d3/d2a/d46 0 2024-04-15T00:29:44.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/209: symlink d8/da/l46 0 2024-04-15T00:29:44.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/192: creat d0/d6/f44 x:0 0 0 2024-04-15T00:29:44.358 INFO:tasks.workunit.client.0.smithi029.stdout:4/216: dwrite de/f2e [0,4194304] 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:1/224: dwrite df/f27 [4194304,4194304] 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:0/229: mknod d5/d15/d27/c48 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:5/237: read d2/d1a/f1c [1085279,799] 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:4/217: chown lb 2 1 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:6/223: dread d1/d8/db/f37 [0,4194304] 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:7/193: fsync d0/d6/d16/d26/f28 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:9/216: getdents d3/d6/d30/d3b/d3c 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:8/210: dread d8/da/f1e [4194304,4194304] 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:9/217: chown d3/d6/d9/d15/d21/f2a 5099 1 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:8/211: stat d8/da/c37 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:2/228: creat d3/dd/d42/f47 x:0 0 0 2024-04-15T00:29:44.999 INFO:tasks.workunit.client.0.smithi029.stdout:1/225: mkdir df/d32/d43/d4c/d55 0 2024-04-15T00:29:45.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/229: sync 2024-04-15T00:29:45.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/212: rename d8/dc/d23/d28/f3c to d8/dc/d23/d28/d3a/f47 0 2024-04-15T00:29:45.228 INFO:tasks.workunit.client.0.smithi029.stdout:3/231: link d17/d2f/d44/f48 d17/d2f/d44/f4f 0 2024-04-15T00:29:45.371 INFO:tasks.workunit.client.0.smithi029.stdout:6/224: dwrite d1/d8/db/f40 [0,4194304] 0 2024-04-15T00:29:45.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/230: dwrite d5/d15/d1f/d32/f3d [0,4194304] 0 2024-04-15T00:29:45.389 INFO:tasks.workunit.client.0.smithi029.stdout:7/194: fsync d0/d6/d1c/f9 0 2024-04-15T00:29:45.401 INFO:tasks.workunit.client.0.smithi029.stdout:5/238: creat d2/de/d13/d22/d26/d36/f53 x:0 0 0 2024-04-15T00:29:45.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/230: truncate d3/d13/f2f 175267 0 2024-04-15T00:29:45.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/231: stat d5/d15/d1f 0 2024-04-15T00:29:45.605 INFO:tasks.workunit.client.0.smithi029.stdout:3/232: readlink d17/l23 0 2024-04-15T00:29:45.778 INFO:tasks.workunit.client.0.smithi029.stdout:4/218: link de/d2b/c33 de/df/d1e/c48 0 2024-04-15T00:29:45.824 INFO:tasks.workunit.client.0.smithi029.stdout:9/218: creat d3/f4e x:0 0 0 2024-04-15T00:29:45.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/226: dwrite df/f21 [0,4194304] 0 2024-04-15T00:29:45.940 INFO:tasks.workunit.client.0.smithi029.stdout:2/231: fdatasync d3/d2a/f3a 0 2024-04-15T00:29:46.258 INFO:tasks.workunit.client.0.smithi029.stdout:8/213: mkdir d8/d48 0 2024-04-15T00:29:46.348 INFO:tasks.workunit.client.0.smithi029.stdout:0/232: rename d5/db/f10 to d5/d15/d1f/d32/f49 0 2024-04-15T00:29:46.354 INFO:tasks.workunit.client.0.smithi029.stdout:7/195: symlink d0/d6/l45 0 2024-04-15T00:29:46.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/219: rename de/f25 to de/d2b/d35/f49 0 2024-04-15T00:29:46.894 INFO:tasks.workunit.client.0.smithi029.stdout:0/233: read d5/d15/f1e [637352,18114] 0 2024-04-15T00:29:47.106 INFO:tasks.workunit.client.0.smithi029.stdout:3/233: write d17/d2a/f34 [266202,113652] 0 2024-04-15T00:29:47.236 INFO:tasks.workunit.client.0.smithi029.stdout:6/225: link d1/d8/db/c28 d1/d1e/d22/c47 0 2024-04-15T00:29:47.262 INFO:tasks.workunit.client.0.smithi029.stdout:8/214: getdents d8/da/d2f/d42 0 2024-04-15T00:29:47.277 INFO:tasks.workunit.client.0.smithi029.stdout:1/227: link df/l54 df/d32/d43/l56 0 2024-04-15T00:29:47.285 INFO:tasks.workunit.client.0.smithi029.stdout:1/228: read - df/d32/f3f zero size 2024-04-15T00:29:47.567 INFO:tasks.workunit.client.0.smithi029.stdout:6/226: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:29:47.663 INFO:tasks.workunit.client.0.smithi029.stdout:0/234: unlink d5/db/c47 0 2024-04-15T00:29:47.685 INFO:tasks.workunit.client.0.smithi029.stdout:3/234: fdatasync f15 0 2024-04-15T00:29:47.696 INFO:tasks.workunit.client.0.smithi029.stdout:1/229: dwrite df/f46 [0,4194304] 0 2024-04-15T00:29:47.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/239: mknod d2/de/d13/d22/c54 0 2024-04-15T00:29:47.931 INFO:tasks.workunit.client.0.smithi029.stdout:2/232: dwrite d3/d13/f2f [0,4194304] 0 2024-04-15T00:29:48.037 INFO:tasks.workunit.client.0.smithi029.stdout:3/235: chown d17/c25 22208396 1 2024-04-15T00:29:48.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/240: creat d2/de/d13/d22/d3c/d41/f55 x:0 0 0 2024-04-15T00:29:48.128 INFO:tasks.workunit.client.0.smithi029.stdout:7/196: dwrite d0/d6/d16/d26/f2b [0,4194304] 0 2024-04-15T00:29:48.211 INFO:tasks.workunit.client.0.smithi029.stdout:5/241: chown d2/de/d13/d22/d26/d36/f53 3 1 2024-04-15T00:29:48.261 INFO:tasks.workunit.client.0.smithi029.stdout:9/219: rename d3/l26 to d3/d6/d9/d29/l4f 0 2024-04-15T00:29:48.315 INFO:tasks.workunit.client.0.smithi029.stdout:8/215: write d8/dc/d23/d28/f44 [142824,104162] 0 2024-04-15T00:29:48.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/220: dread - d3/d6/d9/d15/d21/f2a zero size 2024-04-15T00:29:48.402 INFO:tasks.workunit.client.0.smithi029.stdout:6/227: link d1/f1c d1/d8/db/f48 0 2024-04-15T00:29:48.417 INFO:tasks.workunit.client.0.smithi029.stdout:0/235: creat d5/d15/f4a x:0 0 0 2024-04-15T00:29:48.444 INFO:tasks.workunit.client.0.smithi029.stdout:2/233: dread d3/d13/f16 [0,4194304] 0 2024-04-15T00:29:48.463 INFO:tasks.workunit.client.0.smithi029.stdout:7/197: creat d0/d6/d16/d26/f46 x:0 0 0 2024-04-15T00:29:48.488 INFO:tasks.workunit.client.0.smithi029.stdout:0/236: dread f2 [0,4194304] 0 2024-04-15T00:29:48.625 INFO:tasks.workunit.client.0.smithi029.stdout:9/221: truncate d3/d6/f17 1831428 0 2024-04-15T00:29:48.634 INFO:tasks.workunit.client.0.smithi029.stdout:1/230: write df/f15 [1366910,131054] 0 2024-04-15T00:29:48.696 INFO:tasks.workunit.client.0.smithi029.stdout:8/216: dread d8/f2c [0,4194304] 0 2024-04-15T00:29:48.704 INFO:tasks.workunit.client.0.smithi029.stdout:0/237: dwrite d5/d15/f4a [0,4194304] 0 2024-04-15T00:29:48.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/198: dread d0/d6/f8 [0,4194304] 0 2024-04-15T00:29:48.875 INFO:tasks.workunit.client.0.smithi029.stdout:0/238: dread d5/d15/f4a [0,4194304] 0 2024-04-15T00:29:48.987 INFO:tasks.workunit.client.0.smithi029.stdout:4/220: rename de/df/l38 to de/df/d1e/l4a 0 2024-04-15T00:29:49.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/234: mknod d3/d13/c48 0 2024-04-15T00:29:49.072 INFO:tasks.workunit.client.0.smithi029.stdout:8/217: creat d8/da/f49 x:0 0 0 2024-04-15T00:29:49.073 INFO:tasks.workunit.client.0.smithi029.stdout:1/231: dread - df/d32/d43/f44 zero size 2024-04-15T00:29:49.253 INFO:tasks.workunit.client.0.smithi029.stdout:7/199: fdatasync d0/d6/f3b 0 2024-04-15T00:29:49.296 INFO:tasks.workunit.client.0.smithi029.stdout:3/236: getdents d17 0 2024-04-15T00:29:49.301 INFO:tasks.workunit.client.0.smithi029.stdout:6/228: creat d1/d1e/f49 x:0 0 0 2024-04-15T00:29:49.302 INFO:tasks.workunit.client.0.smithi029.stdout:4/221: fdatasync de/df/d1e/f29 0 2024-04-15T00:29:49.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/218: dread d8/da/d2f/f36 [0,4194304] 0 2024-04-15T00:29:49.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/242: getdents d2/de/d13/d22/d3c/d41 0 2024-04-15T00:29:49.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/235: symlink d3/d13/l49 0 2024-04-15T00:29:49.635 INFO:tasks.workunit.client.0.smithi029.stdout:1/232: symlink df/l57 0 2024-04-15T00:29:49.670 INFO:tasks.workunit.client.0.smithi029.stdout:4/222: creat de/d3a/f4b x:0 0 0 2024-04-15T00:29:49.772 INFO:tasks.workunit.client.0.smithi029.stdout:6/229: creat d1/d8/db/f4a x:0 0 0 2024-04-15T00:29:49.783 INFO:tasks.workunit.client.0.smithi029.stdout:6/230: stat d1/d8/db/f4a 0 2024-04-15T00:29:49.909 INFO:tasks.workunit.client.0.smithi029.stdout:5/243: mknod d2/de/d13/d22/d26/d36/c56 0 2024-04-15T00:29:49.967 INFO:tasks.workunit.client.0.smithi029.stdout:9/222: getdents d3 0 2024-04-15T00:29:50.203 INFO:tasks.workunit.client.0.smithi029.stdout:2/236: mkdir d3/d2a/d46/d4a 0 2024-04-15T00:29:50.269 INFO:tasks.workunit.client.0.smithi029.stdout:1/233: dread df/d29/f2c [0,4194304] 0 2024-04-15T00:29:50.275 INFO:tasks.workunit.client.0.smithi029.stdout:7/200: symlink d0/d6/d16/d37/l47 0 2024-04-15T00:29:50.297 INFO:tasks.workunit.client.0.smithi029.stdout:7/201: readlink d0/d6/d39/d3c/l41 0 2024-04-15T00:29:50.391 INFO:tasks.workunit.client.0.smithi029.stdout:6/231: symlink d1/d8/l4b 0 2024-04-15T00:29:50.583 INFO:tasks.workunit.client.0.smithi029.stdout:2/237: fsync d3/d13/f16 0 2024-04-15T00:29:50.623 INFO:tasks.workunit.client.0.smithi029.stdout:8/219: dwrite d8/f15 [0,4194304] 0 2024-04-15T00:29:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:1/234: creat df/d29/d41/d4f/f58 x:0 0 0 2024-04-15T00:29:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:7/202: fsync d0/d6/f2c 0 2024-04-15T00:29:50.724 INFO:tasks.workunit.client.0.smithi029.stdout:0/239: link d5/db/l3c d5/d15/d1f/d32/l4b 0 2024-04-15T00:29:50.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/232: mknod d1/c4c 0 2024-04-15T00:29:50.799 INFO:tasks.workunit.client.0.smithi029.stdout:6/233: readlink d1/ld 0 2024-04-15T00:29:50.820 INFO:tasks.workunit.client.0.smithi029.stdout:4/223: write de/d3a/f42 [939611,66350] 0 2024-04-15T00:29:50.899 INFO:tasks.workunit.client.0.smithi029.stdout:3/237: dwrite d17/d2f/d44/f48 [0,4194304] 0 2024-04-15T00:29:51.235 INFO:tasks.workunit.client.0.smithi029.stdout:2/238: creat d3/d36/f4b x:0 0 0 2024-04-15T00:29:51.246 INFO:tasks.workunit.client.0.smithi029.stdout:2/239: chown d3/d13/d43/l45 8102681 1 2024-04-15T00:29:51.541 INFO:tasks.workunit.client.0.smithi029.stdout:5/244: dwrite d2/f17 [4194304,4194304] 0 2024-04-15T00:29:51.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/234: dread d1/f1c [0,4194304] 0 2024-04-15T00:29:51.678 INFO:tasks.workunit.client.0.smithi029.stdout:6/235: readlink d1/d8/l2b 0 2024-04-15T00:29:51.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/223: creat d3/d6/d9/f50 x:0 0 0 2024-04-15T00:29:51.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/224: fsync de/df/d1e/f24 0 2024-04-15T00:29:51.701 INFO:tasks.workunit.client.0.smithi029.stdout:6/236: stat d1/ld 0 2024-04-15T00:29:51.737 INFO:tasks.workunit.client.0.smithi029.stdout:3/238: mknod d17/d2f/d44/c50 0 2024-04-15T00:29:51.968 INFO:tasks.workunit.client.0.smithi029.stdout:0/240: mkdir d5/d4c 0 2024-04-15T00:29:52.005 INFO:tasks.workunit.client.0.smithi029.stdout:7/203: rename d0/d6/d16/c3a to d0/d6/d16/c48 0 2024-04-15T00:29:52.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/204: chown d0/d6/c3d 124 1 2024-04-15T00:29:52.022 INFO:tasks.workunit.client.0.smithi029.stdout:7/205: stat d0/d6/d16/d26/f28 0 2024-04-15T00:29:52.304 INFO:tasks.workunit.client.0.smithi029.stdout:6/237: creat d1/d8/db/f4d x:0 0 0 2024-04-15T00:29:52.332 INFO:tasks.workunit.client.0.smithi029.stdout:9/224: truncate d3/d6/d9/f49 329156 0 2024-04-15T00:29:52.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/225: dread - d3/d6/d9/f50 zero size 2024-04-15T00:29:52.454 INFO:tasks.workunit.client.0.smithi029.stdout:1/235: dwrite df/f42 [0,4194304] 0 2024-04-15T00:29:52.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/241: truncate d5/d15/d1f/f44 284351 0 2024-04-15T00:29:52.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/236: write df/d32/f36 [3885051,86810] 0 2024-04-15T00:29:52.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/238: fdatasync d1/f18 0 2024-04-15T00:29:52.771 INFO:tasks.workunit.client.0.smithi029.stdout:0/242: rename d5/db/d1a/c2c to d5/d4c/c4d 0 2024-04-15T00:29:52.849 INFO:tasks.workunit.client.0.smithi029.stdout:7/206: mkdir d0/d6/d39/d3c/d42/d49 0 2024-04-15T00:29:52.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/220: write d8/dc/d23/d28/d3a/f47 [462879,113077] 0 2024-04-15T00:29:53.007 INFO:tasks.workunit.client.0.smithi029.stdout:6/239: dread d1/f1f [0,4194304] 0 2024-04-15T00:29:53.057 INFO:tasks.workunit.client.0.smithi029.stdout:1/237: mkdir df/d32/d43/d4c/d55/d59 0 2024-04-15T00:29:53.114 INFO:tasks.workunit.client.0.smithi029.stdout:0/243: mkdir d5/d4c/d4e 0 2024-04-15T00:29:53.131 INFO:tasks.workunit.client.0.smithi029.stdout:5/245: link d2/de/d13/d22/f40 d2/de/f57 0 2024-04-15T00:29:53.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/207: fsync d0/f22 0 2024-04-15T00:29:53.181 INFO:tasks.workunit.client.0.smithi029.stdout:7/208: chown d0/d6/l27 15 1 2024-04-15T00:29:53.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/239: getdents d17/d2a/d33/d37 0 2024-04-15T00:29:53.297 INFO:tasks.workunit.client.0.smithi029.stdout:7/209: dwrite d0/d6/d16/d26/f2b [0,4194304] 0 2024-04-15T00:29:53.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/244: sync 2024-04-15T00:29:53.485 INFO:tasks.workunit.client.0.smithi029.stdout:4/225: dwrite de/d3a/f46 [0,4194304] 0 2024-04-15T00:29:53.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/246: fdatasync d2/f7 0 2024-04-15T00:29:53.614 INFO:tasks.workunit.client.0.smithi029.stdout:3/240: dread d17/d2a/f2c [0,4194304] 0 2024-04-15T00:29:53.625 INFO:tasks.workunit.client.0.smithi029.stdout:7/210: fsync d0/d6/d1c/fc 0 2024-04-15T00:29:53.687 INFO:tasks.workunit.client.0.smithi029.stdout:0/245: mknod d5/d4c/c4f 0 2024-04-15T00:29:53.729 INFO:tasks.workunit.client.0.smithi029.stdout:6/240: creat d1/d1e/f4e x:0 0 0 2024-04-15T00:29:53.731 INFO:tasks.workunit.client.0.smithi029.stdout:2/240: dwrite d3/d13/d14/f40 [0,4194304] 0 2024-04-15T00:29:53.803 INFO:tasks.workunit.client.0.smithi029.stdout:0/246: sync 2024-04-15T00:29:53.909 INFO:tasks.workunit.client.0.smithi029.stdout:4/226: creat de/df/d1e/f4c x:0 0 0 2024-04-15T00:29:53.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/226: dwrite d3/d6/d9/d15/d21/f32 [0,4194304] 0 2024-04-15T00:29:54.018 INFO:tasks.workunit.client.0.smithi029.stdout:2/241: dread d3/d13/f16 [0,4194304] 0 2024-04-15T00:29:54.031 INFO:tasks.workunit.client.0.smithi029.stdout:4/227: chown de/df/d1e/f24 19183234 1 2024-04-15T00:29:54.038 INFO:tasks.workunit.client.0.smithi029.stdout:4/228: readlink l5 0 2024-04-15T00:29:54.164 INFO:tasks.workunit.client.0.smithi029.stdout:8/221: write f7 [5650404,115910] 0 2024-04-15T00:29:54.204 INFO:tasks.workunit.client.0.smithi029.stdout:1/238: write df/f28 [995115,17626] 0 2024-04-15T00:29:54.419 INFO:tasks.workunit.client.0.smithi029.stdout:2/242: rename d3/lb to d3/d2a/d46/l4c 0 2024-04-15T00:29:54.536 INFO:tasks.workunit.client.0.smithi029.stdout:7/211: creat d0/d6/d39/d3c/d42/d49/f4a x:0 0 0 2024-04-15T00:29:54.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/222: dread d8/da/ff [0,4194304] 0 2024-04-15T00:29:54.666 INFO:tasks.workunit.client.0.smithi029.stdout:1/239: symlink df/d32/l5a 0 2024-04-15T00:29:54.954 INFO:tasks.workunit.client.0.smithi029.stdout:7/212: rmdir d0/d6/d1c 39 2024-04-15T00:29:54.959 INFO:tasks.workunit.client.0.smithi029.stdout:8/223: mkdir d8/d4a 0 2024-04-15T00:29:54.974 INFO:tasks.workunit.client.0.smithi029.stdout:5/247: write d2/fa [449715,124370] 0 2024-04-15T00:29:55.033 INFO:tasks.workunit.client.0.smithi029.stdout:9/227: write d3/d6/d9/d15/d21/f2a [192376,20872] 0 2024-04-15T00:29:55.043 INFO:tasks.workunit.client.0.smithi029.stdout:6/241: link d1/d8/db/l45 d1/d8/db/l4f 0 2024-04-15T00:29:55.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/242: sync 2024-04-15T00:29:55.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/247: dwrite d5/d15/d27/f2a [0,4194304] 0 2024-04-15T00:29:55.268 INFO:tasks.workunit.client.0.smithi029.stdout:3/241: dwrite ff [0,4194304] 0 2024-04-15T00:29:55.364 INFO:tasks.workunit.client.0.smithi029.stdout:8/224: truncate d8/f38 470840 0 2024-04-15T00:29:55.381 INFO:tasks.workunit.client.0.smithi029.stdout:7/213: rename d0/d6/d16/c3e to d0/d6/d39/d3c/d42/c4b 0 2024-04-15T00:29:55.385 INFO:tasks.workunit.client.0.smithi029.stdout:2/243: write d3/d2a/f3a [648534,77217] 0 2024-04-15T00:29:55.459 INFO:tasks.workunit.client.0.smithi029.stdout:6/243: write d1/d1e/f27 [1310096,75345] 0 2024-04-15T00:29:55.497 INFO:tasks.workunit.client.0.smithi029.stdout:5/248: truncate d2/de/d13/d22/d3c/f50 2792388 0 2024-04-15T00:29:55.524 INFO:tasks.workunit.client.0.smithi029.stdout:0/248: chown d5/d15/d27/c33 213719 1 2024-04-15T00:29:55.542 INFO:tasks.workunit.client.0.smithi029.stdout:9/228: mknod d3/d6/d30/d3b/c51 0 2024-04-15T00:29:55.572 INFO:tasks.workunit.client.0.smithi029.stdout:2/244: chown d3/d13/f2f 124201597 1 2024-04-15T00:29:55.617 INFO:tasks.workunit.client.0.smithi029.stdout:3/242: read d17/d2a/d33/d37/f41 [193244,97072] 0 2024-04-15T00:29:55.617 INFO:tasks.workunit.client.0.smithi029.stdout:6/244: readlink d1/d8/l2b 0 2024-04-15T00:29:55.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/229: dwrite de/d2b/d35/f3d [0,4194304] 0 2024-04-15T00:29:55.817 INFO:tasks.workunit.client.0.smithi029.stdout:8/225: creat d8/dc/d23/d28/d30/d39/f4b x:0 0 0 2024-04-15T00:29:55.838 INFO:tasks.workunit.client.0.smithi029.stdout:0/249: mkdir d5/db/d1a/d50 0 2024-04-15T00:29:55.844 INFO:tasks.workunit.client.0.smithi029.stdout:1/240: dwrite df/f1c [0,4194304] 0 2024-04-15T00:29:55.845 INFO:tasks.workunit.client.0.smithi029.stdout:3/243: chown d17/d2a/c3e 3 1 2024-04-15T00:29:55.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/244: readlink l5 0 2024-04-15T00:29:55.948 INFO:tasks.workunit.client.0.smithi029.stdout:2/245: mknod d3/d36/c4d 0 2024-04-15T00:29:55.976 INFO:tasks.workunit.client.0.smithi029.stdout:4/230: dread - de/df/d1e/f4c zero size 2024-04-15T00:29:56.013 INFO:tasks.workunit.client.0.smithi029.stdout:4/231: chown de/d2b 11301 1 2024-04-15T00:29:56.029 INFO:tasks.workunit.client.0.smithi029.stdout:3/245: chown d17/c18 1 1 2024-04-15T00:29:56.053 INFO:tasks.workunit.client.0.smithi029.stdout:7/214: dwrite d0/d6/f44 [0,4194304] 0 2024-04-15T00:29:56.055 INFO:tasks.workunit.client.0.smithi029.stdout:9/229: mkdir d3/d6/d9/d15/d4a/d52 0 2024-04-15T00:29:56.174 INFO:tasks.workunit.client.0.smithi029.stdout:7/215: write d0/d6/d39/d3c/d42/d49/f4a [824980,16329] 0 2024-04-15T00:29:56.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/246: rmdir d3/d13/d43 39 2024-04-15T00:29:56.569 INFO:tasks.workunit.client.0.smithi029.stdout:5/249: write d2/de/d13/d22/d26/d36/f45 [562975,50382] 0 2024-04-15T00:29:56.582 INFO:tasks.workunit.client.0.smithi029.stdout:6/245: write d1/d8/db/f24 [4810995,19640] 0 2024-04-15T00:29:56.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/232: unlink de/d3a/f45 0 2024-04-15T00:29:56.651 INFO:tasks.workunit.client.0.smithi029.stdout:4/233: chown de/d2b/f2a 9549161 1 2024-04-15T00:29:56.766 INFO:tasks.workunit.client.0.smithi029.stdout:3/246: unlink d17/f21 0 2024-04-15T00:29:56.782 INFO:tasks.workunit.client.0.smithi029.stdout:7/216: read d0/d6/f2f [2140952,31685] 0 2024-04-15T00:29:56.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/217: chown d0/d6/d16/c2d 4 1 2024-04-15T00:29:56.841 INFO:tasks.workunit.client.0.smithi029.stdout:9/230: rename d3/d6/d9/d15/d4a/d52 to d3/d6/d9/d15/d4a/d53 0 2024-04-15T00:29:56.852 INFO:tasks.workunit.client.0.smithi029.stdout:9/231: dread - d3/d6/d9/d35/f36 zero size 2024-04-15T00:29:56.888 INFO:tasks.workunit.client.0.smithi029.stdout:0/250: mkdir d5/d15/d27/d51 0 2024-04-15T00:29:56.951 INFO:tasks.workunit.client.0.smithi029.stdout:1/241: rename df/l54 to df/d32/d43/d4c/d55/d59/l5b 0 2024-04-15T00:29:57.103 INFO:tasks.workunit.client.0.smithi029.stdout:6/246: unlink d1/d1e/d22/f43 0 2024-04-15T00:29:57.108 INFO:tasks.workunit.client.0.smithi029.stdout:5/250: truncate d2/de/d13/f2a 664597 0 2024-04-15T00:29:57.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/247: read d3/f5 [593458,116910] 0 2024-04-15T00:29:57.140 INFO:tasks.workunit.client.0.smithi029.stdout:4/234: mknod de/d2b/c4d 0 2024-04-15T00:29:57.269 INFO:tasks.workunit.client.0.smithi029.stdout:8/226: dwrite d8/da/f1e [0,4194304] 0 2024-04-15T00:29:57.485 INFO:tasks.workunit.client.0.smithi029.stdout:0/251: creat d5/db/d1a/f52 x:0 0 0 2024-04-15T00:29:57.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/252: dread - d5/db/d1a/f52 zero size 2024-04-15T00:29:57.638 INFO:tasks.workunit.client.0.smithi029.stdout:1/242: creat df/d32/d43/d4c/f5c x:0 0 0 2024-04-15T00:29:57.642 INFO:tasks.workunit.client.0.smithi029.stdout:6/247: creat d1/d8/db/f50 x:0 0 0 2024-04-15T00:29:57.777 INFO:tasks.workunit.client.0.smithi029.stdout:2/248: mkdir d3/d2a/d4e 0 2024-04-15T00:29:57.781 INFO:tasks.workunit.client.0.smithi029.stdout:5/251: symlink d2/de/d13/d22/d26/d36/l58 0 2024-04-15T00:29:57.861 INFO:tasks.workunit.client.0.smithi029.stdout:8/227: truncate d8/fd 1517229 0 2024-04-15T00:29:57.873 INFO:tasks.workunit.client.0.smithi029.stdout:8/228: chown d8/dc/f1c 0 1 2024-04-15T00:29:57.976 INFO:tasks.workunit.client.0.smithi029.stdout:1/243: fdatasync df/f22 0 2024-04-15T00:29:57.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/244: readlink l6 0 2024-04-15T00:29:57.994 INFO:tasks.workunit.client.0.smithi029.stdout:6/248: symlink d1/l51 0 2024-04-15T00:29:58.180 INFO:tasks.workunit.client.0.smithi029.stdout:1/245: sync 2024-04-15T00:29:58.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/252: creat d2/d1a/f59 x:0 0 0 2024-04-15T00:29:58.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/229: rmdir d8 39 2024-04-15T00:29:58.480 INFO:tasks.workunit.client.0.smithi029.stdout:1/246: creat df/d32/d43/d4c/d55/f5d x:0 0 0 2024-04-15T00:29:58.498 INFO:tasks.workunit.client.0.smithi029.stdout:9/232: write d3/f4e [543508,11203] 0 2024-04-15T00:29:58.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/218: dwrite d0/f22 [0,4194304] 0 2024-04-15T00:29:58.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/247: mkdir d17/d2a/d4c/d51 0 2024-04-15T00:29:58.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/249: rename d1/d8/lc to d1/d1e/l52 0 2024-04-15T00:29:58.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/230: chown d8/f38 31 1 2024-04-15T00:29:58.765 INFO:tasks.workunit.client.0.smithi029.stdout:8/231: write f7 [6995342,108816] 0 2024-04-15T00:29:58.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/232: chown d8/dc/c21 522077182 1 2024-04-15T00:29:58.792 INFO:tasks.workunit.client.0.smithi029.stdout:7/219: read - d0/f36 zero size 2024-04-15T00:29:58.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/247: creat df/d32/d43/d4c/d55/f5e x:0 0 0 2024-04-15T00:29:58.936 INFO:tasks.workunit.client.0.smithi029.stdout:9/233: creat d3/d6/d9/d15/d21/f54 x:0 0 0 2024-04-15T00:29:59.044 INFO:tasks.workunit.client.0.smithi029.stdout:3/248: dread d17/f26 [0,4194304] 0 2024-04-15T00:29:59.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/235: dwrite de/f2e [0,4194304] 0 2024-04-15T00:29:59.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/250: creat d1/d8/f53 x:0 0 0 2024-04-15T00:29:59.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/253: dwrite d5/f13 [0,4194304] 0 2024-04-15T00:29:59.279 INFO:tasks.workunit.client.0.smithi029.stdout:2/249: write d3/dd/d2d/f37 [210296,109358] 0 2024-04-15T00:29:59.279 INFO:tasks.workunit.client.0.smithi029.stdout:9/234: rename d3/d6/d9/d15/d4a to d3/d6/d9/d15/d4a/d53/d55 22 2024-04-15T00:29:59.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:59.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:29:59.396 INFO:tasks.workunit.client.0.smithi029.stdout:3/249: unlink f3 0 2024-04-15T00:29:59.446 INFO:tasks.workunit.client.0.smithi029.stdout:4/236: rmdir de/d2b 39 2024-04-15T00:29:59.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/253: write d2/de/f2e [320931,35847] 0 2024-04-15T00:29:59.451 INFO:tasks.workunit.client.0.smithi029.stdout:1/248: dread df/f30 [0,4194304] 0 2024-04-15T00:29:59.499 INFO:tasks.workunit.client.0.smithi029.stdout:6/251: dwrite d1/d8/f53 [0,4194304] 0 2024-04-15T00:29:59.584 INFO:tasks.workunit.client.0.smithi029.stdout:9/235: truncate d3/d6/d9/d15/d21/f54 281809 0 2024-04-15T00:29:59.605 INFO:tasks.workunit.client.0.smithi029.stdout:0/254: dread d5/d15/d1f/d32/f43 [0,4194304] 0 2024-04-15T00:29:59.629 INFO:tasks.workunit.client.0.smithi029.stdout:2/250: read d3/d13/d14/f1e [380686,43302] 0 2024-04-15T00:29:59.640 INFO:tasks.workunit.client.0.smithi029.stdout:2/251: chown d3/d13/d14/l2e 5352403 1 2024-04-15T00:29:59.655 INFO:tasks.workunit.client.0.smithi029.stdout:2/252: fsync d3/dd/d2d/f37 0 2024-04-15T00:29:59.777 INFO:tasks.workunit.client.0.smithi029.stdout:1/249: read - df/d32/f50 zero size 2024-04-15T00:29:59.804 INFO:tasks.workunit.client.0.smithi029.stdout:2/253: dwrite d3/dd/d2d/f37 [0,4194304] 0 2024-04-15T00:29:59.885 INFO:tasks.workunit.client.0.smithi029.stdout:8/233: write d8/dc/f1c [4799917,104058] 0 2024-04-15T00:29:59.922 INFO:tasks.workunit.client.0.smithi029.stdout:1/250: stat df/d32/f3f 0 2024-04-15T00:30:00.038 INFO:tasks.workunit.client.0.smithi029.stdout:7/220: dwrite d0/f36 [0,4194304] 0 2024-04-15T00:30:00.158 INFO:tasks.workunit.client.0.smithi029.stdout:9/236: fsync d3/d6/d9/d15/f1f 0 2024-04-15T00:30:00.207 INFO:tasks.workunit.client.0.smithi029.stdout:0/255: fsync d5/f7 0 2024-04-15T00:30:00.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/250: creat d17/f52 x:0 0 0 2024-04-15T00:30:00.518 INFO:tasks.workunit.client.0.smithi029.stdout:6/252: dwrite d1/f1c [0,4194304] 0 2024-04-15T00:30:00.606 INFO:tasks.workunit.client.0.smithi029.stdout:5/254: creat d2/de/d13/d22/f5a x:0 0 0 2024-04-15T00:30:00.610 INFO:tasks.workunit.client.0.smithi029.stdout:9/237: mknod d3/c56 0 2024-04-15T00:30:00.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/256: rename d5/db to d5/db/d53 22 2024-04-15T00:30:00.835 INFO:tasks.workunit.client.0.smithi029.stdout:2/254: dwrite d3/f5 [0,4194304] 0 2024-04-15T00:30:00.970 INFO:tasks.workunit.client.0.smithi029.stdout:6/253: unlink d1/d8/l42 0 2024-04-15T00:30:00.995 INFO:tasks.workunit.client.0.smithi029.stdout:8/234: link d8/da/ff d8/dc/d23/d28/d30/f4c 0 2024-04-15T00:30:01.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/237: link de/d2b/d35/c36 de/c4e 0 2024-04-15T00:30:01.123 INFO:tasks.workunit.client.0.smithi029.stdout:1/251: dwrite df/f30 [0,4194304] 0 2024-04-15T00:30:01.384 INFO:tasks.workunit.client.0.smithi029.stdout:9/238: chown d3/c56 7369 1 2024-04-15T00:30:01.520 INFO:tasks.workunit.client.0.smithi029.stdout:2/255: mkdir d3/d36/d4f 0 2024-04-15T00:30:01.567 INFO:tasks.workunit.client.0.smithi029.stdout:0/257: mkdir d5/d54 0 2024-04-15T00:30:01.682 INFO:tasks.workunit.client.0.smithi029.stdout:7/221: write d0/d6/d1c/fc [1140451,8561] 0 2024-04-15T00:30:01.751 INFO:tasks.workunit.client.0.smithi029.stdout:3/251: write d17/d2a/f2c [303782,102612] 0 2024-04-15T00:30:01.942 INFO:tasks.workunit.client.0.smithi029.stdout:4/238: creat de/d2b/d35/f4f x:0 0 0 2024-04-15T00:30:01.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/235: chown d8/dc/d23/d28/d30/f4c 351179 1 2024-04-15T00:30:02.070 INFO:tasks.workunit.client.0.smithi029.stdout:5/255: rmdir d2/de/d44 0 2024-04-15T00:30:02.076 INFO:tasks.workunit.client.0.smithi029.stdout:0/258: symlink d5/db/d1a/l55 0 2024-04-15T00:30:02.419 INFO:tasks.workunit.client.0.smithi029.stdout:9/239: chown d3/d6/d9/fd 12 1 2024-04-15T00:30:02.589 INFO:tasks.workunit.client.0.smithi029.stdout:4/239: fsync de/d2b/f2c 0 2024-04-15T00:30:02.589 INFO:tasks.workunit.client.0.smithi029.stdout:8/236: creat d8/da/d2f/f4d x:0 0 0 2024-04-15T00:30:02.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/256: fsync d2/f17 0 2024-04-15T00:30:02.800 INFO:tasks.workunit.client.0.smithi029.stdout:9/240: truncate d3/d6/d9/d15/d21/f28 411347 0 2024-04-15T00:30:02.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/254: write d1/d1e/d22/f34 [4261306,72827] 0 2024-04-15T00:30:02.950 INFO:tasks.workunit.client.0.smithi029.stdout:0/259: symlink d5/d15/l56 0 2024-04-15T00:30:03.021 INFO:tasks.workunit.client.0.smithi029.stdout:1/252: dwrite df/f25 [0,4194304] 0 2024-04-15T00:30:03.086 INFO:tasks.workunit.client.0.smithi029.stdout:5/257: symlink d2/de/d13/l5b 0 2024-04-15T00:30:03.309 INFO:tasks.workunit.client.0.smithi029.stdout:1/253: sync 2024-04-15T00:30:03.315 INFO:tasks.workunit.client.0.smithi029.stdout:1/254: chown df/d29/d41 75 1 2024-04-15T00:30:03.466 INFO:tasks.workunit.client.0.smithi029.stdout:4/240: mknod de/c50 0 2024-04-15T00:30:03.510 INFO:tasks.workunit.client.0.smithi029.stdout:1/255: symlink df/d32/d43/d4c/d55/d59/l5f 0 2024-04-15T00:30:03.572 INFO:tasks.workunit.client.0.smithi029.stdout:5/258: creat d2/d24/f5c x:0 0 0 2024-04-15T00:30:03.583 INFO:tasks.workunit.client.0.smithi029.stdout:7/222: write d0/d6/d1c/fe [5277441,19099] 0 2024-04-15T00:30:03.634 INFO:tasks.workunit.client.0.smithi029.stdout:4/241: symlink de/d3a/l51 0 2024-04-15T00:30:03.771 INFO:tasks.workunit.client.0.smithi029.stdout:3/252: write d17/f45 [539559,59361] 0 2024-04-15T00:30:03.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/255: getdents d1/d8 0 2024-04-15T00:30:03.865 INFO:tasks.workunit.client.0.smithi029.stdout:3/253: sync 2024-04-15T00:30:03.873 INFO:tasks.workunit.client.0.smithi029.stdout:4/242: truncate de/df/d1e/f29 1982879 0 2024-04-15T00:30:04.204 INFO:tasks.workunit.client.0.smithi029.stdout:2/256: rmdir d3/d13 39 2024-04-15T00:30:04.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/237: write d8/fd [2378212,27675] 0 2024-04-15T00:30:04.283 INFO:tasks.workunit.client.0.smithi029.stdout:9/241: write d3/d6/f17 [2376848,30005] 0 2024-04-15T00:30:04.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/260: dwrite d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:30:04.447 INFO:tasks.workunit.client.0.smithi029.stdout:3/254: mknod d17/d2f/d3c/c53 0 2024-04-15T00:30:04.543 INFO:tasks.workunit.client.0.smithi029.stdout:1/256: write df/d29/d41/f47 [528452,14876] 0 2024-04-15T00:30:04.553 INFO:tasks.workunit.client.0.smithi029.stdout:5/259: write d2/de/d13/d22/d26/d36/f38 [420946,55612] 0 2024-04-15T00:30:04.649 INFO:tasks.workunit.client.0.smithi029.stdout:4/243: dwrite f3 [0,4194304] 0 2024-04-15T00:30:04.714 INFO:tasks.workunit.client.0.smithi029.stdout:7/223: getdents d0/d6/d39/d3c/d42 0 2024-04-15T00:30:04.721 INFO:tasks.workunit.client.0.smithi029.stdout:8/238: truncate d8/f9 6493913 0 2024-04-15T00:30:04.733 INFO:tasks.workunit.client.0.smithi029.stdout:0/261: truncate d5/d15/d27/f2a 1201876 0 2024-04-15T00:30:04.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/242: dread - d3/d6/d9/d15/d4a/f4b zero size 2024-04-15T00:30:04.760 INFO:tasks.workunit.client.0.smithi029.stdout:0/262: stat d5/d15 0 2024-04-15T00:30:04.833 INFO:tasks.workunit.client.0.smithi029.stdout:8/239: sync 2024-04-15T00:30:04.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/257: mkdir d3/d50 0 2024-04-15T00:30:04.919 INFO:tasks.workunit.client.0.smithi029.stdout:5/260: dread d2/de/d13/d22/d3c/f50 [0,4194304] 0 2024-04-15T00:30:04.942 INFO:tasks.workunit.client.0.smithi029.stdout:6/256: getdents d1/d1e 0 2024-04-15T00:30:05.006 INFO:tasks.workunit.client.0.smithi029.stdout:3/255: write d17/d2f/d44/f48 [2909701,114198] 0 2024-04-15T00:30:05.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/257: write df/d29/d41/f4e [2258304,52638] 0 2024-04-15T00:30:05.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/243: mkdir d3/d6/d30/d3b/d3c/d57 0 2024-04-15T00:30:05.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/258: stat df/d32/f3f 0 2024-04-15T00:30:05.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/224: dread d0/d6/d1c/f1b [0,4194304] 0 2024-04-15T00:30:05.425 INFO:tasks.workunit.client.0.smithi029.stdout:8/240: rename d8/dc/d23/d28/d30/d39/f3f to d8/dc/d23/f4e 0 2024-04-15T00:30:05.457 INFO:tasks.workunit.client.0.smithi029.stdout:4/244: dwrite de/d3a/f46 [0,4194304] 0 2024-04-15T00:30:05.713 INFO:tasks.workunit.client.0.smithi029.stdout:2/258: unlink d3/f41 0 2024-04-15T00:30:05.721 INFO:tasks.workunit.client.0.smithi029.stdout:5/261: creat d2/de/d13/d22/d3c/d41/f5d x:0 0 0 2024-04-15T00:30:05.756 INFO:tasks.workunit.client.0.smithi029.stdout:0/263: mkdir d5/d15/d57 0 2024-04-15T00:30:05.763 INFO:tasks.workunit.client.0.smithi029.stdout:3/256: chown d17/f20 24468 1 2024-04-15T00:30:05.782 INFO:tasks.workunit.client.0.smithi029.stdout:1/259: rename df/c11 to df/d32/d43/c60 0 2024-04-15T00:30:05.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/262: dread - d2/d1a/d2d/f48 zero size 2024-04-15T00:30:05.956 INFO:tasks.workunit.client.0.smithi029.stdout:3/257: dread - d17/f4d zero size 2024-04-15T00:30:05.983 INFO:tasks.workunit.client.0.smithi029.stdout:6/257: dread d1/d8/db/f24 [0,4194304] 0 2024-04-15T00:30:05.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/258: stat d17/f4d 0 2024-04-15T00:30:06.005 INFO:tasks.workunit.client.0.smithi029.stdout:6/258: dread - d1/d8/f3d zero size 2024-04-15T00:30:06.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/244: write d3/d6/d9/f22 [786084,104575] 0 2024-04-15T00:30:06.455 INFO:tasks.workunit.client.0.smithi029.stdout:2/259: mkdir d3/d50/d51 0 2024-04-15T00:30:06.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/225: write d0/d6/f25 [4460032,20108] 0 2024-04-15T00:30:06.619 INFO:tasks.workunit.client.0.smithi029.stdout:1/260: mknod df/d29/d41/d4f/c61 0 2024-04-15T00:30:06.646 INFO:tasks.workunit.client.0.smithi029.stdout:6/259: rename d1/f1f to d1/d8/f54 0 2024-04-15T00:30:06.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/260: chown d1/d8/f3d 40 1 2024-04-15T00:30:07.093 INFO:tasks.workunit.client.0.smithi029.stdout:8/241: getdents d8/da/d2f 0 2024-04-15T00:30:07.118 INFO:tasks.workunit.client.0.smithi029.stdout:4/245: getdents de/d2b/d35 0 2024-04-15T00:30:07.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/226: fsync d0/d6/d16/d26/f28 0 2024-04-15T00:30:07.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/246: dread - de/df/d1e/f24 zero size 2024-04-15T00:30:07.162 INFO:tasks.workunit.client.0.smithi029.stdout:4/247: chown de/d2b/d35 4076345 1 2024-04-15T00:30:07.171 INFO:tasks.workunit.client.0.smithi029.stdout:0/264: mknod d5/d15/d1f/c58 0 2024-04-15T00:30:07.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/261: fdatasync df/d29/d41/f48 0 2024-04-15T00:30:07.365 INFO:tasks.workunit.client.0.smithi029.stdout:2/260: fsync d3/dd/f30 0 2024-04-15T00:30:07.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/263: write d2/de/d13/d22/d26/d36/d4d/f51 [804595,5601] 0 2024-04-15T00:30:07.487 INFO:tasks.workunit.client.0.smithi029.stdout:8/242: dread d8/da/f1e [0,4194304] 0 2024-04-15T00:30:07.580 INFO:tasks.workunit.client.0.smithi029.stdout:9/245: write d3/d6/f16 [3697343,97442] 0 2024-04-15T00:30:07.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/243: symlink d8/dc/d23/d28/d30/l4f 0 2024-04-15T00:30:07.930 INFO:tasks.workunit.client.0.smithi029.stdout:8/244: dread d8/da/d2f/f36 [0,4194304] 0 2024-04-15T00:30:07.939 INFO:tasks.workunit.client.0.smithi029.stdout:4/248: mkdir de/df/d52 0 2024-04-15T00:30:07.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/245: dread d8/f2c [0,4194304] 0 2024-04-15T00:30:07.972 INFO:tasks.workunit.client.0.smithi029.stdout:0/265: symlink d5/d15/d27/l59 0 2024-04-15T00:30:08.025 INFO:tasks.workunit.client.0.smithi029.stdout:3/259: write d17/f29 [848113,45603] 0 2024-04-15T00:30:08.212 INFO:tasks.workunit.client.0.smithi029.stdout:6/261: dwrite d1/f20 [0,4194304] 0 2024-04-15T00:30:08.295 INFO:tasks.workunit.client.0.smithi029.stdout:7/227: write d0/d6/f44 [3076924,89911] 0 2024-04-15T00:30:08.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/262: readlink d1/d8/db/l26 0 2024-04-15T00:30:08.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/260: dread d17/d2a/f34 [0,4194304] 0 2024-04-15T00:30:08.543 INFO:tasks.workunit.client.0.smithi029.stdout:8/246: write d8/da/f1e [844638,55613] 0 2024-04-15T00:30:08.547 INFO:tasks.workunit.client.0.smithi029.stdout:0/266: write d5/d15/d1f/d32/f43 [1162053,97586] 0 2024-04-15T00:30:08.676 INFO:tasks.workunit.client.0.smithi029.stdout:7/228: symlink d0/d6/d39/d3c/d42/d49/l4c 0 2024-04-15T00:30:08.702 INFO:tasks.workunit.client.0.smithi029.stdout:6/263: rename d1/d8/ca to d1/c55 0 2024-04-15T00:30:08.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/246: getdents d3/d6/d9/d15/d21 0 2024-04-15T00:30:08.813 INFO:tasks.workunit.client.0.smithi029.stdout:8/247: creat d8/f50 x:0 0 0 2024-04-15T00:30:08.971 INFO:tasks.workunit.client.0.smithi029.stdout:0/267: fsync d5/db/f3b 0 2024-04-15T00:30:09.042 INFO:tasks.workunit.client.0.smithi029.stdout:4/249: dwrite de/df/d1e/f2d [0,4194304] 0 2024-04-15T00:30:09.111 INFO:tasks.workunit.client.0.smithi029.stdout:5/264: dwrite f0 [4194304,4194304] 0 2024-04-15T00:30:09.153 INFO:tasks.workunit.client.0.smithi029.stdout:7/229: chown d0/d6/c34 85 1 2024-04-15T00:30:09.157 INFO:tasks.workunit.client.0.smithi029.stdout:2/261: dwrite d3/d13/d14/f40 [4194304,4194304] 0 2024-04-15T00:30:09.271 INFO:tasks.workunit.client.0.smithi029.stdout:1/262: dwrite df/f42 [0,4194304] 0 2024-04-15T00:30:09.386 INFO:tasks.workunit.client.0.smithi029.stdout:0/268: creat d5/d4c/f5a x:0 0 0 2024-04-15T00:30:09.391 INFO:tasks.workunit.client.0.smithi029.stdout:6/264: write d1/d8/f3d [281452,3620] 0 2024-04-15T00:30:09.403 INFO:tasks.workunit.client.0.smithi029.stdout:8/248: read d8/f9 [3973276,127732] 0 2024-04-15T00:30:09.408 INFO:tasks.workunit.client.0.smithi029.stdout:5/265: fsync d2/f8 0 2024-04-15T00:30:09.460 INFO:tasks.workunit.client.0.smithi029.stdout:3/261: dread d17/d2a/f36 [0,4194304] 0 2024-04-15T00:30:09.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/250: symlink de/df/l53 0 2024-04-15T00:30:09.519 INFO:tasks.workunit.client.0.smithi029.stdout:2/262: symlink d3/d2a/l52 0 2024-04-15T00:30:09.681 INFO:tasks.workunit.client.0.smithi029.stdout:8/249: dread d8/f9 [0,4194304] 0 2024-04-15T00:30:09.754 INFO:tasks.workunit.client.0.smithi029.stdout:9/247: rename d3/d6/d9/d15/d21 to d3/d6/d30/d3b/d58 0 2024-04-15T00:30:09.777 INFO:tasks.workunit.client.0.smithi029.stdout:6/265: write d1/d8/db/f24 [3556133,59697] 0 2024-04-15T00:30:09.781 INFO:tasks.workunit.client.0.smithi029.stdout:7/230: rename d0 to d0/d6/d16/d4d 22 2024-04-15T00:30:09.813 INFO:tasks.workunit.client.0.smithi029.stdout:6/266: chown d1/d8/db/d38/c3c 1108316 1 2024-04-15T00:30:09.874 INFO:tasks.workunit.client.0.smithi029.stdout:8/250: creat d8/dc/d23/f51 x:0 0 0 2024-04-15T00:30:09.983 INFO:tasks.workunit.client.0.smithi029.stdout:1/263: creat df/f62 x:0 0 0 2024-04-15T00:30:09.986 INFO:tasks.workunit.client.0.smithi029.stdout:4/251: mkdir de/d54 0 2024-04-15T00:30:10.231 INFO:tasks.workunit.client.0.smithi029.stdout:2/263: mkdir d3/d53 0 2024-04-15T00:30:10.239 INFO:tasks.workunit.client.0.smithi029.stdout:6/267: rmdir d1/d8/db/d38 39 2024-04-15T00:30:10.252 INFO:tasks.workunit.client.0.smithi029.stdout:5/266: creat d2/de/d13/d22/f5e x:0 0 0 2024-04-15T00:30:10.270 INFO:tasks.workunit.client.0.smithi029.stdout:7/231: dread - d0/d6/d16/d26/f40 zero size 2024-04-15T00:30:10.284 INFO:tasks.workunit.client.0.smithi029.stdout:8/251: dread - d8/da/f43 zero size 2024-04-15T00:30:10.364 INFO:tasks.workunit.client.0.smithi029.stdout:2/264: chown d3/d13/d14/c25 115 1 2024-04-15T00:30:10.381 INFO:tasks.workunit.client.0.smithi029.stdout:3/262: link d17/l23 d17/d2a/d4c/d51/l54 0 2024-04-15T00:30:10.432 INFO:tasks.workunit.client.0.smithi029.stdout:6/268: mkdir d1/d1e/d56 0 2024-04-15T00:30:10.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/232: rmdir d0/d6/d1c 39 2024-04-15T00:30:10.441 INFO:tasks.workunit.client.0.smithi029.stdout:0/269: dwrite d5/d15/d1f/f44 [0,4194304] 0 2024-04-15T00:30:10.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/252: chown d8/dc/d23/d28/d30/l4f 4952 1 2024-04-15T00:30:10.542 INFO:tasks.workunit.client.0.smithi029.stdout:9/248: creat d3/d6/f59 x:0 0 0 2024-04-15T00:30:10.548 INFO:tasks.workunit.client.0.smithi029.stdout:5/267: creat d2/de/d13/d22/d3c/d41/f5f x:0 0 0 2024-04-15T00:30:10.556 INFO:tasks.workunit.client.0.smithi029.stdout:8/253: stat d8/l35 0 2024-04-15T00:30:10.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/268: chown d2/de/d13/d22/d26/l3d 23 1 2024-04-15T00:30:10.626 INFO:tasks.workunit.client.0.smithi029.stdout:0/270: dread d5/d15/d1f/f44 [0,4194304] 0 2024-04-15T00:30:10.793 INFO:tasks.workunit.client.0.smithi029.stdout:3/263: dread - d17/f52 zero size 2024-04-15T00:30:11.005 INFO:tasks.workunit.client.0.smithi029.stdout:4/252: dwrite de/d2b/f30 [0,4194304] 0 2024-04-15T00:30:11.066 INFO:tasks.workunit.client.0.smithi029.stdout:0/271: unlink d5/ce 0 2024-04-15T00:30:11.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/264: getdents df/d29/d41 0 2024-04-15T00:30:11.188 INFO:tasks.workunit.client.0.smithi029.stdout:5/269: dread d2/de/d13/d22/d26/d36/f38 [0,4194304] 0 2024-04-15T00:30:11.216 INFO:tasks.workunit.client.0.smithi029.stdout:9/249: symlink d3/d6/l5a 0 2024-04-15T00:30:11.263 INFO:tasks.workunit.client.0.smithi029.stdout:2/265: dwrite d3/dd/f27 [0,4194304] 0 2024-04-15T00:30:11.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/266: chown d3/l15 425693424 1 2024-04-15T00:30:11.380 INFO:tasks.workunit.client.0.smithi029.stdout:7/233: write d0/d6/d16/d26/f46 [236800,91256] 0 2024-04-15T00:30:11.385 INFO:tasks.workunit.client.0.smithi029.stdout:0/272: dread - d5/db/f45 zero size 2024-04-15T00:30:11.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/254: write d8/f38 [428224,60806] 0 2024-04-15T00:30:11.404 INFO:tasks.workunit.client.0.smithi029.stdout:1/265: read df/d29/d41/f4e [2892866,130976] 0 2024-04-15T00:30:11.493 INFO:tasks.workunit.client.0.smithi029.stdout:1/266: dread - df/f3c zero size 2024-04-15T00:30:11.634 INFO:tasks.workunit.client.0.smithi029.stdout:6/269: dwrite d1/f6 [0,4194304] 0 2024-04-15T00:30:11.770 INFO:tasks.workunit.client.0.smithi029.stdout:2/267: dread d3/f9 [0,4194304] 0 2024-04-15T00:30:11.802 INFO:tasks.workunit.client.0.smithi029.stdout:9/250: creat d3/d6/d9/d15/d4a/d53/f5b x:0 0 0 2024-04-15T00:30:11.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/273: dread d5/d15/f4a [0,4194304] 0 2024-04-15T00:30:11.922 INFO:tasks.workunit.client.0.smithi029.stdout:1/267: creat df/d32/d43/d4c/d55/f63 x:0 0 0 2024-04-15T00:30:11.976 INFO:tasks.workunit.client.0.smithi029.stdout:1/268: dread - df/d32/f35 zero size 2024-04-15T00:30:12.022 INFO:tasks.workunit.client.0.smithi029.stdout:6/270: chown d1/d8/db/c19 16 1 2024-04-15T00:30:12.040 INFO:tasks.workunit.client.0.smithi029.stdout:3/264: dwrite d17/f26 [0,4194304] 0 2024-04-15T00:30:12.115 INFO:tasks.workunit.client.0.smithi029.stdout:9/251: chown d3/d6/d9/ca 128728 1 2024-04-15T00:30:12.251 INFO:tasks.workunit.client.0.smithi029.stdout:7/234: creat d0/f4e x:0 0 0 2024-04-15T00:30:12.259 INFO:tasks.workunit.client.0.smithi029.stdout:7/235: stat d0/d6/l45 0 2024-04-15T00:30:12.314 INFO:tasks.workunit.client.0.smithi029.stdout:1/269: creat df/d32/d43/d4c/f64 x:0 0 0 2024-04-15T00:30:12.612 INFO:tasks.workunit.client.0.smithi029.stdout:9/252: unlink d3/d6/d9/c1c 0 2024-04-15T00:30:12.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/270: getdents d2/d24 0 2024-04-15T00:30:12.633 INFO:tasks.workunit.client.0.smithi029.stdout:3/265: rmdir d17/d2f/d44 39 2024-04-15T00:30:12.668 INFO:tasks.workunit.client.0.smithi029.stdout:9/253: chown d3/d6/d9/d15/d4a/d53 9258821 1 2024-04-15T00:30:12.701 INFO:tasks.workunit.client.0.smithi029.stdout:1/270: sync 2024-04-15T00:30:12.886 INFO:tasks.workunit.client.0.smithi029.stdout:4/253: rename de/d2b/l3b to de/df/d1e/l55 0 2024-04-15T00:30:12.900 INFO:tasks.workunit.client.0.smithi029.stdout:6/271: rmdir d1/d1e 39 2024-04-15T00:30:12.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/236: write d0/d6/f3b [985333,122934] 0 2024-04-15T00:30:13.023 INFO:tasks.workunit.client.0.smithi029.stdout:6/272: write d1/f20 [4437040,106310] 0 2024-04-15T00:30:13.075 INFO:tasks.workunit.client.0.smithi029.stdout:0/274: dwrite d5/db/f42 [0,4194304] 0 2024-04-15T00:30:13.091 INFO:tasks.workunit.client.0.smithi029.stdout:3/266: creat d17/d2a/d33/f55 x:0 0 0 2024-04-15T00:30:13.168 INFO:tasks.workunit.client.0.smithi029.stdout:5/271: read d2/de/d13/f2a [423140,86198] 0 2024-04-15T00:30:13.208 INFO:tasks.workunit.client.0.smithi029.stdout:0/275: chown d5/db/d1a/l41 16 1 2024-04-15T00:30:13.234 INFO:tasks.workunit.client.0.smithi029.stdout:1/271: dread df/f15 [0,4194304] 0 2024-04-15T00:30:13.246 INFO:tasks.workunit.client.0.smithi029.stdout:5/272: dread d2/de/d13/f32 [0,4194304] 0 2024-04-15T00:30:13.275 INFO:tasks.workunit.client.0.smithi029.stdout:8/255: rename d8/da/c37 to d8/da/d3d/c52 0 2024-04-15T00:30:13.279 INFO:tasks.workunit.client.0.smithi029.stdout:7/237: rmdir d0/d6 39 2024-04-15T00:30:13.281 INFO:tasks.workunit.client.0.smithi029.stdout:4/254: fdatasync de/d3a/f42 0 2024-04-15T00:30:13.470 INFO:tasks.workunit.client.0.smithi029.stdout:1/272: unlink la 0 2024-04-15T00:30:13.470 INFO:tasks.workunit.client.0.smithi029.stdout:3/267: stat f0 0 2024-04-15T00:30:13.503 INFO:tasks.workunit.client.0.smithi029.stdout:3/268: dread - d17/f52 zero size 2024-04-15T00:30:13.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/276: getdents d5/d3e 0 2024-04-15T00:30:13.791 INFO:tasks.workunit.client.0.smithi029.stdout:9/254: dwrite d3/d6/d30/d3b/d58/f54 [0,4194304] 0 2024-04-15T00:30:13.961 INFO:tasks.workunit.client.0.smithi029.stdout:2/268: rename d3/d36/l3c to d3/d2a/d46/d4a/l54 0 2024-04-15T00:30:13.973 INFO:tasks.workunit.client.0.smithi029.stdout:3/269: truncate f15 5024883 0 2024-04-15T00:30:14.001 INFO:tasks.workunit.client.0.smithi029.stdout:8/256: mknod d8/d4a/c53 0 2024-04-15T00:30:14.012 INFO:tasks.workunit.client.0.smithi029.stdout:0/277: mknod d5/d15/d1f/d32/c5b 0 2024-04-15T00:30:14.208 INFO:tasks.workunit.client.0.smithi029.stdout:5/273: dwrite d2/de/d13/d22/d26/f49 [0,4194304] 0 2024-04-15T00:30:14.274 INFO:tasks.workunit.client.0.smithi029.stdout:4/255: dwrite de/f19 [0,4194304] 0 2024-04-15T00:30:14.280 INFO:tasks.workunit.client.0.smithi029.stdout:6/273: creat d1/d8/db/f57 x:0 0 0 2024-04-15T00:30:14.289 INFO:tasks.workunit.client.0.smithi029.stdout:3/270: rmdir d17 39 2024-04-15T00:30:14.475 INFO:tasks.workunit.client.0.smithi029.stdout:0/278: symlink d5/d15/d1f/l5c 0 2024-04-15T00:30:14.482 INFO:tasks.workunit.client.0.smithi029.stdout:2/269: rmdir d3/d2a/d46 39 2024-04-15T00:30:14.594 INFO:tasks.workunit.client.0.smithi029.stdout:7/238: write d0/d6/f3f [966381,69346] 0 2024-04-15T00:30:14.627 INFO:tasks.workunit.client.0.smithi029.stdout:4/256: rename de/df/d52 to de/df/d1e/d56 0 2024-04-15T00:30:14.778 INFO:tasks.workunit.client.0.smithi029.stdout:9/255: symlink d3/d41/l5c 0 2024-04-15T00:30:14.799 INFO:tasks.workunit.client.0.smithi029.stdout:9/256: readlink d3/d6/d9/l25 0 2024-04-15T00:30:14.830 INFO:tasks.workunit.client.0.smithi029.stdout:2/270: truncate d3/d2a/f3a 357445 0 2024-04-15T00:30:14.929 INFO:tasks.workunit.client.0.smithi029.stdout:8/257: write d8/dc/d23/d28/d30/d39/f4b [413668,2151] 0 2024-04-15T00:30:14.948 INFO:tasks.workunit.client.0.smithi029.stdout:8/258: readlink d8/dc/d23/d28/l34 0 2024-04-15T00:30:15.021 INFO:tasks.workunit.client.0.smithi029.stdout:5/274: write d2/de/d13/d22/d26/d36/f45 [1008526,53348] 0 2024-04-15T00:30:15.034 INFO:tasks.workunit.client.0.smithi029.stdout:4/257: mknod de/d2b/d35/c57 0 2024-04-15T00:30:15.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/273: link df/d32/d43/c60 df/d32/d43/d4c/c65 0 2024-04-15T00:30:15.361 INFO:tasks.workunit.client.0.smithi029.stdout:7/239: mkdir d0/d6/d4f 0 2024-04-15T00:30:15.371 INFO:tasks.workunit.client.0.smithi029.stdout:6/274: mkdir d1/d1e/d56/d58 0 2024-04-15T00:30:15.451 INFO:tasks.workunit.client.0.smithi029.stdout:0/279: dwrite d5/db/f19 [0,4194304] 0 2024-04-15T00:30:15.510 INFO:tasks.workunit.client.0.smithi029.stdout:5/275: mknod d2/d1a/d2d/c60 0 2024-04-15T00:30:15.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/271: chown d3/d2a/d46/l4c 674 1 2024-04-15T00:30:15.564 INFO:tasks.workunit.client.0.smithi029.stdout:0/280: fsync d5/db/f42 0 2024-04-15T00:30:15.582 INFO:tasks.workunit.client.0.smithi029.stdout:0/281: chown d5/d4c 193 1 2024-04-15T00:30:15.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/258: mkdir de/d54/d58 0 2024-04-15T00:30:15.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/257: rename d3/d6/d9/d35 to d3/d6/d9/d29/d5d 0 2024-04-15T00:30:15.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/275: mkdir d1/d1e/d56/d58/d59 0 2024-04-15T00:30:15.881 INFO:tasks.workunit.client.0.smithi029.stdout:3/271: write d17/f1b [4181718,32647] 0 2024-04-15T00:30:16.003 INFO:tasks.workunit.client.0.smithi029.stdout:1/274: dwrite df/d29/f4b [0,4194304] 0 2024-04-15T00:30:16.089 INFO:tasks.workunit.client.0.smithi029.stdout:0/282: unlink f2 0 2024-04-15T00:30:16.186 INFO:tasks.workunit.client.0.smithi029.stdout:8/259: rename d8/f9 to d8/da/d2f/d42/f54 0 2024-04-15T00:30:16.233 INFO:tasks.workunit.client.0.smithi029.stdout:4/259: chown de/d2b/f47 20893621 1 2024-04-15T00:30:16.614 INFO:tasks.workunit.client.0.smithi029.stdout:6/276: write d1/f3e [917387,83711] 0 2024-04-15T00:30:16.771 INFO:tasks.workunit.client.0.smithi029.stdout:7/240: dwrite d0/d6/d1c/f9 [0,4194304] 0 2024-04-15T00:30:16.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/272: dwrite d3/d13/f28 [0,4194304] 0 2024-04-15T00:30:16.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/277: chown d1/c21 48849306 1 2024-04-15T00:30:16.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/275: fdatasync df/d29/d41/d4f/f58 0 2024-04-15T00:30:16.946 INFO:tasks.workunit.client.0.smithi029.stdout:3/272: dwrite d17/d2f/d3c/f3f [0,4194304] 0 2024-04-15T00:30:17.012 INFO:tasks.workunit.client.0.smithi029.stdout:0/283: dread - d5/d4c/f5a zero size 2024-04-15T00:30:17.014 INFO:tasks.workunit.client.0.smithi029.stdout:1/276: stat df/f13 0 2024-04-15T00:30:17.033 INFO:tasks.workunit.client.0.smithi029.stdout:3/273: fdatasync d17/d2a/d33/f55 0 2024-04-15T00:30:17.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/284: chown d5/db/d1a 445229 1 2024-04-15T00:30:17.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/274: chown d17/f26 87055787 1 2024-04-15T00:30:17.122 INFO:tasks.workunit.client.0.smithi029.stdout:9/258: fdatasync d3/f3e 0 2024-04-15T00:30:17.125 INFO:tasks.workunit.client.0.smithi029.stdout:8/260: fdatasync d8/f50 0 2024-04-15T00:30:17.144 INFO:tasks.workunit.client.0.smithi029.stdout:8/261: stat d8/da/f1e 0 2024-04-15T00:30:17.163 INFO:tasks.workunit.client.0.smithi029.stdout:5/276: rename d2/de/d13/d22/d3c/d41/f5f to d2/d24/f61 0 2024-04-15T00:30:17.232 INFO:tasks.workunit.client.0.smithi029.stdout:4/260: mkdir de/d2b/d59 0 2024-04-15T00:30:17.311 INFO:tasks.workunit.client.0.smithi029.stdout:4/261: dwrite de/f19 [0,4194304] 0 2024-04-15T00:30:17.375 INFO:tasks.workunit.client.0.smithi029.stdout:7/241: fsync d0/d6/f2f 0 2024-04-15T00:30:17.542 INFO:tasks.workunit.client.0.smithi029.stdout:6/278: dread d1/d8/db/f23 [0,4194304] 0 2024-04-15T00:30:17.567 INFO:tasks.workunit.client.0.smithi029.stdout:0/285: dread d5/db/f37 [0,4194304] 0 2024-04-15T00:30:17.918 INFO:tasks.workunit.client.0.smithi029.stdout:8/262: mknod d8/dc/d23/d28/c55 0 2024-04-15T00:30:17.969 INFO:tasks.workunit.client.0.smithi029.stdout:5/277: creat d2/de/d1f/f62 x:0 0 0 2024-04-15T00:30:18.082 INFO:tasks.workunit.client.0.smithi029.stdout:7/242: symlink d0/d6/d1c/l50 0 2024-04-15T00:30:18.149 INFO:tasks.workunit.client.0.smithi029.stdout:6/279: truncate d1/d8/db/f24 2374063 0 2024-04-15T00:30:18.378 INFO:tasks.workunit.client.0.smithi029.stdout:8/263: unlink d8/da/c1d 0 2024-04-15T00:30:18.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/262: symlink de/d54/d58/l5a 0 2024-04-15T00:30:18.603 INFO:tasks.workunit.client.0.smithi029.stdout:3/275: dwrite d17/d2f/d3c/f4a [0,4194304] 0 2024-04-15T00:30:18.663 INFO:tasks.workunit.client.0.smithi029.stdout:1/277: dwrite df/d32/f35 [0,4194304] 0 2024-04-15T00:30:18.724 INFO:tasks.workunit.client.0.smithi029.stdout:2/273: rename d3/d13/l49 to d3/d2a/l55 0 2024-04-15T00:30:18.747 INFO:tasks.workunit.client.0.smithi029.stdout:4/263: creat de/d54/d58/f5b x:0 0 0 2024-04-15T00:30:18.869 INFO:tasks.workunit.client.0.smithi029.stdout:8/264: dread d8/dc/d23/d28/d3a/f47 [0,4194304] 0 2024-04-15T00:30:18.916 INFO:tasks.workunit.client.0.smithi029.stdout:6/280: creat d1/d1e/d56/d58/d59/f5a x:0 0 0 2024-04-15T00:30:18.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/259: dwrite d3/d6/f17 [0,4194304] 0 2024-04-15T00:30:19.057 INFO:tasks.workunit.client.0.smithi029.stdout:3/276: creat d17/d2a/d33/f56 x:0 0 0 2024-04-15T00:30:19.063 INFO:tasks.workunit.client.0.smithi029.stdout:4/264: dwrite f4 [0,4194304] 0 2024-04-15T00:30:19.206 INFO:tasks.workunit.client.0.smithi029.stdout:8/265: read d8/f2b [1009042,44731] 0 2024-04-15T00:30:19.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/243: write d0/d6/d16/d26/f38 [561885,54788] 0 2024-04-15T00:30:19.350 INFO:tasks.workunit.client.0.smithi029.stdout:0/286: dwrite d5/d15/d1f/d32/f3d [0,4194304] 0 2024-04-15T00:30:19.434 INFO:tasks.workunit.client.0.smithi029.stdout:5/278: dwrite d2/d1a/f2c [4194304,4194304] 0 2024-04-15T00:30:19.534 INFO:tasks.workunit.client.0.smithi029.stdout:1/278: write fd [687378,114488] 0 2024-04-15T00:30:19.540 INFO:tasks.workunit.client.0.smithi029.stdout:2/274: write d3/f9 [9392293,79617] 0 2024-04-15T00:30:19.648 INFO:tasks.workunit.client.0.smithi029.stdout:4/265: mknod de/d3a/c5c 0 2024-04-15T00:30:19.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/260: mknod d3/d6/d30/d3b/d58/c5e 0 2024-04-15T00:30:19.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/266: symlink d8/da/d3d/l56 0 2024-04-15T00:30:19.675 INFO:tasks.workunit.client.0.smithi029.stdout:7/244: creat d0/d6/d16/d26/f51 x:0 0 0 2024-04-15T00:30:19.738 INFO:tasks.workunit.client.0.smithi029.stdout:3/277: dread d17/f29 [0,4194304] 0 2024-04-15T00:30:19.741 INFO:tasks.workunit.client.0.smithi029.stdout:7/245: chown d0/d6/f3f 716 1 2024-04-15T00:30:19.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/266: dread de/d2b/f47 [0,4194304] 0 2024-04-15T00:30:19.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/261: unlink d3/d6/d30/c47 0 2024-04-15T00:30:19.897 INFO:tasks.workunit.client.0.smithi029.stdout:6/281: creat d1/d8/db/f5b x:0 0 0 2024-04-15T00:30:19.906 INFO:tasks.workunit.client.0.smithi029.stdout:8/267: fdatasync d8/dc/d23/d28/d3a/f47 0 2024-04-15T00:30:19.930 INFO:tasks.workunit.client.0.smithi029.stdout:8/268: chown d8/f38 0 1 2024-04-15T00:30:19.946 INFO:tasks.workunit.client.0.smithi029.stdout:8/269: fdatasync d8/dc/d23/d28/d30/d39/f4b 0 2024-04-15T00:30:20.081 INFO:tasks.workunit.client.0.smithi029.stdout:0/287: unlink d5/d15/d1f/d32/l4b 0 2024-04-15T00:30:20.090 INFO:tasks.workunit.client.0.smithi029.stdout:5/279: fdatasync d2/f34 0 2024-04-15T00:30:20.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/246: mknod d0/d6/d39/d3c/c52 0 2024-04-15T00:30:20.327 INFO:tasks.workunit.client.0.smithi029.stdout:6/282: fsync d1/f2f 0 2024-04-15T00:30:20.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/275: write d3/f38 [360456,78591] 0 2024-04-15T00:30:20.358 INFO:tasks.workunit.client.0.smithi029.stdout:6/283: chown d1/c5 0 1 2024-04-15T00:30:20.372 INFO:tasks.workunit.client.0.smithi029.stdout:5/280: mkdir d2/de/d1f/d63 0 2024-04-15T00:30:20.394 INFO:tasks.workunit.client.0.smithi029.stdout:8/270: sync 2024-04-15T00:30:20.497 INFO:tasks.workunit.client.0.smithi029.stdout:1/279: dwrite df/f2d [0,4194304] 0 2024-04-15T00:30:20.565 INFO:tasks.workunit.client.0.smithi029.stdout:0/288: truncate d5/d15/d1f/f3a 772438 0 2024-04-15T00:30:20.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/247: read d0/d6/d39/d3c/d42/d49/f4a [76074,126748] 0 2024-04-15T00:30:20.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/248: chown d0 907598 1 2024-04-15T00:30:20.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/278: dwrite d17/d2a/f36 [4194304,4194304] 0 2024-04-15T00:30:20.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/271: truncate d8/f2c 961283 0 2024-04-15T00:30:20.892 INFO:tasks.workunit.client.0.smithi029.stdout:0/289: symlink d5/d15/d1f/l5d 0 2024-04-15T00:30:20.916 INFO:tasks.workunit.client.0.smithi029.stdout:1/280: mknod df/d32/d43/d4c/d55/c66 0 2024-04-15T00:30:20.929 INFO:tasks.workunit.client.0.smithi029.stdout:5/281: read d2/de/d13/d22/d26/d36/d4d/f51 [355788,55581] 0 2024-04-15T00:30:20.968 INFO:tasks.workunit.client.0.smithi029.stdout:7/249: read d0/f22 [1838506,118728] 0 2024-04-15T00:30:20.978 INFO:tasks.workunit.client.0.smithi029.stdout:0/290: sync 2024-04-15T00:30:21.029 INFO:tasks.workunit.client.0.smithi029.stdout:2/276: dread d3/dd/d2d/f34 [0,4194304] 0 2024-04-15T00:30:21.129 INFO:tasks.workunit.client.0.smithi029.stdout:4/267: dwrite de/df/d1e/f4c [0,4194304] 0 2024-04-15T00:30:21.144 INFO:tasks.workunit.client.0.smithi029.stdout:6/284: mknod d1/c5c 0 2024-04-15T00:30:21.312 INFO:tasks.workunit.client.0.smithi029.stdout:8/272: rename d8/da/f1e to d8/dc/d23/f57 0 2024-04-15T00:30:21.329 INFO:tasks.workunit.client.0.smithi029.stdout:5/282: dread d2/f34 [0,4194304] 0 2024-04-15T00:30:21.337 INFO:tasks.workunit.client.0.smithi029.stdout:7/250: fdatasync d0/d6/d16/d26/f28 0 2024-04-15T00:30:21.457 INFO:tasks.workunit.client.0.smithi029.stdout:3/279: dread f15 [0,4194304] 0 2024-04-15T00:30:21.514 INFO:tasks.workunit.client.0.smithi029.stdout:1/281: dread df/f30 [0,4194304] 0 2024-04-15T00:30:21.525 INFO:tasks.workunit.client.0.smithi029.stdout:7/251: chown d0/d6/d1c/c17 2838795 1 2024-04-15T00:30:21.576 INFO:tasks.workunit.client.0.smithi029.stdout:3/280: write d17/d2a/d33/f55 [667842,117529] 0 2024-04-15T00:30:21.580 INFO:tasks.workunit.client.0.smithi029.stdout:9/262: dwrite d3/d6/d9/f49 [0,4194304] 0 2024-04-15T00:30:21.683 INFO:tasks.workunit.client.0.smithi029.stdout:9/263: dread - d3/d6/d9/d15/d4a/f4b zero size 2024-04-15T00:30:21.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/281: chown d17/d2a/d33/d37/c38 3 1 2024-04-15T00:30:22.174 INFO:tasks.workunit.client.0.smithi029.stdout:4/268: fsync de/f2e 0 2024-04-15T00:30:22.183 INFO:tasks.workunit.client.0.smithi029.stdout:2/277: truncate d3/d2a/f3a 46588 0 2024-04-15T00:30:22.188 INFO:tasks.workunit.client.0.smithi029.stdout:5/283: mknod d2/de/d13/d22/d26/d36/c64 0 2024-04-15T00:30:22.722 INFO:tasks.workunit.client.0.smithi029.stdout:9/264: mknod d3/d6/d30/d3b/d3c/d57/c5f 0 2024-04-15T00:30:22.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/291: write d5/d15/d1f/d32/f43 [406410,119464] 0 2024-04-15T00:30:22.791 INFO:tasks.workunit.client.0.smithi029.stdout:0/292: chown d5/db/d1a/c20 16926 1 2024-04-15T00:30:22.903 INFO:tasks.workunit.client.0.smithi029.stdout:6/285: dwrite d1/d8/f53 [4194304,4194304] 0 2024-04-15T00:30:23.051 INFO:tasks.workunit.client.0.smithi029.stdout:8/273: dwrite d8/da/d2f/f36 [0,4194304] 0 2024-04-15T00:30:23.053 INFO:tasks.workunit.client.0.smithi029.stdout:6/286: write d1/d1e/d56/d58/d59/f5a [564919,96429] 0 2024-04-15T00:30:23.128 INFO:tasks.workunit.client.0.smithi029.stdout:3/282: rename d17/d2f/l30 to d17/l57 0 2024-04-15T00:30:23.142 INFO:tasks.workunit.client.0.smithi029.stdout:2/278: fsync d3/d2a/f3a 0 2024-04-15T00:30:23.273 INFO:tasks.workunit.client.0.smithi029.stdout:1/282: dwrite df/d32/d43/d4c/d55/f5d [0,4194304] 0 2024-04-15T00:30:23.366 INFO:tasks.workunit.client.0.smithi029.stdout:5/284: mkdir d2/de/d1f/d63/d65 0 2024-04-15T00:30:23.366 INFO:tasks.workunit.client.0.smithi029.stdout:7/252: getdents d0/d6/d39/d3c/d42/d49 0 2024-04-15T00:30:23.584 INFO:tasks.workunit.client.0.smithi029.stdout:2/279: dread - d3/d2a/d46/f3d zero size 2024-04-15T00:30:23.610 INFO:tasks.workunit.client.0.smithi029.stdout:8/274: truncate d8/da/f43 358652 0 2024-04-15T00:30:23.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/293: getdents d5/d3e 0 2024-04-15T00:30:23.760 INFO:tasks.workunit.client.0.smithi029.stdout:1/283: rmdir df/d32/d43 39 2024-04-15T00:30:23.839 INFO:tasks.workunit.client.0.smithi029.stdout:9/265: dwrite d3/d6/d9/d15/d4a/f4d [0,4194304] 0 2024-04-15T00:30:23.907 INFO:tasks.workunit.client.0.smithi029.stdout:6/287: truncate d1/d1e/f32 2385848 0 2024-04-15T00:30:23.909 INFO:tasks.workunit.client.0.smithi029.stdout:7/253: fsync d0/d6/f3b 0 2024-04-15T00:30:23.916 INFO:tasks.workunit.client.0.smithi029.stdout:3/283: mkdir d17/d2f/d44/d58 0 2024-04-15T00:30:24.012 INFO:tasks.workunit.client.0.smithi029.stdout:8/275: truncate d8/f2b 2326576 0 2024-04-15T00:30:24.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/269: link de/d3a/f42 de/f5d 0 2024-04-15T00:30:24.085 INFO:tasks.workunit.client.0.smithi029.stdout:3/284: dwrite d17/d2f/d3c/f4a [4194304,4194304] 0 2024-04-15T00:30:24.287 INFO:tasks.workunit.client.0.smithi029.stdout:5/285: dwrite d2/d24/f61 [0,4194304] 0 2024-04-15T00:30:24.446 INFO:tasks.workunit.client.0.smithi029.stdout:3/285: mknod d17/d2a/d4c/c59 0 2024-04-15T00:30:24.452 INFO:tasks.workunit.client.0.smithi029.stdout:7/254: symlink d0/d6/l53 0 2024-04-15T00:30:24.458 INFO:tasks.workunit.client.0.smithi029.stdout:1/284: creat df/d32/d43/d4c/d55/d59/f67 x:0 0 0 2024-04-15T00:30:24.468 INFO:tasks.workunit.client.0.smithi029.stdout:8/276: read d8/dc/f3b [2749541,4793] 0 2024-04-15T00:30:24.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/270: dread de/df/d1e/f2d [0,4194304] 0 2024-04-15T00:30:25.239 INFO:tasks.workunit.client.0.smithi029.stdout:1/285: dread - df/d32/d43/d4c/d55/d59/f67 zero size 2024-04-15T00:30:25.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/294: dwrite d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/288: write d1/d8/db/f44 [997116,63655] 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/289: stat d1/d1e/d56/d58 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/271: sync 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:2/280: link d3/d2a/d46/l4c d3/dd/d2d/l56 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:5/286: symlink d2/de/d13/d22/d26/l66 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:3/286: stat d17/l57 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:1/286: creat df/d32/d43/d4c/d55/f68 x:0 0 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/266: rename d3/d6/d30/d3b/d3c to d3/d6/d9/d29/d60 0 2024-04-15T00:30:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/267: chown d3/d6/d30 130604 1 2024-04-15T00:30:25.571 INFO:tasks.workunit.client.0.smithi029.stdout:8/277: write d8/dc/d23/d28/d30/f4c [1696092,20305] 0 2024-04-15T00:30:25.576 INFO:tasks.workunit.client.0.smithi029.stdout:0/295: mkdir d5/d15/d57/d5e 0 2024-04-15T00:30:25.620 INFO:tasks.workunit.client.0.smithi029.stdout:3/287: rmdir d17 39 2024-04-15T00:30:25.630 INFO:tasks.workunit.client.0.smithi029.stdout:1/287: unlink df/f25 0 2024-04-15T00:30:25.729 INFO:tasks.workunit.client.0.smithi029.stdout:2/281: symlink d3/d53/l57 0 2024-04-15T00:30:25.735 INFO:tasks.workunit.client.0.smithi029.stdout:5/287: unlink d2/cd 0 2024-04-15T00:30:25.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/268: dread d3/d6/f17 [0,4194304] 0 2024-04-15T00:30:25.871 INFO:tasks.workunit.client.0.smithi029.stdout:8/278: mknod d8/da/d3d/c58 0 2024-04-15T00:30:25.888 INFO:tasks.workunit.client.0.smithi029.stdout:6/290: dwrite d1/d8/db/f40 [4194304,4194304] 0 2024-04-15T00:30:25.962 INFO:tasks.workunit.client.0.smithi029.stdout:7/255: dwrite d0/d6/d1c/f9 [4194304,4194304] 0 2024-04-15T00:30:26.062 INFO:tasks.workunit.client.0.smithi029.stdout:6/291: chown d1/d1e 2297 1 2024-04-15T00:30:26.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/288: write df/f30 [1817936,83555] 0 2024-04-15T00:30:26.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/296: truncate d5/d15/d1f/d32/f49 4840342 0 2024-04-15T00:30:26.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/256: fsync d0/d6/d16/d26/f38 0 2024-04-15T00:30:26.358 INFO:tasks.workunit.client.0.smithi029.stdout:4/272: rename de/d2b/d35/c36 to de/c5e 0 2024-04-15T00:30:26.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/292: fsync d1/d8/db/f15 0 2024-04-15T00:30:26.462 INFO:tasks.workunit.client.0.smithi029.stdout:7/257: sync 2024-04-15T00:30:26.569 INFO:tasks.workunit.client.0.smithi029.stdout:9/269: dread d3/d6/d9/f11 [0,4194304] 0 2024-04-15T00:30:26.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/282: dwrite d3/d13/d14/f20 [4194304,4194304] 0 2024-04-15T00:30:26.896 INFO:tasks.workunit.client.0.smithi029.stdout:4/273: readlink de/df/l13 0 2024-04-15T00:30:26.906 INFO:tasks.workunit.client.0.smithi029.stdout:4/274: readlink lb 0 2024-04-15T00:30:26.968 INFO:tasks.workunit.client.0.smithi029.stdout:8/279: rename d8/dc/f3b to d8/dc/d23/f59 0 2024-04-15T00:30:26.996 INFO:tasks.workunit.client.0.smithi029.stdout:5/288: dwrite d2/d1a/f20 [0,4194304] 0 2024-04-15T00:30:27.002 INFO:tasks.workunit.client.0.smithi029.stdout:6/293: mknod d1/d8/c5d 0 2024-04-15T00:30:27.076 INFO:tasks.workunit.client.0.smithi029.stdout:0/297: mknod d5/d3e/c5f 0 2024-04-15T00:30:27.081 INFO:tasks.workunit.client.0.smithi029.stdout:3/288: truncate d17/d2a/f36 7745466 0 2024-04-15T00:30:27.093 INFO:tasks.workunit.client.0.smithi029.stdout:7/258: mkdir d0/d6/d16/d26/d54 0 2024-04-15T00:30:27.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/280: chown d8/dc/d23/d28/d30 53 1 2024-04-15T00:30:27.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/259: fsync d0/f22 0 2024-04-15T00:30:27.589 INFO:tasks.workunit.client.0.smithi029.stdout:1/289: rename df/d32/d43 to df/d29/d41/d69 0 2024-04-15T00:30:27.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/290: chown df/f2d 6971291 1 2024-04-15T00:30:27.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/260: sync 2024-04-15T00:30:27.632 INFO:tasks.workunit.client.0.smithi029.stdout:7/261: chown d0/d6/d16/d26/f28 1604 1 2024-04-15T00:30:27.761 INFO:tasks.workunit.client.0.smithi029.stdout:5/289: unlink d2/de/d13/d22/d26/d36/c56 0 2024-04-15T00:30:27.874 INFO:tasks.workunit.client.0.smithi029.stdout:2/283: mkdir d3/d50/d51/d58 0 2024-04-15T00:30:27.887 INFO:tasks.workunit.client.0.smithi029.stdout:2/284: stat d3/dd/c22 0 2024-04-15T00:30:27.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/285: rename d3/d13/d14 to d3/d13/d14/d59 22 2024-04-15T00:30:28.120 INFO:tasks.workunit.client.0.smithi029.stdout:4/275: write de/d2b/f21 [608719,16376] 0 2024-04-15T00:30:28.135 INFO:tasks.workunit.client.0.smithi029.stdout:4/276: chown de/f19 96 1 2024-04-15T00:30:28.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/262: fdatasync d0/d6/d1c/fc 0 2024-04-15T00:30:28.328 INFO:tasks.workunit.client.0.smithi029.stdout:2/286: truncate d3/d13/f16 4784239 0 2024-04-15T00:30:28.331 INFO:tasks.workunit.client.0.smithi029.stdout:9/270: creat d3/d6/f61 x:0 0 0 2024-04-15T00:30:28.341 INFO:tasks.workunit.client.0.smithi029.stdout:6/294: write d1/f20 [3532580,50882] 0 2024-04-15T00:30:28.370 INFO:tasks.workunit.client.0.smithi029.stdout:1/291: symlink df/d32/l6a 0 2024-04-15T00:30:28.413 INFO:tasks.workunit.client.0.smithi029.stdout:4/277: truncate de/df/d1e/f24 172193 0 2024-04-15T00:30:28.576 INFO:tasks.workunit.client.0.smithi029.stdout:7/263: creat d0/d6/d39/d3c/f55 x:0 0 0 2024-04-15T00:30:28.683 INFO:tasks.workunit.client.0.smithi029.stdout:5/290: symlink d2/de/d13/d22/l67 0 2024-04-15T00:30:28.768 INFO:tasks.workunit.client.0.smithi029.stdout:8/281: dwrite d8/fd [0,4194304] 0 2024-04-15T00:30:28.888 INFO:tasks.workunit.client.0.smithi029.stdout:4/278: rmdir de/d54 39 2024-04-15T00:30:28.898 INFO:tasks.workunit.client.0.smithi029.stdout:2/287: dread d3/dd/f27 [0,4194304] 0 2024-04-15T00:30:28.898 INFO:tasks.workunit.client.0.smithi029.stdout:7/264: dread - d0/f4e zero size 2024-04-15T00:30:28.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/288: dread d3/d13/d14/f20 [4194304,4194304] 0 2024-04-15T00:30:29.001 INFO:tasks.workunit.client.0.smithi029.stdout:8/282: mkdir d8/dc/d23/d28/d3a/d5a 0 2024-04-15T00:30:29.010 INFO:tasks.workunit.client.0.smithi029.stdout:0/298: write d5/d15/d1f/d32/f3d [1077405,99414] 0 2024-04-15T00:30:29.024 INFO:tasks.workunit.client.0.smithi029.stdout:5/291: chown d2/de/f57 36837793 1 2024-04-15T00:30:29.106 INFO:tasks.workunit.client.0.smithi029.stdout:6/295: truncate d1/d8/db/f23 2319910 0 2024-04-15T00:30:29.208 INFO:tasks.workunit.client.0.smithi029.stdout:8/283: read d8/dc/f1c [1239561,45307] 0 2024-04-15T00:30:29.259 INFO:tasks.workunit.client.0.smithi029.stdout:0/299: creat d5/d15/d57/f60 x:0 0 0 2024-04-15T00:30:29.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/289: dread d17/d2a/f36 [4194304,4194304] 0 2024-04-15T00:30:29.380 INFO:tasks.workunit.client.0.smithi029.stdout:0/300: sync 2024-04-15T00:30:29.395 INFO:tasks.workunit.client.0.smithi029.stdout:2/289: truncate d3/dd/d42/f47 635381 0 2024-04-15T00:30:29.403 INFO:tasks.workunit.client.0.smithi029.stdout:2/290: readlink d3/d2a/d46/l3e 0 2024-04-15T00:30:29.416 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:29.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:29.435 INFO:tasks.workunit.client.0.smithi029.stdout:4/279: symlink de/d54/l5f 0 2024-04-15T00:30:29.435 INFO:tasks.workunit.client.0.smithi029.stdout:6/296: unlink d1/d8/db/l1d 0 2024-04-15T00:30:29.687 INFO:tasks.workunit.client.0.smithi029.stdout:8/284: dread d8/f38 [0,4194304] 0 2024-04-15T00:30:29.699 INFO:tasks.workunit.client.0.smithi029.stdout:8/285: chown d8/da/d2f/f36 57937675 1 2024-04-15T00:30:29.815 INFO:tasks.workunit.client.0.smithi029.stdout:3/290: fdatasync d17/d2a/d33/f55 0 2024-04-15T00:30:29.943 INFO:tasks.workunit.client.0.smithi029.stdout:9/271: write d3/d6/d9/d15/d4a/d53/f5b [238836,68048] 0 2024-04-15T00:30:29.945 INFO:tasks.workunit.client.0.smithi029.stdout:1/292: write df/f3e [1009351,74355] 0 2024-04-15T00:30:30.053 INFO:tasks.workunit.client.0.smithi029.stdout:4/280: truncate de/d2b/f47 1324862 0 2024-04-15T00:30:30.089 INFO:tasks.workunit.client.0.smithi029.stdout:4/281: chown de/f2e 98623640 1 2024-04-15T00:30:30.138 INFO:tasks.workunit.client.0.smithi029.stdout:7/265: dwrite d0/d6/f2f [0,4194304] 0 2024-04-15T00:30:30.144 INFO:tasks.workunit.client.0.smithi029.stdout:8/286: rename d8/dc/d23/d28/d3a/f40 to d8/da/f5b 0 2024-04-15T00:30:30.229 INFO:tasks.workunit.client.0.smithi029.stdout:8/287: chown d8/dc/d23/d28/d3a 18838912 1 2024-04-15T00:30:30.339 INFO:tasks.workunit.client.0.smithi029.stdout:2/291: rmdir d3/d13/d43 39 2024-04-15T00:30:30.423 INFO:tasks.workunit.client.0.smithi029.stdout:9/272: dread d3/d6/d30/d3b/d58/f54 [0,4194304] 0 2024-04-15T00:30:30.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/273: read - d3/d6/f61 zero size 2024-04-15T00:30:30.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/266: fsync d0/d6/d16/d26/f40 0 2024-04-15T00:30:30.518 INFO:tasks.workunit.client.0.smithi029.stdout:0/301: write d5/d15/d1f/f44 [163080,43858] 0 2024-04-15T00:30:30.788 INFO:tasks.workunit.client.0.smithi029.stdout:5/292: getdents d2/de/d13/d22/d26 0 2024-04-15T00:30:30.972 INFO:tasks.workunit.client.0.smithi029.stdout:3/291: dwrite d17/f29 [0,4194304] 0 2024-04-15T00:30:30.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/293: dwrite df/d29/d41/f45 [0,4194304] 0 2024-04-15T00:30:31.056 INFO:tasks.workunit.client.0.smithi029.stdout:6/297: write d1/d1e/f27 [714945,123757] 0 2024-04-15T00:30:31.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/282: mknod de/d2b/d59/c60 0 2024-04-15T00:30:31.114 INFO:tasks.workunit.client.0.smithi029.stdout:9/274: stat d3/f34 0 2024-04-15T00:30:31.131 INFO:tasks.workunit.client.0.smithi029.stdout:8/288: symlink d8/dc/d23/d28/d3a/d5a/l5c 0 2024-04-15T00:30:31.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/302: rename d5/db/d1a/f52 to d5/d15/d1f/d32/f61 0 2024-04-15T00:30:31.198 INFO:tasks.workunit.client.0.smithi029.stdout:8/289: chown d8/dc/d23/d28/d3a 851 1 2024-04-15T00:30:31.276 INFO:tasks.workunit.client.0.smithi029.stdout:9/275: sync 2024-04-15T00:30:31.280 INFO:tasks.workunit.client.0.smithi029.stdout:7/267: write d0/f22 [3306958,6479] 0 2024-04-15T00:30:31.283 INFO:tasks.workunit.client.0.smithi029.stdout:5/293: write d2/de/d13/d22/f47 [4131225,33789] 0 2024-04-15T00:30:31.330 INFO:tasks.workunit.client.0.smithi029.stdout:9/276: dread d3/d6/f1a [0,4194304] 0 2024-04-15T00:30:31.483 INFO:tasks.workunit.client.0.smithi029.stdout:2/292: rmdir d3/d50/d51/d58 0 2024-04-15T00:30:31.487 INFO:tasks.workunit.client.0.smithi029.stdout:3/292: mkdir d17/d2f/d44/d5a 0 2024-04-15T00:30:31.542 INFO:tasks.workunit.client.0.smithi029.stdout:6/298: creat d1/d8/f5e x:0 0 0 2024-04-15T00:30:31.651 INFO:tasks.workunit.client.0.smithi029.stdout:8/290: rename d8/l2d to d8/dc/l5d 0 2024-04-15T00:30:31.698 INFO:tasks.workunit.client.0.smithi029.stdout:8/291: dread d8/fd [0,4194304] 0 2024-04-15T00:30:32.036 INFO:tasks.workunit.client.0.smithi029.stdout:6/299: mkdir d1/d1e/d56/d58/d5f 0 2024-04-15T00:30:32.048 INFO:tasks.workunit.client.0.smithi029.stdout:7/268: read d0/f36 [3867100,14392] 0 2024-04-15T00:30:32.116 INFO:tasks.workunit.client.0.smithi029.stdout:0/303: creat d5/f62 x:0 0 0 2024-04-15T00:30:32.268 INFO:tasks.workunit.client.0.smithi029.stdout:4/283: write de/df/d1e/f4c [1350582,125351] 0 2024-04-15T00:30:32.497 INFO:tasks.workunit.client.0.smithi029.stdout:1/294: mkdir df/d32/d6b 0 2024-04-15T00:30:32.544 INFO:tasks.workunit.client.0.smithi029.stdout:6/300: rmdir d1/d1e/d56/d58/d59 39 2024-04-15T00:30:32.654 INFO:tasks.workunit.client.0.smithi029.stdout:4/284: mknod de/d3a/c61 0 2024-04-15T00:30:32.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/277: mkdir d3/d6/d9/d15/d62 0 2024-04-15T00:30:32.668 INFO:tasks.workunit.client.0.smithi029.stdout:9/278: chown c1 1199384 1 2024-04-15T00:30:32.678 INFO:tasks.workunit.client.0.smithi029.stdout:9/279: readlink d3/d6/d30/d3b/d58/l23 0 2024-04-15T00:30:33.229 INFO:tasks.workunit.client.0.smithi029.stdout:5/294: write d2/de/d1f/f62 [467123,46350] 0 2024-04-15T00:30:33.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/301: creat d1/d1e/d56/d58/d59/f60 x:0 0 0 2024-04-15T00:30:33.364 INFO:tasks.workunit.client.0.smithi029.stdout:7/269: mknod d0/c56 0 2024-04-15T00:30:33.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/293: rename d3/d36 to d3/d13/d43/d5a 0 2024-04-15T00:30:33.483 INFO:tasks.workunit.client.0.smithi029.stdout:7/270: sync 2024-04-15T00:30:33.622 INFO:tasks.workunit.client.0.smithi029.stdout:8/292: dwrite d8/da/d2f/f4d [0,4194304] 0 2024-04-15T00:30:33.651 INFO:tasks.workunit.client.0.smithi029.stdout:9/280: symlink d3/d6/d9/l63 0 2024-04-15T00:30:33.692 INFO:tasks.workunit.client.0.smithi029.stdout:3/293: dwrite d17/f24 [0,4194304] 0 2024-04-15T00:30:33.799 INFO:tasks.workunit.client.0.smithi029.stdout:1/295: dwrite df/d29/d41/d69/d4c/d55/f5d [0,4194304] 0 2024-04-15T00:30:33.807 INFO:tasks.workunit.client.0.smithi029.stdout:4/285: rename de/f2e to de/d2b/f62 0 2024-04-15T00:30:33.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/294: dread d3/d2a/f3a [0,4194304] 0 2024-04-15T00:30:33.880 INFO:tasks.workunit.client.0.smithi029.stdout:0/304: getdents d5/d15/d57 0 2024-04-15T00:30:33.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/271: creat d0/d6/d1c/f57 x:0 0 0 2024-04-15T00:30:33.986 INFO:tasks.workunit.client.0.smithi029.stdout:5/295: mkdir d2/d68 0 2024-04-15T00:30:34.020 INFO:tasks.workunit.client.0.smithi029.stdout:5/296: rename d2/de to d2/de/d1f/d63/d65/d69 22 2024-04-15T00:30:34.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/296: mknod df/d29/c6c 0 2024-04-15T00:30:34.144 INFO:tasks.workunit.client.0.smithi029.stdout:4/286: truncate f8 1817315 0 2024-04-15T00:30:34.245 INFO:tasks.workunit.client.0.smithi029.stdout:5/297: rmdir d2/de/d13/d22 39 2024-04-15T00:30:34.264 INFO:tasks.workunit.client.0.smithi029.stdout:8/293: write d8/da/ff [5447695,32949] 0 2024-04-15T00:30:34.270 INFO:tasks.workunit.client.0.smithi029.stdout:9/281: write d3/d6/f1a [1070142,123375] 0 2024-04-15T00:30:34.337 INFO:tasks.workunit.client.0.smithi029.stdout:0/305: dread d5/f13 [0,4194304] 0 2024-04-15T00:30:34.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/298: dread d2/f34 [0,4194304] 0 2024-04-15T00:30:34.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/294: creat d17/f5b x:0 0 0 2024-04-15T00:30:34.442 INFO:tasks.workunit.client.0.smithi029.stdout:7/272: symlink d0/d6/l58 0 2024-04-15T00:30:34.453 INFO:tasks.workunit.client.0.smithi029.stdout:4/287: creat de/d2b/d59/f63 x:0 0 0 2024-04-15T00:30:34.453 INFO:tasks.workunit.client.0.smithi029.stdout:1/297: rename df/l49 to df/d29/d41/d69/l6d 0 2024-04-15T00:30:34.488 INFO:tasks.workunit.client.0.smithi029.stdout:3/295: dread - d17/d2f/f39 zero size 2024-04-15T00:30:34.646 INFO:tasks.workunit.client.0.smithi029.stdout:0/306: unlink d5/db/d1a/c20 0 2024-04-15T00:30:34.883 INFO:tasks.workunit.client.0.smithi029.stdout:2/295: link d3/d13/c21 d3/dd/d2d/c5b 0 2024-04-15T00:30:34.883 INFO:tasks.workunit.client.0.smithi029.stdout:6/302: getdents d1/d1e/d22 0 2024-04-15T00:30:34.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/273: fsync d0/d6/f2c 0 2024-04-15T00:30:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:4/288: symlink de/d2b/l64 0 2024-04-15T00:30:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/274: sync 2024-04-15T00:30:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/275: stat d0/d6/l45 0 2024-04-15T00:30:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:0/307: rmdir d5/d3e 39 2024-04-15T00:30:34.884 INFO:tasks.workunit.client.0.smithi029.stdout:5/299: truncate d2/f4 4636075 0 2024-04-15T00:30:35.003 INFO:tasks.workunit.client.0.smithi029.stdout:2/296: rename d3/c24 to d3/d2a/d4e/c5c 0 2024-04-15T00:30:35.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/297: stat d3/f5 0 2024-04-15T00:30:35.026 INFO:tasks.workunit.client.0.smithi029.stdout:2/298: chown d3/dd/l12 60 1 2024-04-15T00:30:35.341 INFO:tasks.workunit.client.0.smithi029.stdout:1/298: write df/d29/d41/f48 [270007,59572] 0 2024-04-15T00:30:35.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/299: fdatasync d3/f9 0 2024-04-15T00:30:35.768 INFO:tasks.workunit.client.0.smithi029.stdout:8/294: dwrite d8/dc/f1c [0,4194304] 0 2024-04-15T00:30:35.781 INFO:tasks.workunit.client.0.smithi029.stdout:9/282: dwrite d3/d6/d9/d29/f4c [0,4194304] 0 2024-04-15T00:30:35.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/300: rmdir d3/d2a/d46 39 2024-04-15T00:30:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:3/296: dwrite f15 [4194304,4194304] 0 2024-04-15T00:30:35.968 INFO:tasks.workunit.client.0.smithi029.stdout:4/289: rename de/d2b/c32 to de/c65 0 2024-04-15T00:30:36.165 INFO:tasks.workunit.client.0.smithi029.stdout:6/303: link d1/d8/db/d38/f39 d1/d1e/f61 0 2024-04-15T00:30:36.167 INFO:tasks.workunit.client.0.smithi029.stdout:7/276: dwrite d0/d6/d16/d26/f38 [0,4194304] 0 2024-04-15T00:30:36.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/297: rmdir d17 39 2024-04-15T00:30:36.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/308: dwrite d5/db/f37 [0,4194304] 0 2024-04-15T00:30:36.353 INFO:tasks.workunit.client.0.smithi029.stdout:9/283: read d3/d6/f12 [2876867,114968] 0 2024-04-15T00:30:36.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/290: write f2 [4405968,22717] 0 2024-04-15T00:30:36.407 INFO:tasks.workunit.client.0.smithi029.stdout:2/301: write d3/dd/f30 [1635845,55091] 0 2024-04-15T00:30:36.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/295: symlink d8/dc/d23/d28/d30/d39/l5e 0 2024-04-15T00:30:36.487 INFO:tasks.workunit.client.0.smithi029.stdout:5/300: dwrite d2/de/d1f/f3b [0,4194304] 0 2024-04-15T00:30:36.570 INFO:tasks.workunit.client.0.smithi029.stdout:0/309: chown d5/d15/d27 32955677 1 2024-04-15T00:30:36.574 INFO:tasks.workunit.client.0.smithi029.stdout:1/299: dwrite df/d29/f2c [0,4194304] 0 2024-04-15T00:30:36.583 INFO:tasks.workunit.client.0.smithi029.stdout:6/304: chown d1/d8/db/f4a 2250609 1 2024-04-15T00:30:37.004 INFO:tasks.workunit.client.0.smithi029.stdout:4/291: rmdir de/d3a 39 2024-04-15T00:30:37.016 INFO:tasks.workunit.client.0.smithi029.stdout:8/296: rename d8/d48 to d8/dc/d23/d28/d5f 0 2024-04-15T00:30:37.051 INFO:tasks.workunit.client.0.smithi029.stdout:8/297: dread d8/f38 [0,4194304] 0 2024-04-15T00:30:37.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/310: creat d5/d15/d1f/f63 x:0 0 0 2024-04-15T00:30:37.174 INFO:tasks.workunit.client.0.smithi029.stdout:5/301: creat d2/de/d1f/f6a x:0 0 0 2024-04-15T00:30:37.182 INFO:tasks.workunit.client.0.smithi029.stdout:1/300: creat df/d29/d41/d4f/f6e x:0 0 0 2024-04-15T00:30:37.201 INFO:tasks.workunit.client.0.smithi029.stdout:0/311: chown d5/db/d1a/d50 908 1 2024-04-15T00:30:37.272 INFO:tasks.workunit.client.0.smithi029.stdout:7/277: creat d0/f59 x:0 0 0 2024-04-15T00:30:37.282 INFO:tasks.workunit.client.0.smithi029.stdout:7/278: chown d0/d6/f25 1642 1 2024-04-15T00:30:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/298: mkdir d17/d2f/d44/d58/d5c 0 2024-04-15T00:30:37.698 INFO:tasks.workunit.client.0.smithi029.stdout:1/301: dread df/f2d [0,4194304] 0 2024-04-15T00:30:37.786 INFO:tasks.workunit.client.0.smithi029.stdout:4/292: getdents de/df/d1e/d56 0 2024-04-15T00:30:37.837 INFO:tasks.workunit.client.0.smithi029.stdout:5/302: creat d2/de/d13/d22/d3c/f6b x:0 0 0 2024-04-15T00:30:37.853 INFO:tasks.workunit.client.0.smithi029.stdout:5/303: chown d2/de/d13/d22/d3c/d41/f5d 505 1 2024-04-15T00:30:37.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/302: write d3/d2a/f3a [817563,41049] 0 2024-04-15T00:30:37.964 INFO:tasks.workunit.client.0.smithi029.stdout:3/299: creat d17/d2a/d46/f5d x:0 0 0 2024-04-15T00:30:38.019 INFO:tasks.workunit.client.0.smithi029.stdout:3/300: read - d17/f20 zero size 2024-04-15T00:30:38.127 INFO:tasks.workunit.client.0.smithi029.stdout:1/302: dread fc [0,4194304] 0 2024-04-15T00:30:38.390 INFO:tasks.workunit.client.0.smithi029.stdout:5/304: mkdir d2/d24/d6c 0 2024-04-15T00:30:38.403 INFO:tasks.workunit.client.0.smithi029.stdout:7/279: creat d0/f5a x:0 0 0 2024-04-15T00:30:38.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/305: dwrite d1/d8/db/f24 [0,4194304] 0 2024-04-15T00:30:38.820 INFO:tasks.workunit.client.0.smithi029.stdout:9/284: rename d3/d41 to d3/d6/d9/d29/d60/d64 0 2024-04-15T00:30:38.845 INFO:tasks.workunit.client.0.smithi029.stdout:3/301: write d17/f26 [4645081,58502] 0 2024-04-15T00:30:38.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/303: creat d3/d13/d43/d5a/d4f/f5d x:0 0 0 2024-04-15T00:30:38.860 INFO:tasks.workunit.client.0.smithi029.stdout:7/280: truncate d0/f1f 3035559 0 2024-04-15T00:30:38.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/306: creat d1/d1e/d56/f62 x:0 0 0 2024-04-15T00:30:38.960 INFO:tasks.workunit.client.0.smithi029.stdout:2/304: chown d3/dd/f35 263716339 1 2024-04-15T00:30:38.986 INFO:tasks.workunit.client.0.smithi029.stdout:7/281: chown d0/d6/d1c/l3 77 1 2024-04-15T00:30:39.073 INFO:tasks.workunit.client.0.smithi029.stdout:4/293: dwrite f8 [0,4194304] 0 2024-04-15T00:30:39.211 INFO:tasks.workunit.client.0.smithi029.stdout:8/298: rename d8/dc/d23/d28/d30/f4c to d8/da/d3d/f60 0 2024-04-15T00:30:39.220 INFO:tasks.workunit.client.0.smithi029.stdout:5/305: dread d2/de/d13/f19 [0,4194304] 0 2024-04-15T00:30:39.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/307: read d1/f1c [2915590,23964] 0 2024-04-15T00:30:39.301 INFO:tasks.workunit.client.0.smithi029.stdout:7/282: mkdir d0/d6/d39/d3c/d5b 0 2024-04-15T00:30:39.314 INFO:tasks.workunit.client.0.smithi029.stdout:9/285: chown d3/d6/c10 54144899 1 2024-04-15T00:30:39.452 INFO:tasks.workunit.client.0.smithi029.stdout:3/302: mknod d17/d2f/c5e 0 2024-04-15T00:30:39.457 INFO:tasks.workunit.client.0.smithi029.stdout:2/305: symlink d3/d2a/d46/d4a/l5e 0 2024-04-15T00:30:39.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/306: mkdir d2/de/d13/d22/d3c/d41/d6d 0 2024-04-15T00:30:39.522 INFO:tasks.workunit.client.0.smithi029.stdout:5/307: chown d2/de/d13/d22/d26/d36/c64 67865 1 2024-04-15T00:30:39.669 INFO:tasks.workunit.client.0.smithi029.stdout:4/294: dwrite f4 [0,4194304] 0 2024-04-15T00:30:39.939 INFO:tasks.workunit.client.0.smithi029.stdout:2/306: creat d3/d13/d43/f5f x:0 0 0 2024-04-15T00:30:40.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/283: creat d0/d6/d4f/f5c x:0 0 0 2024-04-15T00:30:40.142 INFO:tasks.workunit.client.0.smithi029.stdout:8/299: link d8/dc/d23/f51 d8/da/d2f/f61 0 2024-04-15T00:30:40.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/295: fsync f7 0 2024-04-15T00:30:40.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/284: mkdir d0/d6/d4f/d5d 0 2024-04-15T00:30:40.178 INFO:tasks.workunit.client.0.smithi029.stdout:2/307: read d3/d13/d14/f20 [4127567,14784] 0 2024-04-15T00:30:40.212 INFO:tasks.workunit.client.0.smithi029.stdout:4/296: dread de/d2b/f2c [0,4194304] 0 2024-04-15T00:30:40.379 INFO:tasks.workunit.client.0.smithi029.stdout:6/308: getdents d1/d1e/d56 0 2024-04-15T00:30:40.430 INFO:tasks.workunit.client.0.smithi029.stdout:9/286: dwrite d3/d6/d9/d29/d5d/f3a [0,4194304] 0 2024-04-15T00:30:40.507 INFO:tasks.workunit.client.0.smithi029.stdout:0/312: rename d5/d15/c30 to d5/db/c64 0 2024-04-15T00:30:40.518 INFO:tasks.workunit.client.0.smithi029.stdout:3/303: write f1 [4439211,9490] 0 2024-04-15T00:30:40.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/287: stat d3/d6/d9/d15/d4a/f4b 0 2024-04-15T00:30:40.676 INFO:tasks.workunit.client.0.smithi029.stdout:8/300: write d8/f38 [624065,8531] 0 2024-04-15T00:30:40.885 INFO:tasks.workunit.client.0.smithi029.stdout:5/308: getdents d2/d1a 0 2024-04-15T00:30:40.978 INFO:tasks.workunit.client.0.smithi029.stdout:1/303: rename df/d29/d41/d69/d4c/d55/f5d to df/d32/d6b/f6f 0 2024-04-15T00:30:40.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/313: mkdir d5/db/d1a/d65 0 2024-04-15T00:30:41.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/285: creat d0/d6/d4f/d5d/f5e x:0 0 0 2024-04-15T00:30:41.106 INFO:tasks.workunit.client.0.smithi029.stdout:9/288: creat d3/d6/d9/d15/d4a/d53/f65 x:0 0 0 2024-04-15T00:30:41.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/309: write d1/f17 [1955494,29503] 0 2024-04-15T00:30:41.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/304: dread d17/d2a/f32 [0,4194304] 0 2024-04-15T00:30:41.278 INFO:tasks.workunit.client.0.smithi029.stdout:3/305: fdatasync d17/d2a/d46/f5d 0 2024-04-15T00:30:41.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/297: dwrite de/d54/d58/f5b [0,4194304] 0 2024-04-15T00:30:41.315 INFO:tasks.workunit.client.0.smithi029.stdout:2/308: write d3/dd/f31 [184125,27931] 0 2024-04-15T00:30:41.432 INFO:tasks.workunit.client.0.smithi029.stdout:8/301: dread d8/dc/d23/f59 [0,4194304] 0 2024-04-15T00:30:41.432 INFO:tasks.workunit.client.0.smithi029.stdout:7/286: rmdir d0/d6/d39/d3c/d42/d49 39 2024-04-15T00:30:41.464 INFO:tasks.workunit.client.0.smithi029.stdout:9/289: fsync d3/d6/f17 0 2024-04-15T00:30:41.466 INFO:tasks.workunit.client.0.smithi029.stdout:5/309: dread d2/de/d13/d22/d26/d36/f45 [0,4194304] 0 2024-04-15T00:30:41.566 INFO:tasks.workunit.client.0.smithi029.stdout:1/304: getdents df/d32/d6b 0 2024-04-15T00:30:41.587 INFO:tasks.workunit.client.0.smithi029.stdout:2/309: readlink d3/d13/d43/d5a/l3f 0 2024-04-15T00:30:41.618 INFO:tasks.workunit.client.0.smithi029.stdout:5/310: chown d2/f34 125099 1 2024-04-15T00:30:41.687 INFO:tasks.workunit.client.0.smithi029.stdout:0/314: dwrite d5/db/f42 [0,4194304] 0 2024-04-15T00:30:41.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/306: dread d17/d2a/f2c [0,4194304] 0 2024-04-15T00:30:41.716 INFO:tasks.workunit.client.0.smithi029.stdout:2/310: read d3/dd/d2d/f34 [1133980,42158] 0 2024-04-15T00:30:41.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/287: chown d0/d6/d39/d3c/f55 0 1 2024-04-15T00:30:41.863 INFO:tasks.workunit.client.0.smithi029.stdout:6/310: dwrite d1/d8/db/f4a [0,4194304] 0 2024-04-15T00:30:41.944 INFO:tasks.workunit.client.0.smithi029.stdout:8/302: truncate d8/fd 2238231 0 2024-04-15T00:30:41.954 INFO:tasks.workunit.client.0.smithi029.stdout:1/305: truncate df/f19 319341 0 2024-04-15T00:30:42.095 INFO:tasks.workunit.client.0.smithi029.stdout:4/298: dread de/d3a/f46 [0,4194304] 0 2024-04-15T00:30:42.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/311: rename d2/d1a/d2d/f48 to d2/d1a/d2d/f6e 0 2024-04-15T00:30:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:7/288: symlink d0/d6/d1c/l5f 0 2024-04-15T00:30:42.476 INFO:tasks.workunit.client.0.smithi029.stdout:0/315: fsync d5/db/f3b 0 2024-04-15T00:30:42.584 INFO:tasks.workunit.client.0.smithi029.stdout:9/290: symlink d3/d6/d9/d15/d62/l66 0 2024-04-15T00:30:42.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/311: fsync d1/d1e/f32 0 2024-04-15T00:30:42.601 INFO:tasks.workunit.client.0.smithi029.stdout:1/306: symlink df/d29/d41/d69/d4c/l70 0 2024-04-15T00:30:42.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/303: creat d8/dc/d23/d28/f62 x:0 0 0 2024-04-15T00:30:42.753 INFO:tasks.workunit.client.0.smithi029.stdout:7/289: symlink d0/d6/d4f/d5d/l60 0 2024-04-15T00:30:42.905 INFO:tasks.workunit.client.0.smithi029.stdout:3/307: mkdir d17/d2f/d44/d58/d5c/d5f 0 2024-04-15T00:30:43.044 INFO:tasks.workunit.client.0.smithi029.stdout:8/304: dread - d8/da/f49 zero size 2024-04-15T00:30:43.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/290: creat d0/d6/d16/f61 x:0 0 0 2024-04-15T00:30:43.277 INFO:tasks.workunit.client.0.smithi029.stdout:6/312: creat d1/d1e/d56/f63 x:0 0 0 2024-04-15T00:30:43.371 INFO:tasks.workunit.client.0.smithi029.stdout:9/291: symlink d3/d6/d9/d29/l67 0 2024-04-15T00:30:43.375 INFO:tasks.workunit.client.0.smithi029.stdout:8/305: unlink d8/da/ff 0 2024-04-15T00:30:43.438 INFO:tasks.workunit.client.0.smithi029.stdout:5/312: link d2/de/d13/d22/f40 d2/de/d13/d22/d26/f6f 0 2024-04-15T00:30:43.443 INFO:tasks.workunit.client.0.smithi029.stdout:7/291: truncate d0/d6/d1c/fc 1130983 0 2024-04-15T00:30:43.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/313: dread - d2/d1a/f3e zero size 2024-04-15T00:30:43.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/311: getdents d3/dd/d2d 0 2024-04-15T00:30:43.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/312: readlink d3/lf 0 2024-04-15T00:30:43.573 INFO:tasks.workunit.client.0.smithi029.stdout:6/313: dread - d1/d8/db/f50 zero size 2024-04-15T00:30:43.580 INFO:tasks.workunit.client.0.smithi029.stdout:8/306: rmdir d8/dc/d23/d28/d3a 39 2024-04-15T00:30:43.655 INFO:tasks.workunit.client.0.smithi029.stdout:5/314: dread d2/de/d1f/f62 [0,4194304] 0 2024-04-15T00:30:43.739 INFO:tasks.workunit.client.0.smithi029.stdout:2/313: mknod d3/d13/d43/d5a/c60 0 2024-04-15T00:30:43.827 INFO:tasks.workunit.client.0.smithi029.stdout:7/292: sync 2024-04-15T00:30:43.876 INFO:tasks.workunit.client.0.smithi029.stdout:3/308: link d17/d2a/d33/f55 d17/d2a/d33/f60 0 2024-04-15T00:30:44.106 INFO:tasks.workunit.client.0.smithi029.stdout:5/315: mkdir d2/de/d13/d22/d26/d36/d4d/d70 0 2024-04-15T00:30:44.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/314: mkdir d3/dd/d2d/d61 0 2024-04-15T00:30:44.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/316: write d5/d15/d1f/f44 [2304384,102901] 0 2024-04-15T00:30:44.189 INFO:tasks.workunit.client.0.smithi029.stdout:7/293: dread - d0/d6/d16/d26/f51 zero size 2024-04-15T00:30:44.223 INFO:tasks.workunit.client.0.smithi029.stdout:6/314: mkdir d1/d64 0 2024-04-15T00:30:44.244 INFO:tasks.workunit.client.0.smithi029.stdout:9/292: link d3/d6/d9/l20 d3/d6/d9/d15/d4a/l68 0 2024-04-15T00:30:44.280 INFO:tasks.workunit.client.0.smithi029.stdout:4/299: dwrite de/d2b/f2c [0,4194304] 0 2024-04-15T00:30:44.344 INFO:tasks.workunit.client.0.smithi029.stdout:3/309: symlink d17/l61 0 2024-04-15T00:30:44.353 INFO:tasks.workunit.client.0.smithi029.stdout:5/316: mkdir d2/de/d1f/d63/d71 0 2024-04-15T00:30:44.445 INFO:tasks.workunit.client.0.smithi029.stdout:2/315: truncate d3/dd/f30 1050327 0 2024-04-15T00:30:44.546 INFO:tasks.workunit.client.0.smithi029.stdout:7/294: dread d0/f24 [0,4194304] 0 2024-04-15T00:30:44.655 INFO:tasks.workunit.client.0.smithi029.stdout:1/307: write df/f3e [923072,56752] 0 2024-04-15T00:30:44.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/307: dwrite d8/f15 [0,4194304] 0 2024-04-15T00:30:44.994 INFO:tasks.workunit.client.0.smithi029.stdout:4/300: mknod de/d2b/d59/c66 0 2024-04-15T00:30:45.000 INFO:tasks.workunit.client.0.smithi029.stdout:5/317: fsync d2/de/d13/d22/d26/d36/f38 0 2024-04-15T00:30:45.001 INFO:tasks.workunit.client.0.smithi029.stdout:9/293: readlink d3/d6/d9/d29/l4f 0 2024-04-15T00:30:45.005 INFO:tasks.workunit.client.0.smithi029.stdout:0/317: mknod d5/d15/c66 0 2024-04-15T00:30:45.060 INFO:tasks.workunit.client.0.smithi029.stdout:9/294: chown d3/d6/d9/l63 32443237 1 2024-04-15T00:30:45.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/315: dwrite d1/d8/db/f5b [0,4194304] 0 2024-04-15T00:30:45.349 INFO:tasks.workunit.client.0.smithi029.stdout:1/308: mknod df/d29/d41/d69/d4c/d55/c71 0 2024-04-15T00:30:45.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/318: creat d2/de/f72 x:0 0 0 2024-04-15T00:30:45.627 INFO:tasks.workunit.client.0.smithi029.stdout:4/301: rename de/d54/l5f to de/d2b/d59/l67 0 2024-04-15T00:30:45.661 INFO:tasks.workunit.client.0.smithi029.stdout:5/319: write d2/de/f72 [806455,32245] 0 2024-04-15T00:30:45.665 INFO:tasks.workunit.client.0.smithi029.stdout:7/295: symlink d0/d6/l62 0 2024-04-15T00:30:45.737 INFO:tasks.workunit.client.0.smithi029.stdout:1/309: symlink df/d29/d41/d69/d4c/l72 0 2024-04-15T00:30:46.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/308: rmdir d8/dc/d23/d28/d3a 39 2024-04-15T00:30:46.216 INFO:tasks.workunit.client.0.smithi029.stdout:2/316: creat d3/d13/f62 x:0 0 0 2024-04-15T00:30:46.225 INFO:tasks.workunit.client.0.smithi029.stdout:9/295: rename d3/d6/d9/d15/d4a/d53/f65 to d3/d6/d9/d29/d60/d64/f69 0 2024-04-15T00:30:46.493 INFO:tasks.workunit.client.0.smithi029.stdout:8/309: mknod d8/da/d2f/d42/c63 0 2024-04-15T00:30:46.494 INFO:tasks.workunit.client.0.smithi029.stdout:7/296: fsync d0/d6/d16/d26/f51 0 2024-04-15T00:30:46.500 INFO:tasks.workunit.client.0.smithi029.stdout:3/310: rename d17/c25 to d17/c62 0 2024-04-15T00:30:46.524 INFO:tasks.workunit.client.0.smithi029.stdout:5/320: mknod d2/d24/d6c/c73 0 2024-04-15T00:30:46.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/316: rename d1/d1e/d56/f63 to d1/d1e/d56/d58/d5f/f65 0 2024-04-15T00:30:46.672 INFO:tasks.workunit.client.0.smithi029.stdout:2/317: symlink d3/dd/d42/l63 0 2024-04-15T00:30:46.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/318: dread d3/f5 [8388608,4194304] 0 2024-04-15T00:30:47.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/321: rename d2/de/d13/d22/f3f to d2/de/d13/d22/d3c/f74 0 2024-04-15T00:30:47.303 INFO:tasks.workunit.client.0.smithi029.stdout:1/310: write df/d32/f39 [1434256,127699] 0 2024-04-15T00:30:47.330 INFO:tasks.workunit.client.0.smithi029.stdout:1/311: readlink df/d32/l5a 0 2024-04-15T00:30:47.439 INFO:tasks.workunit.client.0.smithi029.stdout:6/317: dread d1/d8/f53 [0,4194304] 0 2024-04-15T00:30:47.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/302: getdents de 0 2024-04-15T00:30:47.529 INFO:tasks.workunit.client.0.smithi029.stdout:7/297: creat d0/d6/d39/d3c/d5b/f63 x:0 0 0 2024-04-15T00:30:47.548 INFO:tasks.workunit.client.0.smithi029.stdout:7/298: chown d0/d6/c2a 7347446 1 2024-04-15T00:30:47.576 INFO:tasks.workunit.client.0.smithi029.stdout:0/318: link d5/db/c64 d5/db/c67 0 2024-04-15T00:30:47.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/296: write d3/d6/d9/d15/f1f [501576,109422] 0 2024-04-15T00:30:47.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/310: unlink d8/dc/d23/c24 0 2024-04-15T00:30:48.024 INFO:tasks.workunit.client.0.smithi029.stdout:1/312: dread df/f1c [0,4194304] 0 2024-04-15T00:30:48.092 INFO:tasks.workunit.client.0.smithi029.stdout:0/319: dread d5/d15/d1f/f3a [0,4194304] 0 2024-04-15T00:30:48.152 INFO:tasks.workunit.client.0.smithi029.stdout:3/311: dwrite d17/d2f/d3c/f4a [0,4194304] 0 2024-04-15T00:30:48.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/320: chown d5/d15/c25 14 1 2024-04-15T00:30:48.202 INFO:tasks.workunit.client.0.smithi029.stdout:1/313: sync 2024-04-15T00:30:48.227 INFO:tasks.workunit.client.0.smithi029.stdout:4/303: getdents de/df/d1e/d56 0 2024-04-15T00:30:48.297 INFO:tasks.workunit.client.0.smithi029.stdout:1/314: dread df/d32/d6b/f6f [0,4194304] 0 2024-04-15T00:30:48.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/304: dread f2 [0,4194304] 0 2024-04-15T00:30:48.565 INFO:tasks.workunit.client.0.smithi029.stdout:0/321: mkdir d5/d15/d68 0 2024-04-15T00:30:48.856 INFO:tasks.workunit.client.0.smithi029.stdout:4/305: creat de/d54/d58/f68 x:0 0 0 2024-04-15T00:30:48.966 INFO:tasks.workunit.client.0.smithi029.stdout:2/319: dwrite d3/d13/f16 [0,4194304] 0 2024-04-15T00:30:49.099 INFO:tasks.workunit.client.0.smithi029.stdout:8/311: write d8/f2c [1449008,67275] 0 2024-04-15T00:30:49.130 INFO:tasks.workunit.client.0.smithi029.stdout:1/315: write df/f2d [2797498,112464] 0 2024-04-15T00:30:49.131 INFO:tasks.workunit.client.0.smithi029.stdout:3/312: write d17/d2f/d3c/f3f [5033655,75475] 0 2024-04-15T00:30:49.182 INFO:tasks.workunit.client.0.smithi029.stdout:4/306: rmdir de/df/d1e 39 2024-04-15T00:30:49.202 INFO:tasks.workunit.client.0.smithi029.stdout:2/320: creat d3/d2a/d4e/f64 x:0 0 0 2024-04-15T00:30:49.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/322: rename d5/db/f3b to d5/d3e/f69 0 2024-04-15T00:30:49.424 INFO:tasks.workunit.client.0.smithi029.stdout:3/313: unlink d17/f52 0 2024-04-15T00:30:49.594 INFO:tasks.workunit.client.0.smithi029.stdout:7/299: dwrite d0/d6/d16/d26/f40 [0,4194304] 0 2024-04-15T00:30:49.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/322: dwrite d2/f11 [0,4194304] 0 2024-04-15T00:30:49.697 INFO:tasks.workunit.client.0.smithi029.stdout:9/297: dwrite d3/d6/d9/d29/d5d/f36 [0,4194304] 0 2024-04-15T00:30:49.704 INFO:tasks.workunit.client.0.smithi029.stdout:2/321: mkdir d3/d50/d51/d65 0 2024-04-15T00:30:49.779 INFO:tasks.workunit.client.0.smithi029.stdout:6/318: dwrite d1/d8/db/f44 [0,4194304] 0 2024-04-15T00:30:49.780 INFO:tasks.workunit.client.0.smithi029.stdout:3/314: readlink d17/d2a/l3d 0 2024-04-15T00:30:49.789 INFO:tasks.workunit.client.0.smithi029.stdout:4/307: write de/d2b/f21 [838225,67249] 0 2024-04-15T00:30:49.927 INFO:tasks.workunit.client.0.smithi029.stdout:0/323: write d5/db/f42 [3340463,75875] 0 2024-04-15T00:30:49.934 INFO:tasks.workunit.client.0.smithi029.stdout:7/300: fdatasync d0/f24 0 2024-04-15T00:30:49.990 INFO:tasks.workunit.client.0.smithi029.stdout:9/298: chown d3/l48 77 1 2024-04-15T00:30:50.026 INFO:tasks.workunit.client.0.smithi029.stdout:1/316: dread df/d29/d41/f45 [0,4194304] 0 2024-04-15T00:30:50.070 INFO:tasks.workunit.client.0.smithi029.stdout:8/312: dwrite d8/dc/d23/f59 [0,4194304] 0 2024-04-15T00:30:50.173 INFO:tasks.workunit.client.0.smithi029.stdout:5/323: creat d2/de/d13/d22/d3c/f75 x:0 0 0 2024-04-15T00:30:50.195 INFO:tasks.workunit.client.0.smithi029.stdout:1/317: fsync df/f62 0 2024-04-15T00:30:50.224 INFO:tasks.workunit.client.0.smithi029.stdout:0/324: dread d5/db/f42 [0,4194304] 0 2024-04-15T00:30:50.244 INFO:tasks.workunit.client.0.smithi029.stdout:5/324: stat d2/d24/c46 0 2024-04-15T00:30:50.326 INFO:tasks.workunit.client.0.smithi029.stdout:4/308: dwrite f8 [0,4194304] 0 2024-04-15T00:30:50.425 INFO:tasks.workunit.client.0.smithi029.stdout:9/299: write d3/d6/d9/d29/d60/d64/f69 [349811,95423] 0 2024-04-15T00:30:50.444 INFO:tasks.workunit.client.0.smithi029.stdout:5/325: fdatasync d2/de/d13/f32 0 2024-04-15T00:30:50.561 INFO:tasks.workunit.client.0.smithi029.stdout:3/315: link d17/f5b d17/d2a/d33/f63 0 2024-04-15T00:30:50.562 INFO:tasks.workunit.client.0.smithi029.stdout:6/319: link d1/c55 d1/d1e/d56/d58/d5f/c66 0 2024-04-15T00:30:50.571 INFO:tasks.workunit.client.0.smithi029.stdout:7/301: creat d0/d6/f64 x:0 0 0 2024-04-15T00:30:50.581 INFO:tasks.workunit.client.0.smithi029.stdout:4/309: creat de/d2b/d35/f69 x:0 0 0 2024-04-15T00:30:50.655 INFO:tasks.workunit.client.0.smithi029.stdout:0/325: mknod d5/db/d1a/d50/c6a 0 2024-04-15T00:30:50.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/326: truncate d2/de/d13/d22/f5a 701184 0 2024-04-15T00:30:50.739 INFO:tasks.workunit.client.0.smithi029.stdout:8/313: write d8/f38 [1434279,102512] 0 2024-04-15T00:30:50.768 INFO:tasks.workunit.client.0.smithi029.stdout:2/322: getdents d3/d13 0 2024-04-15T00:30:51.022 INFO:tasks.workunit.client.0.smithi029.stdout:3/316: rename d17/d2f/d44/f48 to d17/d2f/d44/d58/d5c/f64 0 2024-04-15T00:30:51.050 INFO:tasks.workunit.client.0.smithi029.stdout:7/302: read d0/f24 [1946719,58854] 0 2024-04-15T00:30:51.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/327: creat d2/d1a/d2d/f76 x:0 0 0 2024-04-15T00:30:51.278 INFO:tasks.workunit.client.0.smithi029.stdout:1/318: getdents df/d29/d41/d69/d4c/d55 0 2024-04-15T00:30:51.278 INFO:tasks.workunit.client.0.smithi029.stdout:2/323: creat d3/d2a/d46/d4a/f66 x:0 0 0 2024-04-15T00:30:51.308 INFO:tasks.workunit.client.0.smithi029.stdout:7/303: mkdir d0/d6/d4f/d5d/d65 0 2024-04-15T00:30:51.340 INFO:tasks.workunit.client.0.smithi029.stdout:4/310: read de/df/d1e/f24 [105141,123240] 0 2024-04-15T00:30:51.368 INFO:tasks.workunit.client.0.smithi029.stdout:4/311: truncate de/d54/d58/f68 43818 0 2024-04-15T00:30:51.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/300: getdents d3/d6/d9/d15/d62 0 2024-04-15T00:30:51.676 INFO:tasks.workunit.client.0.smithi029.stdout:3/317: creat d17/d2a/d4c/d51/f65 x:0 0 0 2024-04-15T00:30:51.827 INFO:tasks.workunit.client.0.smithi029.stdout:0/326: write d5/d15/d27/f2d [684500,21406] 0 2024-04-15T00:30:51.918 INFO:tasks.workunit.client.0.smithi029.stdout:6/320: write d1/d8/db/d38/f39 [1192520,76160] 0 2024-04-15T00:30:51.921 INFO:tasks.workunit.client.0.smithi029.stdout:8/314: write d8/da/f5b [991229,32742] 0 2024-04-15T00:30:52.037 INFO:tasks.workunit.client.0.smithi029.stdout:5/328: dwrite d2/de/d13/d22/d26/f35 [0,4194304] 0 2024-04-15T00:30:52.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/319: creat df/d32/d6b/f73 x:0 0 0 2024-04-15T00:30:52.126 INFO:tasks.workunit.client.0.smithi029.stdout:9/301: truncate d3/d6/d9/f50 947385 0 2024-04-15T00:30:52.127 INFO:tasks.workunit.client.0.smithi029.stdout:2/324: dread - d3/d13/d43/d5a/d4f/f5d zero size 2024-04-15T00:30:52.182 INFO:tasks.workunit.client.0.smithi029.stdout:6/321: creat d1/d8/db/d38/f67 x:0 0 0 2024-04-15T00:30:52.241 INFO:tasks.workunit.client.0.smithi029.stdout:8/315: dread d8/dc/d23/d28/f44 [0,4194304] 0 2024-04-15T00:30:52.255 INFO:tasks.workunit.client.0.smithi029.stdout:3/318: dread f15 [4194304,4194304] 0 2024-04-15T00:30:52.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/322: creat d1/d8/db/d38/f68 x:0 0 0 2024-04-15T00:30:52.702 INFO:tasks.workunit.client.0.smithi029.stdout:8/316: stat d8/dc/d23/d28/d3a/d5a/l5c 0 2024-04-15T00:30:52.988 INFO:tasks.workunit.client.0.smithi029.stdout:8/317: rmdir d8/dc/d23/d28/d30 39 2024-04-15T00:30:53.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/320: getdents df/d29/d41/d69/d4c/d55 0 2024-04-15T00:30:53.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/323: rename d1/d8/db/c28 to d1/d1e/d56/c69 0 2024-04-15T00:30:53.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/321: dwrite df/f2d [4194304,4194304] 0 2024-04-15T00:30:53.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/329: getdents d2/de/d13/d22/d26 0 2024-04-15T00:30:53.414 INFO:tasks.workunit.client.0.smithi029.stdout:0/327: dwrite d5/d15/f1e [0,4194304] 0 2024-04-15T00:30:53.482 INFO:tasks.workunit.client.0.smithi029.stdout:6/324: creat d1/d1e/d22/f6a x:0 0 0 2024-04-15T00:30:53.496 INFO:tasks.workunit.client.0.smithi029.stdout:7/304: rmdir d0 39 2024-04-15T00:30:53.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/325: write d3/f32 [484465,76485] 0 2024-04-15T00:30:53.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/319: write d17/d2a/f35 [66619,50484] 0 2024-04-15T00:30:53.564 INFO:tasks.workunit.client.0.smithi029.stdout:8/318: symlink d8/dc/d23/d28/d30/l64 0 2024-04-15T00:30:53.596 INFO:tasks.workunit.client.0.smithi029.stdout:5/330: fsync d2/de/d13/f2a 0 2024-04-15T00:30:53.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/302: dwrite d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:30:53.832 INFO:tasks.workunit.client.0.smithi029.stdout:4/312: dwrite de/d2b/f62 [0,4194304] 0 2024-04-15T00:30:53.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/326: mknod d3/d2a/d46/d4a/c67 0 2024-04-15T00:30:53.912 INFO:tasks.workunit.client.0.smithi029.stdout:6/325: truncate d1/d8/db/d38/f68 461708 0 2024-04-15T00:30:53.917 INFO:tasks.workunit.client.0.smithi029.stdout:3/320: truncate d17/f1b 5504808 0 2024-04-15T00:30:53.935 INFO:tasks.workunit.client.0.smithi029.stdout:7/305: readlink d0/d6/l53 0 2024-04-15T00:30:53.957 INFO:tasks.workunit.client.0.smithi029.stdout:6/326: stat d1/d1e/f61 0 2024-04-15T00:30:54.176 INFO:tasks.workunit.client.0.smithi029.stdout:4/313: chown de/c5e 0 1 2024-04-15T00:30:54.202 INFO:tasks.workunit.client.0.smithi029.stdout:9/303: dread d3/d6/d9/f50 [0,4194304] 0 2024-04-15T00:30:54.238 INFO:tasks.workunit.client.0.smithi029.stdout:2/327: mknod d3/d2a/d46/d4a/c68 0 2024-04-15T00:30:54.259 INFO:tasks.workunit.client.0.smithi029.stdout:1/322: write df/d29/d41/d69/d4c/d55/f5e [832411,115398] 0 2024-04-15T00:30:54.269 INFO:tasks.workunit.client.0.smithi029.stdout:6/327: dread - d1/d8/f5e zero size 2024-04-15T00:30:54.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/306: dread d0/d6/d1c/f9 [0,4194304] 0 2024-04-15T00:30:54.504 INFO:tasks.workunit.client.0.smithi029.stdout:5/331: creat d2/de/d13/d22/d3c/d41/d6d/f77 x:0 0 0 2024-04-15T00:30:54.519 INFO:tasks.workunit.client.0.smithi029.stdout:1/323: dread df/d29/d41/d69/d4c/d55/f5e [0,4194304] 0 2024-04-15T00:30:54.524 INFO:tasks.workunit.client.0.smithi029.stdout:0/328: creat d5/d15/d27/f6b x:0 0 0 2024-04-15T00:30:54.531 INFO:tasks.workunit.client.0.smithi029.stdout:9/304: mkdir d3/d6/d30/d3b/d58/d6a 0 2024-04-15T00:30:54.539 INFO:tasks.workunit.client.0.smithi029.stdout:2/328: fsync d3/f5 0 2024-04-15T00:30:54.951 INFO:tasks.workunit.client.0.smithi029.stdout:8/319: rename d8/da/c33 to d8/da/d3d/c65 0 2024-04-15T00:30:54.958 INFO:tasks.workunit.client.0.smithi029.stdout:6/328: fsync d1/d1e/f4e 0 2024-04-15T00:30:54.979 INFO:tasks.workunit.client.0.smithi029.stdout:1/324: creat df/d32/d6b/f74 x:0 0 0 2024-04-15T00:30:54.983 INFO:tasks.workunit.client.0.smithi029.stdout:5/332: mkdir d2/de/d13/d22/d26/d36/d4d/d78 0 2024-04-15T00:30:54.992 INFO:tasks.workunit.client.0.smithi029.stdout:7/307: truncate d0/d6/d16/f61 1007241 0 2024-04-15T00:30:55.562 INFO:tasks.workunit.client.0.smithi029.stdout:3/321: rename d17/f26 to d17/d2f/d44/f66 0 2024-04-15T00:30:55.567 INFO:tasks.workunit.client.0.smithi029.stdout:8/320: mkdir d8/da/d2f/d66 0 2024-04-15T00:30:55.583 INFO:tasks.workunit.client.0.smithi029.stdout:6/329: truncate d1/f2f 286276 0 2024-04-15T00:30:55.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/333: mknod d2/de/d13/d22/d26/c79 0 2024-04-15T00:30:55.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/305: creat d3/d6/d30/d3b/f6b x:0 0 0 2024-04-15T00:30:56.051 INFO:tasks.workunit.client.0.smithi029.stdout:2/329: dwrite d3/d13/f62 [0,4194304] 0 2024-04-15T00:30:56.116 INFO:tasks.workunit.client.0.smithi029.stdout:0/329: dwrite d5/d15/d1f/d32/f61 [0,4194304] 0 2024-04-15T00:30:56.126 INFO:tasks.workunit.client.0.smithi029.stdout:6/330: rmdir d1/d1e/d56/d58/d59 39 2024-04-15T00:30:56.195 INFO:tasks.workunit.client.0.smithi029.stdout:5/334: truncate d2/de/d13/d22/d26/d36/f37 39697 0 2024-04-15T00:30:56.199 INFO:tasks.workunit.client.0.smithi029.stdout:1/325: dwrite df/d29/d41/f45 [0,4194304] 0 2024-04-15T00:30:56.293 INFO:tasks.workunit.client.0.smithi029.stdout:2/330: chown d3/d13/d43/d5a/f4b 0 1 2024-04-15T00:30:56.317 INFO:tasks.workunit.client.0.smithi029.stdout:0/330: write d5/d15/d27/f2d [2181669,85516] 0 2024-04-15T00:30:56.331 INFO:tasks.workunit.client.0.smithi029.stdout:4/314: rename de/df/d1e/l3f to de/d54/l6a 0 2024-04-15T00:30:56.365 INFO:tasks.workunit.client.0.smithi029.stdout:5/335: rename d2/de/d13/d22/d3c to d2/de/d13/d22/d3c/d7a 22 2024-04-15T00:30:56.381 INFO:tasks.workunit.client.0.smithi029.stdout:5/336: stat d2/de/d13/f19 0 2024-04-15T00:30:56.720 INFO:tasks.workunit.client.0.smithi029.stdout:9/306: dwrite d3/d6/d9/f11 [0,4194304] 0 2024-04-15T00:30:56.811 INFO:tasks.workunit.client.0.smithi029.stdout:6/331: mknod d1/d8/c6b 0 2024-04-15T00:30:56.812 INFO:tasks.workunit.client.0.smithi029.stdout:8/321: creat d8/da/d2f/d66/f67 x:0 0 0 2024-04-15T00:30:56.838 INFO:tasks.workunit.client.0.smithi029.stdout:6/332: dread - d1/d1e/f4e zero size 2024-04-15T00:30:56.876 INFO:tasks.workunit.client.0.smithi029.stdout:1/326: creat df/d29/d41/d69/d4c/f75 x:0 0 0 2024-04-15T00:30:56.929 INFO:tasks.workunit.client.0.smithi029.stdout:3/322: write d17/f5b [761136,22000] 0 2024-04-15T00:30:56.991 INFO:tasks.workunit.client.0.smithi029.stdout:2/331: mknod d3/d2a/d46/c69 0 2024-04-15T00:30:57.010 INFO:tasks.workunit.client.0.smithi029.stdout:6/333: dread d1/d8/db/f48 [0,4194304] 0 2024-04-15T00:30:57.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/332: stat d3/d13/l19 0 2024-04-15T00:30:57.135 INFO:tasks.workunit.client.0.smithi029.stdout:2/333: dread d3/d13/f26 [0,4194304] 0 2024-04-15T00:30:57.224 INFO:tasks.workunit.client.0.smithi029.stdout:4/315: fsync de/df/d1e/f28 0 2024-04-15T00:30:57.288 INFO:tasks.workunit.client.0.smithi029.stdout:5/337: symlink d2/de/d1f/l7b 0 2024-04-15T00:30:57.371 INFO:tasks.workunit.client.0.smithi029.stdout:7/308: getdents d0/d6/d39/d3c/d5b 0 2024-04-15T00:30:57.537 INFO:tasks.workunit.client.0.smithi029.stdout:8/322: fsync d8/f15 0 2024-04-15T00:30:57.594 INFO:tasks.workunit.client.0.smithi029.stdout:9/307: mknod d3/d6/d9/d29/d60/d57/c6c 0 2024-04-15T00:30:57.611 INFO:tasks.workunit.client.0.smithi029.stdout:3/323: read ff [1268451,1686] 0 2024-04-15T00:30:57.627 INFO:tasks.workunit.client.0.smithi029.stdout:9/308: truncate d3/d6/d9/f11 4959132 0 2024-04-15T00:30:57.648 INFO:tasks.workunit.client.0.smithi029.stdout:1/327: mknod df/d29/d41/d69/d4c/d55/d59/c76 0 2024-04-15T00:30:57.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/328: chown df/f22 23 1 2024-04-15T00:30:57.744 INFO:tasks.workunit.client.0.smithi029.stdout:6/334: readlink d1/d1e/l2c 0 2024-04-15T00:30:57.855 INFO:tasks.workunit.client.0.smithi029.stdout:2/334: rename d3/d13/f28 to d3/d13/d14/f6a 0 2024-04-15T00:30:57.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/309: truncate d0/d6/d16/d26/f38 1422964 0 2024-04-15T00:30:58.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/323: symlink d8/dc/d23/d28/d5f/l68 0 2024-04-15T00:30:58.118 INFO:tasks.workunit.client.0.smithi029.stdout:0/331: write d5/d15/d1f/d32/f43 [594853,100722] 0 2024-04-15T00:30:58.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/324: mkdir d17/d2a/d46/d67 0 2024-04-15T00:30:58.158 INFO:tasks.workunit.client.0.smithi029.stdout:0/332: stat d5/d15/d1f/d32/f43 0 2024-04-15T00:30:58.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/335: rmdir d1/d1e/d56/d58 39 2024-04-15T00:30:58.562 INFO:tasks.workunit.client.0.smithi029.stdout:7/310: unlink d0/l43 0 2024-04-15T00:30:58.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/324: unlink d8/da/d2f/f36 0 2024-04-15T00:30:58.996 INFO:tasks.workunit.client.0.smithi029.stdout:5/338: rename d2/de/d1f/f62 to d2/de/d13/d22/f7c 0 2024-04-15T00:30:59.048 INFO:tasks.workunit.client.0.smithi029.stdout:4/316: dwrite de/df/f12 [0,4194304] 0 2024-04-15T00:30:59.120 INFO:tasks.workunit.client.0.smithi029.stdout:8/325: unlink d8/dc/l5d 0 2024-04-15T00:30:59.275 INFO:tasks.workunit.client.0.smithi029.stdout:9/309: write d3/d6/d9/fd [143917,112168] 0 2024-04-15T00:30:59.351 INFO:tasks.workunit.client.0.smithi029.stdout:1/329: write df/f30 [2772289,93203] 0 2024-04-15T00:30:59.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/336: symlink d1/d1e/d56/d58/d59/l6c 0 2024-04-15T00:30:59.463 INFO:tasks.workunit.client.0.smithi029.stdout:6/337: chown d1/d8/db 52041 1 2024-04-15T00:30:59.482 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:59.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:30:59.599 INFO:tasks.workunit.client.0.smithi029.stdout:7/311: rename d0/d6/d16 to d0/d6/d4f/d66 0 2024-04-15T00:30:59.609 INFO:tasks.workunit.client.0.smithi029.stdout:5/339: truncate d2/de/d13/d22/f47 5263318 0 2024-04-15T00:30:59.796 INFO:tasks.workunit.client.0.smithi029.stdout:9/310: fdatasync d3/d6/d9/d15/d4a/f4d 0 2024-04-15T00:30:59.823 INFO:tasks.workunit.client.0.smithi029.stdout:9/311: write d3/d6/d30/d3b/f6b [100611,91755] 0 2024-04-15T00:30:59.861 INFO:tasks.workunit.client.0.smithi029.stdout:9/312: chown d3/d6/d9/d29/d60/d57/c6c 48 1 2024-04-15T00:30:59.945 INFO:tasks.workunit.client.0.smithi029.stdout:0/333: getdents d5/db/d1a 0 2024-04-15T00:30:59.959 INFO:tasks.workunit.client.0.smithi029.stdout:6/338: rmdir d1/d8/db/d38 39 2024-04-15T00:30:59.964 INFO:tasks.workunit.client.0.smithi029.stdout:3/325: write d17/d2f/d44/f4f [4093783,6237] 0 2024-04-15T00:31:00.345 INFO:tasks.workunit.client.0.smithi029.stdout:2/335: rename d3/le to d3/d13/d14/l6b 0 2024-04-15T00:31:00.363 INFO:tasks.workunit.client.0.smithi029.stdout:5/340: rmdir d2/de/d1f/d63 39 2024-04-15T00:31:00.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/326: read - d17/d2a/d33/f56 zero size 2024-04-15T00:31:00.581 INFO:tasks.workunit.client.0.smithi029.stdout:8/326: link d8/da/f49 d8/dc/d23/d28/d30/f69 0 2024-04-15T00:31:00.582 INFO:tasks.workunit.client.0.smithi029.stdout:1/330: write df/f38 [14049,61698] 0 2024-04-15T00:31:00.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/317: write de/df/d1e/f4c [4916161,74020] 0 2024-04-15T00:31:00.657 INFO:tasks.workunit.client.0.smithi029.stdout:0/334: symlink d5/d4c/d4e/l6c 0 2024-04-15T00:31:00.662 INFO:tasks.workunit.client.0.smithi029.stdout:9/313: rename d3/d6/d30/d3b to d3/d6/d9/d29/d60/d64/d6d 0 2024-04-15T00:31:00.667 INFO:tasks.workunit.client.0.smithi029.stdout:6/339: mknod d1/d1e/d56/c6d 0 2024-04-15T00:31:00.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/314: stat d3/d6/d9/d29/d60/c40 0 2024-04-15T00:31:00.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/312: write d0/f22 [5217563,36628] 0 2024-04-15T00:31:01.023 INFO:tasks.workunit.client.0.smithi029.stdout:8/327: fsync d8/f50 0 2024-04-15T00:31:01.033 INFO:tasks.workunit.client.0.smithi029.stdout:4/318: truncate de/d2b/d35/f69 604698 0 2024-04-15T00:31:01.137 INFO:tasks.workunit.client.0.smithi029.stdout:5/341: dwrite d2/d1a/f59 [0,4194304] 0 2024-04-15T00:31:01.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/342: read - d2/de/d13/d22/d3c/f4b zero size 2024-04-15T00:31:01.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/340: symlink d1/d8/l6e 0 2024-04-15T00:31:01.277 INFO:tasks.workunit.client.0.smithi029.stdout:2/336: truncate d3/d13/f16 4046719 0 2024-04-15T00:31:01.292 INFO:tasks.workunit.client.0.smithi029.stdout:9/315: creat d3/d6/d9/d29/d60/f6e x:0 0 0 2024-04-15T00:31:01.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/335: mknod d5/d54/c6d 0 2024-04-15T00:31:01.468 INFO:tasks.workunit.client.0.smithi029.stdout:6/341: fsync d1/d1e/f4e 0 2024-04-15T00:31:01.597 INFO:tasks.workunit.client.0.smithi029.stdout:3/327: write d17/d2f/d44/f66 [2700236,65084] 0 2024-04-15T00:31:01.603 INFO:tasks.workunit.client.0.smithi029.stdout:1/331: write df/d29/d41/f47 [1201814,76334] 0 2024-04-15T00:31:01.604 INFO:tasks.workunit.client.0.smithi029.stdout:2/337: truncate d3/d2a/d4e/f64 971562 0 2024-04-15T00:31:01.663 INFO:tasks.workunit.client.0.smithi029.stdout:5/343: dread d2/f4 [0,4194304] 0 2024-04-15T00:31:01.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/316: dread d3/d6/d9/d29/f4c [0,4194304] 0 2024-04-15T00:31:01.952 INFO:tasks.workunit.client.0.smithi029.stdout:7/313: dwrite d0/f36 [0,4194304] 0 2024-04-15T00:31:02.121 INFO:tasks.workunit.client.0.smithi029.stdout:4/319: dwrite f3 [4194304,4194304] 0 2024-04-15T00:31:02.309 INFO:tasks.workunit.client.0.smithi029.stdout:4/320: dread de/f5d [0,4194304] 0 2024-04-15T00:31:02.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/328: truncate fa 87527 0 2024-04-15T00:31:02.379 INFO:tasks.workunit.client.0.smithi029.stdout:1/332: mknod df/d29/d41/d69/c77 0 2024-04-15T00:31:02.388 INFO:tasks.workunit.client.0.smithi029.stdout:5/344: symlink d2/de/d13/d22/d26/d36/l7d 0 2024-04-15T00:31:02.394 INFO:tasks.workunit.client.0.smithi029.stdout:6/342: mkdir d1/d8/db/d38/d6f 0 2024-04-15T00:31:02.397 INFO:tasks.workunit.client.0.smithi029.stdout:9/317: mknod d3/d6/d9/d15/c6f 0 2024-04-15T00:31:02.414 INFO:tasks.workunit.client.0.smithi029.stdout:8/328: getdents d8/dc/d23 0 2024-04-15T00:31:02.455 INFO:tasks.workunit.client.0.smithi029.stdout:8/329: chown d8/f2c 0 1 2024-04-15T00:31:02.463 INFO:tasks.workunit.client.0.smithi029.stdout:6/343: chown d1/d8/db/d38/c3c 209700 1 2024-04-15T00:31:02.832 INFO:tasks.workunit.client.0.smithi029.stdout:4/321: fdatasync de/f19 0 2024-04-15T00:31:02.939 INFO:tasks.workunit.client.0.smithi029.stdout:9/318: sync 2024-04-15T00:31:03.040 INFO:tasks.workunit.client.0.smithi029.stdout:5/345: creat d2/de/d13/d22/d3c/d41/d6d/f7e x:0 0 0 2024-04-15T00:31:03.201 INFO:tasks.workunit.client.0.smithi029.stdout:4/322: dread - de/d2b/d35/f4f zero size 2024-04-15T00:31:03.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/319: rmdir d3/d6/d9/d29/d60/d64 39 2024-04-15T00:31:03.446 INFO:tasks.workunit.client.0.smithi029.stdout:5/346: truncate d2/fa 766084 0 2024-04-15T00:31:03.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/338: write d3/d2a/d46/f3d [740107,35708] 0 2024-04-15T00:31:03.740 INFO:tasks.workunit.client.0.smithi029.stdout:7/314: dwrite d0/d6/d1c/f57 [0,4194304] 0 2024-04-15T00:31:03.747 INFO:tasks.workunit.client.0.smithi029.stdout:6/344: creat d1/d8/f70 x:0 0 0 2024-04-15T00:31:03.845 INFO:tasks.workunit.client.0.smithi029.stdout:2/339: rmdir d3 39 2024-04-15T00:31:03.848 INFO:tasks.workunit.client.0.smithi029.stdout:5/347: truncate d2/de/d13/d22/d3c/d41/f4c 476118 0 2024-04-15T00:31:03.881 INFO:tasks.workunit.client.0.smithi029.stdout:6/345: dread - d1/d8/f5e zero size 2024-04-15T00:31:03.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/323: link de/d2b/f21 de/d2b/d35/f6b 0 2024-04-15T00:31:03.975 INFO:tasks.workunit.client.0.smithi029.stdout:3/329: dwrite f0 [0,4194304] 0 2024-04-15T00:31:03.975 INFO:tasks.workunit.client.0.smithi029.stdout:0/336: symlink d5/d15/l6e 0 2024-04-15T00:31:04.133 INFO:tasks.workunit.client.0.smithi029.stdout:1/333: write df/d29/f4b [3349386,55197] 0 2024-04-15T00:31:04.152 INFO:tasks.workunit.client.0.smithi029.stdout:8/330: creat d8/da/f6a x:0 0 0 2024-04-15T00:31:04.350 INFO:tasks.workunit.client.0.smithi029.stdout:7/315: read d0/d6/d1c/fe [4978988,115000] 0 2024-04-15T00:31:04.368 INFO:tasks.workunit.client.0.smithi029.stdout:7/316: write d0/d6/d1c/f57 [3451882,14089] 0 2024-04-15T00:31:04.423 INFO:tasks.workunit.client.0.smithi029.stdout:6/346: dread - d1/f3f zero size 2024-04-15T00:31:04.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/324: symlink de/d2b/d35/l6c 0 2024-04-15T00:31:04.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/330: truncate d17/d2a/f34 271584 0 2024-04-15T00:31:04.594 INFO:tasks.workunit.client.0.smithi029.stdout:9/320: write d3/f34 [3286126,128110] 0 2024-04-15T00:31:04.795 INFO:tasks.workunit.client.0.smithi029.stdout:1/334: rename df/d32/d6b to df/d29/d41/d69/d78 0 2024-04-15T00:31:04.850 INFO:tasks.workunit.client.0.smithi029.stdout:7/317: mkdir d0/d6/d4f/d66/d67 0 2024-04-15T00:31:04.977 INFO:tasks.workunit.client.0.smithi029.stdout:3/331: fsync d17/f24 0 2024-04-15T00:31:04.980 INFO:tasks.workunit.client.0.smithi029.stdout:5/348: write d2/de/d13/d22/d3c/d41/d6d/f77 [899868,125385] 0 2024-04-15T00:31:05.000 INFO:tasks.workunit.client.0.smithi029.stdout:0/337: write d5/db/f19 [2760523,65538] 0 2024-04-15T00:31:05.044 INFO:tasks.workunit.client.0.smithi029.stdout:9/321: dread d3/d6/d9/d15/d4a/d53/f5b [0,4194304] 0 2024-04-15T00:31:05.198 INFO:tasks.workunit.client.0.smithi029.stdout:2/340: write d3/dd/f31 [1059950,73927] 0 2024-04-15T00:31:05.275 INFO:tasks.workunit.client.0.smithi029.stdout:7/318: symlink d0/d6/d4f/d66/d37/l68 0 2024-04-15T00:31:05.276 INFO:tasks.workunit.client.0.smithi029.stdout:6/347: symlink d1/d8/db/l71 0 2024-04-15T00:31:05.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/325: dwrite de/d2b/f30 [0,4194304] 0 2024-04-15T00:31:05.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/331: write d8/dc/d23/d28/d30/f69 [386970,124160] 0 2024-04-15T00:31:05.542 INFO:tasks.workunit.client.0.smithi029.stdout:1/335: write df/d32/f50 [159896,115338] 0 2024-04-15T00:31:05.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/349: mknod d2/d1a/c7f 0 2024-04-15T00:31:05.694 INFO:tasks.workunit.client.0.smithi029.stdout:6/348: mkdir d1/d8/d72 0 2024-04-15T00:31:05.729 INFO:tasks.workunit.client.0.smithi029.stdout:5/350: chown d2/f8 45613 1 2024-04-15T00:31:05.762 INFO:tasks.workunit.client.0.smithi029.stdout:9/322: dread d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:31:05.829 INFO:tasks.workunit.client.0.smithi029.stdout:4/326: mkdir de/d6d 0 2024-04-15T00:31:05.853 INFO:tasks.workunit.client.0.smithi029.stdout:1/336: creat df/d29/f79 x:0 0 0 2024-04-15T00:31:05.855 INFO:tasks.workunit.client.0.smithi029.stdout:3/332: write ff [2071712,116166] 0 2024-04-15T00:31:05.866 INFO:tasks.workunit.client.0.smithi029.stdout:8/332: read d8/dc/f1c [2816119,105120] 0 2024-04-15T00:31:05.987 INFO:tasks.workunit.client.0.smithi029.stdout:7/319: mkdir d0/d69 0 2024-04-15T00:31:05.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/338: rename d5/db/c64 to d5/d3e/c6f 0 2024-04-15T00:31:06.009 INFO:tasks.workunit.client.0.smithi029.stdout:5/351: mknod d2/d24/c80 0 2024-04-15T00:31:06.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/323: truncate d3/d6/f16 3120103 0 2024-04-15T00:31:06.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/341: dread - d3/d13/d43/f5f zero size 2024-04-15T00:31:06.063 INFO:tasks.workunit.client.0.smithi029.stdout:7/320: chown d0/d6/d39 8331 1 2024-04-15T00:31:06.078 INFO:tasks.workunit.client.0.smithi029.stdout:3/333: dwrite d17/d2f/d44/f66 [4194304,4194304] 0 2024-04-15T00:31:06.195 INFO:tasks.workunit.client.0.smithi029.stdout:4/327: read de/df/f12 [2988074,113058] 0 2024-04-15T00:31:06.230 INFO:tasks.workunit.client.0.smithi029.stdout:8/333: creat d8/dc/f6b x:0 0 0 2024-04-15T00:31:06.233 INFO:tasks.workunit.client.0.smithi029.stdout:6/349: dread d1/d8/db/f5b [0,4194304] 0 2024-04-15T00:31:06.237 INFO:tasks.workunit.client.0.smithi029.stdout:2/342: dread d3/dd/d2d/f34 [0,4194304] 0 2024-04-15T00:31:06.244 INFO:tasks.workunit.client.0.smithi029.stdout:1/337: mkdir df/d29/d41/d69/d4c/d7a 0 2024-04-15T00:31:06.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/350: chown d1/d1e/f27 64823 1 2024-04-15T00:31:06.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/351: chown d1/d64 38505092 1 2024-04-15T00:31:06.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/338: dread - df/d29/d41/d69/d4c/d55/f68 zero size 2024-04-15T00:31:06.362 INFO:tasks.workunit.client.0.smithi029.stdout:3/334: mkdir d17/d2f/d44/d68 0 2024-04-15T00:31:06.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/324: symlink d3/d6/d9/d15/d4a/d53/l70 0 2024-04-15T00:31:06.376 INFO:tasks.workunit.client.0.smithi029.stdout:5/352: creat d2/de/d13/d22/d3c/d41/d6d/f81 x:0 0 0 2024-04-15T00:31:06.409 INFO:tasks.workunit.client.0.smithi029.stdout:3/335: dread d17/d2a/f2c [0,4194304] 0 2024-04-15T00:31:06.553 INFO:tasks.workunit.client.0.smithi029.stdout:2/343: rmdir d3/d13/d43/d5a 39 2024-04-15T00:31:06.610 INFO:tasks.workunit.client.0.smithi029.stdout:6/352: truncate d1/d1e/d56/f62 613083 0 2024-04-15T00:31:06.974 INFO:tasks.workunit.client.0.smithi029.stdout:9/325: truncate d3/d6/d9/f2c 2807288 0 2024-04-15T00:31:06.983 INFO:tasks.workunit.client.0.smithi029.stdout:3/336: symlink d17/d2f/d44/d58/d5c/l69 0 2024-04-15T00:31:07.007 INFO:tasks.workunit.client.0.smithi029.stdout:9/326: stat d3/d6/d9/d15/d62/l66 0 2024-04-15T00:31:07.084 INFO:tasks.workunit.client.0.smithi029.stdout:1/339: symlink df/l7b 0 2024-04-15T00:31:07.089 INFO:tasks.workunit.client.0.smithi029.stdout:4/328: truncate de/d2b/d35/f6b 1721615 0 2024-04-15T00:31:07.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/334: fsync d8/dc/d23/f51 0 2024-04-15T00:31:07.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/340: stat df/d29/d41 0 2024-04-15T00:31:07.120 INFO:tasks.workunit.client.0.smithi029.stdout:8/335: stat d8/dc/d23/l26 0 2024-04-15T00:31:07.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/341: chown df/f1c 21176478 1 2024-04-15T00:31:07.149 INFO:tasks.workunit.client.0.smithi029.stdout:1/342: read - df/d29/d41/d4f/f58 zero size 2024-04-15T00:31:07.458 INFO:tasks.workunit.client.0.smithi029.stdout:7/321: dwrite d0/d6/d4f/d66/d26/f51 [0,4194304] 0 2024-04-15T00:31:07.522 INFO:tasks.workunit.client.0.smithi029.stdout:7/322: chown d0/f4e 0 1 2024-04-15T00:31:07.682 INFO:tasks.workunit.client.0.smithi029.stdout:6/353: creat d1/d1e/d56/d58/d5f/f73 x:0 0 0 2024-04-15T00:31:07.683 INFO:tasks.workunit.client.0.smithi029.stdout:5/353: rename d2/de/d13/d22/c54 to d2/de/d1f/d63/d65/c82 0 2024-04-15T00:31:07.707 INFO:tasks.workunit.client.0.smithi029.stdout:4/329: truncate de/d2b/f2c 3135607 0 2024-04-15T00:31:07.986 INFO:tasks.workunit.client.0.smithi029.stdout:0/339: write d5/db/f29 [4957597,99469] 0 2024-04-15T00:31:08.006 INFO:tasks.workunit.client.0.smithi029.stdout:3/337: creat d17/d2a/f6a x:0 0 0 2024-04-15T00:31:08.135 INFO:tasks.workunit.client.0.smithi029.stdout:6/354: unlink d1/f3e 0 2024-04-15T00:31:08.144 INFO:tasks.workunit.client.0.smithi029.stdout:6/355: read d1/f1c [791231,120385] 0 2024-04-15T00:31:08.501 INFO:tasks.workunit.client.0.smithi029.stdout:7/323: mknod d0/d69/c6a 0 2024-04-15T00:31:08.519 INFO:tasks.workunit.client.0.smithi029.stdout:1/343: truncate df/d29/d41/f47 1595402 0 2024-04-15T00:31:08.584 INFO:tasks.workunit.client.0.smithi029.stdout:3/338: symlink d17/d2a/d4c/l6b 0 2024-04-15T00:31:08.625 INFO:tasks.workunit.client.0.smithi029.stdout:9/327: read d3/d6/d9/f2c [1678562,88598] 0 2024-04-15T00:31:08.703 INFO:tasks.workunit.client.0.smithi029.stdout:6/356: truncate d1/d1e/f32 2701626 0 2024-04-15T00:31:08.777 INFO:tasks.workunit.client.0.smithi029.stdout:4/330: symlink de/d6d/l6e 0 2024-04-15T00:31:08.803 INFO:tasks.workunit.client.0.smithi029.stdout:2/344: link d3/d13/d14/c25 d3/d13/c6c 0 2024-04-15T00:31:08.841 INFO:tasks.workunit.client.0.smithi029.stdout:7/324: symlink d0/d6/d39/d3c/d5b/l6b 0 2024-04-15T00:31:08.848 INFO:tasks.workunit.client.0.smithi029.stdout:7/325: readlink d0/d6/d1c/l3 0 2024-04-15T00:31:08.927 INFO:tasks.workunit.client.0.smithi029.stdout:1/344: truncate df/d29/d41/d69/d4c/d55/d59/f67 328233 0 2024-04-15T00:31:09.054 INFO:tasks.workunit.client.0.smithi029.stdout:0/340: symlink d5/d15/l70 0 2024-04-15T00:31:09.071 INFO:tasks.workunit.client.0.smithi029.stdout:9/328: read d3/d6/d9/d15/d4a/f4b [2271271,13829] 0 2024-04-15T00:31:09.087 INFO:tasks.workunit.client.0.smithi029.stdout:0/341: stat d5/d15/d1f/d32/f61 0 2024-04-15T00:31:09.093 INFO:tasks.workunit.client.0.smithi029.stdout:0/342: chown d5/f62 1406791861 1 2024-04-15T00:31:09.148 INFO:tasks.workunit.client.0.smithi029.stdout:4/331: rmdir de/d2b/d59 39 2024-04-15T00:31:09.305 INFO:tasks.workunit.client.0.smithi029.stdout:1/345: rmdir df 39 2024-04-15T00:31:09.321 INFO:tasks.workunit.client.0.smithi029.stdout:2/345: dread d3/d13/d14/f1e [0,4194304] 0 2024-04-15T00:31:09.329 INFO:tasks.workunit.client.0.smithi029.stdout:2/346: readlink d3/d2a/l52 0 2024-04-15T00:31:09.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/343: sync 2024-04-15T00:31:09.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/354: getdents d2/d24 0 2024-04-15T00:31:09.466 INFO:tasks.workunit.client.0.smithi029.stdout:5/355: chown d2/de/d13/d22/d3c/f6b 2106839997 1 2024-04-15T00:31:09.480 INFO:tasks.workunit.client.0.smithi029.stdout:5/356: chown d2/de/d13/d22/d26/d36/l58 461065 1 2024-04-15T00:31:09.526 INFO:tasks.workunit.client.0.smithi029.stdout:8/336: rename d8/da/d3d/f60 to d8/da/d3d/f6c 0 2024-04-15T00:31:09.891 INFO:tasks.workunit.client.0.smithi029.stdout:5/357: creat d2/d1a/f83 x:0 0 0 2024-04-15T00:31:10.046 INFO:tasks.workunit.client.0.smithi029.stdout:0/344: creat d5/d15/d57/d5e/f71 x:0 0 0 2024-04-15T00:31:10.124 INFO:tasks.workunit.client.0.smithi029.stdout:3/339: dwrite d17/f24 [0,4194304] 0 2024-04-15T00:31:10.191 INFO:tasks.workunit.client.0.smithi029.stdout:8/337: rename d8/da/l18 to d8/dc/d23/d28/d3a/d5a/l6d 0 2024-04-15T00:31:10.208 INFO:tasks.workunit.client.0.smithi029.stdout:5/358: unlink d2/de/lf 0 2024-04-15T00:31:10.313 INFO:tasks.workunit.client.0.smithi029.stdout:7/326: dwrite d0/d6/d4f/f5c [0,4194304] 0 2024-04-15T00:31:10.524 INFO:tasks.workunit.client.0.smithi029.stdout:4/332: write de/d2b/d35/f3d [278748,99884] 0 2024-04-15T00:31:10.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/357: dwrite d1/f2f [0,4194304] 0 2024-04-15T00:31:10.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/346: mkdir df/d32/d7c 0 2024-04-15T00:31:10.754 INFO:tasks.workunit.client.0.smithi029.stdout:3/340: creat d17/d2a/d46/f6c x:0 0 0 2024-04-15T00:31:10.954 INFO:tasks.workunit.client.0.smithi029.stdout:2/347: dwrite d3/d13/d14/f20 [8388608,4194304] 0 2024-04-15T00:31:10.959 INFO:tasks.workunit.client.0.smithi029.stdout:8/338: dread d8/da/f14 [0,4194304] 0 2024-04-15T00:31:11.047 INFO:tasks.workunit.client.0.smithi029.stdout:9/329: dwrite d3/f4e [0,4194304] 0 2024-04-15T00:31:11.082 INFO:tasks.workunit.client.0.smithi029.stdout:0/345: write d5/d4c/f5a [74565,101769] 0 2024-04-15T00:31:11.177 INFO:tasks.workunit.client.0.smithi029.stdout:3/341: creat d17/d2a/d4c/d51/f6d x:0 0 0 2024-04-15T00:31:11.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/346: stat d5/d15/l17 0 2024-04-15T00:31:11.317 INFO:tasks.workunit.client.0.smithi029.stdout:0/347: chown d5/d4c/f5a 1140 1 2024-04-15T00:31:11.388 INFO:tasks.workunit.client.0.smithi029.stdout:4/333: dwrite de/df/d1e/f4c [4194304,4194304] 0 2024-04-15T00:31:11.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/359: dwrite d2/de/d13/d22/d3c/f50 [0,4194304] 0 2024-04-15T00:31:11.542 INFO:tasks.workunit.client.0.smithi029.stdout:7/327: creat d0/d6/f6c x:0 0 0 2024-04-15T00:31:11.555 INFO:tasks.workunit.client.0.smithi029.stdout:1/347: write df/d29/d41/d69/f4a [568276,11699] 0 2024-04-15T00:31:11.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/360: chown d2/de/d1f/d63/d65 724455294 1 2024-04-15T00:31:11.623 INFO:tasks.workunit.client.0.smithi029.stdout:8/339: rename d8/dc/d23/d28/d3a to d8/da/d2f/d6e 0 2024-04-15T00:31:11.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/348: symlink d5/d15/d57/l72 0 2024-04-15T00:31:11.682 INFO:tasks.workunit.client.0.smithi029.stdout:2/348: mkdir d3/d2a/d6d 0 2024-04-15T00:31:11.741 INFO:tasks.workunit.client.0.smithi029.stdout:3/342: symlink d17/d2a/d46/d67/l6e 0 2024-04-15T00:31:11.757 INFO:tasks.workunit.client.0.smithi029.stdout:6/358: dwrite d1/d8/db/f37 [0,4194304] 0 2024-04-15T00:31:11.820 INFO:tasks.workunit.client.0.smithi029.stdout:0/349: chown d5/d15/d1f/f3a 60682252 1 2024-04-15T00:31:11.828 INFO:tasks.workunit.client.0.smithi029.stdout:6/359: readlink d1/ld 0 2024-04-15T00:31:11.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/348: mknod df/d29/d41/d69/d78/c7d 0 2024-04-15T00:31:11.918 INFO:tasks.workunit.client.0.smithi029.stdout:9/330: fsync d3/d6/d9/d29/d60/d64/d6d/f6b 0 2024-04-15T00:31:11.928 INFO:tasks.workunit.client.0.smithi029.stdout:5/361: creat d2/d24/d6c/f84 x:0 0 0 2024-04-15T00:31:11.997 INFO:tasks.workunit.client.0.smithi029.stdout:0/350: dwrite d5/d15/d57/d5e/f71 [0,4194304] 0 2024-04-15T00:31:12.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/340: creat d8/da/d2f/d6e/f6f x:0 0 0 2024-04-15T00:31:12.134 INFO:tasks.workunit.client.0.smithi029.stdout:3/343: symlink d17/d2f/d44/d58/l6f 0 2024-04-15T00:31:12.154 INFO:tasks.workunit.client.0.smithi029.stdout:6/360: creat d1/d1e/d56/d58/d59/f74 x:0 0 0 2024-04-15T00:31:12.172 INFO:tasks.workunit.client.0.smithi029.stdout:1/349: dread df/f15 [0,4194304] 0 2024-04-15T00:31:12.473 INFO:tasks.workunit.client.0.smithi029.stdout:5/362: symlink d2/de/d13/d22/d3c/d41/d6d/l85 0 2024-04-15T00:31:12.861 INFO:tasks.workunit.client.0.smithi029.stdout:8/341: fsync d8/dc/d23/f57 0 2024-04-15T00:31:12.903 INFO:tasks.workunit.client.0.smithi029.stdout:3/344: creat d17/d2a/d4c/f70 x:0 0 0 2024-04-15T00:31:12.911 INFO:tasks.workunit.client.0.smithi029.stdout:1/350: symlink df/d29/d41/d69/d4c/d55/l7e 0 2024-04-15T00:31:12.919 INFO:tasks.workunit.client.0.smithi029.stdout:7/328: write d0/d6/d4f/d5d/f5e [1046459,14060] 0 2024-04-15T00:31:13.011 INFO:tasks.workunit.client.0.smithi029.stdout:5/363: creat d2/de/d1f/d63/d65/f86 x:0 0 0 2024-04-15T00:31:13.026 INFO:tasks.workunit.client.0.smithi029.stdout:4/334: dwrite de/d54/d58/f5b [0,4194304] 0 2024-04-15T00:31:13.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/361: mknod d1/d64/c75 0 2024-04-15T00:31:13.540 INFO:tasks.workunit.client.0.smithi029.stdout:1/351: fdatasync df/f21 0 2024-04-15T00:31:13.714 INFO:tasks.workunit.client.0.smithi029.stdout:7/329: dread d0/f24 [0,4194304] 0 2024-04-15T00:31:13.768 INFO:tasks.workunit.client.0.smithi029.stdout:3/345: dread d17/d2f/d3c/f4a [0,4194304] 0 2024-04-15T00:31:13.831 INFO:tasks.workunit.client.0.smithi029.stdout:5/364: fsync d2/d24/f61 0 2024-04-15T00:31:13.841 INFO:tasks.workunit.client.0.smithi029.stdout:4/335: stat de/df/d1e/l55 0 2024-04-15T00:31:13.900 INFO:tasks.workunit.client.0.smithi029.stdout:8/342: mknod d8/da/d3d/c70 0 2024-04-15T00:31:13.978 INFO:tasks.workunit.client.0.smithi029.stdout:1/352: rename df/d29/d41/d69/d4c/f64 to df/d29/d41/d69/f7f 0 2024-04-15T00:31:14.023 INFO:tasks.workunit.client.0.smithi029.stdout:9/331: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/f2a [0,4194304] 0 2024-04-15T00:31:14.082 INFO:tasks.workunit.client.0.smithi029.stdout:7/330: rmdir d0/d6/d39/d3c/d42 39 2024-04-15T00:31:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:4/336: truncate de/d3a/f42 2236577 0 2024-04-15T00:31:14.216 INFO:tasks.workunit.client.0.smithi029.stdout:5/365: creat d2/de/d13/d22/d3c/d41/d6d/f87 x:0 0 0 2024-04-15T00:31:14.243 INFO:tasks.workunit.client.0.smithi029.stdout:8/343: dread d8/da/f43 [0,4194304] 0 2024-04-15T00:31:14.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/349: write d3/d13/d43/d5a/f4b [1002901,88591] 0 2024-04-15T00:31:14.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/331: creat d0/d6/d4f/d5d/f6d x:0 0 0 2024-04-15T00:31:14.452 INFO:tasks.workunit.client.0.smithi029.stdout:7/332: stat d0/d6/f3f 0 2024-04-15T00:31:14.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/351: dwrite d5/d15/d27/f2a [0,4194304] 0 2024-04-15T00:31:14.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/350: sync 2024-04-15T00:31:14.594 INFO:tasks.workunit.client.0.smithi029.stdout:9/332: read d3/d6/d9/d29/d5d/f36 [825642,93136] 0 2024-04-15T00:31:14.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/366: mknod d2/de/c88 0 2024-04-15T00:31:14.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/337: chown de/d3a/c40 0 1 2024-04-15T00:31:14.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/333: dread d0/d6/d1c/f9 [0,4194304] 0 2024-04-15T00:31:14.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/344: symlink d8/da/d2f/d6e/l71 0 2024-04-15T00:31:14.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/351: dread d3/d13/d43/d5a/f4b [0,4194304] 0 2024-04-15T00:31:14.731 INFO:tasks.workunit.client.0.smithi029.stdout:6/362: creat d1/d1e/d56/f76 x:0 0 0 2024-04-15T00:31:14.742 INFO:tasks.workunit.client.0.smithi029.stdout:5/367: rename d2/de/d13/d22/d3c to d2/de/d13/d22/d3c/d89 22 2024-04-15T00:31:14.764 INFO:tasks.workunit.client.0.smithi029.stdout:6/363: chown d1/d8/db/fe 0 1 2024-04-15T00:31:14.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/364: chown d1/d8/db 58763 1 2024-04-15T00:31:14.834 INFO:tasks.workunit.client.0.smithi029.stdout:0/352: fsync d5/db/f45 0 2024-04-15T00:31:14.847 INFO:tasks.workunit.client.0.smithi029.stdout:0/353: chown d5/d15/d1f/d32/c5b 1904638 1 2024-04-15T00:31:15.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/334: truncate d0/f22 2184650 0 2024-04-15T00:31:15.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/352: symlink d3/d13/d43/d5a/d4f/l6e 0 2024-04-15T00:31:15.109 INFO:tasks.workunit.client.0.smithi029.stdout:6/365: creat d1/d64/f77 x:0 0 0 2024-04-15T00:31:15.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/354: dread - d5/d15/d57/f60 zero size 2024-04-15T00:31:15.264 INFO:tasks.workunit.client.0.smithi029.stdout:4/338: creat de/d2b/d59/f6f x:0 0 0 2024-04-15T00:31:15.419 INFO:tasks.workunit.client.0.smithi029.stdout:4/339: dread f2 [0,4194304] 0 2024-04-15T00:31:15.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/366: dread d1/d8/db/f3b [0,4194304] 0 2024-04-15T00:31:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:7/335: creat d0/d6/d4f/d66/d26/d54/f6e x:0 0 0 2024-04-15T00:31:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:4/340: chown de/d2b/l64 3307810 1 2024-04-15T00:31:15.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/353: rename d3/d2a/l52 to d3/d2a/l6f 0 2024-04-15T00:31:15.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/345: mknod d8/c72 0 2024-04-15T00:31:15.697 INFO:tasks.workunit.client.0.smithi029.stdout:7/336: creat d0/d6/d39/f6f x:0 0 0 2024-04-15T00:31:15.736 INFO:tasks.workunit.client.0.smithi029.stdout:4/341: creat de/d2b/d59/f70 x:0 0 0 2024-04-15T00:31:15.740 INFO:tasks.workunit.client.0.smithi029.stdout:2/354: sync 2024-04-15T00:31:15.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/367: dwrite d1/d1e/d56/d58/d5f/f65 [0,4194304] 0 2024-04-15T00:31:15.855 INFO:tasks.workunit.client.0.smithi029.stdout:0/355: link d5/d15/d1f/f44 d5/d15/d1f/f73 0 2024-04-15T00:31:15.883 INFO:tasks.workunit.client.0.smithi029.stdout:8/346: symlink d8/dc/d23/d28/d30/d39/l73 0 2024-04-15T00:31:15.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/355: chown d3/d13/d43/d5a/d4f/f5d 12 1 2024-04-15T00:31:15.963 INFO:tasks.workunit.client.0.smithi029.stdout:7/337: read d0/f36 [850690,85051] 0 2024-04-15T00:31:15.992 INFO:tasks.workunit.client.0.smithi029.stdout:1/353: write df/f42 [3877451,122632] 0 2024-04-15T00:31:15.993 INFO:tasks.workunit.client.0.smithi029.stdout:4/342: readlink de/df/d1e/l4a 0 2024-04-15T00:31:16.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/356: dwrite d3/d13/d14/f20 [0,4194304] 0 2024-04-15T00:31:16.093 INFO:tasks.workunit.client.0.smithi029.stdout:6/368: unlink d1/d8/db/f5b 0 2024-04-15T00:31:16.165 INFO:tasks.workunit.client.0.smithi029.stdout:6/369: write d1/d1e/d56/d58/d59/f74 [540201,47455] 0 2024-04-15T00:31:16.247 INFO:tasks.workunit.client.0.smithi029.stdout:4/343: mkdir de/d54/d71 0 2024-04-15T00:31:16.264 INFO:tasks.workunit.client.0.smithi029.stdout:2/357: stat d3/d13/f16 0 2024-04-15T00:31:16.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/346: creat d17/d2f/f71 x:0 0 0 2024-04-15T00:31:16.524 INFO:tasks.workunit.client.0.smithi029.stdout:0/356: write d5/db/f45 [794160,110267] 0 2024-04-15T00:31:16.545 INFO:tasks.workunit.client.0.smithi029.stdout:9/333: write d3/d6/d9/f50 [596303,103554] 0 2024-04-15T00:31:16.551 INFO:tasks.workunit.client.0.smithi029.stdout:0/357: readlink d5/d15/d27/l36 0 2024-04-15T00:31:16.575 INFO:tasks.workunit.client.0.smithi029.stdout:4/344: read de/d2b/f2c [2751992,7749] 0 2024-04-15T00:31:16.592 INFO:tasks.workunit.client.0.smithi029.stdout:9/334: chown d3/d6/d9/d29/d60/d64/d6d/d58/f2a 93833795 1 2024-04-15T00:31:16.704 INFO:tasks.workunit.client.0.smithi029.stdout:0/358: sync 2024-04-15T00:31:16.720 INFO:tasks.workunit.client.0.smithi029.stdout:3/347: truncate d17/d2a/d33/f49 36856 0 2024-04-15T00:31:16.757 INFO:tasks.workunit.client.0.smithi029.stdout:4/345: sync 2024-04-15T00:31:16.825 INFO:tasks.workunit.client.0.smithi029.stdout:5/368: dwrite d2/de/d13/f2a [0,4194304] 0 2024-04-15T00:31:17.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/354: write df/f28 [769142,74001] 0 2024-04-15T00:31:17.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/347: write d8/dc/d23/f57 [330070,122221] 0 2024-04-15T00:31:17.069 INFO:tasks.workunit.client.0.smithi029.stdout:1/355: stat df/d29/d41/d69/d4c/d55 0 2024-04-15T00:31:17.351 INFO:tasks.workunit.client.0.smithi029.stdout:3/348: fsync f15 0 2024-04-15T00:31:17.553 INFO:tasks.workunit.client.0.smithi029.stdout:8/348: symlink d8/da/d2f/d6e/d5a/l74 0 2024-04-15T00:31:17.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/335: dwrite d3/d6/d9/d29/d60/f6e [0,4194304] 0 2024-04-15T00:31:17.945 INFO:tasks.workunit.client.0.smithi029.stdout:4/346: write f8 [3410978,26589] 0 2024-04-15T00:31:18.140 INFO:tasks.workunit.client.0.smithi029.stdout:7/338: rename d0/d6/d4f/d66/d26/d54/f6e to d0/d6/d39/d3c/f70 0 2024-04-15T00:31:18.145 INFO:tasks.workunit.client.0.smithi029.stdout:2/358: link d3/c39 d3/d2a/c70 0 2024-04-15T00:31:18.259 INFO:tasks.workunit.client.0.smithi029.stdout:2/359: sync 2024-04-15T00:31:18.273 INFO:tasks.workunit.client.0.smithi029.stdout:2/360: read d3/d13/f16 [30532,81759] 0 2024-04-15T00:31:18.293 INFO:tasks.workunit.client.0.smithi029.stdout:0/359: mknod d5/d15/c74 0 2024-04-15T00:31:18.300 INFO:tasks.workunit.client.0.smithi029.stdout:5/369: symlink d2/de/d13/d22/d26/d36/d4d/d70/l8a 0 2024-04-15T00:31:18.323 INFO:tasks.workunit.client.0.smithi029.stdout:0/360: dread - d5/d15/d57/f60 zero size 2024-04-15T00:31:18.344 INFO:tasks.workunit.client.0.smithi029.stdout:0/361: write d5/db/f45 [1003472,122457] 0 2024-04-15T00:31:18.398 INFO:tasks.workunit.client.0.smithi029.stdout:8/349: mkdir d8/da/d2f/d42/d75 0 2024-04-15T00:31:18.457 INFO:tasks.workunit.client.0.smithi029.stdout:1/356: getdents df/d32/d7c 0 2024-04-15T00:31:18.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/347: chown de/df/l34 0 1 2024-04-15T00:31:18.767 INFO:tasks.workunit.client.0.smithi029.stdout:6/370: rename d1/d8/db/f24 to d1/d8/d72/f78 0 2024-04-15T00:31:18.914 INFO:tasks.workunit.client.0.smithi029.stdout:2/361: mknod d3/d50/d51/c71 0 2024-04-15T00:31:18.945 INFO:tasks.workunit.client.0.smithi029.stdout:3/349: mknod d17/d2f/c72 0 2024-04-15T00:31:19.103 INFO:tasks.workunit.client.0.smithi029.stdout:5/370: dwrite d2/de/d1f/d63/d65/f86 [0,4194304] 0 2024-04-15T00:31:19.185 INFO:tasks.workunit.client.0.smithi029.stdout:4/348: dread - de/d3a/f4b zero size 2024-04-15T00:31:19.274 INFO:tasks.workunit.client.0.smithi029.stdout:6/371: mkdir d1/d8/d79 0 2024-04-15T00:31:19.341 INFO:tasks.workunit.client.0.smithi029.stdout:1/357: dread df/d29/f2c [0,4194304] 0 2024-04-15T00:31:19.360 INFO:tasks.workunit.client.0.smithi029.stdout:2/362: chown d3/dd/c1d 174270708 1 2024-04-15T00:31:19.433 INFO:tasks.workunit.client.0.smithi029.stdout:8/350: mknod d8/da/d2f/d42/d75/c76 0 2024-04-15T00:31:19.462 INFO:tasks.workunit.client.0.smithi029.stdout:1/358: sync 2024-04-15T00:31:19.525 INFO:tasks.workunit.client.0.smithi029.stdout:2/363: sync 2024-04-15T00:31:19.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/371: mknod d2/de/d13/d22/d26/d36/c8b 0 2024-04-15T00:31:19.650 INFO:tasks.workunit.client.0.smithi029.stdout:5/372: write d2/de/d1f/d63/d65/f86 [2696090,112467] 0 2024-04-15T00:31:19.687 INFO:tasks.workunit.client.0.smithi029.stdout:7/339: mkdir d0/d6/d39/d3c/d42/d49/d71 0 2024-04-15T00:31:19.794 INFO:tasks.workunit.client.0.smithi029.stdout:8/351: chown d8/f2b 104818 1 2024-04-15T00:31:19.811 INFO:tasks.workunit.client.0.smithi029.stdout:8/352: write d8/dc/d23/f57 [3486659,122444] 0 2024-04-15T00:31:19.823 INFO:tasks.workunit.client.0.smithi029.stdout:1/359: mkdir df/d29/d41/d69/d4c/d55/d80 0 2024-04-15T00:31:19.857 INFO:tasks.workunit.client.0.smithi029.stdout:1/360: chown df/d29/d41/d69/d4c/l70 1605419 1 2024-04-15T00:31:19.867 INFO:tasks.workunit.client.0.smithi029.stdout:2/364: dread d3/d13/d43/d5a/f4b [0,4194304] 0 2024-04-15T00:31:20.103 INFO:tasks.workunit.client.0.smithi029.stdout:8/353: mkdir d8/dc/d23/d28/d30/d39/d77 0 2024-04-15T00:31:20.114 INFO:tasks.workunit.client.0.smithi029.stdout:9/336: write d3/d6/d9/d15/d4a/f4d [1224753,90843] 0 2024-04-15T00:31:20.202 INFO:tasks.workunit.client.0.smithi029.stdout:8/354: sync 2024-04-15T00:31:20.229 INFO:tasks.workunit.client.0.smithi029.stdout:2/365: stat d3/d13/f2f 0 2024-04-15T00:31:20.242 INFO:tasks.workunit.client.0.smithi029.stdout:8/355: chown d8/dc/d23/d28/l34 1 1 2024-04-15T00:31:20.280 INFO:tasks.workunit.client.0.smithi029.stdout:7/340: rename d0/d6/d1c/c1a to d0/d6/d39/d3c/d42/d49/c72 0 2024-04-15T00:31:20.286 INFO:tasks.workunit.client.0.smithi029.stdout:8/356: dread d8/da/d2f/d6e/f47 [0,4194304] 0 2024-04-15T00:31:20.334 INFO:tasks.workunit.client.0.smithi029.stdout:9/337: symlink d3/d6/d30/l71 0 2024-04-15T00:31:20.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/373: write d2/d1a/f59 [3045271,28854] 0 2024-04-15T00:31:21.065 INFO:tasks.workunit.client.0.smithi029.stdout:8/357: rename d8/dc to d8/d4a/d78 0 2024-04-15T00:31:21.142 INFO:tasks.workunit.client.0.smithi029.stdout:9/338: write d3/d6/d9/d29/d5d/f3a [4007956,92743] 0 2024-04-15T00:31:21.184 INFO:tasks.workunit.client.0.smithi029.stdout:5/374: rmdir d2/d24 39 2024-04-15T00:31:21.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/366: fdatasync d3/d13/f62 0 2024-04-15T00:31:21.468 INFO:tasks.workunit.client.0.smithi029.stdout:4/349: dwrite de/d2b/d35/f69 [0,4194304] 0 2024-04-15T00:31:21.570 INFO:tasks.workunit.client.0.smithi029.stdout:0/362: dwrite d5/f62 [0,4194304] 0 2024-04-15T00:31:21.576 INFO:tasks.workunit.client.0.smithi029.stdout:3/350: dwrite d17/d2a/f2c [0,4194304] 0 2024-04-15T00:31:21.635 INFO:tasks.workunit.client.0.smithi029.stdout:6/372: dwrite d1/d8/db/f48 [4194304,4194304] 0 2024-04-15T00:31:21.812 INFO:tasks.workunit.client.0.smithi029.stdout:1/361: dwrite fc [0,4194304] 0 2024-04-15T00:31:21.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/341: dwrite d0/f59 [0,4194304] 0 2024-04-15T00:31:21.941 INFO:tasks.workunit.client.0.smithi029.stdout:2/367: chown d3/d13/d14/f6a 46021 1 2024-04-15T00:31:22.069 INFO:tasks.workunit.client.0.smithi029.stdout:5/375: creat d2/de/d13/d22/d3c/d41/d6d/f8c x:0 0 0 2024-04-15T00:31:22.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/362: chown df/d29/d41/d69/d4c/d55/d80 1538 1 2024-04-15T00:31:22.201 INFO:tasks.workunit.client.0.smithi029.stdout:8/358: dwrite d8/da/d2f/f61 [0,4194304] 0 2024-04-15T00:31:22.351 INFO:tasks.workunit.client.0.smithi029.stdout:9/339: dwrite d3/d6/f12 [4194304,4194304] 0 2024-04-15T00:31:22.510 INFO:tasks.workunit.client.0.smithi029.stdout:4/350: dwrite de/d3a/f42 [0,4194304] 0 2024-04-15T00:31:22.627 INFO:tasks.workunit.client.0.smithi029.stdout:3/351: dwrite d17/d2a/f34 [0,4194304] 0 2024-04-15T00:31:22.629 INFO:tasks.workunit.client.0.smithi029.stdout:7/342: write d0/d6/f2f [4593946,80877] 0 2024-04-15T00:31:22.725 INFO:tasks.workunit.client.0.smithi029.stdout:9/340: dread d3/d6/d9/d15/d4a/d53/f5b [0,4194304] 0 2024-04-15T00:31:22.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/373: truncate d1/d1e/d56/d58/d59/f5a 150491 0 2024-04-15T00:31:22.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/351: dread de/d2b/d35/f69 [0,4194304] 0 2024-04-15T00:31:22.811 INFO:tasks.workunit.client.0.smithi029.stdout:4/352: chown de/c4e 30845973 1 2024-04-15T00:31:22.848 INFO:tasks.workunit.client.0.smithi029.stdout:2/368: rename d3/d2a/d46/d4a/c67 to d3/d2a/d46/c72 0 2024-04-15T00:31:22.858 INFO:tasks.workunit.client.0.smithi029.stdout:5/376: stat d2/de/d13/d22/d26/f6f 0 2024-04-15T00:31:22.960 INFO:tasks.workunit.client.0.smithi029.stdout:8/359: fdatasync d8/d4a/d78/d23/d28/f44 0 2024-04-15T00:31:22.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/360: stat d8/da/d3d/c70 0 2024-04-15T00:31:22.975 INFO:tasks.workunit.client.0.smithi029.stdout:8/361: readlink d8/lb 0 2024-04-15T00:31:23.252 INFO:tasks.workunit.client.0.smithi029.stdout:3/352: creat d17/d2f/d44/d58/d5c/f73 x:0 0 0 2024-04-15T00:31:23.325 INFO:tasks.workunit.client.0.smithi029.stdout:7/343: dread d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:31:23.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/344: stat d0/d6/f6c 0 2024-04-15T00:31:23.485 INFO:tasks.workunit.client.0.smithi029.stdout:7/345: dread d0/d6/f2f [0,4194304] 0 2024-04-15T00:31:23.514 INFO:tasks.workunit.client.0.smithi029.stdout:2/369: dread d3/f32 [0,4194304] 0 2024-04-15T00:31:23.801 INFO:tasks.workunit.client.0.smithi029.stdout:5/377: fdatasync d2/fb 0 2024-04-15T00:31:23.802 INFO:tasks.workunit.client.0.smithi029.stdout:1/363: write df/f4d [147128,29576] 0 2024-04-15T00:31:23.859 INFO:tasks.workunit.client.0.smithi029.stdout:5/378: stat d2/d1a/c7f 0 2024-04-15T00:31:23.869 INFO:tasks.workunit.client.0.smithi029.stdout:0/363: dwrite d5/d15/d1f/f73 [0,4194304] 0 2024-04-15T00:31:24.016 INFO:tasks.workunit.client.0.smithi029.stdout:6/374: rename d1/d8/c5d to d1/d8/db/c7a 0 2024-04-15T00:31:24.089 INFO:tasks.workunit.client.0.smithi029.stdout:5/379: dread d2/d1a/f59 [0,4194304] 0 2024-04-15T00:31:24.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/346: fdatasync d0/f22 0 2024-04-15T00:31:24.381 INFO:tasks.workunit.client.0.smithi029.stdout:2/370: rmdir d3/d13/d43/d5a 39 2024-04-15T00:31:24.382 INFO:tasks.workunit.client.0.smithi029.stdout:4/353: write de/df/d1e/f22 [789391,115278] 0 2024-04-15T00:31:24.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/362: write d8/da/f49 [1368882,22814] 0 2024-04-15T00:31:24.420 INFO:tasks.workunit.client.0.smithi029.stdout:3/353: write d17/d2a/f4e [910668,27082] 0 2024-04-15T00:31:24.452 INFO:tasks.workunit.client.0.smithi029.stdout:8/363: write d8/da/f49 [1599364,117994] 0 2024-04-15T00:31:24.471 INFO:tasks.workunit.client.0.smithi029.stdout:8/364: chown d8/c72 251233595 1 2024-04-15T00:31:24.484 INFO:tasks.workunit.client.0.smithi029.stdout:8/365: stat d8/d4a/d78/d23/d28/d30/c32 0 2024-04-15T00:31:24.553 INFO:tasks.workunit.client.0.smithi029.stdout:5/380: mkdir d2/de/d13/d22/d26/d36/d4d/d70/d8d 0 2024-04-15T00:31:24.693 INFO:tasks.workunit.client.0.smithi029.stdout:0/364: mknod d5/d15/d68/c75 0 2024-04-15T00:31:24.705 INFO:tasks.workunit.client.0.smithi029.stdout:0/365: chown d5/d15/d1f/d32/f61 135 1 2024-04-15T00:31:24.851 INFO:tasks.workunit.client.0.smithi029.stdout:4/354: mknod de/d2b/d35/c72 0 2024-04-15T00:31:24.856 INFO:tasks.workunit.client.0.smithi029.stdout:3/354: fdatasync d17/d2a/f32 0 2024-04-15T00:31:24.921 INFO:tasks.workunit.client.0.smithi029.stdout:8/366: mkdir d8/da/d2f/d79 0 2024-04-15T00:31:24.962 INFO:tasks.workunit.client.0.smithi029.stdout:5/381: fsync d2/de/d13/f19 0 2024-04-15T00:31:24.968 INFO:tasks.workunit.client.0.smithi029.stdout:5/382: chown d2 2085 1 2024-04-15T00:31:24.998 INFO:tasks.workunit.client.0.smithi029.stdout:1/364: link df/d29/d41/d69/f4a df/d29/d41/f81 0 2024-04-15T00:31:25.103 INFO:tasks.workunit.client.0.smithi029.stdout:2/371: creat d3/d2a/d6d/f73 x:0 0 0 2024-04-15T00:31:25.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/341: rename d3/d6/d9/f11 to d3/d6/d9/d15/d4a/f72 0 2024-04-15T00:31:25.209 INFO:tasks.workunit.client.0.smithi029.stdout:6/375: write d1/d1e/f4e [173333,110812] 0 2024-04-15T00:31:25.300 INFO:tasks.workunit.client.0.smithi029.stdout:4/355: creat de/d2b/d35/f73 x:0 0 0 2024-04-15T00:31:25.300 INFO:tasks.workunit.client.0.smithi029.stdout:3/355: creat d17/d2f/d3c/f74 x:0 0 0 2024-04-15T00:31:25.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/367: symlink d8/d4a/d78/d23/d28/d5f/l7a 0 2024-04-15T00:31:25.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/372: creat d3/d2a/d46/f74 x:0 0 0 2024-04-15T00:31:25.610 INFO:tasks.workunit.client.0.smithi029.stdout:7/347: rename d0/d6/d1c/f9 to d0/d6/d4f/d66/d67/f73 0 2024-04-15T00:31:25.615 INFO:tasks.workunit.client.0.smithi029.stdout:4/356: creat de/f74 x:0 0 0 2024-04-15T00:31:25.795 INFO:tasks.workunit.client.0.smithi029.stdout:3/356: mknod d17/d2f/d44/d58/d5c/c75 0 2024-04-15T00:31:25.909 INFO:tasks.workunit.client.0.smithi029.stdout:0/366: write d5/db/f29 [7818117,126421] 0 2024-04-15T00:31:25.982 INFO:tasks.workunit.client.0.smithi029.stdout:8/368: dread d8/fd [0,4194304] 0 2024-04-15T00:31:26.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/357: rmdir de/d54 39 2024-04-15T00:31:26.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/373: fsync d3/d13/d43/f5f 0 2024-04-15T00:31:26.289 INFO:tasks.workunit.client.0.smithi029.stdout:1/365: rename df/d29/d41/d69/d4c/l72 to df/d29/d41/d69/d4c/d55/l82 0 2024-04-15T00:31:26.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/376: dwrite d1/d8/db/f50 [0,4194304] 0 2024-04-15T00:31:26.398 INFO:tasks.workunit.client.0.smithi029.stdout:5/383: creat d2/f8e x:0 0 0 2024-04-15T00:31:26.422 INFO:tasks.workunit.client.0.smithi029.stdout:7/348: write d0/d6/f64 [614978,29894] 0 2024-04-15T00:31:26.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/374: unlink d3/d13/d14/l2e 0 2024-04-15T00:31:26.677 INFO:tasks.workunit.client.0.smithi029.stdout:5/384: sync 2024-04-15T00:31:26.713 INFO:tasks.workunit.client.0.smithi029.stdout:3/357: mkdir d17/d2f/d76 0 2024-04-15T00:31:26.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/342: rename d3/d6/d9/d15/d4a/f4d to d3/d6/d9/d29/d5d/f73 0 2024-04-15T00:31:26.725 INFO:tasks.workunit.client.0.smithi029.stdout:0/367: mkdir d5/db/d1a/d65/d76 0 2024-04-15T00:31:27.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/366: creat df/d29/d41/d69/d4c/d7a/f83 x:0 0 0 2024-04-15T00:31:27.082 INFO:tasks.workunit.client.0.smithi029.stdout:4/358: creat de/f75 x:0 0 0 2024-04-15T00:31:27.084 INFO:tasks.workunit.client.0.smithi029.stdout:7/349: mkdir d0/d74 0 2024-04-15T00:31:27.217 INFO:tasks.workunit.client.0.smithi029.stdout:9/343: dread d3/d6/f17 [0,4194304] 0 2024-04-15T00:31:27.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/368: mkdir d5/d15/d27/d51/d77 0 2024-04-15T00:31:27.510 INFO:tasks.workunit.client.0.smithi029.stdout:8/369: dwrite d8/d4a/d78/d23/f59 [0,4194304] 0 2024-04-15T00:31:27.777 INFO:tasks.workunit.client.0.smithi029.stdout:5/385: dwrite d2/d1a/f3e [0,4194304] 0 2024-04-15T00:31:27.848 INFO:tasks.workunit.client.0.smithi029.stdout:4/359: creat de/d2b/d59/f76 x:0 0 0 2024-04-15T00:31:27.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/358: dwrite d17/d2a/d4c/f70 [0,4194304] 0 2024-04-15T00:31:28.002 INFO:tasks.workunit.client.0.smithi029.stdout:6/377: truncate d1/d8/db/f50 2492229 0 2024-04-15T00:31:28.004 INFO:tasks.workunit.client.0.smithi029.stdout:7/350: unlink d0/d6/d39/d3c/d42/d49/f4a 0 2024-04-15T00:31:28.073 INFO:tasks.workunit.client.0.smithi029.stdout:0/369: dread d5/d15/d1f/d32/f49 [4194304,4194304] 0 2024-04-15T00:31:28.422 INFO:tasks.workunit.client.0.smithi029.stdout:8/370: creat d8/da/d2f/d42/f7b x:0 0 0 2024-04-15T00:31:28.511 INFO:tasks.workunit.client.0.smithi029.stdout:1/367: mkdir df/d84 0 2024-04-15T00:31:28.721 INFO:tasks.workunit.client.0.smithi029.stdout:5/386: creat d2/de/d13/d22/d26/d36/d4d/f8f x:0 0 0 2024-04-15T00:31:28.956 INFO:tasks.workunit.client.0.smithi029.stdout:6/378: dread d1/d8/f54 [0,4194304] 0 2024-04-15T00:31:28.957 INFO:tasks.workunit.client.0.smithi029.stdout:0/370: chown d5/d15/d1f/l39 38289740 1 2024-04-15T00:31:28.964 INFO:tasks.workunit.client.0.smithi029.stdout:6/379: chown d1 11576 1 2024-04-15T00:31:29.155 INFO:tasks.workunit.client.0.smithi029.stdout:8/371: creat d8/f7c x:0 0 0 2024-04-15T00:31:29.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/387: truncate f0 2903099 0 2024-04-15T00:31:29.215 INFO:tasks.workunit.client.0.smithi029.stdout:8/372: chown d8/da/d2f/d6e 48935 1 2024-04-15T00:31:29.227 INFO:tasks.workunit.client.0.smithi029.stdout:2/375: link d3/d2a/d4e/c5c d3/d2a/c75 0 2024-04-15T00:31:29.228 INFO:tasks.workunit.client.0.smithi029.stdout:1/368: dread df/d32/f50 [0,4194304] 0 2024-04-15T00:31:29.260 INFO:tasks.workunit.client.0.smithi029.stdout:3/359: truncate d17/d2a/d33/f49 699320 0 2024-04-15T00:31:29.303 INFO:tasks.workunit.client.0.smithi029.stdout:9/344: dwrite d3/d6/d9/fd [0,4194304] 0 2024-04-15T00:31:29.353 INFO:tasks.workunit.client.0.smithi029.stdout:8/373: sync 2024-04-15T00:31:29.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/351: getdents d0/d74 0 2024-04-15T00:31:29.464 INFO:tasks.workunit.client.0.smithi029.stdout:8/374: dread d8/d4a/d78/d23/d28/f44 [0,4194304] 0 2024-04-15T00:31:29.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/375: chown d8/da/d2f/d66 119627794 1 2024-04-15T00:31:29.536 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:29.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:29.580 INFO:tasks.workunit.client.0.smithi029.stdout:8/376: dwrite d8/da/d2f/d42/f7b [0,4194304] 0 2024-04-15T00:31:29.990 INFO:tasks.workunit.client.0.smithi029.stdout:4/360: dwrite de/df/f12 [0,4194304] 0 2024-04-15T00:31:30.161 INFO:tasks.workunit.client.0.smithi029.stdout:0/371: rename d5/c21 to d5/d15/d27/d51/d77/c78 0 2024-04-15T00:31:30.166 INFO:tasks.workunit.client.0.smithi029.stdout:6/380: mkdir d1/d8/db/d7b 0 2024-04-15T00:31:30.177 INFO:tasks.workunit.client.0.smithi029.stdout:8/377: fdatasync d8/da/f14 0 2024-04-15T00:31:30.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/352: dread - d0/d6/d39/f6f zero size 2024-04-15T00:31:30.232 INFO:tasks.workunit.client.0.smithi029.stdout:4/361: mknod de/d3a/c77 0 2024-04-15T00:31:30.251 INFO:tasks.workunit.client.0.smithi029.stdout:7/353: chown d0/d6/d39/d3c/d5b/f63 382687 1 2024-04-15T00:31:30.706 INFO:tasks.workunit.client.0.smithi029.stdout:3/360: mknod d17/d2f/d44/d68/c77 0 2024-04-15T00:31:30.727 INFO:tasks.workunit.client.0.smithi029.stdout:2/376: rename d3/d2a/d46/f3d to d3/dd/d42/f76 0 2024-04-15T00:31:30.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/369: dwrite df/f1c [0,4194304] 0 2024-04-15T00:31:30.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/378: mknod d8/d4a/d78/d23/d28/d30/d39/c7d 0 2024-04-15T00:31:30.904 INFO:tasks.workunit.client.0.smithi029.stdout:7/354: chown d0/f1f 0 1 2024-04-15T00:31:30.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/362: symlink de/df/l78 0 2024-04-15T00:31:30.966 INFO:tasks.workunit.client.0.smithi029.stdout:5/388: dwrite d2/d1a/f2c [0,4194304] 0 2024-04-15T00:31:31.075 INFO:tasks.workunit.client.0.smithi029.stdout:9/345: rename d3/d6/d9/d15/c6f to d3/d6/d9/d29/d60/d64/d6d/d58/c74 0 2024-04-15T00:31:31.077 INFO:tasks.workunit.client.0.smithi029.stdout:7/355: dread - d0/d6/d39/d3c/f70 zero size 2024-04-15T00:31:31.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/377: unlink d3/l18 0 2024-04-15T00:31:31.163 INFO:tasks.workunit.client.0.smithi029.stdout:3/361: symlink d17/d2a/d46/d67/l78 0 2024-04-15T00:31:31.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/379: dread d8/da/d3d/f6c [0,4194304] 0 2024-04-15T00:31:31.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/346: read d3/d6/d9/d15/d4a/d53/f5b [64518,22982] 0 2024-04-15T00:31:31.381 INFO:tasks.workunit.client.0.smithi029.stdout:5/389: rename d2/f8e to d2/de/d13/d22/d26/d36/f90 0 2024-04-15T00:31:31.415 INFO:tasks.workunit.client.0.smithi029.stdout:2/378: mknod d3/d50/d51/c77 0 2024-04-15T00:31:31.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/380: chown d8/da/d3d/c70 7192 1 2024-04-15T00:31:31.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/381: dwrite d1/d8/db/f48 [0,4194304] 0 2024-04-15T00:31:31.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/363: symlink de/d54/d58/l79 0 2024-04-15T00:31:31.624 INFO:tasks.workunit.client.0.smithi029.stdout:8/381: chown d8/da/l31 34831214 1 2024-04-15T00:31:31.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/372: dwrite d5/d15/d1f/d32/f61 [0,4194304] 0 2024-04-15T00:31:31.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/370: dread df/d32/f39 [0,4194304] 0 2024-04-15T00:31:31.779 INFO:tasks.workunit.client.0.smithi029.stdout:4/364: chown de/d2b/f2a 87 1 2024-04-15T00:31:31.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/390: dread d2/f52 [0,4194304] 0 2024-04-15T00:31:31.947 INFO:tasks.workunit.client.0.smithi029.stdout:2/379: dread d3/d13/f2f [0,4194304] 0 2024-04-15T00:31:32.136 INFO:tasks.workunit.client.0.smithi029.stdout:8/382: creat d8/da/d2f/d42/f7e x:0 0 0 2024-04-15T00:31:32.175 INFO:tasks.workunit.client.0.smithi029.stdout:7/356: dwrite d0/d6/d39/d3c/d5b/f63 [0,4194304] 0 2024-04-15T00:31:32.265 INFO:tasks.workunit.client.0.smithi029.stdout:3/362: dwrite d17/d2f/d44/d58/d5c/f64 [0,4194304] 0 2024-04-15T00:31:32.354 INFO:tasks.workunit.client.0.smithi029.stdout:2/380: creat d3/d2a/d4e/f78 x:0 0 0 2024-04-15T00:31:32.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/382: write d1/f20 [71779,77795] 0 2024-04-15T00:31:32.387 INFO:tasks.workunit.client.0.smithi029.stdout:3/363: chown d17/d2a/f2c 7568167 1 2024-04-15T00:31:32.404 INFO:tasks.workunit.client.0.smithi029.stdout:9/347: creat d3/d6/d9/f75 x:0 0 0 2024-04-15T00:31:32.447 INFO:tasks.workunit.client.0.smithi029.stdout:1/371: dread df/d29/d41/d69/d4c/d55/f5e [0,4194304] 0 2024-04-15T00:31:32.476 INFO:tasks.workunit.client.0.smithi029.stdout:3/364: chown d17/d2f/d44/f4f 0 1 2024-04-15T00:31:32.685 INFO:tasks.workunit.client.0.smithi029.stdout:0/373: write d5/d15/d1f/f63 [60072,62702] 0 2024-04-15T00:31:32.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/372: sync 2024-04-15T00:31:33.001 INFO:tasks.workunit.client.0.smithi029.stdout:8/383: fdatasync d8/da/d2f/d6e/f47 0 2024-04-15T00:31:33.018 INFO:tasks.workunit.client.0.smithi029.stdout:5/391: creat d2/de/d13/d22/d26/d36/d4d/d70/d8d/f91 x:0 0 0 2024-04-15T00:31:33.036 INFO:tasks.workunit.client.0.smithi029.stdout:9/348: truncate d3/d6/d9/d29/d5d/f3a 3474490 0 2024-04-15T00:31:33.039 INFO:tasks.workunit.client.0.smithi029.stdout:3/365: truncate d17/d2a/d46/f5d 383057 0 2024-04-15T00:31:33.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/373: creat df/d29/d41/f85 x:0 0 0 2024-04-15T00:31:33.209 INFO:tasks.workunit.client.0.smithi029.stdout:4/365: dwrite de/d3a/f4b [0,4194304] 0 2024-04-15T00:31:33.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/384: dread d8/d4a/d78/f1c [0,4194304] 0 2024-04-15T00:31:33.533 INFO:tasks.workunit.client.0.smithi029.stdout:7/357: symlink d0/d6/d39/d3c/d42/d49/d71/l75 0 2024-04-15T00:31:33.778 INFO:tasks.workunit.client.0.smithi029.stdout:0/374: mknod d5/d15/d27/c79 0 2024-04-15T00:31:33.782 INFO:tasks.workunit.client.0.smithi029.stdout:3/366: truncate f0 2805957 0 2024-04-15T00:31:33.993 INFO:tasks.workunit.client.0.smithi029.stdout:1/374: mknod df/d29/d41/c86 0 2024-04-15T00:31:34.001 INFO:tasks.workunit.client.0.smithi029.stdout:9/349: unlink d3/d6/d9/d29/d60/d64/d6d/d58/c45 0 2024-04-15T00:31:34.035 INFO:tasks.workunit.client.0.smithi029.stdout:4/366: symlink de/d2b/d59/l7a 0 2024-04-15T00:31:34.063 INFO:tasks.workunit.client.0.smithi029.stdout:4/367: dread f2 [4194304,4194304] 0 2024-04-15T00:31:34.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/385: dread d8/da/f14 [0,4194304] 0 2024-04-15T00:31:34.298 INFO:tasks.workunit.client.0.smithi029.stdout:7/358: rename d0/d6/c2a to d0/d6/d39/d3c/d42/d49/d71/c76 0 2024-04-15T00:31:34.381 INFO:tasks.workunit.client.0.smithi029.stdout:3/367: chown d17/c18 511956 1 2024-04-15T00:31:34.430 INFO:tasks.workunit.client.0.smithi029.stdout:0/375: creat d5/d3e/f7a x:0 0 0 2024-04-15T00:31:34.481 INFO:tasks.workunit.client.0.smithi029.stdout:9/350: truncate d3/d6/d9/f2c 2318355 0 2024-04-15T00:31:34.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/383: creat d1/f7c x:0 0 0 2024-04-15T00:31:34.676 INFO:tasks.workunit.client.0.smithi029.stdout:7/359: mkdir d0/d6/d4f/d66/d26/d77 0 2024-04-15T00:31:34.694 INFO:tasks.workunit.client.0.smithi029.stdout:7/360: stat d0/d6/d39/d3c/d42/c4b 0 2024-04-15T00:31:34.914 INFO:tasks.workunit.client.0.smithi029.stdout:2/381: write d3/d13/d43/d5a/d4f/f5d [65684,92957] 0 2024-04-15T00:31:35.134 INFO:tasks.workunit.client.0.smithi029.stdout:5/392: dwrite d2/de/d1f/f6a [0,4194304] 0 2024-04-15T00:31:35.251 INFO:tasks.workunit.client.0.smithi029.stdout:2/382: dread d3/dd/d2d/f37 [0,4194304] 0 2024-04-15T00:31:35.322 INFO:tasks.workunit.client.0.smithi029.stdout:5/393: dread - d2/de/d13/d22/d26/d36/f90 zero size 2024-04-15T00:31:35.350 INFO:tasks.workunit.client.0.smithi029.stdout:8/386: dwrite d8/f2c [0,4194304] 0 2024-04-15T00:31:35.353 INFO:tasks.workunit.client.0.smithi029.stdout:0/376: mkdir d5/db/d7b 0 2024-04-15T00:31:35.422 INFO:tasks.workunit.client.0.smithi029.stdout:3/368: write d17/f29 [2198623,51764] 0 2024-04-15T00:31:35.432 INFO:tasks.workunit.client.0.smithi029.stdout:4/368: link de/d3a/f4b de/df/f7b 0 2024-04-15T00:31:35.432 INFO:tasks.workunit.client.0.smithi029.stdout:5/394: readlink d2/de/d13/l5b 0 2024-04-15T00:31:35.565 INFO:tasks.workunit.client.0.smithi029.stdout:1/375: getdents df/d29/d41/d69/d4c/d7a 0 2024-04-15T00:31:35.673 INFO:tasks.workunit.client.0.smithi029.stdout:2/383: dread d3/dd/d42/f47 [0,4194304] 0 2024-04-15T00:31:35.674 INFO:tasks.workunit.client.0.smithi029.stdout:9/351: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/f2a [0,4194304] 0 2024-04-15T00:31:35.784 INFO:tasks.workunit.client.0.smithi029.stdout:4/369: symlink de/d3a/l7c 0 2024-04-15T00:31:35.816 INFO:tasks.workunit.client.0.smithi029.stdout:6/384: dwrite d1/d1e/f32 [0,4194304] 0 2024-04-15T00:31:35.908 INFO:tasks.workunit.client.0.smithi029.stdout:8/387: mknod d8/da/d2f/d6e/c7f 0 2024-04-15T00:31:35.917 INFO:tasks.workunit.client.0.smithi029.stdout:6/385: readlink d1/ld 0 2024-04-15T00:31:35.940 INFO:tasks.workunit.client.0.smithi029.stdout:4/370: chown de/d3a/f42 130600 1 2024-04-15T00:31:35.983 INFO:tasks.workunit.client.0.smithi029.stdout:6/386: readlink d1/d8/l4b 0 2024-04-15T00:31:36.008 INFO:tasks.workunit.client.0.smithi029.stdout:4/371: readlink de/d3a/l51 0 2024-04-15T00:31:36.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/361: dwrite d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:31:36.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/376: unlink df/c1f 0 2024-04-15T00:31:36.213 INFO:tasks.workunit.client.0.smithi029.stdout:7/362: dread - d0/f5a zero size 2024-04-15T00:31:36.288 INFO:tasks.workunit.client.0.smithi029.stdout:9/352: mknod d3/d6/d9/d29/d60/d64/d6d/d58/d6a/c76 0 2024-04-15T00:31:36.475 INFO:tasks.workunit.client.0.smithi029.stdout:7/363: readlink d0/d6/d1c/l50 0 2024-04-15T00:31:36.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/377: getdents d5/d15 0 2024-04-15T00:31:36.510 INFO:tasks.workunit.client.0.smithi029.stdout:4/372: fsync de/d2b/f47 0 2024-04-15T00:31:36.517 INFO:tasks.workunit.client.0.smithi029.stdout:6/387: mknod d1/d1e/d56/c7d 0 2024-04-15T00:31:36.582 INFO:tasks.workunit.client.0.smithi029.stdout:1/377: creat df/d29/d41/d4f/f87 x:0 0 0 2024-04-15T00:31:36.587 INFO:tasks.workunit.client.0.smithi029.stdout:5/395: dwrite d2/d1a/f59 [0,4194304] 0 2024-04-15T00:31:36.693 INFO:tasks.workunit.client.0.smithi029.stdout:2/384: dread d3/d13/f62 [0,4194304] 0 2024-04-15T00:31:36.694 INFO:tasks.workunit.client.0.smithi029.stdout:8/388: dread d8/da/d2f/f4d [0,4194304] 0 2024-04-15T00:31:36.729 INFO:tasks.workunit.client.0.smithi029.stdout:3/369: dwrite d17/f5b [0,4194304] 0 2024-04-15T00:31:36.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/353: symlink d3/d6/d9/d29/d5d/l77 0 2024-04-15T00:31:36.842 INFO:tasks.workunit.client.0.smithi029.stdout:1/378: stat df/d29/d41/d69/d4c/f75 0 2024-04-15T00:31:36.850 INFO:tasks.workunit.client.0.smithi029.stdout:0/378: rmdir d5/d15/d1f 39 2024-04-15T00:31:36.866 INFO:tasks.workunit.client.0.smithi029.stdout:7/364: write d0/d6/f3b [1381411,14692] 0 2024-04-15T00:31:36.889 INFO:tasks.workunit.client.0.smithi029.stdout:9/354: chown d3/d6/f17 15745336 1 2024-04-15T00:31:36.901 INFO:tasks.workunit.client.0.smithi029.stdout:7/365: readlink d0/d6/d1c/l50 0 2024-04-15T00:31:37.003 INFO:tasks.workunit.client.0.smithi029.stdout:2/385: fdatasync d3/dd/d2d/f34 0 2024-04-15T00:31:37.020 INFO:tasks.workunit.client.0.smithi029.stdout:1/379: creat df/d29/d41/d69/f88 x:0 0 0 2024-04-15T00:31:37.120 INFO:tasks.workunit.client.0.smithi029.stdout:0/379: truncate d5/d4c/f5a 146800 0 2024-04-15T00:31:37.125 INFO:tasks.workunit.client.0.smithi029.stdout:8/389: rename d8/d4a/d78/d23/d28/d30/d39/l73 to d8/d4a/d78/d23/d28/d30/l80 0 2024-04-15T00:31:37.161 INFO:tasks.workunit.client.0.smithi029.stdout:4/373: symlink de/d54/d71/l7d 0 2024-04-15T00:31:37.240 INFO:tasks.workunit.client.0.smithi029.stdout:1/380: sync 2024-04-15T00:31:37.277 INFO:tasks.workunit.client.0.smithi029.stdout:6/388: creat d1/d1e/f7e x:0 0 0 2024-04-15T00:31:37.302 INFO:tasks.workunit.client.0.smithi029.stdout:5/396: fdatasync d2/de/d13/d22/d3c/d41/f4c 0 2024-04-15T00:31:37.393 INFO:tasks.workunit.client.0.smithi029.stdout:2/386: unlink d3/dd/d2d/l56 0 2024-04-15T00:31:37.461 INFO:tasks.workunit.client.0.smithi029.stdout:9/355: mknod d3/d6/d9/d29/d60/c78 0 2024-04-15T00:31:37.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/370: dwrite d17/d2a/d33/f56 [0,4194304] 0 2024-04-15T00:31:38.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/366: write d0/d6/d4f/d66/d26/f51 [390001,98679] 0 2024-04-15T00:31:38.029 INFO:tasks.workunit.client.0.smithi029.stdout:1/381: truncate df/d29/d41/f4e 4711865 0 2024-04-15T00:31:38.036 INFO:tasks.workunit.client.0.smithi029.stdout:4/374: chown de/df/d1e/f29 63464 1 2024-04-15T00:31:38.226 INFO:tasks.workunit.client.0.smithi029.stdout:2/387: dread d3/dd/f30 [0,4194304] 0 2024-04-15T00:31:38.233 INFO:tasks.workunit.client.0.smithi029.stdout:2/388: readlink d3/l23 0 2024-04-15T00:31:38.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/389: dread d3/d13/d14/f1e [0,4194304] 0 2024-04-15T00:31:38.710 INFO:tasks.workunit.client.0.smithi029.stdout:1/382: mknod df/d29/d41/d69/d4c/d55/d59/c89 0 2024-04-15T00:31:38.941 INFO:tasks.workunit.client.0.smithi029.stdout:8/390: dwrite d8/da/f6a [0,4194304] 0 2024-04-15T00:31:39.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/390: stat d3/d13/c6c 0 2024-04-15T00:31:39.128 INFO:tasks.workunit.client.0.smithi029.stdout:9/356: dwrite d3/f4e [4194304,4194304] 0 2024-04-15T00:31:39.215 INFO:tasks.workunit.client.0.smithi029.stdout:5/397: rmdir d2/d68 0 2024-04-15T00:31:39.447 INFO:tasks.workunit.client.0.smithi029.stdout:1/383: symlink df/d32/d7c/l8a 0 2024-04-15T00:31:39.563 INFO:tasks.workunit.client.0.smithi029.stdout:5/398: dread d2/de/d13/d22/d3c/d41/f4c [0,4194304] 0 2024-04-15T00:31:39.577 INFO:tasks.workunit.client.0.smithi029.stdout:6/389: dwrite d1/d8/db/f50 [0,4194304] 0 2024-04-15T00:31:39.663 INFO:tasks.workunit.client.0.smithi029.stdout:1/384: rename df/d29/d41/d69/d4c/l70 to df/d29/d41/d69/d4c/d55/l8b 0 2024-04-15T00:31:39.715 INFO:tasks.workunit.client.0.smithi029.stdout:6/390: chown d1/d64/c75 24079 1 2024-04-15T00:31:39.741 INFO:tasks.workunit.client.0.smithi029.stdout:1/385: chown df/d29/f79 8407593 1 2024-04-15T00:31:39.788 INFO:tasks.workunit.client.0.smithi029.stdout:4/375: dwrite de/d2b/d35/f73 [0,4194304] 0 2024-04-15T00:31:39.859 INFO:tasks.workunit.client.0.smithi029.stdout:8/391: creat d8/da/d3d/f81 x:0 0 0 2024-04-15T00:31:39.988 INFO:tasks.workunit.client.0.smithi029.stdout:6/391: dread d1/d1e/d56/d58/d59/f5a [0,4194304] 0 2024-04-15T00:31:40.008 INFO:tasks.workunit.client.0.smithi029.stdout:7/367: mkdir d0/d6/d39/d3c/d78 0 2024-04-15T00:31:40.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/386: symlink df/d29/d41/d69/l8c 0 2024-04-15T00:31:40.081 INFO:tasks.workunit.client.0.smithi029.stdout:4/376: truncate de/df/d1e/f24 1169132 0 2024-04-15T00:31:40.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/380: write d5/d15/d27/f6b [302647,48533] 0 2024-04-15T00:31:40.195 INFO:tasks.workunit.client.0.smithi029.stdout:7/368: symlink d0/d6/d4f/d66/d26/l79 0 2024-04-15T00:31:40.223 INFO:tasks.workunit.client.0.smithi029.stdout:3/371: dwrite f0 [0,4194304] 0 2024-04-15T00:31:40.258 INFO:tasks.workunit.client.0.smithi029.stdout:0/381: sync 2024-04-15T00:31:40.361 INFO:tasks.workunit.client.0.smithi029.stdout:8/392: mkdir d8/d4a/d78/d23/d28/d30/d39/d77/d82 0 2024-04-15T00:31:40.365 INFO:tasks.workunit.client.0.smithi029.stdout:4/377: unlink de/d3a/f46 0 2024-04-15T00:31:40.383 INFO:tasks.workunit.client.0.smithi029.stdout:4/378: chown de/d3a/c3e 35543317 1 2024-04-15T00:31:40.511 INFO:tasks.workunit.client.0.smithi029.stdout:6/392: link d1/d8/db/f23 d1/d8/d72/f7f 0 2024-04-15T00:31:40.574 INFO:tasks.workunit.client.0.smithi029.stdout:2/391: write d3/d13/d14/f1e [1403056,64929] 0 2024-04-15T00:31:40.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/399: write d2/de/d13/d22/f5e [995587,75739] 0 2024-04-15T00:31:40.638 INFO:tasks.workunit.client.0.smithi029.stdout:2/392: stat d3/d50 0 2024-04-15T00:31:40.767 INFO:tasks.workunit.client.0.smithi029.stdout:9/357: dwrite d3/d6/f61 [0,4194304] 0 2024-04-15T00:31:40.768 INFO:tasks.workunit.client.0.smithi029.stdout:5/400: dread d2/de/d13/f32 [0,4194304] 0 2024-04-15T00:31:40.858 INFO:tasks.workunit.client.0.smithi029.stdout:4/379: mkdir de/d6d/d7e 0 2024-04-15T00:31:40.860 INFO:tasks.workunit.client.0.smithi029.stdout:1/387: write df/f46 [1730606,27164] 0 2024-04-15T00:31:40.862 INFO:tasks.workunit.client.0.smithi029.stdout:6/393: rmdir d1/d1e 39 2024-04-15T00:31:40.911 INFO:tasks.workunit.client.0.smithi029.stdout:5/401: chown d2/f52 3457 1 2024-04-15T00:31:41.161 INFO:tasks.workunit.client.0.smithi029.stdout:7/369: write d0/d6/d4f/f5c [4009617,31888] 0 2024-04-15T00:31:41.239 INFO:tasks.workunit.client.0.smithi029.stdout:8/393: dwrite d8/d4a/d78/f1c [0,4194304] 0 2024-04-15T00:31:41.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/394: chown d8/d4a/d78/c21 3757 1 2024-04-15T00:31:41.555 INFO:tasks.workunit.client.0.smithi029.stdout:3/372: fdatasync d17/f1b 0 2024-04-15T00:31:41.586 INFO:tasks.workunit.client.0.smithi029.stdout:1/388: mknod df/d29/c8d 0 2024-04-15T00:31:41.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/370: unlink d0/d6/f3f 0 2024-04-15T00:31:41.612 INFO:tasks.workunit.client.0.smithi029.stdout:9/358: read d3/d6/d9/d15/f1f [529203,50288] 0 2024-04-15T00:31:41.638 INFO:tasks.workunit.client.0.smithi029.stdout:5/402: read d2/fa [626867,11092] 0 2024-04-15T00:31:41.696 INFO:tasks.workunit.client.0.smithi029.stdout:6/394: mknod d1/d8/d79/c80 0 2024-04-15T00:31:41.703 INFO:tasks.workunit.client.0.smithi029.stdout:3/373: readlink d17/d2f/l3a 0 2024-04-15T00:31:41.875 INFO:tasks.workunit.client.0.smithi029.stdout:7/371: creat d0/d6/d4f/d66/d37/f7a x:0 0 0 2024-04-15T00:31:41.888 INFO:tasks.workunit.client.0.smithi029.stdout:9/359: symlink d3/d6/d9/d15/l79 0 2024-04-15T00:31:41.954 INFO:tasks.workunit.client.0.smithi029.stdout:8/395: write d8/f50 [678700,123607] 0 2024-04-15T00:31:41.968 INFO:tasks.workunit.client.0.smithi029.stdout:6/395: dread d1/d8/f54 [0,4194304] 0 2024-04-15T00:31:41.992 INFO:tasks.workunit.client.0.smithi029.stdout:2/393: dwrite d3/d2a/d46/f74 [0,4194304] 0 2024-04-15T00:31:42.126 INFO:tasks.workunit.client.0.smithi029.stdout:5/403: symlink d2/d1a/d2d/l92 0 2024-04-15T00:31:42.128 INFO:tasks.workunit.client.0.smithi029.stdout:0/382: dwrite d5/d15/d1f/f63 [0,4194304] 0 2024-04-15T00:31:42.140 INFO:tasks.workunit.client.0.smithi029.stdout:1/389: dread df/d29/d41/f48 [0,4194304] 0 2024-04-15T00:31:42.306 INFO:tasks.workunit.client.0.smithi029.stdout:2/394: dread d3/dd/f30 [0,4194304] 0 2024-04-15T00:31:42.325 INFO:tasks.workunit.client.0.smithi029.stdout:4/380: dwrite de/d2b/d59/f63 [0,4194304] 0 2024-04-15T00:31:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:3/374: getdents d17/d2a/d33/d37 0 2024-04-15T00:31:42.452 INFO:tasks.workunit.client.0.smithi029.stdout:0/383: stat d5/d15/f4a 0 2024-04-15T00:31:42.454 INFO:tasks.workunit.client.0.smithi029.stdout:1/390: read df/d29/d41/d69/d78/f6f [803181,11128] 0 2024-04-15T00:31:42.473 INFO:tasks.workunit.client.0.smithi029.stdout:7/372: rename d0/d6/d39/d3c/d78 to d0/d6/d4f/d66/d7b 0 2024-04-15T00:31:42.507 INFO:tasks.workunit.client.0.smithi029.stdout:7/373: chown d0/f5a 4 1 2024-04-15T00:31:42.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/384: write d5/d15/d27/f6b [634573,55269] 0 2024-04-15T00:31:42.539 INFO:tasks.workunit.client.0.smithi029.stdout:7/374: stat d0/d6/d39/d3c/d42/d49 0 2024-04-15T00:31:42.665 INFO:tasks.workunit.client.0.smithi029.stdout:9/360: unlink d3/d6/f16 0 2024-04-15T00:31:42.675 INFO:tasks.workunit.client.0.smithi029.stdout:9/361: chown d3/d6/d9/d29 799 1 2024-04-15T00:31:42.889 INFO:tasks.workunit.client.0.smithi029.stdout:5/404: unlink d2/de/d13/d22/d26/d36/d4d/d70/l8a 0 2024-04-15T00:31:43.312 INFO:tasks.workunit.client.0.smithi029.stdout:8/396: truncate d8/da/d2f/d42/f54 1228445 0 2024-04-15T00:31:43.316 INFO:tasks.workunit.client.0.smithi029.stdout:1/391: symlink df/d29/d41/d69/d4c/l8e 0 2024-04-15T00:31:43.474 INFO:tasks.workunit.client.0.smithi029.stdout:0/385: dread d5/f62 [0,4194304] 0 2024-04-15T00:31:43.914 INFO:tasks.workunit.client.0.smithi029.stdout:3/375: dwrite f15 [4194304,4194304] 0 2024-04-15T00:31:43.996 INFO:tasks.workunit.client.0.smithi029.stdout:8/397: dread d8/f38 [0,4194304] 0 2024-04-15T00:31:44.029 INFO:tasks.workunit.client.0.smithi029.stdout:6/396: write d1/d1e/d22/f6a [472963,37951] 0 2024-04-15T00:31:44.030 INFO:tasks.workunit.client.0.smithi029.stdout:0/386: read d5/d15/f1e [266891,108057] 0 2024-04-15T00:31:44.109 INFO:tasks.workunit.client.0.smithi029.stdout:1/392: symlink df/l8f 0 2024-04-15T00:31:44.126 INFO:tasks.workunit.client.0.smithi029.stdout:4/381: dwrite de/d2b/d35/f49 [0,4194304] 0 2024-04-15T00:31:44.540 INFO:tasks.workunit.client.0.smithi029.stdout:0/387: creat d5/d4c/d4e/f7c x:0 0 0 2024-04-15T00:31:44.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/395: creat d3/f79 x:0 0 0 2024-04-15T00:31:44.617 INFO:tasks.workunit.client.0.smithi029.stdout:8/398: creat d8/d4a/d78/d23/d28/d5f/f83 x:0 0 0 2024-04-15T00:31:44.625 INFO:tasks.workunit.client.0.smithi029.stdout:9/362: link d3/d6/l3d d3/d6/l7a 0 2024-04-15T00:31:44.694 INFO:tasks.workunit.client.0.smithi029.stdout:5/405: link d2/d1a/c7f d2/de/d13/c93 0 2024-04-15T00:31:44.697 INFO:tasks.workunit.client.0.smithi029.stdout:3/376: unlink d17/d2a/d4c/d51/l54 0 2024-04-15T00:31:44.737 INFO:tasks.workunit.client.0.smithi029.stdout:1/393: mkdir df/d32/d90 0 2024-04-15T00:31:44.800 INFO:tasks.workunit.client.0.smithi029.stdout:2/396: truncate d3/d13/d43/d5a/f4b 1483025 0 2024-04-15T00:31:44.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/397: stat d3/d53 0 2024-04-15T00:31:44.876 INFO:tasks.workunit.client.0.smithi029.stdout:8/399: read - d8/da/d2f/d42/f7e zero size 2024-04-15T00:31:44.907 INFO:tasks.workunit.client.0.smithi029.stdout:0/388: dread d5/db/f42 [0,4194304] 0 2024-04-15T00:31:44.946 INFO:tasks.workunit.client.0.smithi029.stdout:7/375: rename d0/d6/d39/f6f to d0/f7c 0 2024-04-15T00:31:44.954 INFO:tasks.workunit.client.0.smithi029.stdout:3/377: mknod d17/d2a/d46/d67/c79 0 2024-04-15T00:31:44.980 INFO:tasks.workunit.client.0.smithi029.stdout:3/378: dread - d17/f20 zero size 2024-04-15T00:31:45.013 INFO:tasks.workunit.client.0.smithi029.stdout:3/379: stat d17/d2f/l3a 0 2024-04-15T00:31:45.068 INFO:tasks.workunit.client.0.smithi029.stdout:5/406: dread d2/f11 [0,4194304] 0 2024-04-15T00:31:45.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/407: dread d2/d1a/f20 [0,4194304] 0 2024-04-15T00:31:45.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/394: dread df/f42 [0,4194304] 0 2024-04-15T00:31:45.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/376: mknod d0/d6/d1c/c7d 0 2024-04-15T00:31:45.576 INFO:tasks.workunit.client.0.smithi029.stdout:6/397: write d1/d1e/d22/f3a [460203,40839] 0 2024-04-15T00:31:45.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/382: dwrite de/f74 [0,4194304] 0 2024-04-15T00:31:45.716 INFO:tasks.workunit.client.0.smithi029.stdout:7/377: sync 2024-04-15T00:31:45.890 INFO:tasks.workunit.client.0.smithi029.stdout:3/380: creat d17/d2f/d76/f7a x:0 0 0 2024-04-15T00:31:45.891 INFO:tasks.workunit.client.0.smithi029.stdout:9/363: rename d3/l48 to d3/d6/d9/d29/l7b 0 2024-04-15T00:31:45.912 INFO:tasks.workunit.client.0.smithi029.stdout:6/398: unlink d1/c4c 0 2024-04-15T00:31:45.965 INFO:tasks.workunit.client.0.smithi029.stdout:3/381: fsync f15 0 2024-04-15T00:31:46.004 INFO:tasks.workunit.client.0.smithi029.stdout:0/389: dwrite d5/d15/d1f/f3a [0,4194304] 0 2024-04-15T00:31:46.086 INFO:tasks.workunit.client.0.smithi029.stdout:8/400: dwrite d8/da/d2f/d6e/f6f [0,4194304] 0 2024-04-15T00:31:46.152 INFO:tasks.workunit.client.0.smithi029.stdout:3/382: chown d17/d2a/l3d 78 1 2024-04-15T00:31:46.181 INFO:tasks.workunit.client.0.smithi029.stdout:2/398: getdents d3/dd 0 2024-04-15T00:31:46.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/395: rmdir df/d84 0 2024-04-15T00:31:46.278 INFO:tasks.workunit.client.0.smithi029.stdout:6/399: mkdir d1/d8/d79/d81 0 2024-04-15T00:31:46.286 INFO:tasks.workunit.client.0.smithi029.stdout:5/408: write d2/d1a/f2c [5623746,77317] 0 2024-04-15T00:31:46.451 INFO:tasks.workunit.client.0.smithi029.stdout:0/390: mkdir d5/d15/d27/d51/d7d 0 2024-04-15T00:31:46.470 INFO:tasks.workunit.client.0.smithi029.stdout:3/383: truncate d17/d2a/d4c/d51/f6d 315772 0 2024-04-15T00:31:46.486 INFO:tasks.workunit.client.0.smithi029.stdout:3/384: read d17/d2a/f32 [657150,8251] 0 2024-04-15T00:31:46.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/383: link de/d3a/c40 de/d54/c7f 0 2024-04-15T00:31:46.889 INFO:tasks.workunit.client.0.smithi029.stdout:2/399: symlink d3/d2a/l7a 0 2024-04-15T00:31:46.917 INFO:tasks.workunit.client.0.smithi029.stdout:3/385: dread - d17/d2f/d44/d58/d5c/f73 zero size 2024-04-15T00:31:46.918 INFO:tasks.workunit.client.0.smithi029.stdout:8/401: write d8/f15 [4369940,76635] 0 2024-04-15T00:31:46.920 INFO:tasks.workunit.client.0.smithi029.stdout:5/409: chown d2/de/d13/c93 13120466 1 2024-04-15T00:31:47.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/378: dwrite d0/f59 [0,4194304] 0 2024-04-15T00:31:47.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/402: unlink d8/d4a/d78/l25 0 2024-04-15T00:31:47.396 INFO:tasks.workunit.client.0.smithi029.stdout:1/396: getdents df/d29/d41/d69 0 2024-04-15T00:31:47.425 INFO:tasks.workunit.client.0.smithi029.stdout:7/379: mkdir d0/d6/d39/d3c/d5b/d7e 0 2024-04-15T00:31:47.427 INFO:tasks.workunit.client.0.smithi029.stdout:9/364: mknod d3/d6/c7c 0 2024-04-15T00:31:47.529 INFO:tasks.workunit.client.0.smithi029.stdout:8/403: read d8/d4a/d78/d23/f51 [2629645,27946] 0 2024-04-15T00:31:47.555 INFO:tasks.workunit.client.0.smithi029.stdout:4/384: write de/d2b/f2a [3100463,126337] 0 2024-04-15T00:31:47.574 INFO:tasks.workunit.client.0.smithi029.stdout:6/400: dwrite d1/f12 [0,4194304] 0 2024-04-15T00:31:47.674 INFO:tasks.workunit.client.0.smithi029.stdout:7/380: chown d0/d6/d1c/c1e 895 1 2024-04-15T00:31:47.745 INFO:tasks.workunit.client.0.smithi029.stdout:0/391: dwrite d5/d15/d57/d5e/f71 [0,4194304] 0 2024-04-15T00:31:47.973 INFO:tasks.workunit.client.0.smithi029.stdout:2/400: dwrite d3/dd/f30 [0,4194304] 0 2024-04-15T00:31:48.075 INFO:tasks.workunit.client.0.smithi029.stdout:3/386: dwrite d17/d2f/d44/f4f [0,4194304] 0 2024-04-15T00:31:48.250 INFO:tasks.workunit.client.0.smithi029.stdout:5/410: getdents d2/de/d1f/d63 0 2024-04-15T00:31:48.250 INFO:tasks.workunit.client.0.smithi029.stdout:3/387: sync 2024-04-15T00:31:48.358 INFO:tasks.workunit.client.0.smithi029.stdout:3/388: sync 2024-04-15T00:31:48.912 INFO:tasks.workunit.client.0.smithi029.stdout:4/385: link de/d54/d58/f68 de/df/d1e/d56/f80 0 2024-04-15T00:31:49.029 INFO:tasks.workunit.client.0.smithi029.stdout:1/397: write df/d29/d41/d69/d4c/d55/d59/f67 [1133133,14712] 0 2024-04-15T00:31:49.031 INFO:tasks.workunit.client.0.smithi029.stdout:8/404: write d8/d4a/d78/d23/d28/d30/d39/f4b [1049803,5064] 0 2024-04-15T00:31:49.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/401: getdents d3/d2a/d46 0 2024-04-15T00:31:49.156 INFO:tasks.workunit.client.0.smithi029.stdout:1/398: stat df/d29/d41/d69/d78/f74 0 2024-04-15T00:31:49.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/365: dwrite d3/d6/d9/d15/d4a/f72 [0,4194304] 0 2024-04-15T00:31:49.253 INFO:tasks.workunit.client.0.smithi029.stdout:4/386: dread de/d2b/f30 [0,4194304] 0 2024-04-15T00:31:49.332 INFO:tasks.workunit.client.0.smithi029.stdout:7/381: write d0/d6/d4f/d66/d26/f28 [2324053,106700] 0 2024-04-15T00:31:49.510 INFO:tasks.workunit.client.0.smithi029.stdout:2/402: creat d3/d2a/d6d/f7b x:0 0 0 2024-04-15T00:31:49.526 INFO:tasks.workunit.client.0.smithi029.stdout:8/405: creat d8/da/d2f/d66/f84 x:0 0 0 2024-04-15T00:31:49.553 INFO:tasks.workunit.client.0.smithi029.stdout:4/387: truncate de/d2b/d35/f49 4260383 0 2024-04-15T00:31:49.582 INFO:tasks.workunit.client.0.smithi029.stdout:0/392: mknod d5/c7e 0 2024-04-15T00:31:49.705 INFO:tasks.workunit.client.0.smithi029.stdout:9/366: mknod d3/d6/d30/c7d 0 2024-04-15T00:31:49.715 INFO:tasks.workunit.client.0.smithi029.stdout:7/382: creat d0/d6/d4f/f7f x:0 0 0 2024-04-15T00:31:49.716 INFO:tasks.workunit.client.0.smithi029.stdout:5/411: dwrite d2/de/d13/f19 [0,4194304] 0 2024-04-15T00:31:49.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/401: dwrite d1/d1e/f49 [0,4194304] 0 2024-04-15T00:31:49.842 INFO:tasks.workunit.client.0.smithi029.stdout:4/388: readlink de/df/d1e/l37 0 2024-04-15T00:31:49.863 INFO:tasks.workunit.client.0.smithi029.stdout:0/393: readlink d5/d15/d1f/l39 0 2024-04-15T00:31:49.903 INFO:tasks.workunit.client.0.smithi029.stdout:3/389: dwrite d17/d2f/d3c/f74 [0,4194304] 0 2024-04-15T00:31:49.985 INFO:tasks.workunit.client.0.smithi029.stdout:8/406: creat d8/d4a/f85 x:0 0 0 2024-04-15T00:31:50.004 INFO:tasks.workunit.client.0.smithi029.stdout:1/399: dread df/f28 [0,4194304] 0 2024-04-15T00:31:50.121 INFO:tasks.workunit.client.0.smithi029.stdout:9/367: mkdir d3/d6/d9/d15/d7e 0 2024-04-15T00:31:50.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/403: dwrite d3/dd/d2d/f37 [0,4194304] 0 2024-04-15T00:31:50.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/402: symlink d1/d1e/d56/d58/d59/l82 0 2024-04-15T00:31:50.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/412: creat d2/de/d13/d22/d3c/d41/d6d/f94 x:0 0 0 2024-04-15T00:31:50.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/389: truncate de/df/d1e/f29 2113200 0 2024-04-15T00:31:50.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/403: readlink d1/d1e/d56/d58/d59/l82 0 2024-04-15T00:31:50.463 INFO:tasks.workunit.client.0.smithi029.stdout:2/404: rmdir d3/d50 39 2024-04-15T00:31:50.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/390: dread d17/d2a/f2c [0,4194304] 0 2024-04-15T00:31:50.483 INFO:tasks.workunit.client.0.smithi029.stdout:7/383: write d0/f7c [196589,63641] 0 2024-04-15T00:31:50.567 INFO:tasks.workunit.client.0.smithi029.stdout:6/404: dread d1/d1e/f32 [0,4194304] 0 2024-04-15T00:31:50.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/407: creat d8/da/d3d/f86 x:0 0 0 2024-04-15T00:31:50.646 INFO:tasks.workunit.client.0.smithi029.stdout:7/384: sync 2024-04-15T00:31:50.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/394: dwrite d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:31:50.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/400: link df/d29/d41/d69/l8c df/d29/d41/d69/l91 0 2024-04-15T00:31:50.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/405: chown d1/d8/db/f23 4 1 2024-04-15T00:31:50.744 INFO:tasks.workunit.client.0.smithi029.stdout:9/368: truncate d3/d6/d9/d29/d5d/f3a 2586871 0 2024-04-15T00:31:50.780 INFO:tasks.workunit.client.0.smithi029.stdout:1/401: chown df/f13 41 1 2024-04-15T00:31:50.792 INFO:tasks.workunit.client.0.smithi029.stdout:6/406: chown d1/d1e/d56/d58/d59 2 1 2024-04-15T00:31:50.899 INFO:tasks.workunit.client.0.smithi029.stdout:3/391: creat d17/d2f/d44/d58/d5c/d5f/f7b x:0 0 0 2024-04-15T00:31:50.903 INFO:tasks.workunit.client.0.smithi029.stdout:5/413: creat d2/f95 x:0 0 0 2024-04-15T00:31:51.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/405: write d3/d2a/d4e/f64 [1532751,88103] 0 2024-04-15T00:31:51.171 INFO:tasks.workunit.client.0.smithi029.stdout:4/390: write de/d2b/f21 [545283,6232] 0 2024-04-15T00:31:51.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/385: fdatasync d0/d6/d4f/d5d/f5e 0 2024-04-15T00:31:51.202 INFO:tasks.workunit.client.0.smithi029.stdout:8/408: write d8/d4a/d78/f6b [873287,78712] 0 2024-04-15T00:31:51.269 INFO:tasks.workunit.client.0.smithi029.stdout:9/369: rmdir d3/d6/d9/d29/d60/d57 39 2024-04-15T00:31:51.277 INFO:tasks.workunit.client.0.smithi029.stdout:9/370: chown d3/d6/f59 36382840 1 2024-04-15T00:31:51.414 INFO:tasks.workunit.client.0.smithi029.stdout:6/407: rmdir d1 39 2024-04-15T00:31:51.417 INFO:tasks.workunit.client.0.smithi029.stdout:1/402: truncate df/d32/f3f 682043 0 2024-04-15T00:31:51.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/392: mknod d17/d2a/d33/c7c 0 2024-04-15T00:31:51.576 INFO:tasks.workunit.client.0.smithi029.stdout:4/391: rmdir de/d3a 39 2024-04-15T00:31:51.578 INFO:tasks.workunit.client.0.smithi029.stdout:2/406: mknod d3/d2a/d46/c7c 0 2024-04-15T00:31:51.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/409: mkdir d8/d4a/d78/d87 0 2024-04-15T00:31:51.772 INFO:tasks.workunit.client.0.smithi029.stdout:3/393: chown d17/d2a/d4c/d51/f6d 38 1 2024-04-15T00:31:51.802 INFO:tasks.workunit.client.0.smithi029.stdout:0/395: dwrite d5/d15/d1f/d32/f3d [0,4194304] 0 2024-04-15T00:31:51.877 INFO:tasks.workunit.client.0.smithi029.stdout:2/407: rmdir d3/d2a/d46 39 2024-04-15T00:31:51.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/403: truncate df/d32/f3b 2170315 0 2024-04-15T00:31:52.010 INFO:tasks.workunit.client.0.smithi029.stdout:9/371: write d3/d6/d9/d29/d60/d64/d6d/d58/f28 [132666,121997] 0 2024-04-15T00:31:52.040 INFO:tasks.workunit.client.0.smithi029.stdout:5/414: dwrite d2/f8 [0,4194304] 0 2024-04-15T00:31:52.111 INFO:tasks.workunit.client.0.smithi029.stdout:3/394: creat d17/d2a/d4c/d51/f7d x:0 0 0 2024-04-15T00:31:52.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/386: write d0/d6/d4f/d66/d67/f73 [3256678,45744] 0 2024-04-15T00:31:52.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/396: dread d5/d15/d27/f6b [0,4194304] 0 2024-04-15T00:31:52.327 INFO:tasks.workunit.client.0.smithi029.stdout:1/404: symlink df/d29/d41/d69/d4c/l92 0 2024-04-15T00:31:52.349 INFO:tasks.workunit.client.0.smithi029.stdout:1/405: read df/f13 [1880183,84306] 0 2024-04-15T00:31:52.394 INFO:tasks.workunit.client.0.smithi029.stdout:7/387: truncate d0/d6/d1c/f1b 2288449 0 2024-04-15T00:31:52.535 INFO:tasks.workunit.client.0.smithi029.stdout:3/395: dread d17/f24 [0,4194304] 0 2024-04-15T00:31:52.681 INFO:tasks.workunit.client.0.smithi029.stdout:0/397: truncate d5/db/f42 4312816 0 2024-04-15T00:31:52.697 INFO:tasks.workunit.client.0.smithi029.stdout:5/415: mknod d2/d24/c96 0 2024-04-15T00:31:52.708 INFO:tasks.workunit.client.0.smithi029.stdout:9/372: mkdir d3/d6/d9/d29/d60/d7f 0 2024-04-15T00:31:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:7/388: rename d0/d6/d4f/d66/d26/f46 to d0/d6/d4f/d66/d26/f80 0 2024-04-15T00:31:52.756 INFO:tasks.workunit.client.0.smithi029.stdout:7/389: stat d0/d6/d4f/d66 0 2024-04-15T00:31:52.785 INFO:tasks.workunit.client.0.smithi029.stdout:7/390: readlink d0/d6/l58 0 2024-04-15T00:31:52.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/373: dread d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:31:53.135 INFO:tasks.workunit.client.0.smithi029.stdout:4/392: getdents de/d54/d71 0 2024-04-15T00:31:53.309 INFO:tasks.workunit.client.0.smithi029.stdout:0/398: symlink d5/db/d1a/d65/l7f 0 2024-04-15T00:31:53.315 INFO:tasks.workunit.client.0.smithi029.stdout:6/408: getdents d1/d64 0 2024-04-15T00:31:53.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/416: symlink d2/de/d13/d22/d26/d36/l97 0 2024-04-15T00:31:53.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/396: truncate d17/d2a/f36 7213219 0 2024-04-15T00:31:53.428 INFO:tasks.workunit.client.0.smithi029.stdout:1/406: write df/f3c [518619,53735] 0 2024-04-15T00:31:53.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/407: write df/d29/d41/d69/d4c/d55/d59/f67 [572362,9027] 0 2024-04-15T00:31:53.619 INFO:tasks.workunit.client.0.smithi029.stdout:2/408: dwrite d3/d13/d43/d5a/f4b [0,4194304] 0 2024-04-15T00:31:53.681 INFO:tasks.workunit.client.0.smithi029.stdout:8/410: dwrite d8/da/d2f/d42/f54 [0,4194304] 0 2024-04-15T00:31:53.770 INFO:tasks.workunit.client.0.smithi029.stdout:2/409: dread - d3/d2a/d6d/f7b zero size 2024-04-15T00:31:53.790 INFO:tasks.workunit.client.0.smithi029.stdout:7/391: creat d0/d6/d4f/f81 x:0 0 0 2024-04-15T00:31:53.807 INFO:tasks.workunit.client.0.smithi029.stdout:0/399: creat d5/d4c/d4e/f80 x:0 0 0 2024-04-15T00:31:53.816 INFO:tasks.workunit.client.0.smithi029.stdout:6/409: rename d1/d8/db/f11 to d1/d1e/d22/f83 0 2024-04-15T00:31:53.820 INFO:tasks.workunit.client.0.smithi029.stdout:4/393: read - de/f75 zero size 2024-04-15T00:31:53.992 INFO:tasks.workunit.client.0.smithi029.stdout:9/374: dread d3/d6/d9/d29/d60/d64/d6d/d58/f32 [0,4194304] 0 2024-04-15T00:31:54.004 INFO:tasks.workunit.client.0.smithi029.stdout:9/375: readlink d3/d6/d9/d29/l67 0 2024-04-15T00:31:54.214 INFO:tasks.workunit.client.0.smithi029.stdout:8/411: truncate d8/f7c 885067 0 2024-04-15T00:31:54.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/417: mknod d2/de/d1f/d63/d71/c98 0 2024-04-15T00:31:54.236 INFO:tasks.workunit.client.0.smithi029.stdout:3/397: creat d17/d2f/d44/d5a/f7e x:0 0 0 2024-04-15T00:31:54.258 INFO:tasks.workunit.client.0.smithi029.stdout:7/392: mkdir d0/d6/d4f/d5d/d82 0 2024-04-15T00:31:54.270 INFO:tasks.workunit.client.0.smithi029.stdout:2/410: rename d3/d2a/d6d/f7b to d3/dd/d2d/f7d 0 2024-04-15T00:31:54.275 INFO:tasks.workunit.client.0.smithi029.stdout:6/410: dread - d1/d8/db/d38/f67 zero size 2024-04-15T00:31:55.052 INFO:tasks.workunit.client.0.smithi029.stdout:9/376: fdatasync d3/d6/d9/d15/d4a/d53/f5b 0 2024-04-15T00:31:55.064 INFO:tasks.workunit.client.0.smithi029.stdout:9/377: chown d3/d6 0 1 2024-04-15T00:31:55.078 INFO:tasks.workunit.client.0.smithi029.stdout:9/378: chown d3/d6/d9/d29/f4c 3438209 1 2024-04-15T00:31:55.095 INFO:tasks.workunit.client.0.smithi029.stdout:0/400: mknod d5/d15/d68/c81 0 2024-04-15T00:31:55.255 INFO:tasks.workunit.client.0.smithi029.stdout:7/393: symlink d0/d6/d4f/d5d/l83 0 2024-04-15T00:31:55.267 INFO:tasks.workunit.client.0.smithi029.stdout:2/411: creat d3/d13/d14/f7e x:0 0 0 2024-04-15T00:31:55.277 INFO:tasks.workunit.client.0.smithi029.stdout:0/401: sync 2024-04-15T00:31:55.377 INFO:tasks.workunit.client.0.smithi029.stdout:5/418: rename d2/de/d13/d22/f47 to d2/de/d13/d22/d3c/d41/d6d/f99 0 2024-04-15T00:31:55.379 INFO:tasks.workunit.client.0.smithi029.stdout:1/408: write df/d32/f39 [4357569,55829] 0 2024-04-15T00:31:55.686 INFO:tasks.workunit.client.0.smithi029.stdout:3/398: truncate fa 189407 0 2024-04-15T00:31:55.688 INFO:tasks.workunit.client.0.smithi029.stdout:4/394: write f2 [3021273,97106] 0 2024-04-15T00:31:55.803 INFO:tasks.workunit.client.0.smithi029.stdout:2/412: chown d3/l8 124 1 2024-04-15T00:31:55.810 INFO:tasks.workunit.client.0.smithi029.stdout:2/413: chown d3/d53/l57 258 1 2024-04-15T00:31:55.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/394: read d0/d6/d4f/d66/d26/f80 [189992,81635] 0 2024-04-15T00:31:55.950 INFO:tasks.workunit.client.0.smithi029.stdout:5/419: truncate d2/de/d13/d22/f5e 211516 0 2024-04-15T00:31:56.079 INFO:tasks.workunit.client.0.smithi029.stdout:4/395: rename de/f75 to de/d54/f81 0 2024-04-15T00:31:56.154 INFO:tasks.workunit.client.0.smithi029.stdout:7/395: fsync d0/f24 0 2024-04-15T00:31:56.204 INFO:tasks.workunit.client.0.smithi029.stdout:6/411: creat d1/d1e/d56/d58/f84 x:0 0 0 2024-04-15T00:31:56.306 INFO:tasks.workunit.client.0.smithi029.stdout:6/412: dread d1/f18 [4194304,4194304] 0 2024-04-15T00:31:56.670 INFO:tasks.workunit.client.0.smithi029.stdout:8/412: write d8/da/d2f/d42/f7e [315719,79899] 0 2024-04-15T00:31:56.701 INFO:tasks.workunit.client.0.smithi029.stdout:8/413: read d8/f2b [111489,6000] 0 2024-04-15T00:31:56.804 INFO:tasks.workunit.client.0.smithi029.stdout:1/409: creat df/d32/f93 x:0 0 0 2024-04-15T00:31:56.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/414: rename d3/d2a/d4e/c5c to d3/d13/d43/d5a/d4f/c7f 0 2024-04-15T00:31:56.970 INFO:tasks.workunit.client.0.smithi029.stdout:5/420: dread d2/f7 [0,4194304] 0 2024-04-15T00:31:57.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/414: dread d8/f7c [0,4194304] 0 2024-04-15T00:31:57.060 INFO:tasks.workunit.client.0.smithi029.stdout:7/396: symlink d0/d6/d4f/d66/d26/d77/l84 0 2024-04-15T00:31:57.146 INFO:tasks.workunit.client.0.smithi029.stdout:6/413: mkdir d1/d8/db/d7b/d85 0 2024-04-15T00:31:57.229 INFO:tasks.workunit.client.0.smithi029.stdout:9/379: write d3/d6/d9/d29/d60/d64/d6d/f6b [686377,118231] 0 2024-04-15T00:31:57.250 INFO:tasks.workunit.client.0.smithi029.stdout:9/380: read d3/d6/f17 [3230396,41262] 0 2024-04-15T00:31:57.258 INFO:tasks.workunit.client.0.smithi029.stdout:0/402: write d5/d15/d1f/f3a [3812691,43693] 0 2024-04-15T00:31:57.301 INFO:tasks.workunit.client.0.smithi029.stdout:2/415: fdatasync d3/d2a/d6d/f73 0 2024-04-15T00:31:57.313 INFO:tasks.workunit.client.0.smithi029.stdout:2/416: chown d3/d13/f2f 6 1 2024-04-15T00:31:57.388 INFO:tasks.workunit.client.0.smithi029.stdout:5/421: rmdir d2/de/d13/d22/d3c 39 2024-04-15T00:31:57.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/415: truncate d8/f50 260066 0 2024-04-15T00:31:57.529 INFO:tasks.workunit.client.0.smithi029.stdout:3/399: dwrite d17/d2a/d46/f6c [0,4194304] 0 2024-04-15T00:31:57.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/410: mkdir df/d29/d41/d69/d4c/d55/d80/d94 0 2024-04-15T00:31:57.609 INFO:tasks.workunit.client.0.smithi029.stdout:6/414: mkdir d1/d8/db/d38/d86 0 2024-04-15T00:31:57.620 INFO:tasks.workunit.client.0.smithi029.stdout:7/397: read d0/f59 [981569,44459] 0 2024-04-15T00:31:57.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/411: read - df/d29/d41/d69/f44 zero size 2024-04-15T00:31:57.665 INFO:tasks.workunit.client.0.smithi029.stdout:9/381: rmdir d3/d6/d9/d29/d60/d64 39 2024-04-15T00:31:57.908 INFO:tasks.workunit.client.0.smithi029.stdout:5/422: truncate d2/de/d13/d22/d26/f35 3154786 0 2024-04-15T00:31:57.915 INFO:tasks.workunit.client.0.smithi029.stdout:8/416: creat d8/da/f88 x:0 0 0 2024-04-15T00:31:58.081 INFO:tasks.workunit.client.0.smithi029.stdout:4/396: dwrite de/f3c [0,4194304] 0 2024-04-15T00:31:58.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/398: dread - d0/d6/d4f/d5d/f6d zero size 2024-04-15T00:31:58.212 INFO:tasks.workunit.client.0.smithi029.stdout:6/415: chown d1/d8/d72/f78 14 1 2024-04-15T00:31:58.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/416: stat d1/c36 0 2024-04-15T00:31:58.235 INFO:tasks.workunit.client.0.smithi029.stdout:6/417: chown d1/d8/db/f48 12321 1 2024-04-15T00:31:58.290 INFO:tasks.workunit.client.0.smithi029.stdout:9/382: chown d3/d6/d9/d29/d60/d64/d6d/d58/d6a 22540 1 2024-04-15T00:31:58.392 INFO:tasks.workunit.client.0.smithi029.stdout:8/417: unlink d8/d4a/d78/d23/d28/d5f/l7a 0 2024-04-15T00:31:58.790 INFO:tasks.workunit.client.0.smithi029.stdout:7/399: mknod d0/d6/d4f/d66/d67/c85 0 2024-04-15T00:31:58.792 INFO:tasks.workunit.client.0.smithi029.stdout:0/403: write d5/d15/d1f/f73 [1229498,76291] 0 2024-04-15T00:31:58.935 INFO:tasks.workunit.client.0.smithi029.stdout:7/400: readlink d0/d6/d4f/d66/d26/l30 0 2024-04-15T00:31:59.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/412: creat df/d29/d41/d69/d4c/d55/d80/d94/f95 x:0 0 0 2024-04-15T00:31:59.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/417: dwrite d3/d2a/d4e/f78 [0,4194304] 0 2024-04-15T00:31:59.131 INFO:tasks.workunit.client.0.smithi029.stdout:7/401: stat d0/d6/l45 0 2024-04-15T00:31:59.140 INFO:tasks.workunit.client.0.smithi029.stdout:9/383: stat d3/f4e 0 2024-04-15T00:31:59.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/397: dread de/df/d1e/f4c [4194304,4194304] 0 2024-04-15T00:31:59.305 INFO:tasks.workunit.client.0.smithi029.stdout:0/404: rename d5/d15/d27/f6b to d5/d15/d27/d28/f82 0 2024-04-15T00:31:59.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/418: dread d3/d13/f2f [0,4194304] 0 2024-04-15T00:31:59.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/400: getdents d17/d2f/d44/d58 0 2024-04-15T00:31:59.522 INFO:tasks.workunit.client.0.smithi029.stdout:3/401: readlink d17/l57 0 2024-04-15T00:31:59.592 INFO:tasks.workunit.client.0.smithi029.stdout:1/413: chown df/d29/d41/d69/c60 107324 1 2024-04-15T00:31:59.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:59.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:31:59.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/384: fsync d3/d6/d9/d29/d60/f6e 0 2024-04-15T00:31:59.781 INFO:tasks.workunit.client.0.smithi029.stdout:9/385: dread d3/d6/d9/d29/d60/d64/d6d/d58/f32 [0,4194304] 0 2024-04-15T00:31:59.841 INFO:tasks.workunit.client.0.smithi029.stdout:2/419: mknod d3/dd/d42/c80 0 2024-04-15T00:31:59.844 INFO:tasks.workunit.client.0.smithi029.stdout:0/405: truncate d5/db/f29 5642015 0 2024-04-15T00:31:59.862 INFO:tasks.workunit.client.0.smithi029.stdout:5/423: getdents d2/de/d13/d22 0 2024-04-15T00:31:59.875 INFO:tasks.workunit.client.0.smithi029.stdout:3/402: mkdir d17/d2f/d76/d7f 0 2024-04-15T00:32:00.007 INFO:tasks.workunit.client.0.smithi029.stdout:4/398: creat de/d6d/d7e/f82 x:0 0 0 2024-04-15T00:32:00.015 INFO:tasks.workunit.client.0.smithi029.stdout:5/424: sync 2024-04-15T00:32:00.295 INFO:tasks.workunit.client.0.smithi029.stdout:3/403: mknod d17/d2a/d46/d67/c80 0 2024-04-15T00:32:00.392 INFO:tasks.workunit.client.0.smithi029.stdout:6/418: dwrite d1/d8/db/fe [0,4194304] 0 2024-04-15T00:32:00.619 INFO:tasks.workunit.client.0.smithi029.stdout:5/425: rename d2/d24 to d2/de/d13/d22/d26/d36/d4d/d70/d9a 0 2024-04-15T00:32:00.626 INFO:tasks.workunit.client.0.smithi029.stdout:9/386: symlink d3/d6/d9/d15/d7e/l80 0 2024-04-15T00:32:00.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/399: truncate de/d54/d58/f68 690377 0 2024-04-15T00:32:00.760 INFO:tasks.workunit.client.0.smithi029.stdout:6/419: creat d1/d8/d72/f87 x:0 0 0 2024-04-15T00:32:00.768 INFO:tasks.workunit.client.0.smithi029.stdout:8/418: dwrite d8/d4a/d78/f6b [0,4194304] 0 2024-04-15T00:32:00.772 INFO:tasks.workunit.client.0.smithi029.stdout:4/400: chown de/d2b/d35/c72 225 1 2024-04-15T00:32:00.836 INFO:tasks.workunit.client.0.smithi029.stdout:2/420: mkdir d3/d50/d51/d65/d81 0 2024-04-15T00:32:00.903 INFO:tasks.workunit.client.0.smithi029.stdout:6/420: write d1/d8/d72/f87 [395578,53923] 0 2024-04-15T00:32:00.925 INFO:tasks.workunit.client.0.smithi029.stdout:2/421: write d3/d13/d14/f7e [101032,124509] 0 2024-04-15T00:32:00.975 INFO:tasks.workunit.client.0.smithi029.stdout:4/401: dread de/d2b/f30 [0,4194304] 0 2024-04-15T00:32:01.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/426: write d2/de/d13/d22/d3c/d41/d6d/f94 [208700,121309] 0 2024-04-15T00:32:01.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/421: dread - d1/d1e/d56/d58/d59/f60 zero size 2024-04-15T00:32:01.913 INFO:tasks.workunit.client.0.smithi029.stdout:9/387: rename d3/lf to d3/d6/d9/l81 0 2024-04-15T00:32:01.972 INFO:tasks.workunit.client.0.smithi029.stdout:4/402: write de/df/d1e/f4c [3727472,20772] 0 2024-04-15T00:32:01.981 INFO:tasks.workunit.client.0.smithi029.stdout:1/414: dwrite df/d29/d41/d69/d4c/f75 [0,4194304] 0 2024-04-15T00:32:02.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/402: dwrite d0/d6/f6c [0,4194304] 0 2024-04-15T00:32:02.137 INFO:tasks.workunit.client.0.smithi029.stdout:0/406: dwrite d5/d15/d1f/d32/f49 [0,4194304] 0 2024-04-15T00:32:02.175 INFO:tasks.workunit.client.0.smithi029.stdout:2/422: getdents d3/dd/d2d 0 2024-04-15T00:32:02.203 INFO:tasks.workunit.client.0.smithi029.stdout:3/404: dwrite d17/d2a/f34 [0,4194304] 0 2024-04-15T00:32:02.274 INFO:tasks.workunit.client.0.smithi029.stdout:1/415: stat df/d29/d41/f45 0 2024-04-15T00:32:02.291 INFO:tasks.workunit.client.0.smithi029.stdout:7/403: sync 2024-04-15T00:32:02.317 INFO:tasks.workunit.client.0.smithi029.stdout:8/419: dwrite d8/da/d2f/f61 [0,4194304] 0 2024-04-15T00:32:02.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/407: read d5/db/f42 [153585,61682] 0 2024-04-15T00:32:02.542 INFO:tasks.workunit.client.0.smithi029.stdout:7/404: readlink d0/d6/d4f/d66/d26/l29 0 2024-04-15T00:32:02.550 INFO:tasks.workunit.client.0.smithi029.stdout:1/416: mkdir df/d29/d41/d96 0 2024-04-15T00:32:02.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/417: sync 2024-04-15T00:32:02.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/422: dwrite d1/d8/d72/f7f [0,4194304] 0 2024-04-15T00:32:02.693 INFO:tasks.workunit.client.0.smithi029.stdout:5/427: link d2/de/d13/d22/d26/d36/d4d/d70/d9a/f61 d2/de/d1f/d63/d71/f9b 0 2024-04-15T00:32:02.697 INFO:tasks.workunit.client.0.smithi029.stdout:0/408: chown d5/d15/d57 205984422 1 2024-04-15T00:32:02.825 INFO:tasks.workunit.client.0.smithi029.stdout:4/403: dread de/d2b/d35/f69 [0,4194304] 0 2024-04-15T00:32:02.956 INFO:tasks.workunit.client.0.smithi029.stdout:3/405: dwrite f1 [0,4194304] 0 2024-04-15T00:32:03.037 INFO:tasks.workunit.client.0.smithi029.stdout:9/388: dwrite d3/d6/d9/f49 [0,4194304] 0 2024-04-15T00:32:03.047 INFO:tasks.workunit.client.0.smithi029.stdout:2/423: dwrite d3/dd/d2d/f7d [0,4194304] 0 2024-04-15T00:32:03.338 INFO:tasks.workunit.client.0.smithi029.stdout:8/420: truncate d8/d4a/d78/d23/d28/f44 968713 0 2024-04-15T00:32:03.341 INFO:tasks.workunit.client.0.smithi029.stdout:7/405: mknod d0/d6/d4f/d66/d26/d54/c86 0 2024-04-15T00:32:03.350 INFO:tasks.workunit.client.0.smithi029.stdout:1/418: truncate df/f28 234057 0 2024-04-15T00:32:03.375 INFO:tasks.workunit.client.0.smithi029.stdout:1/419: chown df/c1d 48295725 1 2024-04-15T00:32:03.379 INFO:tasks.workunit.client.0.smithi029.stdout:7/406: chown d0/d6/d1c/c1e 631296 1 2024-04-15T00:32:03.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/424: truncate d3/d2a/d4e/f64 1352171 0 2024-04-15T00:32:03.618 INFO:tasks.workunit.client.0.smithi029.stdout:0/409: symlink d5/db/l83 0 2024-04-15T00:32:03.625 INFO:tasks.workunit.client.0.smithi029.stdout:6/423: creat d1/d8/db/d38/d86/f88 x:0 0 0 2024-04-15T00:32:03.643 INFO:tasks.workunit.client.0.smithi029.stdout:0/410: chown d5/d15/d27/f2a 38334 1 2024-04-15T00:32:03.809 INFO:tasks.workunit.client.0.smithi029.stdout:7/407: mkdir d0/d6/d4f/d5d/d87 0 2024-04-15T00:32:03.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/420: dread df/d32/f3b [0,4194304] 0 2024-04-15T00:32:04.120 INFO:tasks.workunit.client.0.smithi029.stdout:5/428: creat d2/de/d13/d22/d26/d36/d4d/d78/f9c x:0 0 0 2024-04-15T00:32:04.129 INFO:tasks.workunit.client.0.smithi029.stdout:9/389: creat d3/d6/d9/d29/d60/d7f/f82 x:0 0 0 2024-04-15T00:32:04.150 INFO:tasks.workunit.client.0.smithi029.stdout:5/429: stat d2/de/d1f/d63 0 2024-04-15T00:32:04.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/411: creat d5/d4c/f84 x:0 0 0 2024-04-15T00:32:04.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/421: truncate d8/f50 1096386 0 2024-04-15T00:32:04.311 INFO:tasks.workunit.client.0.smithi029.stdout:7/408: creat d0/d6/d4f/d66/d67/f88 x:0 0 0 2024-04-15T00:32:04.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/421: unlink df/d32/d7c/l8a 0 2024-04-15T00:32:04.569 INFO:tasks.workunit.client.0.smithi029.stdout:5/430: symlink d2/de/d13/d22/d3c/d41/l9d 0 2024-04-15T00:32:04.584 INFO:tasks.workunit.client.0.smithi029.stdout:5/431: dread - d2/de/d13/d22/d26/f6f zero size 2024-04-15T00:32:04.771 INFO:tasks.workunit.client.0.smithi029.stdout:6/424: creat d1/d1e/d56/f89 x:0 0 0 2024-04-15T00:32:04.874 INFO:tasks.workunit.client.0.smithi029.stdout:1/422: symlink df/d29/d41/d69/d78/l97 0 2024-04-15T00:32:04.943 INFO:tasks.workunit.client.0.smithi029.stdout:7/409: mkdir d0/d6/d4f/d66/d26/d77/d89 0 2024-04-15T00:32:04.959 INFO:tasks.workunit.client.0.smithi029.stdout:9/390: creat d3/d6/d9/d29/d60/d57/f83 x:0 0 0 2024-04-15T00:32:05.073 INFO:tasks.workunit.client.0.smithi029.stdout:2/425: getdents d3 0 2024-04-15T00:32:05.140 INFO:tasks.workunit.client.0.smithi029.stdout:4/404: dwrite de/d2b/f2c [0,4194304] 0 2024-04-15T00:32:05.272 INFO:tasks.workunit.client.0.smithi029.stdout:3/406: dwrite d17/d2a/f2c [0,4194304] 0 2024-04-15T00:32:05.330 INFO:tasks.workunit.client.0.smithi029.stdout:1/423: chown df/d29/f2c 1000783 1 2024-04-15T00:32:05.765 INFO:tasks.workunit.client.0.smithi029.stdout:8/422: write d8/da/d2f/d66/f84 [436275,8085] 0 2024-04-15T00:32:05.772 INFO:tasks.workunit.client.0.smithi029.stdout:0/412: write d5/d15/d1f/f63 [3669595,14546] 0 2024-04-15T00:32:05.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/423: chown d8/da/d2f/d66/f67 13 1 2024-04-15T00:32:05.822 INFO:tasks.workunit.client.0.smithi029.stdout:5/432: truncate d2/de/d1f/d63/d71/f9b 2343176 0 2024-04-15T00:32:06.007 INFO:tasks.workunit.client.0.smithi029.stdout:3/407: dread fa [0,4194304] 0 2024-04-15T00:32:06.045 INFO:tasks.workunit.client.0.smithi029.stdout:9/391: write d3/d6/d9/f50 [71754,30940] 0 2024-04-15T00:32:06.075 INFO:tasks.workunit.client.0.smithi029.stdout:3/408: dread - d17/f4d zero size 2024-04-15T00:32:06.114 INFO:tasks.workunit.client.0.smithi029.stdout:7/410: dwrite d0/f4e [0,4194304] 0 2024-04-15T00:32:06.179 INFO:tasks.workunit.client.0.smithi029.stdout:2/426: mknod d3/d2a/c82 0 2024-04-15T00:32:06.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/409: chown d17/d2a/d46 103381288 1 2024-04-15T00:32:06.197 INFO:tasks.workunit.client.0.smithi029.stdout:9/392: readlink d3/d6/d9/d15/d7e/l80 0 2024-04-15T00:32:06.224 INFO:tasks.workunit.client.0.smithi029.stdout:8/424: chown d8/da/d3d/c58 2 1 2024-04-15T00:32:06.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/433: mkdir d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e 0 2024-04-15T00:32:06.329 INFO:tasks.workunit.client.0.smithi029.stdout:1/424: write df/f3e [351709,78594] 0 2024-04-15T00:32:06.329 INFO:tasks.workunit.client.0.smithi029.stdout:9/393: readlink d3/d6/d9/d29/l4f 0 2024-04-15T00:32:06.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/413: dread d5/db/f37 [0,4194304] 0 2024-04-15T00:32:06.454 INFO:tasks.workunit.client.0.smithi029.stdout:9/394: rename d3/d6/d9/d15/d4a/d53 to d3/d6/d9/d15/d4a/d53/d84 22 2024-04-15T00:32:06.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/425: getdents d1/d8/db/d38/d86 0 2024-04-15T00:32:06.527 INFO:tasks.workunit.client.0.smithi029.stdout:9/395: dread d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:32:06.792 INFO:tasks.workunit.client.0.smithi029.stdout:3/410: creat d17/d2f/d44/d58/d5c/f81 x:0 0 0 2024-04-15T00:32:06.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/434: creat d2/de/d13/d22/d3c/f9f x:0 0 0 2024-04-15T00:32:06.832 INFO:tasks.workunit.client.0.smithi029.stdout:6/426: creat d1/d8/db/d38/f8a x:0 0 0 2024-04-15T00:32:06.864 INFO:tasks.workunit.client.0.smithi029.stdout:3/411: chown d17/c18 26054 1 2024-04-15T00:32:06.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/435: stat d2/de/d1f/d63/d71 0 2024-04-15T00:32:06.972 INFO:tasks.workunit.client.0.smithi029.stdout:7/411: creat d0/d6/d4f/d66/d26/d77/d89/f8a x:0 0 0 2024-04-15T00:32:07.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/414: creat d5/db/d1a/d65/d76/f85 x:0 0 0 2024-04-15T00:32:07.051 INFO:tasks.workunit.client.0.smithi029.stdout:0/415: chown d5/d15/d27/d51/d7d 46299187 1 2024-04-15T00:32:07.082 INFO:tasks.workunit.client.0.smithi029.stdout:4/405: link de/d2b/d59/l67 de/d54/d71/l83 0 2024-04-15T00:32:07.298 INFO:tasks.workunit.client.0.smithi029.stdout:2/427: creat d3/d13/f83 x:0 0 0 2024-04-15T00:32:07.300 INFO:tasks.workunit.client.0.smithi029.stdout:6/427: fsync d1/d1e/f49 0 2024-04-15T00:32:07.363 INFO:tasks.workunit.client.0.smithi029.stdout:1/425: truncate df/d29/d41/d69/f4a 1560490 0 2024-04-15T00:32:07.387 INFO:tasks.workunit.client.0.smithi029.stdout:3/412: creat d17/d2a/d33/f82 x:0 0 0 2024-04-15T00:32:07.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/413: readlink lc 0 2024-04-15T00:32:07.407 INFO:tasks.workunit.client.0.smithi029.stdout:8/425: dwrite d8/d4a/d78/d23/f59 [0,4194304] 0 2024-04-15T00:32:07.574 INFO:tasks.workunit.client.0.smithi029.stdout:1/426: sync 2024-04-15T00:32:07.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/396: write d3/d6/d9/d29/d60/d64/d6d/d58/f28 [306168,8946] 0 2024-04-15T00:32:07.790 INFO:tasks.workunit.client.0.smithi029.stdout:2/428: symlink d3/d50/d51/d65/l84 0 2024-04-15T00:32:07.841 INFO:tasks.workunit.client.0.smithi029.stdout:9/397: dread d3/d6/d9/f50 [0,4194304] 0 2024-04-15T00:32:07.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/398: sync 2024-04-15T00:32:08.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/426: dread d8/d4a/d78/f1c [0,4194304] 0 2024-04-15T00:32:08.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/416: fsync d5/d4c/f5a 0 2024-04-15T00:32:08.409 INFO:tasks.workunit.client.0.smithi029.stdout:5/436: write d2/de/d13/f2f [1754580,122786] 0 2024-04-15T00:32:08.457 INFO:tasks.workunit.client.0.smithi029.stdout:9/399: fdatasync d3/d6/f13 0 2024-04-15T00:32:08.594 INFO:tasks.workunit.client.0.smithi029.stdout:4/406: dwrite de/d2b/f21 [0,4194304] 0 2024-04-15T00:32:08.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/412: dwrite d0/f36 [0,4194304] 0 2024-04-15T00:32:08.730 INFO:tasks.workunit.client.0.smithi029.stdout:8/427: fsync d8/da/d2f/d42/f7e 0 2024-04-15T00:32:08.754 INFO:tasks.workunit.client.0.smithi029.stdout:4/407: chown de/df/l78 22627 1 2024-04-15T00:32:08.924 INFO:tasks.workunit.client.0.smithi029.stdout:1/427: dread df/d29/d41/d69/f4a [0,4194304] 0 2024-04-15T00:32:08.962 INFO:tasks.workunit.client.0.smithi029.stdout:0/417: dread d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:32:09.078 INFO:tasks.workunit.client.0.smithi029.stdout:5/437: symlink d2/de/d13/d22/d3c/d41/la0 0 2024-04-15T00:32:09.093 INFO:tasks.workunit.client.0.smithi029.stdout:5/438: chown d2/de/d13/d22/d3c/d41/c4f 1787656 1 2024-04-15T00:32:09.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/414: rename d17/d2a/d4c/d51 to d17/d83 0 2024-04-15T00:32:09.388 INFO:tasks.workunit.client.0.smithi029.stdout:4/408: creat de/d54/d71/f84 x:0 0 0 2024-04-15T00:32:09.418 INFO:tasks.workunit.client.0.smithi029.stdout:6/428: getdents d1/d1e 0 2024-04-15T00:32:09.523 INFO:tasks.workunit.client.0.smithi029.stdout:2/429: write d3/f79 [789652,33493] 0 2024-04-15T00:32:09.616 INFO:tasks.workunit.client.0.smithi029.stdout:7/413: mknod d0/d6/d39/d3c/d5b/d7e/c8b 0 2024-04-15T00:32:09.781 INFO:tasks.workunit.client.0.smithi029.stdout:4/409: symlink de/d2b/d35/l85 0 2024-04-15T00:32:10.007 INFO:tasks.workunit.client.0.smithi029.stdout:2/430: truncate d3/dd/d2d/f34 516597 0 2024-04-15T00:32:10.014 INFO:tasks.workunit.client.0.smithi029.stdout:9/400: mknod d3/d6/d9/c85 0 2024-04-15T00:32:10.118 INFO:tasks.workunit.client.0.smithi029.stdout:3/415: mkdir d17/d2f/d84 0 2024-04-15T00:32:10.127 INFO:tasks.workunit.client.0.smithi029.stdout:3/416: chown d17/d2a/d46/f6c 3242 1 2024-04-15T00:32:10.193 INFO:tasks.workunit.client.0.smithi029.stdout:5/439: creat d2/de/d1f/fa1 x:0 0 0 2024-04-15T00:32:10.247 INFO:tasks.workunit.client.0.smithi029.stdout:4/410: creat de/d2b/d59/f86 x:0 0 0 2024-04-15T00:32:10.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/428: write d8/f2c [2314435,22522] 0 2024-04-15T00:32:10.424 INFO:tasks.workunit.client.0.smithi029.stdout:1/428: write df/f13 [1806820,67284] 0 2024-04-15T00:32:10.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/414: creat d0/d6/d4f/d5d/d87/f8c x:0 0 0 2024-04-15T00:32:10.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/417: mkdir d17/d2f/d44/d58/d5c/d5f/d85 0 2024-04-15T00:32:10.481 INFO:tasks.workunit.client.0.smithi029.stdout:3/418: chown fa 22681978 1 2024-04-15T00:32:10.505 INFO:tasks.workunit.client.0.smithi029.stdout:8/429: readlink d8/d4a/d78/d23/d28/d30/d39/l5e 0 2024-04-15T00:32:10.512 INFO:tasks.workunit.client.0.smithi029.stdout:3/419: chown d17/d2a/d33/c7c 3 1 2024-04-15T00:32:10.603 INFO:tasks.workunit.client.0.smithi029.stdout:0/418: write d5/d3e/f69 [2362217,18440] 0 2024-04-15T00:32:10.621 INFO:tasks.workunit.client.0.smithi029.stdout:0/419: fsync d5/d15/d1f/f63 0 2024-04-15T00:32:10.771 INFO:tasks.workunit.client.0.smithi029.stdout:6/429: rename d1/d1e/d22/f34 to d1/f8b 0 2024-04-15T00:32:10.776 INFO:tasks.workunit.client.0.smithi029.stdout:2/431: mkdir d3/dd/d2d/d61/d85 0 2024-04-15T00:32:11.037 INFO:tasks.workunit.client.0.smithi029.stdout:4/411: truncate de/df/d1e/f24 1207018 0 2024-04-15T00:32:11.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/430: dread d8/da/d2f/f61 [0,4194304] 0 2024-04-15T00:32:11.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/420: rename d5/d4c/f5a to d5/d15/d27/d51/d77/f86 0 2024-04-15T00:32:11.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/421: chown d5/d15/d27 2368 1 2024-04-15T00:32:11.311 INFO:tasks.workunit.client.0.smithi029.stdout:6/430: truncate d1/d8/f5e 559394 0 2024-04-15T00:32:11.388 INFO:tasks.workunit.client.0.smithi029.stdout:6/431: stat d1/d8/db/fe 0 2024-04-15T00:32:11.391 INFO:tasks.workunit.client.0.smithi029.stdout:5/440: dwrite d2/d1a/f2c [4194304,4194304] 0 2024-04-15T00:32:11.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/431: creat d8/d4a/d78/f89 x:0 0 0 2024-04-15T00:32:11.541 INFO:tasks.workunit.client.0.smithi029.stdout:4/412: rename de/d2b/f47 to de/d54/d71/f87 0 2024-04-15T00:32:11.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/422: mkdir d5/db/d1a/d65/d87 0 2024-04-15T00:32:11.668 INFO:tasks.workunit.client.0.smithi029.stdout:0/423: readlink d5/db/d1a/l41 0 2024-04-15T00:32:11.676 INFO:tasks.workunit.client.0.smithi029.stdout:0/424: stat d5/d15/d57/d5e/f71 0 2024-04-15T00:32:11.695 INFO:tasks.workunit.client.0.smithi029.stdout:9/401: link d3/d6/l38 d3/d6/l86 0 2024-04-15T00:32:11.748 INFO:tasks.workunit.client.0.smithi029.stdout:7/415: write d0/d6/f2c [252951,76033] 0 2024-04-15T00:32:11.791 INFO:tasks.workunit.client.0.smithi029.stdout:1/429: dwrite df/f30 [0,4194304] 0 2024-04-15T00:32:11.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/432: creat d1/d8/f8c x:0 0 0 2024-04-15T00:32:11.870 INFO:tasks.workunit.client.0.smithi029.stdout:5/441: truncate d2/d1a/f59 3502018 0 2024-04-15T00:32:11.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/420: write d17/d2a/f6a [398416,102265] 0 2024-04-15T00:32:11.944 INFO:tasks.workunit.client.0.smithi029.stdout:6/433: dread d1/f18 [4194304,4194304] 0 2024-04-15T00:32:11.953 INFO:tasks.workunit.client.0.smithi029.stdout:4/413: rmdir de 39 2024-04-15T00:32:11.960 INFO:tasks.workunit.client.0.smithi029.stdout:8/432: dread - d8/d4a/d78/d23/d28/f62 zero size 2024-04-15T00:32:11.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/432: link d3/d13/c29 d3/dd/d2d/c86 0 2024-04-15T00:32:11.989 INFO:tasks.workunit.client.0.smithi029.stdout:8/433: chown d8/da/l46 0 1 2024-04-15T00:32:12.002 INFO:tasks.workunit.client.0.smithi029.stdout:8/434: read d8/da/f14 [612100,103598] 0 2024-04-15T00:32:12.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/430: unlink df/l57 0 2024-04-15T00:32:12.250 INFO:tasks.workunit.client.0.smithi029.stdout:1/431: sync 2024-04-15T00:32:12.260 INFO:tasks.workunit.client.0.smithi029.stdout:2/433: mknod d3/c87 0 2024-04-15T00:32:12.280 INFO:tasks.workunit.client.0.smithi029.stdout:4/414: readlink de/df/d1e/l37 0 2024-04-15T00:32:12.416 INFO:tasks.workunit.client.0.smithi029.stdout:9/402: creat d3/d6/f87 x:0 0 0 2024-04-15T00:32:12.650 INFO:tasks.workunit.client.0.smithi029.stdout:4/415: fdatasync de/d2b/d59/f76 0 2024-04-15T00:32:12.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/416: chown de/d2b/d59/c66 78 1 2024-04-15T00:32:13.021 INFO:tasks.workunit.client.0.smithi029.stdout:7/416: write d0/d6/d4f/d66/d26/f80 [353907,96459] 0 2024-04-15T00:32:13.134 INFO:tasks.workunit.client.0.smithi029.stdout:0/425: getdents d5/d54 0 2024-04-15T00:32:13.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/421: write d17/d83/f65 [795645,96672] 0 2024-04-15T00:32:13.145 INFO:tasks.workunit.client.0.smithi029.stdout:5/442: write d2/de/d13/d22/d26/d36/d4d/f51 [1471664,82247] 0 2024-04-15T00:32:13.255 INFO:tasks.workunit.client.0.smithi029.stdout:9/403: fsync d3/d6/f17 0 2024-04-15T00:32:13.292 INFO:tasks.workunit.client.0.smithi029.stdout:6/434: creat d1/d1e/d56/d58/f8d x:0 0 0 2024-04-15T00:32:13.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/435: write d8/da/f49 [249584,45398] 0 2024-04-15T00:32:13.361 INFO:tasks.workunit.client.0.smithi029.stdout:8/436: dread - d8/d4a/d78/d23/d28/f62 zero size 2024-04-15T00:32:13.391 INFO:tasks.workunit.client.0.smithi029.stdout:1/432: mknod df/c98 0 2024-04-15T00:32:13.404 INFO:tasks.workunit.client.0.smithi029.stdout:1/433: chown df/d29/d41/d69/d4c 2390739 1 2024-04-15T00:32:13.411 INFO:tasks.workunit.client.0.smithi029.stdout:4/417: truncate de/df/d1e/f28 75529 0 2024-04-15T00:32:13.636 INFO:tasks.workunit.client.0.smithi029.stdout:7/417: mkdir d0/d6/d4f/d5d/d8d 0 2024-04-15T00:32:13.876 INFO:tasks.workunit.client.0.smithi029.stdout:9/404: unlink d3/d6/d9/d29/d60/d57/c5f 0 2024-04-15T00:32:13.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/435: unlink d1/d1e/d56/d58/d59/l6c 0 2024-04-15T00:32:14.069 INFO:tasks.workunit.client.0.smithi029.stdout:1/434: dread - df/d29/d41/d4f/f87 zero size 2024-04-15T00:32:14.136 INFO:tasks.workunit.client.0.smithi029.stdout:4/418: rename de/df/d1e/l26 to de/df/d1e/d56/l88 0 2024-04-15T00:32:14.364 INFO:tasks.workunit.client.0.smithi029.stdout:6/436: fsync d1/d8/f3d 0 2024-04-15T00:32:14.400 INFO:tasks.workunit.client.0.smithi029.stdout:2/434: truncate d3/dd/f27 78820 0 2024-04-15T00:32:14.452 INFO:tasks.workunit.client.0.smithi029.stdout:9/405: rmdir d3/d6/d9/d15/d4a 39 2024-04-15T00:32:14.495 INFO:tasks.workunit.client.0.smithi029.stdout:8/437: mkdir d8/da/d3d/d8a 0 2024-04-15T00:32:14.908 INFO:tasks.workunit.client.0.smithi029.stdout:9/406: read d3/d6/d9/fd [905829,60015] 0 2024-04-15T00:32:14.987 INFO:tasks.workunit.client.0.smithi029.stdout:3/422: write d17/d83/f6d [1103510,16912] 0 2024-04-15T00:32:15.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/443: dwrite d2/de/d13/d22/d26/d36/f53 [0,4194304] 0 2024-04-15T00:32:15.235 INFO:tasks.workunit.client.0.smithi029.stdout:8/438: symlink d8/d4a/d78/d23/d28/d30/d39/d77/d82/l8b 0 2024-04-15T00:32:15.414 INFO:tasks.workunit.client.0.smithi029.stdout:6/437: rmdir d1/d8/d79/d81 0 2024-04-15T00:32:15.505 INFO:tasks.workunit.client.0.smithi029.stdout:8/439: chown d8/d4a/d78/d23/d28/d30/c45 40351 1 2024-04-15T00:32:15.560 INFO:tasks.workunit.client.0.smithi029.stdout:3/423: creat d17/d2f/d84/f86 x:0 0 0 2024-04-15T00:32:15.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/419: getdents de/d2b/d59 0 2024-04-15T00:32:15.679 INFO:tasks.workunit.client.0.smithi029.stdout:0/426: write d5/d15/f1c [521996,109882] 0 2024-04-15T00:32:15.763 INFO:tasks.workunit.client.0.smithi029.stdout:5/444: mknod d2/de/d1f/ca2 0 2024-04-15T00:32:15.805 INFO:tasks.workunit.client.0.smithi029.stdout:3/424: creat d17/d2f/d44/f87 x:0 0 0 2024-04-15T00:32:15.911 INFO:tasks.workunit.client.0.smithi029.stdout:7/418: dwrite d0/d6/d39/d3c/f55 [0,4194304] 0 2024-04-15T00:32:15.911 INFO:tasks.workunit.client.0.smithi029.stdout:0/427: read d5/d15/d1f/d32/f43 [230631,124896] 0 2024-04-15T00:32:15.913 INFO:tasks.workunit.client.0.smithi029.stdout:6/438: getdents d1/d8/db/d38/d6f 0 2024-04-15T00:32:16.117 INFO:tasks.workunit.client.0.smithi029.stdout:0/428: dread d5/db/f42 [0,4194304] 0 2024-04-15T00:32:16.159 INFO:tasks.workunit.client.0.smithi029.stdout:8/440: getdents d8/da/d2f 0 2024-04-15T00:32:16.211 INFO:tasks.workunit.client.0.smithi029.stdout:1/435: dwrite df/d29/d41/d69/d4c/d55/f5e [0,4194304] 0 2024-04-15T00:32:16.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/439: truncate d1/d1e/d56/f76 409894 0 2024-04-15T00:32:16.401 INFO:tasks.workunit.client.0.smithi029.stdout:8/441: dread d8/da/f14 [0,4194304] 0 2024-04-15T00:32:16.445 INFO:tasks.workunit.client.0.smithi029.stdout:0/429: dread d5/f62 [0,4194304] 0 2024-04-15T00:32:16.556 INFO:tasks.workunit.client.0.smithi029.stdout:5/445: write d2/de/d1f/d63/d65/f86 [2831017,7885] 0 2024-04-15T00:32:16.948 INFO:tasks.workunit.client.0.smithi029.stdout:1/436: write df/f24 [3802850,45638] 0 2024-04-15T00:32:16.960 INFO:tasks.workunit.client.0.smithi029.stdout:8/442: rename d8/d4a/d78/d23/d28/f62 to d8/da/d2f/d42/f8c 0 2024-04-15T00:32:17.076 INFO:tasks.workunit.client.0.smithi029.stdout:2/435: dwrite d3/dd/f27 [0,4194304] 0 2024-04-15T00:32:17.138 INFO:tasks.workunit.client.0.smithi029.stdout:9/407: dwrite d3/d6/d9/d29/d5d/f36 [0,4194304] 0 2024-04-15T00:32:17.159 INFO:tasks.workunit.client.0.smithi029.stdout:0/430: mknod d5/db/c88 0 2024-04-15T00:32:17.222 INFO:tasks.workunit.client.0.smithi029.stdout:4/420: dwrite f8 [4194304,4194304] 0 2024-04-15T00:32:17.222 INFO:tasks.workunit.client.0.smithi029.stdout:3/425: dwrite d17/d2a/d33/f63 [0,4194304] 0 2024-04-15T00:32:17.368 INFO:tasks.workunit.client.0.smithi029.stdout:7/419: dwrite d0/d6/f18 [0,4194304] 0 2024-04-15T00:32:17.374 INFO:tasks.workunit.client.0.smithi029.stdout:1/437: fdatasync df/f19 0 2024-04-15T00:32:17.391 INFO:tasks.workunit.client.0.smithi029.stdout:5/446: dread d2/de/d13/d22/f5e [0,4194304] 0 2024-04-15T00:32:17.485 INFO:tasks.workunit.client.0.smithi029.stdout:2/436: fsync d3/dd/f31 0 2024-04-15T00:32:17.561 INFO:tasks.workunit.client.0.smithi029.stdout:0/431: rmdir d5/d15/d57 39 2024-04-15T00:32:17.620 INFO:tasks.workunit.client.0.smithi029.stdout:6/440: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:32:17.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/447: readlink d2/de/d13/d22/d26/l3d 0 2024-04-15T00:32:17.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/437: dread - d3/dd/f35 zero size 2024-04-15T00:32:17.683 INFO:tasks.workunit.client.0.smithi029.stdout:9/408: mkdir d3/d88 0 2024-04-15T00:32:17.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/443: dread d8/da/d3d/f6c [0,4194304] 0 2024-04-15T00:32:17.803 INFO:tasks.workunit.client.0.smithi029.stdout:8/444: chown d8/d4a/d78/d23/d28/d30/c32 7111 1 2024-04-15T00:32:17.977 INFO:tasks.workunit.client.0.smithi029.stdout:1/438: symlink df/d29/d41/d69/d4c/l99 0 2024-04-15T00:32:17.984 INFO:tasks.workunit.client.0.smithi029.stdout:0/432: dread - d5/d4c/d4e/f80 zero size 2024-04-15T00:32:18.121 INFO:tasks.workunit.client.0.smithi029.stdout:2/438: dread d3/dd/f31 [0,4194304] 0 2024-04-15T00:32:18.235 INFO:tasks.workunit.client.0.smithi029.stdout:5/448: mknod d2/de/d13/d22/d26/ca3 0 2024-04-15T00:32:18.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/445: dread d8/d4a/d78/d23/d28/f44 [0,4194304] 0 2024-04-15T00:32:18.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/421: dwrite de/d54/f81 [0,4194304] 0 2024-04-15T00:32:18.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/420: write d0/d6/d1c/f57 [4070228,42836] 0 2024-04-15T00:32:18.746 INFO:tasks.workunit.client.0.smithi029.stdout:6/441: symlink d1/d8/db/d7b/d85/l8e 0 2024-04-15T00:32:18.819 INFO:tasks.workunit.client.0.smithi029.stdout:3/426: rmdir d17/d2f/d44/d58/d5c/d5f/d85 0 2024-04-15T00:32:19.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/422: mknod de/d54/d58/c89 0 2024-04-15T00:32:19.555 INFO:tasks.workunit.client.0.smithi029.stdout:6/442: dread d1/d8/db/f50 [0,4194304] 0 2024-04-15T00:32:19.568 INFO:tasks.workunit.client.0.smithi029.stdout:6/443: chown d1/d8/db/d38/c3c 134517 1 2024-04-15T00:32:19.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/433: link d5/d3e/f69 d5/d3e/f89 0 2024-04-15T00:32:19.740 INFO:tasks.workunit.client.0.smithi029.stdout:9/409: creat d3/d6/d9/d29/d60/d64/d6d/f89 x:0 0 0 2024-04-15T00:32:19.740 INFO:tasks.workunit.client.0.smithi029.stdout:4/423: rmdir de/d6d/d7e 39 2024-04-15T00:32:19.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/410: dread - d3/d6/d9/d29/d60/d64/d6d/f89 zero size 2024-04-15T00:32:19.910 INFO:tasks.workunit.client.0.smithi029.stdout:3/427: dread d17/d2f/d3c/f3f [0,4194304] 0 2024-04-15T00:32:19.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/446: write d8/d4a/d78/d23/d28/d30/d39/f4b [1484842,35204] 0 2024-04-15T00:32:19.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/444: fsync d1/d1e/d56/f89 0 2024-04-15T00:32:20.111 INFO:tasks.workunit.client.0.smithi029.stdout:4/424: mkdir de/d54/d58/d8a 0 2024-04-15T00:32:20.222 INFO:tasks.workunit.client.0.smithi029.stdout:5/449: link d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/c73 d2/ca4 0 2024-04-15T00:32:20.225 INFO:tasks.workunit.client.0.smithi029.stdout:3/428: sync 2024-04-15T00:32:20.281 INFO:tasks.workunit.client.0.smithi029.stdout:1/439: dwrite df/d29/d41/f47 [0,4194304] 0 2024-04-15T00:32:20.356 INFO:tasks.workunit.client.0.smithi029.stdout:2/439: dwrite d3/d13/f62 [0,4194304] 0 2024-04-15T00:32:20.464 INFO:tasks.workunit.client.0.smithi029.stdout:7/421: dwrite d0/d6/d4f/f5c [0,4194304] 0 2024-04-15T00:32:20.536 INFO:tasks.workunit.client.0.smithi029.stdout:0/434: write d5/d15/d1f/f63 [2673888,22784] 0 2024-04-15T00:32:20.551 INFO:tasks.workunit.client.0.smithi029.stdout:6/445: creat d1/d8/db/d7b/d85/f8f x:0 0 0 2024-04-15T00:32:20.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/447: creat d8/da/d3d/d8a/f8d x:0 0 0 2024-04-15T00:32:20.598 INFO:tasks.workunit.client.0.smithi029.stdout:4/425: rmdir de/d54/d58 39 2024-04-15T00:32:20.608 INFO:tasks.workunit.client.0.smithi029.stdout:9/411: dread d3/d6/f17 [0,4194304] 0 2024-04-15T00:32:20.640 INFO:tasks.workunit.client.0.smithi029.stdout:5/450: chown d2/de/d13/d22/d3c/d41/d6d/f87 2566 1 2024-04-15T00:32:20.643 INFO:tasks.workunit.client.0.smithi029.stdout:1/440: chown df/d29/d41/d69/d4c/f75 27 1 2024-04-15T00:32:20.717 INFO:tasks.workunit.client.0.smithi029.stdout:9/412: sync 2024-04-15T00:32:20.768 INFO:tasks.workunit.client.0.smithi029.stdout:3/429: symlink d17/d2a/l88 0 2024-04-15T00:32:20.813 INFO:tasks.workunit.client.0.smithi029.stdout:0/435: chown d5/d3e/c6f 1485 1 2024-04-15T00:32:20.828 INFO:tasks.workunit.client.0.smithi029.stdout:0/436: read d5/d15/d1f/d32/f43 [427852,24500] 0 2024-04-15T00:32:21.007 INFO:tasks.workunit.client.0.smithi029.stdout:2/440: mknod d3/d50/c88 0 2024-04-15T00:32:21.014 INFO:tasks.workunit.client.0.smithi029.stdout:8/448: unlink d8/f50 0 2024-04-15T00:32:21.031 INFO:tasks.workunit.client.0.smithi029.stdout:3/430: fsync d17/d2a/d33/f82 0 2024-04-15T00:32:21.035 INFO:tasks.workunit.client.0.smithi029.stdout:0/437: mkdir d5/d4c/d8a 0 2024-04-15T00:32:21.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/431: readlink d17/l57 0 2024-04-15T00:32:21.420 INFO:tasks.workunit.client.0.smithi029.stdout:7/422: write d0/d6/d4f/d66/d67/f73 [1055805,58224] 0 2024-04-15T00:32:21.433 INFO:tasks.workunit.client.0.smithi029.stdout:8/449: creat d8/da/d3d/d8a/f8e x:0 0 0 2024-04-15T00:32:21.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/432: rename c11 to d17/d2f/d84/c89 0 2024-04-15T00:32:21.455 INFO:tasks.workunit.client.0.smithi029.stdout:6/446: write d1/d8/d72/f78 [1419639,49004] 0 2024-04-15T00:32:21.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/426: write de/df/d1e/d56/f80 [645331,22578] 0 2024-04-15T00:32:21.537 INFO:tasks.workunit.client.0.smithi029.stdout:9/413: creat d3/f8a x:0 0 0 2024-04-15T00:32:21.567 INFO:tasks.workunit.client.0.smithi029.stdout:1/441: getdents df/d29/d41 0 2024-04-15T00:32:21.601 INFO:tasks.workunit.client.0.smithi029.stdout:0/438: mknod d5/d15/d57/d5e/c8b 0 2024-04-15T00:32:21.653 INFO:tasks.workunit.client.0.smithi029.stdout:3/433: chown d17/d2a/d33/f56 2373194 1 2024-04-15T00:32:21.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/414: chown d3/d6/d9/d29/d5d/l77 5369 1 2024-04-15T00:32:21.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/451: dwrite d2/de/d13/d22/d26/d36/f37 [0,4194304] 0 2024-04-15T00:32:21.834 INFO:tasks.workunit.client.0.smithi029.stdout:8/450: rmdir d8/da/d2f/d6e/d5a 39 2024-04-15T00:32:21.835 INFO:tasks.workunit.client.0.smithi029.stdout:4/427: fsync de/f74 0 2024-04-15T00:32:22.055 INFO:tasks.workunit.client.0.smithi029.stdout:7/423: mkdir d0/d6/d39/d3c/d42/d49/d71/d8e 0 2024-04-15T00:32:22.067 INFO:tasks.workunit.client.0.smithi029.stdout:3/434: fsync d17/d2a/d33/d37/f41 0 2024-04-15T00:32:22.079 INFO:tasks.workunit.client.0.smithi029.stdout:9/415: readlink d3/d6/l38 0 2024-04-15T00:32:22.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/441: truncate d3/dd/f27 2357944 0 2024-04-15T00:32:22.234 INFO:tasks.workunit.client.0.smithi029.stdout:2/442: chown d3/d50/d51/c77 852793156 1 2024-04-15T00:32:22.255 INFO:tasks.workunit.client.0.smithi029.stdout:0/439: dread d5/d15/d1f/d32/f3d [0,4194304] 0 2024-04-15T00:32:22.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/428: mkdir de/d54/d71/d8b 0 2024-04-15T00:32:22.272 INFO:tasks.workunit.client.0.smithi029.stdout:8/451: creat d8/d4a/d78/d23/d28/d5f/f8f x:0 0 0 2024-04-15T00:32:22.365 INFO:tasks.workunit.client.0.smithi029.stdout:5/452: mkdir d2/da5 0 2024-04-15T00:32:22.428 INFO:tasks.workunit.client.0.smithi029.stdout:1/442: rename df/d29/d41/d69/d4c/d55/l82 to df/d29/d41/d69/d4c/d55/d80/l9a 0 2024-04-15T00:32:22.570 INFO:tasks.workunit.client.0.smithi029.stdout:3/435: readlink d17/l2d 0 2024-04-15T00:32:22.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/424: fdatasync d0/d6/d4f/d66/d26/f28 0 2024-04-15T00:32:22.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/443: unlink d3/d13/d14/l17 0 2024-04-15T00:32:22.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/425: readlink d0/d6/d4f/d5d/l83 0 2024-04-15T00:32:22.709 INFO:tasks.workunit.client.0.smithi029.stdout:3/436: sync 2024-04-15T00:32:22.730 INFO:tasks.workunit.client.0.smithi029.stdout:6/447: dwrite d1/d1e/d56/d58/d59/f60 [0,4194304] 0 2024-04-15T00:32:22.794 INFO:tasks.workunit.client.0.smithi029.stdout:6/448: sync 2024-04-15T00:32:22.795 INFO:tasks.workunit.client.0.smithi029.stdout:4/429: chown de/df/d1e/f24 54865 1 2024-04-15T00:32:22.953 INFO:tasks.workunit.client.0.smithi029.stdout:0/440: dread d5/d15/d1f/f3a [0,4194304] 0 2024-04-15T00:32:23.932 INFO:tasks.workunit.client.0.smithi029.stdout:6/449: symlink d1/d1e/d22/l90 0 2024-04-15T00:32:23.951 INFO:tasks.workunit.client.0.smithi029.stdout:6/450: dread - d1/d8/db/d7b/d85/f8f zero size 2024-04-15T00:32:23.996 INFO:tasks.workunit.client.0.smithi029.stdout:1/443: unlink df/d29/d41/d69/l8c 0 2024-04-15T00:32:24.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/416: link d3/d6/f1a d3/d6/d9/d29/d60/d64/f8b 0 2024-04-15T00:32:24.458 INFO:tasks.workunit.client.0.smithi029.stdout:8/452: rmdir d8/da/d2f/d79 0 2024-04-15T00:32:24.469 INFO:tasks.workunit.client.0.smithi029.stdout:5/453: link d2/de/d1f/l7b d2/da5/la6 0 2024-04-15T00:32:24.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/451: mkdir d1/d8/db/d7b/d91 0 2024-04-15T00:32:24.560 INFO:tasks.workunit.client.0.smithi029.stdout:4/430: symlink de/d54/d71/d8b/l8c 0 2024-04-15T00:32:24.588 INFO:tasks.workunit.client.0.smithi029.stdout:4/431: dread - de/d2b/d59/f6f zero size 2024-04-15T00:32:24.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/417: chown d3/f3e 13745706 1 2024-04-15T00:32:24.770 INFO:tasks.workunit.client.0.smithi029.stdout:3/437: link d17/f4d d17/d2a/d46/d67/f8a 0 2024-04-15T00:32:24.777 INFO:tasks.workunit.client.0.smithi029.stdout:5/454: fdatasync d2/d1a/f2c 0 2024-04-15T00:32:24.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/453: mknod d8/da/d2f/d66/c90 0 2024-04-15T00:32:24.831 INFO:tasks.workunit.client.0.smithi029.stdout:9/418: symlink d3/d6/d9/d29/d60/d64/l8c 0 2024-04-15T00:32:24.874 INFO:tasks.workunit.client.0.smithi029.stdout:5/455: read - d2/de/d13/d22/d26/f6f zero size 2024-04-15T00:32:24.947 INFO:tasks.workunit.client.0.smithi029.stdout:2/444: write d3/dd/d2d/f7d [1720289,55498] 0 2024-04-15T00:32:24.986 INFO:tasks.workunit.client.0.smithi029.stdout:6/452: dread d1/f2f [0,4194304] 0 2024-04-15T00:32:25.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/444: rename df/d29/c2a to df/c9b 0 2024-04-15T00:32:25.300 INFO:tasks.workunit.client.0.smithi029.stdout:3/438: rmdir d17/d2a/d33 39 2024-04-15T00:32:25.304 INFO:tasks.workunit.client.0.smithi029.stdout:8/454: unlink d8/d4a/f85 0 2024-04-15T00:32:25.628 INFO:tasks.workunit.client.0.smithi029.stdout:0/441: dwrite d5/d15/d1f/f73 [0,4194304] 0 2024-04-15T00:32:25.629 INFO:tasks.workunit.client.0.smithi029.stdout:9/419: dread d3/d6/d9/d29/d60/d64/d6d/d58/f2a [0,4194304] 0 2024-04-15T00:32:25.701 INFO:tasks.workunit.client.0.smithi029.stdout:3/439: fsync d17/d2f/d3c/f74 0 2024-04-15T00:32:25.711 INFO:tasks.workunit.client.0.smithi029.stdout:7/426: creat d0/f8f x:0 0 0 2024-04-15T00:32:25.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/442: dread d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:32:25.878 INFO:tasks.workunit.client.0.smithi029.stdout:5/456: mknod d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/ca7 0 2024-04-15T00:32:26.242 INFO:tasks.workunit.client.0.smithi029.stdout:3/440: creat d17/d2f/d76/f8b x:0 0 0 2024-04-15T00:32:26.309 INFO:tasks.workunit.client.0.smithi029.stdout:0/443: truncate d5/db/f19 6099073 0 2024-04-15T00:32:26.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/453: creat d1/f92 x:0 0 0 2024-04-15T00:32:26.493 INFO:tasks.workunit.client.0.smithi029.stdout:5/457: dread d2/de/f10 [0,4194304] 0 2024-04-15T00:32:26.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/432: write de/df/d1e/f28 [51119,99056] 0 2024-04-15T00:32:26.583 INFO:tasks.workunit.client.0.smithi029.stdout:5/458: dread d2/de/d13/d22/d3c/f50 [0,4194304] 0 2024-04-15T00:32:26.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/444: creat d5/d15/d1f/d32/f8c x:0 0 0 2024-04-15T00:32:26.643 INFO:tasks.workunit.client.0.smithi029.stdout:6/454: creat d1/d8/db/d7b/f93 x:0 0 0 2024-04-15T00:32:26.760 INFO:tasks.workunit.client.0.smithi029.stdout:8/455: write d8/da/d2f/d6e/f6f [3603318,116802] 0 2024-04-15T00:32:26.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/455: sync 2024-04-15T00:32:27.188 INFO:tasks.workunit.client.0.smithi029.stdout:0/445: mknod d5/d15/d27/d51/d77/c8d 0 2024-04-15T00:32:27.218 INFO:tasks.workunit.client.0.smithi029.stdout:1/445: stat df/d29/d41/d69/d4c/l8e 0 2024-04-15T00:32:27.278 INFO:tasks.workunit.client.0.smithi029.stdout:7/427: getdents d0/d6/d4f/d5d/d87 0 2024-04-15T00:32:27.291 INFO:tasks.workunit.client.0.smithi029.stdout:7/428: dread - d0/d6/d39/d3c/f70 zero size 2024-04-15T00:32:27.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/446: sync 2024-04-15T00:32:27.338 INFO:tasks.workunit.client.0.smithi029.stdout:6/456: rmdir d1/d64 39 2024-04-15T00:32:27.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/445: write d3/d13/f2f [3810688,15914] 0 2024-04-15T00:32:27.443 INFO:tasks.workunit.client.0.smithi029.stdout:0/446: creat d5/d15/d57/d5e/f8e x:0 0 0 2024-04-15T00:32:27.445 INFO:tasks.workunit.client.0.smithi029.stdout:7/429: mkdir d0/d6/d4f/d66/d67/d90 0 2024-04-15T00:32:27.493 INFO:tasks.workunit.client.0.smithi029.stdout:9/420: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:32:27.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/433: mkdir de/d54/d58/d8a/d8d 0 2024-04-15T00:32:27.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/421: read d3/d6/d9/f22 [1426944,103582] 0 2024-04-15T00:32:27.661 INFO:tasks.workunit.client.0.smithi029.stdout:3/441: dwrite d17/d2a/d46/f6c [0,4194304] 0 2024-04-15T00:32:27.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/434: stat de/d2b/d59/c60 0 2024-04-15T00:32:27.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/447: getdents df/d32/d90 0 2024-04-15T00:32:27.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/447: unlink d5/db/f37 0 2024-04-15T00:32:27.802 INFO:tasks.workunit.client.0.smithi029.stdout:6/457: symlink d1/d1e/d56/d58/l94 0 2024-04-15T00:32:27.865 INFO:tasks.workunit.client.0.smithi029.stdout:5/459: dwrite d2/de/d13/f2f [0,4194304] 0 2024-04-15T00:32:27.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/456: getdents d8/da/d2f 0 2024-04-15T00:32:27.975 INFO:tasks.workunit.client.0.smithi029.stdout:9/422: chown d3/d6/l3d 15067542 1 2024-04-15T00:32:28.284 INFO:tasks.workunit.client.0.smithi029.stdout:1/448: unlink df/c98 0 2024-04-15T00:32:28.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/442: creat d17/d2a/d4c/f8c x:0 0 0 2024-04-15T00:32:28.437 INFO:tasks.workunit.client.0.smithi029.stdout:2/446: truncate d3/dd/f31 499284 0 2024-04-15T00:32:28.685 INFO:tasks.workunit.client.0.smithi029.stdout:5/460: truncate d2/f8 2245351 0 2024-04-15T00:32:28.894 INFO:tasks.workunit.client.0.smithi029.stdout:4/435: mknod de/d6d/d7e/c8e 0 2024-04-15T00:32:28.933 INFO:tasks.workunit.client.0.smithi029.stdout:1/449: creat df/d29/d41/d69/d4c/d55/d80/d94/f9c x:0 0 0 2024-04-15T00:32:28.952 INFO:tasks.workunit.client.0.smithi029.stdout:1/450: fdatasync df/d29/d41/d69/d4c/d55/d80/d94/f9c 0 2024-04-15T00:32:29.122 INFO:tasks.workunit.client.0.smithi029.stdout:6/458: symlink d1/d64/l95 0 2024-04-15T00:32:29.278 INFO:tasks.workunit.client.0.smithi029.stdout:7/430: rename d0/c21 to d0/d6/d39/d3c/c91 0 2024-04-15T00:32:29.295 INFO:tasks.workunit.client.0.smithi029.stdout:9/423: rmdir d3/d6/d9/d15/d4a 39 2024-04-15T00:32:29.594 INFO:tasks.workunit.client.0.smithi029.stdout:7/431: creat d0/d6/d39/d3c/d42/d49/d71/f92 x:0 0 0 2024-04-15T00:32:29.604 INFO:tasks.workunit.client.0.smithi029.stdout:7/432: chown d0/d6/f2f 7 1 2024-04-15T00:32:29.662 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:29.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:29.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/424: truncate d3/d6/f17 4089189 0 2024-04-15T00:32:29.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/448: dwrite d5/d4c/d4e/f80 [0,4194304] 0 2024-04-15T00:32:29.853 INFO:tasks.workunit.client.0.smithi029.stdout:2/447: rename d3/d13/f26 to d3/dd/d42/f89 0 2024-04-15T00:32:29.991 INFO:tasks.workunit.client.0.smithi029.stdout:9/425: mknod d3/d6/d9/d29/d60/d7f/c8d 0 2024-04-15T00:32:30.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/443: link d17/f4d d17/d2f/d84/f8d 0 2024-04-15T00:32:30.143 INFO:tasks.workunit.client.0.smithi029.stdout:7/433: mknod d0/d74/c93 0 2024-04-15T00:32:30.168 INFO:tasks.workunit.client.0.smithi029.stdout:8/457: dwrite d8/da/d2f/f61 [4194304,4194304] 0 2024-04-15T00:32:30.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/449: mkdir d5/db/d8f 0 2024-04-15T00:32:30.272 INFO:tasks.workunit.client.0.smithi029.stdout:0/450: stat d5/d54 0 2024-04-15T00:32:30.447 INFO:tasks.workunit.client.0.smithi029.stdout:4/436: write de/f19 [3782754,34735] 0 2024-04-15T00:32:30.472 INFO:tasks.workunit.client.0.smithi029.stdout:1/451: write df/d29/d41/f47 [2668095,46336] 0 2024-04-15T00:32:30.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/461: dwrite d2/de/d13/d22/d3c/d41/d6d/f81 [0,4194304] 0 2024-04-15T00:32:30.756 INFO:tasks.workunit.client.0.smithi029.stdout:5/462: chown d2/de/d1f/f3b 24179086 1 2024-04-15T00:32:30.759 INFO:tasks.workunit.client.0.smithi029.stdout:6/459: dwrite d1/d1e/f27 [0,4194304] 0 2024-04-15T00:32:30.931 INFO:tasks.workunit.client.0.smithi029.stdout:4/437: dread de/df/d1e/f22 [0,4194304] 0 2024-04-15T00:32:30.934 INFO:tasks.workunit.client.0.smithi029.stdout:1/452: chown df/d29/d41/d69/l56 0 1 2024-04-15T00:32:30.998 INFO:tasks.workunit.client.0.smithi029.stdout:7/434: getdents d0/d6/d4f/d5d/d65 0 2024-04-15T00:32:31.015 INFO:tasks.workunit.client.0.smithi029.stdout:7/435: chown d0/d6/d39/d3c/d5b/l6b 35976479 1 2024-04-15T00:32:31.127 INFO:tasks.workunit.client.0.smithi029.stdout:3/444: link d17/d2a/d46/d67/f8a d17/d2a/d4c/f8e 0 2024-04-15T00:32:31.250 INFO:tasks.workunit.client.0.smithi029.stdout:2/448: write d3/dd/f27 [1326508,109195] 0 2024-04-15T00:32:31.363 INFO:tasks.workunit.client.0.smithi029.stdout:4/438: fsync de/d2b/f62 0 2024-04-15T00:32:31.380 INFO:tasks.workunit.client.0.smithi029.stdout:8/458: write f7 [3093565,82810] 0 2024-04-15T00:32:31.412 INFO:tasks.workunit.client.0.smithi029.stdout:8/459: fsync d8/d4a/d78/d23/f51 0 2024-04-15T00:32:31.497 INFO:tasks.workunit.client.0.smithi029.stdout:6/460: fdatasync d1/d1e/d22/f83 0 2024-04-15T00:32:31.543 INFO:tasks.workunit.client.0.smithi029.stdout:8/460: dwrite d8/d4a/d78/d23/f51 [4194304,4194304] 0 2024-04-15T00:32:31.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/463: unlink d2/de/d13/d22/d3c/f74 0 2024-04-15T00:32:31.793 INFO:tasks.workunit.client.0.smithi029.stdout:9/426: dwrite d3/d6/d9/d15/d4a/d53/f5b [0,4194304] 0 2024-04-15T00:32:31.878 INFO:tasks.workunit.client.0.smithi029.stdout:7/436: write d0/d6/f64 [1241005,125807] 0 2024-04-15T00:32:31.940 INFO:tasks.workunit.client.0.smithi029.stdout:0/451: dwrite d5/d4c/f84 [0,4194304] 0 2024-04-15T00:32:32.006 INFO:tasks.workunit.client.0.smithi029.stdout:1/453: link df/d29/d41/d69/d4c/d55/d80/d94/f9c df/d29/d41/d69/f9d 0 2024-04-15T00:32:32.270 INFO:tasks.workunit.client.0.smithi029.stdout:6/461: creat d1/d8/db/d7b/d85/f96 x:0 0 0 2024-04-15T00:32:32.336 INFO:tasks.workunit.client.0.smithi029.stdout:4/439: rmdir de/d3a 39 2024-04-15T00:32:32.377 INFO:tasks.workunit.client.0.smithi029.stdout:2/449: dwrite d3/dd/d2d/f34 [0,4194304] 0 2024-04-15T00:32:32.612 INFO:tasks.workunit.client.0.smithi029.stdout:9/427: mknod d3/d6/d9/d29/d60/d64/d6d/d58/c8e 0 2024-04-15T00:32:32.631 INFO:tasks.workunit.client.0.smithi029.stdout:0/452: readlink d5/d15/l40 0 2024-04-15T00:32:32.644 INFO:tasks.workunit.client.0.smithi029.stdout:8/461: mknod d8/da/d3d/c91 0 2024-04-15T00:32:32.674 INFO:tasks.workunit.client.0.smithi029.stdout:9/428: chown d3/d6/f59 259625 1 2024-04-15T00:32:32.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/445: getdents d17/d2f/d44/d58/d5c 0 2024-04-15T00:32:32.777 INFO:tasks.workunit.client.0.smithi029.stdout:0/453: dread d5/d15/d1f/f3a [0,4194304] 0 2024-04-15T00:32:32.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/454: truncate df/f28 903676 0 2024-04-15T00:32:32.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/464: write d2/de/d13/d22/d3c/f4b [356913,58168] 0 2024-04-15T00:32:32.937 INFO:tasks.workunit.client.0.smithi029.stdout:7/437: write d0/d6/f3b [2051478,28747] 0 2024-04-15T00:32:33.408 INFO:tasks.workunit.client.0.smithi029.stdout:9/429: fsync d3/d6/d9/f49 0 2024-04-15T00:32:33.411 INFO:tasks.workunit.client.0.smithi029.stdout:6/462: write d1/d1e/d56/f62 [633874,86637] 0 2024-04-15T00:32:33.627 INFO:tasks.workunit.client.0.smithi029.stdout:9/430: dread d3/d6/d9/d29/d60/f6e [0,4194304] 0 2024-04-15T00:32:33.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/446: dread d17/d83/f65 [0,4194304] 0 2024-04-15T00:32:33.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/431: chown d3/d6 69598409 1 2024-04-15T00:32:33.761 INFO:tasks.workunit.client.0.smithi029.stdout:0/454: dread d5/f7 [0,4194304] 0 2024-04-15T00:32:33.857 INFO:tasks.workunit.client.0.smithi029.stdout:8/462: mkdir d8/da/d2f/d6e/d92 0 2024-04-15T00:32:33.862 INFO:tasks.workunit.client.0.smithi029.stdout:4/440: rename de/d2b/l64 to de/d6d/l8f 0 2024-04-15T00:32:33.869 INFO:tasks.workunit.client.0.smithi029.stdout:5/465: creat d2/de/d13/d22/d3c/d41/d6d/fa8 x:0 0 0 2024-04-15T00:32:33.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/463: chown d8/da/d2f/f61 60012 1 2024-04-15T00:32:33.923 INFO:tasks.workunit.client.0.smithi029.stdout:8/464: chown d8/d4a/d78/d23/d28/d30/c45 235955431 1 2024-04-15T00:32:33.999 INFO:tasks.workunit.client.0.smithi029.stdout:6/463: symlink d1/d1e/d56/d58/d59/l97 0 2024-04-15T00:32:34.295 INFO:tasks.workunit.client.0.smithi029.stdout:3/447: rename l10 to d17/d2a/d46/l8f 0 2024-04-15T00:32:34.477 INFO:tasks.workunit.client.0.smithi029.stdout:4/441: dread de/df/d1e/f4c [4194304,4194304] 0 2024-04-15T00:32:34.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/432: fdatasync d3/d6/d9/d29/d5d/f3a 0 2024-04-15T00:32:34.641 INFO:tasks.workunit.client.0.smithi029.stdout:3/448: symlink d17/d2f/d44/d68/l90 0 2024-04-15T00:32:34.689 INFO:tasks.workunit.client.0.smithi029.stdout:5/466: symlink d2/de/d1f/la9 0 2024-04-15T00:32:34.729 INFO:tasks.workunit.client.0.smithi029.stdout:7/438: link d0/d74/c93 d0/d74/c94 0 2024-04-15T00:32:34.923 INFO:tasks.workunit.client.0.smithi029.stdout:2/450: dwrite d3/d13/d14/f40 [4194304,4194304] 0 2024-04-15T00:32:34.997 INFO:tasks.workunit.client.0.smithi029.stdout:5/467: fdatasync d2/de/d13/d22/d3c/d41/d6d/f8c 0 2024-04-15T00:32:35.069 INFO:tasks.workunit.client.0.smithi029.stdout:7/439: dread - d0/d6/d4f/d66/d37/f7a zero size 2024-04-15T00:32:35.074 INFO:tasks.workunit.client.0.smithi029.stdout:3/449: sync 2024-04-15T00:32:35.269 INFO:tasks.workunit.client.0.smithi029.stdout:5/468: truncate d2/de/d13/d22/d3c/d41/d6d/f77 191832 0 2024-04-15T00:32:35.281 INFO:tasks.workunit.client.0.smithi029.stdout:5/469: stat d2/fb 0 2024-04-15T00:32:35.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/440: dread d0/d6/d4f/d66/d26/f28 [0,4194304] 0 2024-04-15T00:32:35.446 INFO:tasks.workunit.client.0.smithi029.stdout:7/441: dread d0/d6/d4f/d66/d26/f28 [0,4194304] 0 2024-04-15T00:32:35.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/442: readlink d0/d6/d39/d3c/d5b/l6b 0 2024-04-15T00:32:35.588 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:32:06.096 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.589 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:32:06.100 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.607 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:32:06.087 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.610 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:32:06.090 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.611 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:32:06.090 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.611 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:32:06.092 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.680 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:32:06.190 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.695 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:32:06.186 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.752 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:32:06.231 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:32:35.771 INFO:tasks.workunit.client.0.smithi029.stdout:3/450: creat d17/d2f/d44/d58/f91 x:0 0 0 2024-04-15T00:32:35.773 INFO:tasks.workunit.client.0.smithi029.stdout:8/465: write d8/da/f14 [215214,40247] 0 2024-04-15T00:32:35.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/464: rename d1/d64 to d1/d8/db/d98 0 2024-04-15T00:32:35.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/442: write de/df/d1e/f24 [1280321,40843] 0 2024-04-15T00:32:36.029 INFO:tasks.workunit.client.0.smithi029.stdout:1/455: creat df/f9e x:0 0 0 2024-04-15T00:32:36.061 INFO:tasks.workunit.client.0.smithi029.stdout:7/443: unlink d0/d6/c34 0 2024-04-15T00:32:36.113 INFO:tasks.workunit.client.0.smithi029.stdout:9/433: dwrite d3/d6/d9/d29/d5d/f3a [0,4194304] 0 2024-04-15T00:32:36.193 INFO:tasks.workunit.client.0.smithi029.stdout:0/455: dwrite d5/d3e/f69 [0,4194304] 0 2024-04-15T00:32:36.198 INFO:tasks.workunit.client.0.smithi029.stdout:8/466: symlink d8/l93 0 2024-04-15T00:32:36.366 INFO:tasks.workunit.client.0.smithi029.stdout:5/470: dwrite d2/de/d13/f19 [0,4194304] 0 2024-04-15T00:32:36.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/451: rmdir d3/d2a/d46 39 2024-04-15T00:32:36.471 INFO:tasks.workunit.client.0.smithi029.stdout:6/465: write d1/d1e/d56/f89 [589849,88095] 0 2024-04-15T00:32:36.486 INFO:tasks.workunit.client.0.smithi029.stdout:1/456: read df/f4d [165684,95313] 0 2024-04-15T00:32:36.504 INFO:tasks.workunit.client.0.smithi029.stdout:7/444: rename d0/d6/d4f/d66/d37/l47 to d0/d6/d4f/l95 0 2024-04-15T00:32:36.580 INFO:tasks.workunit.client.0.smithi029.stdout:2/452: rmdir d3/dd 39 2024-04-15T00:32:36.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/471: dread d2/d1a/f1c [0,4194304] 0 2024-04-15T00:32:36.790 INFO:tasks.workunit.client.0.smithi029.stdout:9/434: mknod d3/d6/c8f 0 2024-04-15T00:32:36.801 INFO:tasks.workunit.client.0.smithi029.stdout:9/435: chown d3/d6/d9/d29/d60 79744256 1 2024-04-15T00:32:36.809 INFO:tasks.workunit.client.0.smithi029.stdout:1/457: rmdir df/d29 39 2024-04-15T00:32:36.815 INFO:tasks.workunit.client.0.smithi029.stdout:0/456: rename d5/db/d1a/d50/c6a to d5/d15/d57/c90 0 2024-04-15T00:32:36.828 INFO:tasks.workunit.client.0.smithi029.stdout:3/451: getdents d17/d2f/d44/d58 0 2024-04-15T00:32:36.850 INFO:tasks.workunit.client.0.smithi029.stdout:7/445: creat d0/d6/d4f/d66/d26/d77/f96 x:0 0 0 2024-04-15T00:32:36.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/472: dread - d2/de/d13/d22/d26/d36/d4d/d70/d8d/f91 zero size 2024-04-15T00:32:36.880 INFO:tasks.workunit.client.0.smithi029.stdout:0/457: chown d5/d15/f4a 1036382144 1 2024-04-15T00:32:36.948 INFO:tasks.workunit.client.0.smithi029.stdout:6/466: write d1/d1e/d56/d58/f8d [429370,64520] 0 2024-04-15T00:32:37.040 INFO:tasks.workunit.client.0.smithi029.stdout:5/473: dread d2/de/d13/d22/d26/f49 [0,4194304] 0 2024-04-15T00:32:37.118 INFO:tasks.workunit.client.0.smithi029.stdout:4/443: getdents de/d54/d58 0 2024-04-15T00:32:37.126 INFO:tasks.workunit.client.0.smithi029.stdout:9/436: read d3/d6/f17 [961598,100714] 0 2024-04-15T00:32:37.269 INFO:tasks.workunit.client.0.smithi029.stdout:0/458: unlink d5/d15/l40 0 2024-04-15T00:32:37.366 INFO:tasks.workunit.client.0.smithi029.stdout:0/459: dwrite d5/d4c/f84 [0,4194304] 0 2024-04-15T00:32:37.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/446: fsync d0/d6/d39/d3c/d42/d49/d71/f92 0 2024-04-15T00:32:37.608 INFO:tasks.workunit.client.0.smithi029.stdout:8/467: link d8/d4a/d78/d23/d28/d5f/f83 d8/da/d2f/d6e/f94 0 2024-04-15T00:32:37.642 INFO:tasks.workunit.client.0.smithi029.stdout:6/467: write d1/d8/db/f40 [4066172,101324] 0 2024-04-15T00:32:37.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/444: write de/d2b/f21 [3922865,38686] 0 2024-04-15T00:32:37.810 INFO:tasks.workunit.client.0.smithi029.stdout:2/453: chown d3/d13/d43/d5a/f4b 3536 1 2024-04-15T00:32:37.894 INFO:tasks.workunit.client.0.smithi029.stdout:5/474: mkdir d2/de/d13/daa 0 2024-04-15T00:32:37.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/437: rename d3/c39 to d3/d6/d9/d29/d60/d64/d6d/d58/c90 0 2024-04-15T00:32:37.932 INFO:tasks.workunit.client.0.smithi029.stdout:6/468: symlink d1/d8/db/d98/l99 0 2024-04-15T00:32:37.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/475: read d2/fa [514089,11720] 0 2024-04-15T00:32:38.322 INFO:tasks.workunit.client.0.smithi029.stdout:1/458: symlink df/d29/d41/d69/d4c/d7a/l9f 0 2024-04-15T00:32:38.489 INFO:tasks.workunit.client.0.smithi029.stdout:8/468: write d8/da/d2f/d42/f7e [1067425,5199] 0 2024-04-15T00:32:38.889 INFO:tasks.workunit.client.0.smithi029.stdout:5/476: dread d2/f11 [0,4194304] 0 2024-04-15T00:32:38.900 INFO:tasks.workunit.client.0.smithi029.stdout:5/477: chown d2/de/f57 3104 1 2024-04-15T00:32:39.060 INFO:tasks.workunit.client.0.smithi029.stdout:6/469: unlink d1/d8/l2b 0 2024-04-15T00:32:39.069 INFO:tasks.workunit.client.0.smithi029.stdout:4/445: creat de/d54/d58/d8a/d8d/f90 x:0 0 0 2024-04-15T00:32:39.076 INFO:tasks.workunit.client.0.smithi029.stdout:3/452: link d17/d2a/d33/f63 d17/d2f/d3c/f92 0 2024-04-15T00:32:39.077 INFO:tasks.workunit.client.0.smithi029.stdout:1/459: creat df/d29/d41/d4f/fa0 x:0 0 0 2024-04-15T00:32:39.110 INFO:tasks.workunit.client.0.smithi029.stdout:6/470: chown d1/d8/f70 211011 1 2024-04-15T00:32:39.130 INFO:tasks.workunit.client.0.smithi029.stdout:6/471: chown d1/f7c 98442728 1 2024-04-15T00:32:39.142 INFO:tasks.workunit.client.0.smithi029.stdout:6/472: chown d1/d1e/f33 2144827 1 2024-04-15T00:32:39.168 INFO:tasks.workunit.client.0.smithi029.stdout:0/460: link d5/d15/d1f/l2e d5/d15/d57/l91 0 2024-04-15T00:32:39.194 INFO:tasks.workunit.client.0.smithi029.stdout:0/461: chown d5/d3e 75670 1 2024-04-15T00:32:39.276 INFO:tasks.workunit.client.0.smithi029.stdout:8/469: dread d8/f2c [0,4194304] 0 2024-04-15T00:32:39.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/478: symlink d2/de/d13/d22/d26/d36/lab 0 2024-04-15T00:32:39.583 INFO:tasks.workunit.client.0.smithi029.stdout:1/460: mknod df/d29/d41/d69/d4c/d55/ca1 0 2024-04-15T00:32:39.619 INFO:tasks.workunit.client.0.smithi029.stdout:4/446: dread de/d2b/f2c [0,4194304] 0 2024-04-15T00:32:39.648 INFO:tasks.workunit.client.0.smithi029.stdout:6/473: symlink d1/d8/l9a 0 2024-04-15T00:32:39.704 INFO:tasks.workunit.client.0.smithi029.stdout:8/470: creat d8/da/f95 x:0 0 0 2024-04-15T00:32:39.763 INFO:tasks.workunit.client.0.smithi029.stdout:7/447: dwrite d0/d6/d4f/d66/d26/f38 [0,4194304] 0 2024-04-15T00:32:39.992 INFO:tasks.workunit.client.0.smithi029.stdout:5/479: symlink d2/d1a/d2d/lac 0 2024-04-15T00:32:40.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/438: dwrite d3/d6/f61 [4194304,4194304] 0 2024-04-15T00:32:40.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/454: rename d3/f9 to d3/d2a/d46/d4a/f8a 0 2024-04-15T00:32:40.182 INFO:tasks.workunit.client.0.smithi029.stdout:1/461: symlink df/d29/d41/d69/d4c/d7a/la2 0 2024-04-15T00:32:40.349 INFO:tasks.workunit.client.0.smithi029.stdout:5/480: read - d2/de/d13/d22/d26/d36/f90 zero size 2024-04-15T00:32:40.394 INFO:tasks.workunit.client.0.smithi029.stdout:3/453: dwrite d17/f5b [0,4194304] 0 2024-04-15T00:32:40.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/474: dread d1/d8/db/fe [0,4194304] 0 2024-04-15T00:32:40.508 INFO:tasks.workunit.client.0.smithi029.stdout:3/454: readlink d17/d2a/l3d 0 2024-04-15T00:32:40.513 INFO:tasks.workunit.client.0.smithi029.stdout:1/462: chown df/f28 246 1 2024-04-15T00:32:40.547 INFO:tasks.workunit.client.0.smithi029.stdout:7/448: rename d0/d6/d1c/c1e to d0/d6/d4f/d66/d26/d77/c97 0 2024-04-15T00:32:40.640 INFO:tasks.workunit.client.0.smithi029.stdout:0/462: getdents d5/d15/d27/d51 0 2024-04-15T00:32:40.673 INFO:tasks.workunit.client.0.smithi029.stdout:5/481: symlink d2/de/d1f/d63/d71/lad 0 2024-04-15T00:32:40.785 INFO:tasks.workunit.client.0.smithi029.stdout:1/463: rmdir df/d29/d41/d4f 39 2024-04-15T00:32:40.906 INFO:tasks.workunit.client.0.smithi029.stdout:8/471: dwrite d8/f7c [0,4194304] 0 2024-04-15T00:32:40.972 INFO:tasks.workunit.client.0.smithi029.stdout:4/447: rename de/d2b/c4d to de/d3a/c91 0 2024-04-15T00:32:41.064 INFO:tasks.workunit.client.0.smithi029.stdout:3/455: write d17/d2a/f6a [991009,25589] 0 2024-04-15T00:32:41.067 INFO:tasks.workunit.client.0.smithi029.stdout:7/449: write d0/d6/f44 [4888776,92082] 0 2024-04-15T00:32:41.337 INFO:tasks.workunit.client.0.smithi029.stdout:1/464: symlink df/d29/d41/d69/d4c/d55/d80/la3 0 2024-04-15T00:32:41.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/439: creat d3/d6/d9/d29/d60/d64/d6d/f91 x:0 0 0 2024-04-15T00:32:41.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/440: stat d3/d6/d9/c85 0 2024-04-15T00:32:41.459 INFO:tasks.workunit.client.0.smithi029.stdout:2/455: link d3/dd/c1d d3/dd/c8b 0 2024-04-15T00:32:41.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/472: mknod d8/d4a/c96 0 2024-04-15T00:32:41.477 INFO:tasks.workunit.client.0.smithi029.stdout:0/463: rename d5/d15/d27/c33 to d5/db/d1a/d65/c92 0 2024-04-15T00:32:41.491 INFO:tasks.workunit.client.0.smithi029.stdout:7/450: fdatasync d0/d6/f64 0 2024-04-15T00:32:41.510 INFO:tasks.workunit.client.0.smithi029.stdout:4/448: chown de/d54/d71/f87 55092 1 2024-04-15T00:32:41.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/475: link d1/d1e/f4e d1/d8/db/d38/d6f/f9b 0 2024-04-15T00:32:41.646 INFO:tasks.workunit.client.0.smithi029.stdout:9/441: symlink d3/d6/d9/d29/d60/d7f/l92 0 2024-04-15T00:32:41.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/456: dread d3/d2a/d46/f74 [0,4194304] 0 2024-04-15T00:32:41.771 INFO:tasks.workunit.client.0.smithi029.stdout:7/451: creat d0/d6/d39/f98 x:0 0 0 2024-04-15T00:32:42.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/465: mkdir df/da4 0 2024-04-15T00:32:42.100 INFO:tasks.workunit.client.0.smithi029.stdout:5/482: rename d2/de/d1f/d63/d71/f9b to d2/de/d13/d22/d3c/fae 0 2024-04-15T00:32:42.249 INFO:tasks.workunit.client.0.smithi029.stdout:9/442: creat d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f93 x:0 0 0 2024-04-15T00:32:42.293 INFO:tasks.workunit.client.0.smithi029.stdout:7/452: creat d0/d6/d4f/d66/d37/f99 x:0 0 0 2024-04-15T00:32:42.300 INFO:tasks.workunit.client.0.smithi029.stdout:3/456: dwrite d17/d2a/d46/f6c [0,4194304] 0 2024-04-15T00:32:42.438 INFO:tasks.workunit.client.0.smithi029.stdout:6/476: dread d1/d8/db/d38/f39 [4194304,4194304] 0 2024-04-15T00:32:42.492 INFO:tasks.workunit.client.0.smithi029.stdout:4/449: write de/df/d1e/d56/f80 [1404648,104290] 0 2024-04-15T00:32:42.506 INFO:tasks.workunit.client.0.smithi029.stdout:4/450: chown de/f5d 0 1 2024-04-15T00:32:42.629 INFO:tasks.workunit.client.0.smithi029.stdout:8/473: rename d8/l10 to d8/d4a/l97 0 2024-04-15T00:32:42.656 INFO:tasks.workunit.client.0.smithi029.stdout:2/457: mknod d3/d2a/c8c 0 2024-04-15T00:32:42.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/457: rmdir d17/d2f/d44/d68 39 2024-04-15T00:32:42.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/443: dread d3/d6/d9/d29/d5d/f36 [0,4194304] 0 2024-04-15T00:32:42.858 INFO:tasks.workunit.client.0.smithi029.stdout:6/477: truncate d1/d8/db/d7b/d85/f96 647143 0 2024-04-15T00:32:42.863 INFO:tasks.workunit.client.0.smithi029.stdout:0/464: rename d5/d15/f1c to d5/d15/d1f/d32/f93 0 2024-04-15T00:32:42.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/453: creat d0/d6/d4f/d5d/d65/f9a x:0 0 0 2024-04-15T00:32:43.072 INFO:tasks.workunit.client.0.smithi029.stdout:3/458: mkdir d17/d2a/d4c/d93 0 2024-04-15T00:32:43.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/466: dwrite df/f30 [0,4194304] 0 2024-04-15T00:32:43.725 INFO:tasks.workunit.client.0.smithi029.stdout:4/451: rename de/d2b/d35/f4f to de/d2b/d59/f92 0 2024-04-15T00:32:43.741 INFO:tasks.workunit.client.0.smithi029.stdout:5/483: write d2/de/d13/d22/d26/f49 [485612,111049] 0 2024-04-15T00:32:43.750 INFO:tasks.workunit.client.0.smithi029.stdout:7/454: read - d0/d6/d4f/d66/d26/d77/f96 zero size 2024-04-15T00:32:43.904 INFO:tasks.workunit.client.0.smithi029.stdout:3/459: symlink d17/d2f/d44/d58/l94 0 2024-04-15T00:32:43.908 INFO:tasks.workunit.client.0.smithi029.stdout:9/444: mknod d3/d88/c94 0 2024-04-15T00:32:43.925 INFO:tasks.workunit.client.0.smithi029.stdout:9/445: chown d3/d6/d9/c1d 3903 1 2024-04-15T00:32:44.044 INFO:tasks.workunit.client.0.smithi029.stdout:0/465: mkdir d5/db/d7b/d94 0 2024-04-15T00:32:44.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/452: mknod de/d54/d58/c93 0 2024-04-15T00:32:44.262 INFO:tasks.workunit.client.0.smithi029.stdout:4/453: stat de/d2b/d35/l85 0 2024-04-15T00:32:44.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/460: read d17/d2a/d33/f60 [396215,78143] 0 2024-04-15T00:32:44.643 INFO:tasks.workunit.client.0.smithi029.stdout:6/478: link d1/d1e/f32 d1/d8/f9c 0 2024-04-15T00:32:44.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/454: symlink de/d54/d58/d8a/l94 0 2024-04-15T00:32:44.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/455: stat de/d2b/f62 0 2024-04-15T00:32:44.857 INFO:tasks.workunit.client.0.smithi029.stdout:9/446: fdatasync d3/d6/d9/d29/d5d/f73 0 2024-04-15T00:32:44.878 INFO:tasks.workunit.client.0.smithi029.stdout:8/474: getdents d8/d4a/d78/d23/d28/d30/d39/d77/d82 0 2024-04-15T00:32:44.967 INFO:tasks.workunit.client.0.smithi029.stdout:6/479: dread - d1/d8/f70 zero size 2024-04-15T00:32:45.069 INFO:tasks.workunit.client.0.smithi029.stdout:4/456: rename de/d2b/d59/l7a to de/d54/d58/l95 0 2024-04-15T00:32:45.160 INFO:tasks.workunit.client.0.smithi029.stdout:8/475: fdatasync d8/da/d2f/d66/f67 0 2024-04-15T00:32:45.200 INFO:tasks.workunit.client.0.smithi029.stdout:2/458: dwrite d3/dd/d42/f76 [0,4194304] 0 2024-04-15T00:32:45.398 INFO:tasks.workunit.client.0.smithi029.stdout:4/457: creat de/d2b/d59/f96 x:0 0 0 2024-04-15T00:32:45.457 INFO:tasks.workunit.client.0.smithi029.stdout:7/455: symlink d0/l9b 0 2024-04-15T00:32:45.468 INFO:tasks.workunit.client.0.smithi029.stdout:7/456: stat d0/d6/d4f/d66/d67/d90 0 2024-04-15T00:32:45.563 INFO:tasks.workunit.client.0.smithi029.stdout:3/461: mknod d17/d2f/d44/c95 0 2024-04-15T00:32:45.692 INFO:tasks.workunit.client.0.smithi029.stdout:9/447: rename d3/d6/f1a to d3/d6/d9/d15/d7e/f95 0 2024-04-15T00:32:45.725 INFO:tasks.workunit.client.0.smithi029.stdout:5/484: dwrite d2/de/d13/f2a [0,4194304] 0 2024-04-15T00:32:45.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/448: read d3/d6/d9/d15/f1f [188287,104216] 0 2024-04-15T00:32:45.837 INFO:tasks.workunit.client.0.smithi029.stdout:7/457: symlink d0/d74/l9c 0 2024-04-15T00:32:45.905 INFO:tasks.workunit.client.0.smithi029.stdout:3/462: unlink d17/d2a/d46/d67/c79 0 2024-04-15T00:32:45.936 INFO:tasks.workunit.client.0.smithi029.stdout:6/480: link d1/c9 d1/d1e/d22/c9d 0 2024-04-15T00:32:45.942 INFO:tasks.workunit.client.0.smithi029.stdout:0/466: write d5/d15/d57/f60 [849223,51449] 0 2024-04-15T00:32:46.010 INFO:tasks.workunit.client.0.smithi029.stdout:5/485: rmdir d2/de/d13/d22/d26/d36/d4d 39 2024-04-15T00:32:46.082 INFO:tasks.workunit.client.0.smithi029.stdout:7/458: truncate d0/d6/f2c 587907 0 2024-04-15T00:32:46.087 INFO:tasks.workunit.client.0.smithi029.stdout:9/449: chown d3/d6/d9/d29/d60/d64/d6d/d58/c90 442 1 2024-04-15T00:32:46.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/467: dwrite df/d29/d41/d4f/f6e [0,4194304] 0 2024-04-15T00:32:46.191 INFO:tasks.workunit.client.0.smithi029.stdout:9/450: chown d3/d6/f12 8960314 1 2024-04-15T00:32:46.342 INFO:tasks.workunit.client.0.smithi029.stdout:0/467: rename d5/d15/d1f/f44 to d5/d15/d1f/d32/f95 0 2024-04-15T00:32:46.442 INFO:tasks.workunit.client.0.smithi029.stdout:6/481: unlink d1/d8/db/c46 0 2024-04-15T00:32:46.505 INFO:tasks.workunit.client.0.smithi029.stdout:1/468: creat df/d32/d7c/fa5 x:0 0 0 2024-04-15T00:32:46.629 INFO:tasks.workunit.client.0.smithi029.stdout:7/459: rename d0/d6/d4f/d66/d26/d77/d89/f8a to d0/d6/d4f/f9d 0 2024-04-15T00:32:46.642 INFO:tasks.workunit.client.0.smithi029.stdout:7/460: stat d0/d6/d4f/d66/d26/d77/l84 0 2024-04-15T00:32:46.762 INFO:tasks.workunit.client.0.smithi029.stdout:5/486: truncate d2/de/d13/d22/d26/d36/d4d/f51 1738151 0 2024-04-15T00:32:46.811 INFO:tasks.workunit.client.0.smithi029.stdout:1/469: creat df/d29/d41/d69/d4c/d7a/fa6 x:0 0 0 2024-04-15T00:32:46.947 INFO:tasks.workunit.client.0.smithi029.stdout:7/461: unlink d0/d6/l58 0 2024-04-15T00:32:47.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/487: creat d2/d1a/faf x:0 0 0 2024-04-15T00:32:47.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/470: fsync df/d29/d41/d69/d4c/f5c 0 2024-04-15T00:32:47.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/459: dwrite d3/d13/d14/f6a [0,4194304] 0 2024-04-15T00:32:47.365 INFO:tasks.workunit.client.0.smithi029.stdout:0/468: creat d5/d15/d27/f96 x:0 0 0 2024-04-15T00:32:47.387 INFO:tasks.workunit.client.0.smithi029.stdout:4/458: dwrite de/df/f12 [0,4194304] 0 2024-04-15T00:32:47.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/462: fsync d0/d6/f64 0 2024-04-15T00:32:47.495 INFO:tasks.workunit.client.0.smithi029.stdout:5/488: read d2/de/d1f/d63/d65/f86 [3486961,101949] 0 2024-04-15T00:32:47.582 INFO:tasks.workunit.client.0.smithi029.stdout:0/469: chown d5/d4c/c4f 185117119 1 2024-04-15T00:32:47.619 INFO:tasks.workunit.client.0.smithi029.stdout:8/476: dwrite d8/da/d2f/d6e/f94 [0,4194304] 0 2024-04-15T00:32:47.730 INFO:tasks.workunit.client.0.smithi029.stdout:5/489: chown d2/de/d13/d22/d26/f6f 7313258 1 2024-04-15T00:32:47.746 INFO:tasks.workunit.client.0.smithi029.stdout:3/463: dwrite fa [0,4194304] 0 2024-04-15T00:32:47.831 INFO:tasks.workunit.client.0.smithi029.stdout:5/490: chown d2/de/d13/f19 13432 1 2024-04-15T00:32:47.885 INFO:tasks.workunit.client.0.smithi029.stdout:9/451: write d3/d6/d9/d29/d60/d64/d6d/d58/f32 [2720134,15746] 0 2024-04-15T00:32:48.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/459: fsync de/f74 0 2024-04-15T00:32:48.028 INFO:tasks.workunit.client.0.smithi029.stdout:0/470: creat d5/d4c/f97 x:0 0 0 2024-04-15T00:32:48.033 INFO:tasks.workunit.client.0.smithi029.stdout:1/471: write df/f21 [49655,103335] 0 2024-04-15T00:32:48.057 INFO:tasks.workunit.client.0.smithi029.stdout:6/482: dwrite d1/d8/f53 [0,4194304] 0 2024-04-15T00:32:48.150 INFO:tasks.workunit.client.0.smithi029.stdout:1/472: read df/d29/d41/f48 [477651,60212] 0 2024-04-15T00:32:48.306 INFO:tasks.workunit.client.0.smithi029.stdout:5/491: creat d2/de/fb0 x:0 0 0 2024-04-15T00:32:48.652 INFO:tasks.workunit.client.0.smithi029.stdout:2/460: rename d3/d50/d51/d65/l84 to d3/d13/d43/d5a/d4f/l8d 0 2024-04-15T00:32:48.661 INFO:tasks.workunit.client.0.smithi029.stdout:1/473: fdatasync df/d29/f4b 0 2024-04-15T00:32:48.668 INFO:tasks.workunit.client.0.smithi029.stdout:5/492: symlink d2/de/d13/d22/d26/d36/d4d/d70/d8d/lb1 0 2024-04-15T00:32:48.669 INFO:tasks.workunit.client.0.smithi029.stdout:3/464: getdents d17/d2f/d76/d7f 0 2024-04-15T00:32:48.846 INFO:tasks.workunit.client.0.smithi029.stdout:7/463: creat d0/d6/d39/d3c/d42/f9e x:0 0 0 2024-04-15T00:32:48.852 INFO:tasks.workunit.client.0.smithi029.stdout:4/460: mknod de/d2b/c97 0 2024-04-15T00:32:49.077 INFO:tasks.workunit.client.0.smithi029.stdout:6/483: rename d1/d1e/d56/c6d to d1/d8/c9e 0 2024-04-15T00:32:49.089 INFO:tasks.workunit.client.0.smithi029.stdout:5/493: symlink d2/de/d13/d22/d26/d36/d4d/lb2 0 2024-04-15T00:32:49.269 INFO:tasks.workunit.client.0.smithi029.stdout:2/461: dread d3/dd/f30 [0,4194304] 0 2024-04-15T00:32:49.285 INFO:tasks.workunit.client.0.smithi029.stdout:5/494: chown d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/f84 0 1 2024-04-15T00:32:49.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/477: dwrite d8/d4a/d78/f89 [0,4194304] 0 2024-04-15T00:32:49.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/465: mknod d17/c96 0 2024-04-15T00:32:49.461 INFO:tasks.workunit.client.0.smithi029.stdout:8/478: chown d8/d4a/d78/f89 1 1 2024-04-15T00:32:49.464 INFO:tasks.workunit.client.0.smithi029.stdout:3/466: chown d17/d2f/c72 3766201 1 2024-04-15T00:32:49.495 INFO:tasks.workunit.client.0.smithi029.stdout:6/484: unlink d1/d1e/f33 0 2024-04-15T00:32:49.788 INFO:tasks.workunit.client.0.smithi029.stdout:1/474: creat df/fa7 x:0 0 0 2024-04-15T00:32:50.016 INFO:tasks.workunit.client.0.smithi029.stdout:6/485: mkdir d1/d8/d79/d9f 0 2024-04-15T00:32:50.106 INFO:tasks.workunit.client.0.smithi029.stdout:9/452: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/f54 [0,4194304] 0 2024-04-15T00:32:50.181 INFO:tasks.workunit.client.0.smithi029.stdout:0/471: write d5/d15/d1f/d32/f93 [984596,88326] 0 2024-04-15T00:32:50.359 INFO:tasks.workunit.client.0.smithi029.stdout:2/462: mknod d3/c8e 0 2024-04-15T00:32:50.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/464: write d0/d6/d4f/d66/d67/f73 [5983441,51903] 0 2024-04-15T00:32:50.394 INFO:tasks.workunit.client.0.smithi029.stdout:3/467: write d17/d2f/d44/d58/d5c/f73 [160342,33307] 0 2024-04-15T00:32:50.505 INFO:tasks.workunit.client.0.smithi029.stdout:4/461: dwrite de/d54/d58/f5b [4194304,4194304] 0 2024-04-15T00:32:50.572 INFO:tasks.workunit.client.0.smithi029.stdout:8/479: mknod d8/d4a/d78/d23/d28/c98 0 2024-04-15T00:32:50.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/486: mknod d1/d8/db/d38/d86/ca0 0 2024-04-15T00:32:50.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/468: mknod d17/d83/c97 0 2024-04-15T00:32:50.854 INFO:tasks.workunit.client.0.smithi029.stdout:7/465: mknod d0/d6/d4f/d66/d26/c9f 0 2024-04-15T00:32:50.870 INFO:tasks.workunit.client.0.smithi029.stdout:5/495: link d2/f52 d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fb3 0 2024-04-15T00:32:51.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/453: write d3/f1b [4023725,7183] 0 2024-04-15T00:32:51.084 INFO:tasks.workunit.client.0.smithi029.stdout:6/487: mknod d1/d8/db/d7b/ca1 0 2024-04-15T00:32:51.129 INFO:tasks.workunit.client.0.smithi029.stdout:8/480: read d8/da/d2f/d42/f7b [793712,66385] 0 2024-04-15T00:32:51.283 INFO:tasks.workunit.client.0.smithi029.stdout:9/454: rmdir d3/d88 39 2024-04-15T00:32:51.284 INFO:tasks.workunit.client.0.smithi029.stdout:1/475: dwrite df/f3e [0,4194304] 0 2024-04-15T00:32:51.375 INFO:tasks.workunit.client.0.smithi029.stdout:2/463: creat d3/d13/d43/f8f x:0 0 0 2024-04-15T00:32:51.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/472: dwrite d5/db/d1a/d65/d76/f85 [0,4194304] 0 2024-04-15T00:32:51.410 INFO:tasks.workunit.client.0.smithi029.stdout:4/462: truncate de/df/d1e/f29 2271051 0 2024-04-15T00:32:51.456 INFO:tasks.workunit.client.0.smithi029.stdout:3/469: sync 2024-04-15T00:32:51.456 INFO:tasks.workunit.client.0.smithi029.stdout:7/466: sync 2024-04-15T00:32:51.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/463: readlink de/d54/d71/d8b/l8c 0 2024-04-15T00:32:51.517 INFO:tasks.workunit.client.0.smithi029.stdout:2/464: chown d3/d2a/d46/c72 0 1 2024-04-15T00:32:51.613 INFO:tasks.workunit.client.0.smithi029.stdout:6/488: mknod d1/d8/db/d7b/d91/ca2 0 2024-04-15T00:32:51.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/496: dwrite d2/fb [0,4194304] 0 2024-04-15T00:32:51.819 INFO:tasks.workunit.client.0.smithi029.stdout:0/473: rename d5/d4c/d4e/f7c to d5/db/d8f/f98 0 2024-04-15T00:32:51.894 INFO:tasks.workunit.client.0.smithi029.stdout:9/455: dwrite d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:32:51.967 INFO:tasks.workunit.client.0.smithi029.stdout:6/489: mkdir d1/d8/d72/da3 0 2024-04-15T00:32:51.984 INFO:tasks.workunit.client.0.smithi029.stdout:6/490: chown d1/l51 7761819 1 2024-04-15T00:32:52.033 INFO:tasks.workunit.client.0.smithi029.stdout:7/467: symlink d0/d6/d4f/d66/d67/d90/la0 0 2024-04-15T00:32:52.087 INFO:tasks.workunit.client.0.smithi029.stdout:2/465: mknod d3/d13/c90 0 2024-04-15T00:32:52.121 INFO:tasks.workunit.client.0.smithi029.stdout:4/464: write de/d2b/f2c [4000178,117592] 0 2024-04-15T00:32:52.195 INFO:tasks.workunit.client.0.smithi029.stdout:3/470: dwrite d17/f24 [0,4194304] 0 2024-04-15T00:32:52.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/497: write d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/f84 [494700,64999] 0 2024-04-15T00:32:52.306 INFO:tasks.workunit.client.0.smithi029.stdout:8/481: getdents d8/da/d2f/d42/d75 0 2024-04-15T00:32:52.324 INFO:tasks.workunit.client.0.smithi029.stdout:5/498: readlink d2/de/d13/l5b 0 2024-04-15T00:32:52.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/468: truncate d0/f1f 2899784 0 2024-04-15T00:32:52.430 INFO:tasks.workunit.client.0.smithi029.stdout:4/465: fsync de/f5d 0 2024-04-15T00:32:52.451 INFO:tasks.workunit.client.0.smithi029.stdout:9/456: chown d3/f34 447940964 1 2024-04-15T00:32:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:2/466: dread d3/d13/f62 [0,4194304] 0 2024-04-15T00:32:52.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/482: mknod d8/d4a/d78/d23/c99 0 2024-04-15T00:32:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/474: write d5/d15/d1f/f73 [2245960,24815] 0 2024-04-15T00:32:52.730 INFO:tasks.workunit.client.0.smithi029.stdout:3/471: dread - d17/d2a/d4c/f8c zero size 2024-04-15T00:32:52.741 INFO:tasks.workunit.client.0.smithi029.stdout:1/476: getdents df/d29 0 2024-04-15T00:32:52.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/491: rename d1/d8/d72/f7f to d1/d8/db/d7b/d91/fa4 0 2024-04-15T00:32:52.810 INFO:tasks.workunit.client.0.smithi029.stdout:0/475: chown d5/d3e/f69 17615540 1 2024-04-15T00:32:52.835 INFO:tasks.workunit.client.0.smithi029.stdout:7/469: creat d0/d6/d4f/d66/d26/d77/d89/fa1 x:0 0 0 2024-04-15T00:32:52.942 INFO:tasks.workunit.client.0.smithi029.stdout:4/466: dread de/d2b/d35/f73 [0,4194304] 0 2024-04-15T00:32:52.998 INFO:tasks.workunit.client.0.smithi029.stdout:7/470: sync 2024-04-15T00:32:53.166 INFO:tasks.workunit.client.0.smithi029.stdout:8/483: creat d8/d4a/d78/d23/d28/d5f/f9a x:0 0 0 2024-04-15T00:32:53.172 INFO:tasks.workunit.client.0.smithi029.stdout:9/457: write d3/d6/d9/f50 [809326,78931] 0 2024-04-15T00:32:53.481 INFO:tasks.workunit.client.0.smithi029.stdout:6/492: truncate d1/f17 3761209 0 2024-04-15T00:32:53.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/467: fsync d3/f38 0 2024-04-15T00:32:53.656 INFO:tasks.workunit.client.0.smithi029.stdout:0/476: mknod d5/db/d1a/d65/d76/c99 0 2024-04-15T00:32:53.665 INFO:tasks.workunit.client.0.smithi029.stdout:0/477: chown d5/d3e/f69 3 1 2024-04-15T00:32:53.773 INFO:tasks.workunit.client.0.smithi029.stdout:0/478: dwrite d5/d15/d1f/f73 [0,4194304] 0 2024-04-15T00:32:53.848 INFO:tasks.workunit.client.0.smithi029.stdout:5/499: link d2/de/d13/d22/d3c/d41/d6d/l85 d2/de/d13/d22/d26/d36/d4d/d70/d8d/lb4 0 2024-04-15T00:32:53.878 INFO:tasks.workunit.client.0.smithi029.stdout:1/477: write df/d29/d41/d69/d4c/f75 [444307,47688] 0 2024-04-15T00:32:53.945 INFO:tasks.workunit.client.0.smithi029.stdout:3/472: dwrite d17/d2f/d76/f7a [0,4194304] 0 2024-04-15T00:32:54.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/478: dread df/f28 [0,4194304] 0 2024-04-15T00:32:54.185 INFO:tasks.workunit.client.0.smithi029.stdout:0/479: dread d5/d15/d1f/d32/f3d [0,4194304] 0 2024-04-15T00:32:54.204 INFO:tasks.workunit.client.0.smithi029.stdout:9/458: write d3/f34 [1032498,32041] 0 2024-04-15T00:32:54.281 INFO:tasks.workunit.client.0.smithi029.stdout:6/493: truncate d1/f7c 905741 0 2024-04-15T00:32:54.480 INFO:tasks.workunit.client.0.smithi029.stdout:7/471: mkdir d0/d6/da2 0 2024-04-15T00:32:54.513 INFO:tasks.workunit.client.0.smithi029.stdout:5/500: write d2/d1a/faf [573704,84695] 0 2024-04-15T00:32:54.535 INFO:tasks.workunit.client.0.smithi029.stdout:5/501: chown d2/de/d13/d22/d26/d36/l58 507 1 2024-04-15T00:32:54.753 INFO:tasks.workunit.client.0.smithi029.stdout:4/467: dwrite de/d54/f81 [4194304,4194304] 0 2024-04-15T00:32:54.901 INFO:tasks.workunit.client.0.smithi029.stdout:0/480: rename d5/db/d1a/d65/d76/f85 to d5/db/d7b/d94/f9a 0 2024-04-15T00:32:54.905 INFO:tasks.workunit.client.0.smithi029.stdout:9/459: truncate d3/d6/d9/d29/d5d/f3a 4550765 0 2024-04-15T00:32:55.060 INFO:tasks.workunit.client.0.smithi029.stdout:5/502: creat d2/de/d13/d22/d3c/fb5 x:0 0 0 2024-04-15T00:32:55.122 INFO:tasks.workunit.client.0.smithi029.stdout:4/468: creat de/d54/d58/d8a/f98 x:0 0 0 2024-04-15T00:32:55.223 INFO:tasks.workunit.client.0.smithi029.stdout:1/479: unlink df/d29/d41/d69/d4c/d55/d80/l9a 0 2024-04-15T00:32:55.304 INFO:tasks.workunit.client.0.smithi029.stdout:1/480: dwrite df/f3e [0,4194304] 0 2024-04-15T00:32:55.365 INFO:tasks.workunit.client.0.smithi029.stdout:1/481: chown c5 1317722 1 2024-04-15T00:32:55.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/472: rename d0/d6/d4f/d66/d26/l30 to d0/d6/d4f/d66/d26/d54/la3 0 2024-04-15T00:32:55.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/460: truncate d3/d6/d9/d29/d5d/f36 3255706 0 2024-04-15T00:32:55.508 INFO:tasks.workunit.client.0.smithi029.stdout:6/494: creat d1/d8/d72/da3/fa5 x:0 0 0 2024-04-15T00:32:55.594 INFO:tasks.workunit.client.0.smithi029.stdout:2/468: creat d3/f91 x:0 0 0 2024-04-15T00:32:55.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/503: truncate d2/de/d13/d22/f5a 1280561 0 2024-04-15T00:32:55.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/484: dwrite d8/da/f49 [0,4194304] 0 2024-04-15T00:32:55.778 INFO:tasks.workunit.client.0.smithi029.stdout:4/469: creat de/d54/d58/d8a/d8d/f99 x:0 0 0 2024-04-15T00:32:55.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/482: mknod df/d29/d41/d69/d4c/d55/d80/ca8 0 2024-04-15T00:32:55.887 INFO:tasks.workunit.client.0.smithi029.stdout:9/461: mkdir d3/d6/d9/d29/d5d/d96 0 2024-04-15T00:32:55.976 INFO:tasks.workunit.client.0.smithi029.stdout:7/473: dread d0/d6/f3b [0,4194304] 0 2024-04-15T00:32:56.037 INFO:tasks.workunit.client.0.smithi029.stdout:3/473: link lc d17/d2a/l98 0 2024-04-15T00:32:56.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/470: fdatasync de/f74 0 2024-04-15T00:32:56.058 INFO:tasks.workunit.client.0.smithi029.stdout:4/471: chown de/d2b 509088 1 2024-04-15T00:32:56.061 INFO:tasks.workunit.client.0.smithi029.stdout:3/474: stat d17/d2f/d76/f8b 0 2024-04-15T00:32:56.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/485: creat d8/da/d2f/f9b x:0 0 0 2024-04-15T00:32:56.124 INFO:tasks.workunit.client.0.smithi029.stdout:3/475: write d17/d2f/d76/f7a [2752242,59026] 0 2024-04-15T00:32:56.130 INFO:tasks.workunit.client.0.smithi029.stdout:4/472: chown de/df/d1e/d56/f80 49822555 1 2024-04-15T00:32:56.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/504: symlink d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/lb6 0 2024-04-15T00:32:56.259 INFO:tasks.workunit.client.0.smithi029.stdout:1/483: symlink df/d29/d41/d4f/la9 0 2024-04-15T00:32:56.402 INFO:tasks.workunit.client.0.smithi029.stdout:9/462: mkdir d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97 0 2024-04-15T00:32:56.915 INFO:tasks.workunit.client.0.smithi029.stdout:4/473: mknod de/d54/d58/c9a 0 2024-04-15T00:32:57.000 INFO:tasks.workunit.client.0.smithi029.stdout:0/481: dwrite d5/d4c/f84 [0,4194304] 0 2024-04-15T00:32:57.063 INFO:tasks.workunit.client.0.smithi029.stdout:8/486: rename d8/d4a/d78/d23/f51 to d8/da/f9c 0 2024-04-15T00:32:57.122 INFO:tasks.workunit.client.0.smithi029.stdout:6/495: creat d1/d1e/d22/fa6 x:0 0 0 2024-04-15T00:32:57.146 INFO:tasks.workunit.client.0.smithi029.stdout:1/484: fsync df/d29/d41/d69/d4c/f5c 0 2024-04-15T00:32:57.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/469: write d3/d13/d43/d5a/d4f/f5d [238505,122187] 0 2024-04-15T00:32:57.473 INFO:tasks.workunit.client.0.smithi029.stdout:4/474: dread f2 [0,4194304] 0 2024-04-15T00:32:57.524 INFO:tasks.workunit.client.0.smithi029.stdout:6/496: truncate d1/f92 336461 0 2024-04-15T00:32:57.561 INFO:tasks.workunit.client.0.smithi029.stdout:0/482: dread d5/d15/d1f/d32/f61 [0,4194304] 0 2024-04-15T00:32:57.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/463: symlink d3/d6/d9/d29/l98 0 2024-04-15T00:32:57.801 INFO:tasks.workunit.client.0.smithi029.stdout:7/474: dwrite d0/d6/d39/d3c/d42/d49/d71/f92 [0,4194304] 0 2024-04-15T00:32:57.882 INFO:tasks.workunit.client.0.smithi029.stdout:6/497: chown d1/d1e/l52 26047003 1 2024-04-15T00:32:57.958 INFO:tasks.workunit.client.0.smithi029.stdout:0/483: symlink d5/d15/d1f/d32/l9b 0 2024-04-15T00:32:58.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/470: dread d3/d13/d14/f20 [8388608,4194304] 0 2024-04-15T00:32:58.105 INFO:tasks.workunit.client.0.smithi029.stdout:9/464: dread d3/d6/d9/d29/d60/d64/d6d/f6b [0,4194304] 0 2024-04-15T00:32:58.142 INFO:tasks.workunit.client.0.smithi029.stdout:5/505: write f0 [3287482,23585] 0 2024-04-15T00:32:58.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/506: readlink d2/de/d13/d22/d26/l66 0 2024-04-15T00:32:58.199 INFO:tasks.workunit.client.0.smithi029.stdout:6/498: fsync d1/d8/db/f15 0 2024-04-15T00:32:58.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/475: creat d0/d6/d39/d3c/d5b/fa4 x:0 0 0 2024-04-15T00:32:58.250 INFO:tasks.workunit.client.0.smithi029.stdout:5/507: dread d2/de/d13/d22/d3c/f50 [0,4194304] 0 2024-04-15T00:32:58.257 INFO:tasks.workunit.client.0.smithi029.stdout:6/499: dread - d1/d8/db/d38/f67 zero size 2024-04-15T00:32:58.294 INFO:tasks.workunit.client.0.smithi029.stdout:0/484: mknod d5/db/d8f/c9c 0 2024-04-15T00:32:58.507 INFO:tasks.workunit.client.0.smithi029.stdout:3/476: write d17/d2a/d46/d67/f8a [271282,58870] 0 2024-04-15T00:32:58.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/487: getdents d8/d4a/d78 0 2024-04-15T00:32:58.869 INFO:tasks.workunit.client.0.smithi029.stdout:4/475: dwrite de/d2b/d59/f6f [0,4194304] 0 2024-04-15T00:32:58.938 INFO:tasks.workunit.client.0.smithi029.stdout:9/465: creat d3/d6/d9/d29/d60/d64/d6d/d58/f99 x:0 0 0 2024-04-15T00:32:59.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/476: fsync d0/d6/d1c/fe 0 2024-04-15T00:32:59.075 INFO:tasks.workunit.client.0.smithi029.stdout:1/485: dwrite df/d29/d41/d69/d78/f74 [0,4194304] 0 2024-04-15T00:32:59.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/500: unlink d1/c5c 0 2024-04-15T00:32:59.209 INFO:tasks.workunit.client.0.smithi029.stdout:0/485: chown d5/d15/c66 3746 1 2024-04-15T00:32:59.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/486: chown d5/db/f45 99254714 1 2024-04-15T00:32:59.260 INFO:tasks.workunit.client.0.smithi029.stdout:2/471: creat d3/dd/d2d/d61/d85/f92 x:0 0 0 2024-04-15T00:32:59.607 INFO:tasks.workunit.client.0.smithi029.stdout:4/476: unlink de/d3a/c77 0 2024-04-15T00:32:59.722 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:59.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:32:59.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/466: rename d3/d6/d9/d29/d5d to d3/d6/d9/d29/d60/d57/d9a 0 2024-04-15T00:32:59.944 INFO:tasks.workunit.client.0.smithi029.stdout:7/477: mknod d0/d6/d4f/d5d/ca5 0 2024-04-15T00:33:00.138 INFO:tasks.workunit.client.0.smithi029.stdout:0/487: symlink d5/db/d1a/d65/d76/l9d 0 2024-04-15T00:33:00.187 INFO:tasks.workunit.client.0.smithi029.stdout:2/472: stat d3/d13/d43/d5a/d4f/c7f 0 2024-04-15T00:33:00.265 INFO:tasks.workunit.client.0.smithi029.stdout:4/477: mkdir de/d6d/d7e/d9b 0 2024-04-15T00:33:00.273 INFO:tasks.workunit.client.0.smithi029.stdout:4/478: chown de/d2b/d35/l6c 120937 1 2024-04-15T00:33:00.287 INFO:tasks.workunit.client.0.smithi029.stdout:9/467: dread - d3/d6/d9/f75 zero size 2024-04-15T00:33:00.301 INFO:tasks.workunit.client.0.smithi029.stdout:9/468: stat d3/d6/d9/d29/d60/d64/l8c 0 2024-04-15T00:33:00.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/478: mkdir d0/d6/d4f/d5d/d87/da6 0 2024-04-15T00:33:00.336 INFO:tasks.workunit.client.0.smithi029.stdout:7/479: stat d0/d6/d4f/d66/d26/f28 0 2024-04-15T00:33:00.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/479: mknod de/df/d1e/c9c 0 2024-04-15T00:33:00.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/508: dwrite d2/de/d13/d22/d3c/d41/d6d/f8c [0,4194304] 0 2024-04-15T00:33:00.969 INFO:tasks.workunit.client.0.smithi029.stdout:9/469: rename d3/d6/d9/d15/d4a/l68 to d3/d6/d9/d15/d7e/l9b 0 2024-04-15T00:33:01.017 INFO:tasks.workunit.client.0.smithi029.stdout:3/477: write d17/d2a/f35 [750456,120474] 0 2024-04-15T00:33:01.164 INFO:tasks.workunit.client.0.smithi029.stdout:5/509: dwrite d2/de/d13/d22/d3c/fb5 [0,4194304] 0 2024-04-15T00:33:01.173 INFO:tasks.workunit.client.0.smithi029.stdout:4/480: creat de/d6d/f9d x:0 0 0 2024-04-15T00:33:01.324 INFO:tasks.workunit.client.0.smithi029.stdout:5/510: readlink d2/de/d13/l5b 0 2024-04-15T00:33:01.344 INFO:tasks.workunit.client.0.smithi029.stdout:8/488: dwrite d8/f7c [0,4194304] 0 2024-04-15T00:33:01.619 INFO:tasks.workunit.client.0.smithi029.stdout:3/478: rename d17/d2a/d33/f49 to d17/d2a/d33/d37/f99 0 2024-04-15T00:33:01.660 INFO:tasks.workunit.client.0.smithi029.stdout:2/473: mkdir d3/d93 0 2024-04-15T00:33:01.810 INFO:tasks.workunit.client.0.smithi029.stdout:5/511: creat d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fb7 x:0 0 0 2024-04-15T00:33:01.855 INFO:tasks.workunit.client.0.smithi029.stdout:8/489: mknod d8/d4a/d78/d23/d28/c9d 0 2024-04-15T00:33:01.888 INFO:tasks.workunit.client.0.smithi029.stdout:3/479: fsync d17/d2f/d44/d58/d5c/f81 0 2024-04-15T00:33:01.992 INFO:tasks.workunit.client.0.smithi029.stdout:9/470: creat d3/d6/f9c x:0 0 0 2024-04-15T00:33:02.029 INFO:tasks.workunit.client.0.smithi029.stdout:5/512: creat d2/de/d13/d22/d26/d36/d4d/d70/fb8 x:0 0 0 2024-04-15T00:33:02.033 INFO:tasks.workunit.client.0.smithi029.stdout:6/501: write d1/d1e/d22/f6a [1157802,89290] 0 2024-04-15T00:33:02.167 INFO:tasks.workunit.client.0.smithi029.stdout:1/486: dwrite df/d29/d41/d69/d4c/d55/d59/f67 [0,4194304] 0 2024-04-15T00:33:02.247 INFO:tasks.workunit.client.0.smithi029.stdout:3/480: unlink d17/l57 0 2024-04-15T00:33:02.484 INFO:tasks.workunit.client.0.smithi029.stdout:6/502: truncate d1/d8/db/d38/f8a 310799 0 2024-04-15T00:33:02.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/481: rename d17/d2f/d44/f4f to d17/d2f/d44/d58/d5c/f9a 0 2024-04-15T00:33:02.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/513: symlink d2/da5/lb9 0 2024-04-15T00:33:02.751 INFO:tasks.workunit.client.0.smithi029.stdout:0/488: write d5/db/f29 [2465968,25401] 0 2024-04-15T00:33:02.804 INFO:tasks.workunit.client.0.smithi029.stdout:3/482: rmdir d17/d2a 39 2024-04-15T00:33:02.811 INFO:tasks.workunit.client.0.smithi029.stdout:5/514: stat d2/de/d13/d22/d26/l3d 0 2024-04-15T00:33:02.823 INFO:tasks.workunit.client.0.smithi029.stdout:7/480: dwrite d0/d6/d4f/d5d/d87/f8c [0,4194304] 0 2024-04-15T00:33:03.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/483: creat d17/d83/f9b x:0 0 0 2024-04-15T00:33:03.204 INFO:tasks.workunit.client.0.smithi029.stdout:4/481: write de/df/f18 [762218,69197] 0 2024-04-15T00:33:03.588 INFO:tasks.workunit.client.0.smithi029.stdout:8/490: dwrite d8/d4a/d78/f1c [4194304,4194304] 0 2024-04-15T00:33:03.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/474: write d3/d13/f83 [79945,53072] 0 2024-04-15T00:33:03.676 INFO:tasks.workunit.client.0.smithi029.stdout:1/487: write df/f28 [1522446,62414] 0 2024-04-15T00:33:03.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/471: write d3/d6/d9/d29/d60/d57/d9a/f3a [921241,23222] 0 2024-04-15T00:33:03.741 INFO:tasks.workunit.client.0.smithi029.stdout:2/475: chown d3/dd/d2d/d61/d85/f92 2592 1 2024-04-15T00:33:03.870 INFO:tasks.workunit.client.0.smithi029.stdout:2/476: dread d3/d13/d14/f20 [4194304,4194304] 0 2024-04-15T00:33:03.877 INFO:tasks.workunit.client.0.smithi029.stdout:7/481: mknod d0/d6/d4f/d5d/d65/ca7 0 2024-04-15T00:33:03.884 INFO:tasks.workunit.client.0.smithi029.stdout:6/503: write d1/d1e/d22/f83 [7107876,113579] 0 2024-04-15T00:33:03.951 INFO:tasks.workunit.client.0.smithi029.stdout:5/515: truncate d2/de/d13/d22/f5e 1103213 0 2024-04-15T00:33:04.404 INFO:tasks.workunit.client.0.smithi029.stdout:7/482: sync 2024-04-15T00:33:04.465 INFO:tasks.workunit.client.0.smithi029.stdout:2/477: mknod d3/d2a/d4e/c94 0 2024-04-15T00:33:04.597 INFO:tasks.workunit.client.0.smithi029.stdout:3/484: read d17/d2a/d46/f6c [1282358,91387] 0 2024-04-15T00:33:04.687 INFO:tasks.workunit.client.0.smithi029.stdout:5/516: dread d2/de/d13/d22/d26/d36/f37 [0,4194304] 0 2024-04-15T00:33:04.814 INFO:tasks.workunit.client.0.smithi029.stdout:9/472: mkdir d3/d6/d9/d15/d9d 0 2024-04-15T00:33:04.907 INFO:tasks.workunit.client.0.smithi029.stdout:7/483: fdatasync d0/d6/d4f/f7f 0 2024-04-15T00:33:04.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/478: readlink d3/la 0 2024-04-15T00:33:04.982 INFO:tasks.workunit.client.0.smithi029.stdout:0/489: dwrite d5/db/d8f/f98 [0,4194304] 0 2024-04-15T00:33:05.055 INFO:tasks.workunit.client.0.smithi029.stdout:6/504: creat d1/d8/db/d38/d6f/fa7 x:0 0 0 2024-04-15T00:33:05.126 INFO:tasks.workunit.client.0.smithi029.stdout:4/482: link de/d2b/d35/f3d de/df/d1e/d56/f9e 0 2024-04-15T00:33:05.213 INFO:tasks.workunit.client.0.smithi029.stdout:8/491: rename d8/da/d3d/d8a/f8d to d8/da/d2f/d6e/f9e 0 2024-04-15T00:33:05.235 INFO:tasks.workunit.client.0.smithi029.stdout:3/485: dread d17/d2a/f2c [0,4194304] 0 2024-04-15T00:33:05.399 INFO:tasks.workunit.client.0.smithi029.stdout:8/492: dread d8/da/d2f/d42/f7b [0,4194304] 0 2024-04-15T00:33:05.454 INFO:tasks.workunit.client.0.smithi029.stdout:6/505: creat d1/d8/db/d38/fa8 x:0 0 0 2024-04-15T00:33:05.502 INFO:tasks.workunit.client.0.smithi029.stdout:2/479: truncate d3/d2a/f3a 554528 0 2024-04-15T00:33:05.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/517: rename d2/d1a/d2d/c60 to d2/de/d13/daa/cba 0 2024-04-15T00:33:05.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/488: unlink df/f62 0 2024-04-15T00:33:05.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/486: fdatasync ff 0 2024-04-15T00:33:05.709 INFO:tasks.workunit.client.0.smithi029.stdout:4/483: truncate de/df/d1e/f22 1768017 0 2024-04-15T00:33:05.819 INFO:tasks.workunit.client.0.smithi029.stdout:7/484: mkdir d0/d6/da8 0 2024-04-15T00:33:06.011 INFO:tasks.workunit.client.0.smithi029.stdout:8/493: dread d8/da/f9c [0,4194304] 0 2024-04-15T00:33:06.093 INFO:tasks.workunit.client.0.smithi029.stdout:2/480: rename d3/d13/d14 to d3/d2a/d46/d95 0 2024-04-15T00:33:06.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/487: truncate f15 6207326 0 2024-04-15T00:33:06.125 INFO:tasks.workunit.client.0.smithi029.stdout:1/489: mknod df/d29/d41/d69/d4c/d7a/caa 0 2024-04-15T00:33:06.186 INFO:tasks.workunit.client.0.smithi029.stdout:4/484: symlink de/d54/d58/l9f 0 2024-04-15T00:33:06.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/490: dwrite d5/d3e/f69 [0,4194304] 0 2024-04-15T00:33:06.732 INFO:tasks.workunit.client.0.smithi029.stdout:2/481: symlink d3/d2a/d6d/l96 0 2024-04-15T00:33:06.743 INFO:tasks.workunit.client.0.smithi029.stdout:1/490: unlink df/l14 0 2024-04-15T00:33:06.759 INFO:tasks.workunit.client.0.smithi029.stdout:9/473: dwrite d3/f3e [0,4194304] 0 2024-04-15T00:33:06.844 INFO:tasks.workunit.client.0.smithi029.stdout:4/485: rmdir de/d54/d71 39 2024-04-15T00:33:06.866 INFO:tasks.workunit.client.0.smithi029.stdout:7/485: symlink d0/d6/d4f/d5d/d87/da6/la9 0 2024-04-15T00:33:06.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/506: write d1/d8/db/d38/f39 [8759670,104636] 0 2024-04-15T00:33:06.955 INFO:tasks.workunit.client.0.smithi029.stdout:5/518: write d2/f7 [5800224,52652] 0 2024-04-15T00:33:07.076 INFO:tasks.workunit.client.0.smithi029.stdout:3/488: dread d17/d2a/d4c/f70 [0,4194304] 0 2024-04-15T00:33:07.163 INFO:tasks.workunit.client.0.smithi029.stdout:8/494: dwrite d8/d4a/d78/d23/f57 [4194304,4194304] 0 2024-04-15T00:33:07.240 INFO:tasks.workunit.client.0.smithi029.stdout:0/491: symlink d5/db/d7b/l9e 0 2024-04-15T00:33:07.250 INFO:tasks.workunit.client.0.smithi029.stdout:5/519: read - d2/de/d13/d22/d26/d36/d4d/d70/d8d/f91 zero size 2024-04-15T00:33:07.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/492: chown d5/d15/d27/c79 8 1 2024-04-15T00:33:07.281 INFO:tasks.workunit.client.0.smithi029.stdout:8/495: chown d8/da/d2f/d42/f54 375541609 1 2024-04-15T00:33:07.380 INFO:tasks.workunit.client.0.smithi029.stdout:4/486: dread de/d2b/d59/f6f [0,4194304] 0 2024-04-15T00:33:07.388 INFO:tasks.workunit.client.0.smithi029.stdout:4/487: readlink de/df/l78 0 2024-04-15T00:33:07.465 INFO:tasks.workunit.client.0.smithi029.stdout:7/486: truncate d0/d6/f25 4783795 0 2024-04-15T00:33:07.531 INFO:tasks.workunit.client.0.smithi029.stdout:1/491: write df/f4d [671747,121690] 0 2024-04-15T00:33:07.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/507: write d1/d8/db/d7b/f93 [635121,15285] 0 2024-04-15T00:33:07.608 INFO:tasks.workunit.client.0.smithi029.stdout:0/493: readlink d5/d15/d1f/l3f 0 2024-04-15T00:33:07.676 INFO:tasks.workunit.client.0.smithi029.stdout:7/487: sync 2024-04-15T00:33:07.864 INFO:tasks.workunit.client.0.smithi029.stdout:8/496: creat d8/da/d3d/d8a/f9f x:0 0 0 2024-04-15T00:33:07.887 INFO:tasks.workunit.client.0.smithi029.stdout:9/474: creat d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e x:0 0 0 2024-04-15T00:33:08.027 INFO:tasks.workunit.client.0.smithi029.stdout:1/492: mknod df/d29/d41/d69/d78/cab 0 2024-04-15T00:33:08.063 INFO:tasks.workunit.client.0.smithi029.stdout:2/482: rename d3/d13/f62 to d3/d13/f97 0 2024-04-15T00:33:08.148 INFO:tasks.workunit.client.0.smithi029.stdout:4/488: unlink de/d2b/d59/f92 0 2024-04-15T00:33:08.212 INFO:tasks.workunit.client.0.smithi029.stdout:3/489: creat d17/d2f/d44/f9c x:0 0 0 2024-04-15T00:33:08.252 INFO:tasks.workunit.client.0.smithi029.stdout:8/497: unlink d8/l93 0 2024-04-15T00:33:08.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/508: mknod d1/d8/d79/d9f/ca9 0 2024-04-15T00:33:08.420 INFO:tasks.workunit.client.0.smithi029.stdout:0/494: mkdir d5/d15/d27/d9f 0 2024-04-15T00:33:08.926 INFO:tasks.workunit.client.0.smithi029.stdout:5/520: write d2/d1a/f59 [2995262,17992] 0 2024-04-15T00:33:09.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/483: dread d3/d13/f2f [0,4194304] 0 2024-04-15T00:33:09.077 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:32:39.587 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/488: dwrite d0/d6/d39/d3c/d5b/fa4 [0,4194304] 0 2024-04-15T00:33:09.140 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:32:39.650 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.169 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:32:39.679 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.194 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:32:39.684 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.197 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:32:39.688 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.202 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:32:39.693 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.205 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:32:39.696 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.213 INFO:tasks.workunit.client.0.smithi029.stdout:9/475: fdatasync d3/d6/d9/d29/d60/d64/f8b 0 2024-04-15T00:33:09.227 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:32:39.718 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.233 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:32:39.724 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:33:09.236 INFO:tasks.workunit.client.0.smithi029.stdout:9/476: readlink d3/d6/d9/d15/l79 0 2024-04-15T00:33:09.385 INFO:tasks.workunit.client.0.smithi029.stdout:9/477: sync 2024-04-15T00:33:09.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/489: rename de/df/d1e/l4a to de/d54/d58/d8a/d8d/la0 0 2024-04-15T00:33:09.943 INFO:tasks.workunit.client.0.smithi029.stdout:4/490: sync 2024-04-15T00:33:09.967 INFO:tasks.workunit.client.0.smithi029.stdout:6/509: dread d1/d8/db/d7b/d91/fa4 [0,4194304] 0 2024-04-15T00:33:09.990 INFO:tasks.workunit.client.0.smithi029.stdout:5/521: unlink d2/de/d13/d22/d26/f49 0 2024-04-15T00:33:10.033 INFO:tasks.workunit.client.0.smithi029.stdout:0/495: dread d5/d4c/d4e/f80 [0,4194304] 0 2024-04-15T00:33:10.049 INFO:tasks.workunit.client.0.smithi029.stdout:1/493: dwrite df/d29/d41/d69/f9d [0,4194304] 0 2024-04-15T00:33:10.120 INFO:tasks.workunit.client.0.smithi029.stdout:7/489: creat d0/d6/d4f/d66/d26/faa x:0 0 0 2024-04-15T00:33:10.570 INFO:tasks.workunit.client.0.smithi029.stdout:6/510: creat d1/d8/d72/da3/faa x:0 0 0 2024-04-15T00:33:10.696 INFO:tasks.workunit.client.0.smithi029.stdout:0/496: unlink d5/db/d1a/l41 0 2024-04-15T00:33:10.745 INFO:tasks.workunit.client.0.smithi029.stdout:7/490: truncate d0/f7c 1119770 0 2024-04-15T00:33:10.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/491: dread d0/d6/d1c/fe [0,4194304] 0 2024-04-15T00:33:10.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/492: chown d0/d6/d1c/l12 215 1 2024-04-15T00:33:10.929 INFO:tasks.workunit.client.0.smithi029.stdout:3/490: getdents d17/d2a/d46 0 2024-04-15T00:33:11.125 INFO:tasks.workunit.client.0.smithi029.stdout:7/493: mkdir d0/d6/d39/d3c/d42/d49/d71/dab 0 2024-04-15T00:33:11.171 INFO:tasks.workunit.client.0.smithi029.stdout:4/491: creat de/d54/fa1 x:0 0 0 2024-04-15T00:33:11.302 INFO:tasks.workunit.client.0.smithi029.stdout:6/511: mkdir d1/d1e/d56/d58/d5f/dab 0 2024-04-15T00:33:11.378 INFO:tasks.workunit.client.0.smithi029.stdout:9/478: getdents d3/d6/d9/d29/d60/d57 0 2024-04-15T00:33:11.497 INFO:tasks.workunit.client.0.smithi029.stdout:4/492: rmdir de/d2b 39 2024-04-15T00:33:11.564 INFO:tasks.workunit.client.0.smithi029.stdout:9/479: dread d3/d6/d9/f49 [0,4194304] 0 2024-04-15T00:33:11.636 INFO:tasks.workunit.client.0.smithi029.stdout:7/494: dread d0/d6/d4f/d66/d26/f38 [0,4194304] 0 2024-04-15T00:33:11.833 INFO:tasks.workunit.client.0.smithi029.stdout:8/498: mknod d8/d4a/ca0 0 2024-04-15T00:33:11.937 INFO:tasks.workunit.client.0.smithi029.stdout:2/484: dwrite d3/d13/f16 [0,4194304] 0 2024-04-15T00:33:12.015 INFO:tasks.workunit.client.0.smithi029.stdout:4/493: symlink de/d54/d58/d8a/la2 0 2024-04-15T00:33:12.031 INFO:tasks.workunit.client.0.smithi029.stdout:3/491: write d17/d2a/d33/f63 [2407873,114093] 0 2024-04-15T00:33:12.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/497: write d5/d15/d57/d5e/f71 [372562,29385] 0 2024-04-15T00:33:12.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/495: rmdir d0/d6/d39/d3c 39 2024-04-15T00:33:12.057 INFO:tasks.workunit.client.0.smithi029.stdout:8/499: mkdir d8/d4a/da1 0 2024-04-15T00:33:12.074 INFO:tasks.workunit.client.0.smithi029.stdout:6/512: write d1/d8/f3d [641980,69564] 0 2024-04-15T00:33:12.178 INFO:tasks.workunit.client.0.smithi029.stdout:4/494: rmdir de/d6d 39 2024-04-15T00:33:12.178 INFO:tasks.workunit.client.0.smithi029.stdout:2/485: readlink d3/d2a/l7a 0 2024-04-15T00:33:12.195 INFO:tasks.workunit.client.0.smithi029.stdout:3/492: sync 2024-04-15T00:33:12.257 INFO:tasks.workunit.client.0.smithi029.stdout:1/494: dwrite df/f38 [0,4194304] 0 2024-04-15T00:33:12.321 INFO:tasks.workunit.client.0.smithi029.stdout:5/522: dwrite d2/de/d13/f32 [0,4194304] 0 2024-04-15T00:33:12.424 INFO:tasks.workunit.client.0.smithi029.stdout:0/498: symlink d5/db/d1a/la0 0 2024-04-15T00:33:12.473 INFO:tasks.workunit.client.0.smithi029.stdout:8/500: symlink d8/da/d3d/d8a/la2 0 2024-04-15T00:33:12.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/499: sync 2024-04-15T00:33:12.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/513: write d1/d8/db/d7b/d85/f8f [839102,41371] 0 2024-04-15T00:33:12.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/486: creat d3/d2a/d46/d95/f98 x:0 0 0 2024-04-15T00:33:12.819 INFO:tasks.workunit.client.0.smithi029.stdout:9/480: dwrite d3/f4e [0,4194304] 0 2024-04-15T00:33:12.829 INFO:tasks.workunit.client.0.smithi029.stdout:8/501: write d8/da/d3d/d8a/f8e [113452,112524] 0 2024-04-15T00:33:12.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/495: dread de/d3a/f4b [0,4194304] 0 2024-04-15T00:33:12.917 INFO:tasks.workunit.client.0.smithi029.stdout:1/495: mknod df/d29/d41/d69/d4c/d55/cac 0 2024-04-15T00:33:12.963 INFO:tasks.workunit.client.0.smithi029.stdout:7/496: dread d0/d6/d1c/f57 [0,4194304] 0 2024-04-15T00:33:13.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/496: chown df/f30 1 1 2024-04-15T00:33:13.089 INFO:tasks.workunit.client.0.smithi029.stdout:0/500: rename d5/db/d7b/d94 to d5/db/d1a/d50/da1 0 2024-04-15T00:33:13.172 INFO:tasks.workunit.client.0.smithi029.stdout:8/502: chown d8/da/d2f/d42/f54 13 1 2024-04-15T00:33:13.194 INFO:tasks.workunit.client.0.smithi029.stdout:3/493: dread d17/d2f/d44/f66 [4194304,4194304] 0 2024-04-15T00:33:13.197 INFO:tasks.workunit.client.0.smithi029.stdout:9/481: truncate d3/d6/f59 100265 0 2024-04-15T00:33:13.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/496: write de/f19 [4369698,102360] 0 2024-04-15T00:33:13.271 INFO:tasks.workunit.client.0.smithi029.stdout:2/487: write d3/d13/f83 [1056576,38237] 0 2024-04-15T00:33:13.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/523: dwrite d2/de/d13/d22/d3c/d41/d6d/f8c [0,4194304] 0 2024-04-15T00:33:13.390 INFO:tasks.workunit.client.0.smithi029.stdout:7/497: rename d0/d6/d39 to d0/d6/d39/d3c/d42/d49/d71/dab/dac 22 2024-04-15T00:33:13.527 INFO:tasks.workunit.client.0.smithi029.stdout:6/514: dwrite d1/d8/f9c [0,4194304] 0 2024-04-15T00:33:13.548 INFO:tasks.workunit.client.0.smithi029.stdout:1/497: symlink df/d29/d41/d69/d4c/d55/d80/d94/lad 0 2024-04-15T00:33:13.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/501: dread d5/d15/d1f/d32/f93 [0,4194304] 0 2024-04-15T00:33:13.650 INFO:tasks.workunit.client.0.smithi029.stdout:4/497: chown de/d2b/d59/f70 2924803 1 2024-04-15T00:33:13.688 INFO:tasks.workunit.client.0.smithi029.stdout:3/494: dwrite ff [0,4194304] 0 2024-04-15T00:33:13.853 INFO:tasks.workunit.client.0.smithi029.stdout:5/524: dread - d2/f95 zero size 2024-04-15T00:33:13.856 INFO:tasks.workunit.client.0.smithi029.stdout:9/482: fdatasync d3/d6/d9/d29/d60/d64/d6d/f6b 0 2024-04-15T00:33:13.863 INFO:tasks.workunit.client.0.smithi029.stdout:2/488: chown d3/d2a/l55 46924552 1 2024-04-15T00:33:13.897 INFO:tasks.workunit.client.0.smithi029.stdout:2/489: write d3/d13/f16 [2485447,49754] 0 2024-04-15T00:33:13.970 INFO:tasks.workunit.client.0.smithi029.stdout:8/503: mknod d8/d4a/d78/d23/d28/d30/d39/d77/d82/ca3 0 2024-04-15T00:33:13.995 INFO:tasks.workunit.client.0.smithi029.stdout:6/515: chown d1/f7c 760 1 2024-04-15T00:33:14.021 INFO:tasks.workunit.client.0.smithi029.stdout:7/498: dread d0/d6/d4f/d66/f61 [0,4194304] 0 2024-04-15T00:33:14.162 INFO:tasks.workunit.client.0.smithi029.stdout:8/504: sync 2024-04-15T00:33:14.211 INFO:tasks.workunit.client.0.smithi029.stdout:9/483: read d3/d6/d9/f2c [2171961,104298] 0 2024-04-15T00:33:14.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/490: mkdir d3/d13/d43/d5a/d4f/d99 0 2024-04-15T00:33:14.471 INFO:tasks.workunit.client.0.smithi029.stdout:6/516: symlink d1/d8/db/d7b/d85/lac 0 2024-04-15T00:33:14.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/505: fdatasync d8/fd 0 2024-04-15T00:33:14.943 INFO:tasks.workunit.client.0.smithi029.stdout:7/499: rename d0/d6/d4f/l95 to d0/d6/d4f/d5d/d87/da6/lad 0 2024-04-15T00:33:14.950 INFO:tasks.workunit.client.0.smithi029.stdout:1/498: write fd [1678332,79879] 0 2024-04-15T00:33:15.049 INFO:tasks.workunit.client.0.smithi029.stdout:3/495: creat d17/d2f/f9d x:0 0 0 2024-04-15T00:33:15.052 INFO:tasks.workunit.client.0.smithi029.stdout:0/502: write d5/d15/d1f/f73 [2015211,119892] 0 2024-04-15T00:33:15.097 INFO:tasks.workunit.client.0.smithi029.stdout:5/525: link d2/d1a/f2c d2/de/d13/d22/fbb 0 2024-04-15T00:33:15.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/491: mkdir d3/d13/d43/d9a 0 2024-04-15T00:33:15.185 INFO:tasks.workunit.client.0.smithi029.stdout:4/498: getdents de/d54/d58/d8a 0 2024-04-15T00:33:15.568 INFO:tasks.workunit.client.0.smithi029.stdout:9/484: write d3/d6/d9/d29/d60/d64/d6d/d58/f28 [260100,85376] 0 2024-04-15T00:33:15.588 INFO:tasks.workunit.client.0.smithi029.stdout:8/506: link d8/d4a/d78/d23/f57 d8/d4a/d78/d23/d28/d5f/fa4 0 2024-04-15T00:33:15.605 INFO:tasks.workunit.client.0.smithi029.stdout:9/485: stat d3/d6/d9/d29/d60/d64/d6d/d58/c8e 0 2024-04-15T00:33:15.616 INFO:tasks.workunit.client.0.smithi029.stdout:9/486: chown d3/d6/d9/f2c 193 1 2024-04-15T00:33:15.645 INFO:tasks.workunit.client.0.smithi029.stdout:9/487: read d3/d6/d9/d29/d60/f6e [1634101,130247] 0 2024-04-15T00:33:15.689 INFO:tasks.workunit.client.0.smithi029.stdout:0/503: rename d5/db/l14 to d5/db/d1a/d65/la2 0 2024-04-15T00:33:15.699 INFO:tasks.workunit.client.0.smithi029.stdout:0/504: readlink d5/db/d1a/l55 0 2024-04-15T00:33:15.824 INFO:tasks.workunit.client.0.smithi029.stdout:6/517: write d1/d1e/d56/f89 [228458,115384] 0 2024-04-15T00:33:15.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/518: stat d1/d8/db/d7b/d85 0 2024-04-15T00:33:15.952 INFO:tasks.workunit.client.0.smithi029.stdout:5/526: dread d2/f52 [4194304,4194304] 0 2024-04-15T00:33:16.000 INFO:tasks.workunit.client.0.smithi029.stdout:4/499: unlink de/d3a/c91 0 2024-04-15T00:33:16.066 INFO:tasks.workunit.client.0.smithi029.stdout:9/488: symlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/l9f 0 2024-04-15T00:33:16.109 INFO:tasks.workunit.client.0.smithi029.stdout:0/505: fsync d5/d3e/f69 0 2024-04-15T00:33:16.124 INFO:tasks.workunit.client.0.smithi029.stdout:0/506: chown d5/d15/d1f/d32/f43 4062069 1 2024-04-15T00:33:16.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/499: write df/f13 [5186583,66383] 0 2024-04-15T00:33:16.422 INFO:tasks.workunit.client.0.smithi029.stdout:7/500: getdents d0 0 2024-04-15T00:33:16.441 INFO:tasks.workunit.client.0.smithi029.stdout:3/496: getdents d17/d83 0 2024-04-15T00:33:16.441 INFO:tasks.workunit.client.0.smithi029.stdout:8/507: unlink d8/da/d2f/d6e/d5a/l74 0 2024-04-15T00:33:16.454 INFO:tasks.workunit.client.0.smithi029.stdout:9/489: rename d3/d6/d9/d29/d60/d57 to d3/d6/d9/d29/d60/d7f/da0 0 2024-04-15T00:33:16.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/507: fdatasync d5/d15/d1f/d32/f43 0 2024-04-15T00:33:16.614 INFO:tasks.workunit.client.0.smithi029.stdout:2/492: dwrite d3/dd/d2d/f34 [0,4194304] 0 2024-04-15T00:33:16.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/493: read - d3/dd/f35 zero size 2024-04-15T00:33:16.852 INFO:tasks.workunit.client.0.smithi029.stdout:9/490: dread d3/d6/d9/d29/d60/d7f/da0/d9a/f73 [0,4194304] 0 2024-04-15T00:33:16.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/500: rename de/d54/d58/d8a/d8d to de/d54/d71/da3 0 2024-04-15T00:33:16.895 INFO:tasks.workunit.client.0.smithi029.stdout:5/527: dwrite d2/f52 [4194304,4194304] 0 2024-04-15T00:33:16.960 INFO:tasks.workunit.client.0.smithi029.stdout:6/519: truncate d1/f17 2593379 0 2024-04-15T00:33:17.026 INFO:tasks.workunit.client.0.smithi029.stdout:6/520: write d1/d1e/d56/f89 [620418,94172] 0 2024-04-15T00:33:17.067 INFO:tasks.workunit.client.0.smithi029.stdout:3/497: symlink d17/d2f/d3c/l9e 0 2024-04-15T00:33:17.194 INFO:tasks.workunit.client.0.smithi029.stdout:1/500: creat df/d29/d41/d69/d4c/d55/d80/d94/fae x:0 0 0 2024-04-15T00:33:17.199 INFO:tasks.workunit.client.0.smithi029.stdout:0/508: dread d5/db/f29 [0,4194304] 0 2024-04-15T00:33:17.210 INFO:tasks.workunit.client.0.smithi029.stdout:9/491: symlink d3/d6/d9/d15/d4a/d53/la1 0 2024-04-15T00:33:17.358 INFO:tasks.workunit.client.0.smithi029.stdout:6/521: mknod d1/d8/db/d98/cad 0 2024-04-15T00:33:17.359 INFO:tasks.workunit.client.0.smithi029.stdout:5/528: creat d2/de/d13/d22/d26/d36/d4d/d70/d8d/fbc x:0 0 0 2024-04-15T00:33:17.359 INFO:tasks.workunit.client.0.smithi029.stdout:3/498: rmdir d17/d2f/d44/d58 39 2024-04-15T00:33:17.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/492: sync 2024-04-15T00:33:17.396 INFO:tasks.workunit.client.0.smithi029.stdout:3/499: write d17/f5b [2087328,50385] 0 2024-04-15T00:33:17.461 INFO:tasks.workunit.client.0.smithi029.stdout:1/501: truncate df/f2d 3924088 0 2024-04-15T00:33:17.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/529: creat d2/de/fbd x:0 0 0 2024-04-15T00:33:17.537 INFO:tasks.workunit.client.0.smithi029.stdout:0/509: dread d5/d15/d27/d28/f82 [0,4194304] 0 2024-04-15T00:33:17.572 INFO:tasks.workunit.client.0.smithi029.stdout:3/500: read d17/f4d [32794,22970] 0 2024-04-15T00:33:17.622 INFO:tasks.workunit.client.0.smithi029.stdout:0/510: sync 2024-04-15T00:33:17.776 INFO:tasks.workunit.client.0.smithi029.stdout:4/501: creat de/fa4 x:0 0 0 2024-04-15T00:33:17.791 INFO:tasks.workunit.client.0.smithi029.stdout:7/501: write d0/d6/f18 [1980638,11574] 0 2024-04-15T00:33:17.807 INFO:tasks.workunit.client.0.smithi029.stdout:7/502: chown d0/d6/d4f/d5d/f6d 0 1 2024-04-15T00:33:17.814 INFO:tasks.workunit.client.0.smithi029.stdout:7/503: chown d0/d6/l45 0 1 2024-04-15T00:33:17.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/502: sync 2024-04-15T00:33:17.970 INFO:tasks.workunit.client.0.smithi029.stdout:2/494: write d3/d2a/d46/f74 [4671564,24371] 0 2024-04-15T00:33:18.044 INFO:tasks.workunit.client.0.smithi029.stdout:6/522: mknod d1/d1e/d56/cae 0 2024-04-15T00:33:18.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/495: dwrite d3/dd/d2d/f34 [0,4194304] 0 2024-04-15T00:33:18.158 INFO:tasks.workunit.client.0.smithi029.stdout:2/496: sync 2024-04-15T00:33:18.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/530: rename d2/de/d13/d22/d3c/d41/l9d to d2/de/d13/d22/d3c/d41/d6d/lbe 0 2024-04-15T00:33:18.304 INFO:tasks.workunit.client.0.smithi029.stdout:8/508: link d8/da/d3d/l56 d8/d4a/d78/d23/la5 0 2024-04-15T00:33:18.311 INFO:tasks.workunit.client.0.smithi029.stdout:9/493: write d3/d6/d9/d29/d60/d64/f8b [1942815,117103] 0 2024-04-15T00:33:18.336 INFO:tasks.workunit.client.0.smithi029.stdout:1/502: mkdir df/d29/d41/daf 0 2024-04-15T00:33:18.452 INFO:tasks.workunit.client.0.smithi029.stdout:4/503: readlink de/d2b/d59/l67 0 2024-04-15T00:33:19.074 INFO:tasks.workunit.client.0.smithi029.stdout:0/511: symlink d5/d15/d27/d9f/la3 0 2024-04-15T00:33:19.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/509: rmdir d8/da/d2f 39 2024-04-15T00:33:19.222 INFO:tasks.workunit.client.0.smithi029.stdout:1/503: creat df/d29/d41/d69/d4c/d55/d59/fb0 x:0 0 0 2024-04-15T00:33:19.226 INFO:tasks.workunit.client.0.smithi029.stdout:7/504: mknod d0/d6/d4f/d5d/d82/cae 0 2024-04-15T00:33:19.235 INFO:tasks.workunit.client.0.smithi029.stdout:4/504: fsync de/d2b/d35/f73 0 2024-04-15T00:33:19.764 INFO:tasks.workunit.client.0.smithi029.stdout:9/494: mknod d3/d88/ca2 0 2024-04-15T00:33:20.033 INFO:tasks.workunit.client.0.smithi029.stdout:8/510: symlink d8/d4a/d78/d23/d28/d30/la6 0 2024-04-15T00:33:20.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/531: dwrite d2/de/d13/d22/d26/d36/d4d/d70/fb8 [0,4194304] 0 2024-04-15T00:33:20.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/511: mkdir d8/da7 0 2024-04-15T00:33:20.582 INFO:tasks.workunit.client.0.smithi029.stdout:8/512: mkdir d8/da8 0 2024-04-15T00:33:20.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/532: rmdir d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e 39 2024-04-15T00:33:20.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/505: getdents d0/d6/d4f/d66/d26/d77/d89 0 2024-04-15T00:33:20.734 INFO:tasks.workunit.client.0.smithi029.stdout:5/533: sync 2024-04-15T00:33:20.929 INFO:tasks.workunit.client.0.smithi029.stdout:0/512: write d5/d3e/f89 [4366057,87817] 0 2024-04-15T00:33:20.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/504: write df/d29/d41/d69/d4c/d55/d59/f67 [1251177,74153] 0 2024-04-15T00:33:21.061 INFO:tasks.workunit.client.0.smithi029.stdout:1/505: chown df/d29/f2c 210538 1 2024-04-15T00:33:21.088 INFO:tasks.workunit.client.0.smithi029.stdout:0/513: read d5/d15/d1f/d32/f49 [709144,58891] 0 2024-04-15T00:33:21.132 INFO:tasks.workunit.client.0.smithi029.stdout:3/501: dwrite d17/d2f/d44/d58/d5c/f64 [0,4194304] 0 2024-04-15T00:33:21.208 INFO:tasks.workunit.client.0.smithi029.stdout:3/502: sync 2024-04-15T00:33:21.213 INFO:tasks.workunit.client.0.smithi029.stdout:7/506: dread d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:33:21.236 INFO:tasks.workunit.client.0.smithi029.stdout:7/507: dread - d0/d6/d39/d3c/f70 zero size 2024-04-15T00:33:21.236 INFO:tasks.workunit.client.0.smithi029.stdout:3/503: chown d17/d2a/d4c/f8c 714593012 1 2024-04-15T00:33:21.257 INFO:tasks.workunit.client.0.smithi029.stdout:7/508: readlink d0/d6/d4f/d66/d26/l29 0 2024-04-15T00:33:21.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/534: rmdir d2/de/d1f/d63 39 2024-04-15T00:33:21.307 INFO:tasks.workunit.client.0.smithi029.stdout:6/523: rename d1/d8/db/d98/f77 to d1/d8/faf 0 2024-04-15T00:33:21.330 INFO:tasks.workunit.client.0.smithi029.stdout:4/505: write de/d6d/d7e/f82 [280636,48111] 0 2024-04-15T00:33:21.444 INFO:tasks.workunit.client.0.smithi029.stdout:9/495: dwrite d3/d6/f13 [0,4194304] 0 2024-04-15T00:33:21.519 INFO:tasks.workunit.client.0.smithi029.stdout:8/513: creat d8/da/d3d/fa9 x:0 0 0 2024-04-15T00:33:21.528 INFO:tasks.workunit.client.0.smithi029.stdout:7/509: chown d0/d6/d4f/d66/c48 7411 1 2024-04-15T00:33:21.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/497: rename d3/d2a/d4e/c94 to d3/d13/d43/d5a/d4f/d99/c9b 0 2024-04-15T00:33:21.888 INFO:tasks.workunit.client.0.smithi029.stdout:4/506: fsync f4 0 2024-04-15T00:33:21.912 INFO:tasks.workunit.client.0.smithi029.stdout:6/524: fdatasync d1/d1e/d56/d58/d59/f74 0 2024-04-15T00:33:21.913 INFO:tasks.workunit.client.0.smithi029.stdout:8/514: creat d8/d4a/d78/d23/faa x:0 0 0 2024-04-15T00:33:22.081 INFO:tasks.workunit.client.0.smithi029.stdout:1/506: creat df/fb1 x:0 0 0 2024-04-15T00:33:22.092 INFO:tasks.workunit.client.0.smithi029.stdout:5/535: write d2/f34 [526285,98191] 0 2024-04-15T00:33:22.128 INFO:tasks.workunit.client.0.smithi029.stdout:9/496: mkdir d3/da3 0 2024-04-15T00:33:22.222 INFO:tasks.workunit.client.0.smithi029.stdout:3/504: write d17/d2a/d33/d37/f99 [130714,16292] 0 2024-04-15T00:33:22.254 INFO:tasks.workunit.client.0.smithi029.stdout:6/525: dread - d1/d8/faf zero size 2024-04-15T00:33:22.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/507: rename de/c50 to de/d54/d71/d8b/ca5 0 2024-04-15T00:33:22.445 INFO:tasks.workunit.client.0.smithi029.stdout:0/514: getdents d5/d4c/d4e 0 2024-04-15T00:33:22.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/498: dwrite d3/d2a/d46/d95/f40 [8388608,4194304] 0 2024-04-15T00:33:22.632 INFO:tasks.workunit.client.0.smithi029.stdout:1/507: fdatasync df/d29/f79 0 2024-04-15T00:33:22.646 INFO:tasks.workunit.client.0.smithi029.stdout:3/505: fdatasync d17/d2f/d3c/f74 0 2024-04-15T00:33:22.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/515: mknod d8/d4a/d78/d87/cab 0 2024-04-15T00:33:22.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/536: dread d2/de/d13/f32 [0,4194304] 0 2024-04-15T00:33:22.767 INFO:tasks.workunit.client.0.smithi029.stdout:6/526: write d1/d8/db/d7b/d91/fa4 [3508072,70208] 0 2024-04-15T00:33:22.876 INFO:tasks.workunit.client.0.smithi029.stdout:0/515: rmdir d5/d15/d57 39 2024-04-15T00:33:22.886 INFO:tasks.workunit.client.0.smithi029.stdout:9/497: dwrite d3/d6/d9/d29/d60/d7f/da0/f83 [0,4194304] 0 2024-04-15T00:33:23.032 INFO:tasks.workunit.client.0.smithi029.stdout:7/510: getdents d0/d6/d39/d3c/d42/d49 0 2024-04-15T00:33:23.120 INFO:tasks.workunit.client.0.smithi029.stdout:0/516: dread d5/f62 [0,4194304] 0 2024-04-15T00:33:23.150 INFO:tasks.workunit.client.0.smithi029.stdout:2/499: mknod d3/dd/d2d/d61/d85/c9c 0 2024-04-15T00:33:23.161 INFO:tasks.workunit.client.0.smithi029.stdout:4/508: mkdir de/d54/da6 0 2024-04-15T00:33:23.171 INFO:tasks.workunit.client.0.smithi029.stdout:1/508: truncate df/d29/d41/f81 2502378 0 2024-04-15T00:33:23.236 INFO:tasks.workunit.client.0.smithi029.stdout:6/527: symlink d1/d8/d79/lb0 0 2024-04-15T00:33:23.251 INFO:tasks.workunit.client.0.smithi029.stdout:2/500: stat d3/dd/d42 0 2024-04-15T00:33:23.299 INFO:tasks.workunit.client.0.smithi029.stdout:9/498: dread d3/d6/d9/d29/d60/d64/d6d/d58/f2a [0,4194304] 0 2024-04-15T00:33:23.504 INFO:tasks.workunit.client.0.smithi029.stdout:3/506: mknod d17/d2a/d4c/d93/c9f 0 2024-04-15T00:33:23.529 INFO:tasks.workunit.client.0.smithi029.stdout:7/511: creat d0/d6/d4f/d66/d67/faf x:0 0 0 2024-04-15T00:33:23.531 INFO:tasks.workunit.client.0.smithi029.stdout:4/509: mkdir de/d54/d71/d8b/da7 0 2024-04-15T00:33:23.571 INFO:tasks.workunit.client.0.smithi029.stdout:0/517: dread d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:33:23.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/537: dread d2/de/d1f/d63/d65/f86 [0,4194304] 0 2024-04-15T00:33:23.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/512: stat d0/d6/d4f/d5d/f5e 0 2024-04-15T00:33:23.914 INFO:tasks.workunit.client.0.smithi029.stdout:9/499: readlink d3/l8 0 2024-04-15T00:33:23.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/500: chown d3/d6/d9/d29/d60/d7f/da0/d9a/d96 1086452 1 2024-04-15T00:33:24.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/510: rename de/d2b/d35/l6c to de/d3a/la8 0 2024-04-15T00:33:24.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/538: chown d2/c29 482 1 2024-04-15T00:33:24.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/507: truncate d17/d2f/d44/d5a/f7e 1033106 0 2024-04-15T00:33:24.256 INFO:tasks.workunit.client.0.smithi029.stdout:8/516: link d8/da/f88 d8/da/fac 0 2024-04-15T00:33:24.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/528: creat d1/d8/db/fb1 x:0 0 0 2024-04-15T00:33:24.461 INFO:tasks.workunit.client.0.smithi029.stdout:5/539: rmdir d2/de/d13/d22/d26/d36/d4d/d70/d9a 39 2024-04-15T00:33:24.565 INFO:tasks.workunit.client.0.smithi029.stdout:1/509: dwrite df/d29/d41/d69/d4c/d7a/fa6 [0,4194304] 0 2024-04-15T00:33:24.636 INFO:tasks.workunit.client.0.smithi029.stdout:1/510: read df/f42 [2045782,125620] 0 2024-04-15T00:33:24.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/518: symlink d5/d15/d27/d51/d7d/la4 0 2024-04-15T00:33:24.759 INFO:tasks.workunit.client.0.smithi029.stdout:6/529: mknod d1/d1e/d56/d58/d59/cb2 0 2024-04-15T00:33:24.807 INFO:tasks.workunit.client.0.smithi029.stdout:3/508: dread ff [0,4194304] 0 2024-04-15T00:33:24.819 INFO:tasks.workunit.client.0.smithi029.stdout:0/519: sync 2024-04-15T00:33:24.821 INFO:tasks.workunit.client.0.smithi029.stdout:2/501: dwrite d3/dd/d2d/d61/d85/f92 [0,4194304] 0 2024-04-15T00:33:24.954 INFO:tasks.workunit.client.0.smithi029.stdout:3/509: dread d17/d83/f65 [0,4194304] 0 2024-04-15T00:33:24.979 INFO:tasks.workunit.client.0.smithi029.stdout:3/510: write d17/d2a/d33/d37/f99 [1371041,105930] 0 2024-04-15T00:33:25.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/511: mkdir df/d32/db2 0 2024-04-15T00:33:25.218 INFO:tasks.workunit.client.0.smithi029.stdout:0/520: creat d5/db/d1a/d50/fa5 x:0 0 0 2024-04-15T00:33:25.265 INFO:tasks.workunit.client.0.smithi029.stdout:2/502: truncate d3/d13/f83 606951 0 2024-04-15T00:33:25.271 INFO:tasks.workunit.client.0.smithi029.stdout:7/513: write d0/d6/f44 [2689335,20126] 0 2024-04-15T00:33:25.506 INFO:tasks.workunit.client.0.smithi029.stdout:1/512: symlink df/d32/d7c/lb3 0 2024-04-15T00:33:25.523 INFO:tasks.workunit.client.0.smithi029.stdout:1/513: dread - df/d29/d41/d69/d4c/d55/f68 zero size 2024-04-15T00:33:25.730 INFO:tasks.workunit.client.0.smithi029.stdout:5/540: rename d2/de/d1f/d63/d65/c82 to d2/cbf 0 2024-04-15T00:33:25.754 INFO:tasks.workunit.client.0.smithi029.stdout:5/541: chown d2/de/d13/d22/d26/d36/d4d/d70/d8d/fbc 1757 1 2024-04-15T00:33:25.806 INFO:tasks.workunit.client.0.smithi029.stdout:7/514: symlink d0/d6/d39/d3c/d42/d49/d71/dab/lb0 0 2024-04-15T00:33:26.017 INFO:tasks.workunit.client.0.smithi029.stdout:5/542: symlink d2/de/d13/daa/lc0 0 2024-04-15T00:33:26.058 INFO:tasks.workunit.client.0.smithi029.stdout:4/511: write de/df/d1e/d56/f9e [2869238,13278] 0 2024-04-15T00:33:26.084 INFO:tasks.workunit.client.0.smithi029.stdout:9/501: dwrite d3/d6/f59 [0,4194304] 0 2024-04-15T00:33:26.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/512: chown de/d2b/f21 30 1 2024-04-15T00:33:26.232 INFO:tasks.workunit.client.0.smithi029.stdout:5/543: rmdir d2/de/d1f 39 2024-04-15T00:33:26.234 INFO:tasks.workunit.client.0.smithi029.stdout:0/521: link d5/d15/c74 d5/d15/d27/d28/ca6 0 2024-04-15T00:33:26.303 INFO:tasks.workunit.client.0.smithi029.stdout:2/503: rename d3/d13/d43/d5a/l3f to d3/d13/d43/l9d 0 2024-04-15T00:33:26.304 INFO:tasks.workunit.client.0.smithi029.stdout:9/502: dread d3/d6/d9/fd [0,4194304] 0 2024-04-15T00:33:26.324 INFO:tasks.workunit.client.0.smithi029.stdout:2/504: chown d3/d13/d43/l45 509885604 1 2024-04-15T00:33:26.344 INFO:tasks.workunit.client.0.smithi029.stdout:0/522: sync 2024-04-15T00:33:26.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/517: creat d8/fad x:0 0 0 2024-04-15T00:33:26.526 INFO:tasks.workunit.client.0.smithi029.stdout:6/530: write d1/f31 [2505193,13459] 0 2024-04-15T00:33:26.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/513: rmdir de/d2b 39 2024-04-15T00:33:26.615 INFO:tasks.workunit.client.0.smithi029.stdout:6/531: write d1/d8/db/f23 [844450,54291] 0 2024-04-15T00:33:26.619 INFO:tasks.workunit.client.0.smithi029.stdout:5/544: chown d2/de/d1f/ca2 8206626 1 2024-04-15T00:33:26.662 INFO:tasks.workunit.client.0.smithi029.stdout:3/511: dwrite d17/d2f/d3c/f3f [0,4194304] 0 2024-04-15T00:33:26.760 INFO:tasks.workunit.client.0.smithi029.stdout:0/523: symlink d5/d15/d27/d51/d7d/la7 0 2024-04-15T00:33:26.786 INFO:tasks.workunit.client.0.smithi029.stdout:4/514: fdatasync f7 0 2024-04-15T00:33:26.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/515: chown de/d54/d71/f87 10556 1 2024-04-15T00:33:26.990 INFO:tasks.workunit.client.0.smithi029.stdout:8/518: unlink d8/da/f6a 0 2024-04-15T00:33:27.029 INFO:tasks.workunit.client.0.smithi029.stdout:1/514: rename df/d29/d41/d69/f4a to df/d29/d41/d69/d78/fb4 0 2024-04-15T00:33:27.065 INFO:tasks.workunit.client.0.smithi029.stdout:6/532: dread d1/d1e/f4e [0,4194304] 0 2024-04-15T00:33:27.123 INFO:tasks.workunit.client.0.smithi029.stdout:7/515: dwrite d0/d6/d39/d3c/d42/d49/d71/f92 [0,4194304] 0 2024-04-15T00:33:27.127 INFO:tasks.workunit.client.0.smithi029.stdout:1/515: sync 2024-04-15T00:33:27.292 INFO:tasks.workunit.client.0.smithi029.stdout:9/503: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:33:27.292 INFO:tasks.workunit.client.0.smithi029.stdout:5/545: truncate d2/f95 782850 0 2024-04-15T00:33:27.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/504: readlink d3/d6/l5a 0 2024-04-15T00:33:27.435 INFO:tasks.workunit.client.0.smithi029.stdout:0/524: mkdir d5/d4c/d4e/da8 0 2024-04-15T00:33:27.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/505: dread d3/d6/f17 [0,4194304] 0 2024-04-15T00:33:27.578 INFO:tasks.workunit.client.0.smithi029.stdout:2/505: rename d3/d2a/d4e/f78 to d3/d2a/d46/d4a/f9e 0 2024-04-15T00:33:27.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/519: symlink d8/da/d3d/d8a/lae 0 2024-04-15T00:33:27.645 INFO:tasks.workunit.client.0.smithi029.stdout:8/520: chown d8/d4a/d78/d23/d28/c9d 120359891 1 2024-04-15T00:33:27.663 INFO:tasks.workunit.client.0.smithi029.stdout:8/521: chown d8/d4a/d78/d23/d28/d30/d39/d77 3 1 2024-04-15T00:33:27.952 INFO:tasks.workunit.client.0.smithi029.stdout:7/516: rename d0/d6/d4f/d66/c48 to d0/d6/d4f/d5d/d65/cb1 0 2024-04-15T00:33:28.103 INFO:tasks.workunit.client.0.smithi029.stdout:8/522: symlink d8/laf 0 2024-04-15T00:33:28.105 INFO:tasks.workunit.client.0.smithi029.stdout:3/512: write d17/f24 [4461074,39361] 0 2024-04-15T00:33:28.122 INFO:tasks.workunit.client.0.smithi029.stdout:8/523: chown d8/d4a 42443719 1 2024-04-15T00:33:28.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/533: write d1/d1e/d56/d58/d5f/f73 [608290,27549] 0 2024-04-15T00:33:28.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/525: creat d5/d15/d57/d5e/fa9 x:0 0 0 2024-04-15T00:33:28.326 INFO:tasks.workunit.client.0.smithi029.stdout:5/546: write d2/fa [560220,42289] 0 2024-04-15T00:33:28.426 INFO:tasks.workunit.client.0.smithi029.stdout:4/516: dwrite de/d2b/f2c [0,4194304] 0 2024-04-15T00:33:28.493 INFO:tasks.workunit.client.0.smithi029.stdout:9/506: write d3/d6/d9/d29/f4c [180667,9824] 0 2024-04-15T00:33:28.551 INFO:tasks.workunit.client.0.smithi029.stdout:8/524: symlink d8/lb0 0 2024-04-15T00:33:28.571 INFO:tasks.workunit.client.0.smithi029.stdout:7/517: getdents d0/d6/d4f/d66/d26/d77/d89 0 2024-04-15T00:33:28.640 INFO:tasks.workunit.client.0.smithi029.stdout:9/507: chown d3/d6/d9/d29/d60/d64/d6d/d58/c8e 4897364 1 2024-04-15T00:33:28.645 INFO:tasks.workunit.client.0.smithi029.stdout:2/506: dwrite d3/dd/d2d/f37 [0,4194304] 0 2024-04-15T00:33:28.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/516: link df/d29/d41/d69/c77 df/d29/d41/d69/d4c/d55/cb5 0 2024-04-15T00:33:28.748 INFO:tasks.workunit.client.0.smithi029.stdout:3/513: mknod d17/d2a/ca0 0 2024-04-15T00:33:28.749 INFO:tasks.workunit.client.0.smithi029.stdout:4/517: fsync f7 0 2024-04-15T00:33:28.752 INFO:tasks.workunit.client.0.smithi029.stdout:5/547: dread - d2/de/d13/d22/d3c/d41/d6d/f7e zero size 2024-04-15T00:33:28.957 INFO:tasks.workunit.client.0.smithi029.stdout:7/518: unlink d0/d6/d4f/d5d/l60 0 2024-04-15T00:33:29.046 INFO:tasks.workunit.client.0.smithi029.stdout:7/519: dwrite d0/d6/d39/d3c/d42/d49/d71/f92 [0,4194304] 0 2024-04-15T00:33:29.377 INFO:tasks.workunit.client.0.smithi029.stdout:4/518: dread de/d3a/f4b [0,4194304] 0 2024-04-15T00:33:29.425 INFO:tasks.workunit.client.0.smithi029.stdout:8/525: truncate d8/d4a/d78/d23/d28/d5f/f9a 863034 0 2024-04-15T00:33:29.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/526: dwrite d5/d15/d27/f2a [0,4194304] 0 2024-04-15T00:33:29.566 INFO:tasks.workunit.client.0.smithi029.stdout:3/514: truncate d17/d2f/d44/d58/d5c/f9a 4248152 0 2024-04-15T00:33:29.573 INFO:tasks.workunit.client.0.smithi029.stdout:3/515: stat d17/d2f/d3c/l9e 0 2024-04-15T00:33:29.664 INFO:tasks.workunit.client.0.smithi029.stdout:7/520: mknod d0/d6/d4f/d66/d26/d54/cb2 0 2024-04-15T00:33:29.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/508: mknod d3/d6/ca4 0 2024-04-15T00:33:29.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/534: getdents d1/d8 0 2024-04-15T00:33:29.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:33:29.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:33:29.901 INFO:tasks.workunit.client.0.smithi029.stdout:8/526: mkdir d8/d4a/d78/d23/d28/d30/db1 0 2024-04-15T00:33:29.945 INFO:tasks.workunit.client.0.smithi029.stdout:0/527: creat d5/d15/d27/d51/d7d/faa x:0 0 0 2024-04-15T00:33:29.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/528: dread d5/f62 [0,4194304] 0 2024-04-15T00:33:30.107 INFO:tasks.workunit.client.0.smithi029.stdout:3/516: mkdir d17/d2a/d4c/da1 0 2024-04-15T00:33:30.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/521: unlink d0/d6/l62 0 2024-04-15T00:33:30.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/509: fsync d3/d6/d9/f75 0 2024-04-15T00:33:30.214 INFO:tasks.workunit.client.0.smithi029.stdout:2/507: creat d3/dd/d2d/d61/f9f x:0 0 0 2024-04-15T00:33:30.329 INFO:tasks.workunit.client.0.smithi029.stdout:6/535: creat d1/d8/d72/fb3 x:0 0 0 2024-04-15T00:33:30.385 INFO:tasks.workunit.client.0.smithi029.stdout:8/527: creat d8/d4a/d78/d23/fb2 x:0 0 0 2024-04-15T00:33:30.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/529: unlink d5/d15/d1f/c58 0 2024-04-15T00:33:30.432 INFO:tasks.workunit.client.0.smithi029.stdout:0/530: chown d5/d4c 102 1 2024-04-15T00:33:30.528 INFO:tasks.workunit.client.0.smithi029.stdout:3/517: fsync d17/d83/f65 0 2024-04-15T00:33:30.534 INFO:tasks.workunit.client.0.smithi029.stdout:7/522: fsync d0/d6/d39/d3c/d5b/f63 0 2024-04-15T00:33:30.588 INFO:tasks.workunit.client.0.smithi029.stdout:9/510: truncate d3/d6/d9/d29/d60/d7f/da0/d9a/f73 2800194 0 2024-04-15T00:33:30.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/536: dwrite d1/d1e/f32 [0,4194304] 0 2024-04-15T00:33:30.945 INFO:tasks.workunit.client.0.smithi029.stdout:5/548: write d2/de/d13/d22/f7c [1469356,49478] 0 2024-04-15T00:33:30.995 INFO:tasks.workunit.client.0.smithi029.stdout:6/537: stat d1/d8/db/f44 0 2024-04-15T00:33:31.032 INFO:tasks.workunit.client.0.smithi029.stdout:7/523: creat d0/d6/d39/d3c/d5b/d7e/fb3 x:0 0 0 2024-04-15T00:33:31.051 INFO:tasks.workunit.client.0.smithi029.stdout:0/531: dread d5/db/f19 [4194304,4194304] 0 2024-04-15T00:33:31.087 INFO:tasks.workunit.client.0.smithi029.stdout:9/511: creat d3/d6/d9/d29/d60/d64/fa5 x:0 0 0 2024-04-15T00:33:31.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/518: dread d17/d2a/f4e [0,4194304] 0 2024-04-15T00:33:31.116 INFO:tasks.workunit.client.0.smithi029.stdout:4/519: link de/fa4 de/d6d/fa9 0 2024-04-15T00:33:31.363 INFO:tasks.workunit.client.0.smithi029.stdout:8/528: unlink d8/da/d3d/c52 0 2024-04-15T00:33:31.665 INFO:tasks.workunit.client.0.smithi029.stdout:9/512: fdatasync d3/d6/f12 0 2024-04-15T00:33:31.715 INFO:tasks.workunit.client.0.smithi029.stdout:0/532: truncate d5/d4c/f97 860537 0 2024-04-15T00:33:31.743 INFO:tasks.workunit.client.0.smithi029.stdout:3/519: truncate d17/d2f/d44/f87 569559 0 2024-04-15T00:33:31.843 INFO:tasks.workunit.client.0.smithi029.stdout:8/529: mknod d8/d4a/d78/d87/cb3 0 2024-04-15T00:33:31.849 INFO:tasks.workunit.client.0.smithi029.stdout:7/524: mknod d0/d6/da2/cb4 0 2024-04-15T00:33:31.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/525: chown d0/d6/d39/d3c/f70 2683 1 2024-04-15T00:33:31.972 INFO:tasks.workunit.client.0.smithi029.stdout:9/513: mknod d3/d6/d9/d29/d60/d64/d6d/d58/ca6 0 2024-04-15T00:33:31.986 INFO:tasks.workunit.client.0.smithi029.stdout:9/514: chown d3/d6/d9/d29/d60/d64/l8c 27828 1 2024-04-15T00:33:31.991 INFO:tasks.workunit.client.0.smithi029.stdout:0/533: rmdir d5/d4c/d4e 39 2024-04-15T00:33:32.326 INFO:tasks.workunit.client.0.smithi029.stdout:2/508: dwrite d3/d13/d43/f8f [0,4194304] 0 2024-04-15T00:33:32.409 INFO:tasks.workunit.client.0.smithi029.stdout:7/526: mknod d0/d69/cb5 0 2024-04-15T00:33:32.416 INFO:tasks.workunit.client.0.smithi029.stdout:7/527: stat d0/d6/d1c/c17 0 2024-04-15T00:33:32.533 INFO:tasks.workunit.client.0.smithi029.stdout:5/549: rename d2/de/d13/d22/d3c/d41/d6d/fa8 to d2/de/d13/d22/d26/d36/fc1 0 2024-04-15T00:33:32.538 INFO:tasks.workunit.client.0.smithi029.stdout:1/517: mknod df/d29/d41/d69/d4c/cb6 0 2024-04-15T00:33:32.574 INFO:tasks.workunit.client.0.smithi029.stdout:2/509: sync 2024-04-15T00:33:32.581 INFO:tasks.workunit.client.0.smithi029.stdout:3/520: symlink d17/d2a/d4c/da1/la2 0 2024-04-15T00:33:32.614 INFO:tasks.workunit.client.0.smithi029.stdout:3/521: chown d17/d2f/d44/c95 416 1 2024-04-15T00:33:32.733 INFO:tasks.workunit.client.0.smithi029.stdout:7/528: rename d0/c2e to d0/d6/da8/cb6 0 2024-04-15T00:33:32.752 INFO:tasks.workunit.client.0.smithi029.stdout:2/510: dread d3/d2a/d46/d95/f20 [8388608,4194304] 0 2024-04-15T00:33:32.899 INFO:tasks.workunit.client.0.smithi029.stdout:3/522: truncate d17/d2a/f4e 118700 0 2024-04-15T00:33:33.020 INFO:tasks.workunit.client.0.smithi029.stdout:2/511: mkdir d3/dd/da0 0 2024-04-15T00:33:33.161 INFO:tasks.workunit.client.0.smithi029.stdout:4/520: write de/d3a/f42 [2580020,84343] 0 2024-04-15T00:33:33.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/534: creat d5/d15/d27/fab x:0 0 0 2024-04-15T00:33:33.208 INFO:tasks.workunit.client.0.smithi029.stdout:3/523: dread - d17/d2f/d44/d58/d5c/d5f/f7b zero size 2024-04-15T00:33:33.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/538: dwrite d1/d1e/d22/fa6 [0,4194304] 0 2024-04-15T00:33:33.402 INFO:tasks.workunit.client.0.smithi029.stdout:4/521: dread de/d2b/d59/f6f [0,4194304] 0 2024-04-15T00:33:33.536 INFO:tasks.workunit.client.0.smithi029.stdout:8/530: dwrite d8/da/d3d/f6c [0,4194304] 0 2024-04-15T00:33:33.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/515: write d3/d6/d9/f49 [2329131,127583] 0 2024-04-15T00:33:33.700 INFO:tasks.workunit.client.0.smithi029.stdout:5/550: write d2/de/d13/d22/d26/d36/d4d/d70/d8d/fbc [1035182,103796] 0 2024-04-15T00:33:33.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/512: write d3/d2a/d46/d95/f40 [1366748,129828] 0 2024-04-15T00:33:33.761 INFO:tasks.workunit.client.0.smithi029.stdout:8/531: dread d8/f2b [0,4194304] 0 2024-04-15T00:33:33.879 INFO:tasks.workunit.client.0.smithi029.stdout:1/518: dwrite df/d29/d41/d4f/fa0 [0,4194304] 0 2024-04-15T00:33:34.392 INFO:tasks.workunit.client.0.smithi029.stdout:3/524: creat d17/d83/fa3 x:0 0 0 2024-04-15T00:33:34.414 INFO:tasks.workunit.client.0.smithi029.stdout:2/513: dread - d3/f91 zero size 2024-04-15T00:33:34.432 INFO:tasks.workunit.client.0.smithi029.stdout:7/529: dread - d0/d6/d4f/f7f zero size 2024-04-15T00:33:34.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/525: readlink d17/d2a/d46/d67/l78 0 2024-04-15T00:33:34.502 INFO:tasks.workunit.client.0.smithi029.stdout:8/532: symlink d8/da/d3d/d8a/lb4 0 2024-04-15T00:33:34.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/551: dread d2/de/d13/d22/d26/f35 [0,4194304] 0 2024-04-15T00:33:34.624 INFO:tasks.workunit.client.0.smithi029.stdout:0/535: creat d5/db/d1a/d65/d87/fac x:0 0 0 2024-04-15T00:33:34.756 INFO:tasks.workunit.client.0.smithi029.stdout:9/516: mkdir d3/da3/da7 0 2024-04-15T00:33:34.914 INFO:tasks.workunit.client.0.smithi029.stdout:3/526: fsync d17/f4d 0 2024-04-15T00:33:34.956 INFO:tasks.workunit.client.0.smithi029.stdout:7/530: read - d0/d6/d4f/d66/d37/f99 zero size 2024-04-15T00:33:35.075 INFO:tasks.workunit.client.0.smithi029.stdout:8/533: rename d8/da/d2f/d6e to d8/da/d2f/d6e/d5a/db5 22 2024-04-15T00:33:35.092 INFO:tasks.workunit.client.0.smithi029.stdout:5/552: read f0 [1604018,81479] 0 2024-04-15T00:33:35.112 INFO:tasks.workunit.client.0.smithi029.stdout:0/536: mknod d5/db/d1a/d65/d87/cad 0 2024-04-15T00:33:35.150 INFO:tasks.workunit.client.0.smithi029.stdout:6/539: link d1/d1e/d56/c7d d1/d8/db/d7b/cb4 0 2024-04-15T00:33:35.417 INFO:tasks.workunit.client.0.smithi029.stdout:3/527: truncate d17/d2a/d33/d37/f99 940710 0 2024-04-15T00:33:35.431 INFO:tasks.workunit.client.0.smithi029.stdout:3/528: dread - d17/d2f/d44/d58/d5c/f81 zero size 2024-04-15T00:33:35.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/534: fsync d8/da/f95 0 2024-04-15T00:33:35.570 INFO:tasks.workunit.client.0.smithi029.stdout:8/535: chown d8/da/f43 988332898 1 2024-04-15T00:33:35.630 INFO:tasks.workunit.client.0.smithi029.stdout:0/537: dread - d5/d15/d1f/d32/f8c zero size 2024-04-15T00:33:35.685 INFO:tasks.workunit.client.0.smithi029.stdout:6/540: rename d1/d1e/d56/d58/d59/f74 to d1/d8/d79/fb5 0 2024-04-15T00:33:35.847 INFO:tasks.workunit.client.0.smithi029.stdout:6/541: sync 2024-04-15T00:33:35.884 INFO:tasks.workunit.client.0.smithi029.stdout:5/553: mkdir d2/de/d1f/dc2 0 2024-04-15T00:33:35.895 INFO:tasks.workunit.client.0.smithi029.stdout:4/522: dwrite de/df/d1e/f2d [0,4194304] 0 2024-04-15T00:33:36.005 INFO:tasks.workunit.client.0.smithi029.stdout:0/538: truncate d5/db/f45 388100 0 2024-04-15T00:33:36.029 INFO:tasks.workunit.client.0.smithi029.stdout:2/514: getdents d3/d2a/d46/d4a 0 2024-04-15T00:33:36.038 INFO:tasks.workunit.client.0.smithi029.stdout:6/542: chown d1/c36 5 1 2024-04-15T00:33:36.053 INFO:tasks.workunit.client.0.smithi029.stdout:3/529: dread d17/d2f/d3c/f74 [0,4194304] 0 2024-04-15T00:33:36.062 INFO:tasks.workunit.client.0.smithi029.stdout:4/523: read f7 [1447690,59634] 0 2024-04-15T00:33:36.222 INFO:tasks.workunit.client.0.smithi029.stdout:4/524: dread de/d3a/f42 [0,4194304] 0 2024-04-15T00:33:36.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/543: fdatasync d1/d8/db/d38/fa8 0 2024-04-15T00:33:36.429 INFO:tasks.workunit.client.0.smithi029.stdout:3/530: dread d17/d2a/f6a [0,4194304] 0 2024-04-15T00:33:36.429 INFO:tasks.workunit.client.0.smithi029.stdout:0/539: dread - d5/d15/d27/d51/d7d/faa zero size 2024-04-15T00:33:36.487 INFO:tasks.workunit.client.0.smithi029.stdout:4/525: fdatasync de/df/d1e/f28 0 2024-04-15T00:33:36.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/531: sync 2024-04-15T00:33:36.522 INFO:tasks.workunit.client.0.smithi029.stdout:1/519: dwrite df/d29/d41/d69/f88 [0,4194304] 0 2024-04-15T00:33:36.524 INFO:tasks.workunit.client.0.smithi029.stdout:9/517: write d3/d6/d9/d15/f1f [421150,2327] 0 2024-04-15T00:33:36.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/544: chown d1/d1e/d56/f62 28 1 2024-04-15T00:33:36.618 INFO:tasks.workunit.client.0.smithi029.stdout:3/532: readlink d17/d2f/l42 0 2024-04-15T00:33:36.896 INFO:tasks.workunit.client.0.smithi029.stdout:2/515: creat d3/d13/d43/fa1 x:0 0 0 2024-04-15T00:33:36.898 INFO:tasks.workunit.client.0.smithi029.stdout:1/520: unlink df/d29/f52 0 2024-04-15T00:33:36.908 INFO:tasks.workunit.client.0.smithi029.stdout:4/526: truncate de/d54/f81 3206340 0 2024-04-15T00:33:36.948 INFO:tasks.workunit.client.0.smithi029.stdout:7/531: write d0/d6/d4f/d66/d67/f73 [3725932,102534] 0 2024-04-15T00:33:36.949 INFO:tasks.workunit.client.0.smithi029.stdout:6/545: fsync d1/d8/db/d7b/d85/f8f 0 2024-04-15T00:33:36.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/518: mkdir d3/d6/d9/d29/d60/d64/da8 0 2024-04-15T00:33:37.037 INFO:tasks.workunit.client.0.smithi029.stdout:3/533: symlink d17/d2f/d44/d58/d5c/la4 0 2024-04-15T00:33:37.041 INFO:tasks.workunit.client.0.smithi029.stdout:3/534: chown l7 169280150 1 2024-04-15T00:33:37.256 INFO:tasks.workunit.client.0.smithi029.stdout:0/540: mknod d5/d4c/cae 0 2024-04-15T00:33:37.369 INFO:tasks.workunit.client.0.smithi029.stdout:4/527: mkdir de/d3a/daa 0 2024-04-15T00:33:37.512 INFO:tasks.workunit.client.0.smithi029.stdout:6/546: symlink d1/d8/d79/d9f/lb6 0 2024-04-15T00:33:37.539 INFO:tasks.workunit.client.0.smithi029.stdout:8/536: dwrite d8/d4a/d78/d23/d28/d5f/f8f [0,4194304] 0 2024-04-15T00:33:37.620 INFO:tasks.workunit.client.0.smithi029.stdout:7/532: mkdir d0/d6/d4f/d66/d37/db7 0 2024-04-15T00:33:37.642 INFO:tasks.workunit.client.0.smithi029.stdout:9/519: fdatasync d3/d6/d9/fd 0 2024-04-15T00:33:37.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/537: chown d8/d4a/d78/d23 14449 1 2024-04-15T00:33:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/528: dwrite de/d2b/d59/f86 [0,4194304] 0 2024-04-15T00:33:37.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/529: dread de/d2b/f62 [0,4194304] 0 2024-04-15T00:33:38.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/533: rmdir d0/d6/d4f/d66/d26/d77/d89 39 2024-04-15T00:33:38.090 INFO:tasks.workunit.client.0.smithi029.stdout:6/547: mkdir d1/d8/db/db7 0 2024-04-15T00:33:38.200 INFO:tasks.workunit.client.0.smithi029.stdout:4/530: chown de/d6d/l8f 2680448 1 2024-04-15T00:33:38.235 INFO:tasks.workunit.client.0.smithi029.stdout:5/554: dwrite d2/de/d13/d22/d26/d36/d4d/d70/d9a/f5c [0,4194304] 0 2024-04-15T00:33:38.302 INFO:tasks.workunit.client.0.smithi029.stdout:6/548: fdatasync d1/d1e/d56/f89 0 2024-04-15T00:33:38.316 INFO:tasks.workunit.client.0.smithi029.stdout:4/531: chown de/d2b/d35/f73 217632 1 2024-04-15T00:33:38.326 INFO:tasks.workunit.client.0.smithi029.stdout:0/541: getdents d5/d15/d57/d5e 0 2024-04-15T00:33:38.482 INFO:tasks.workunit.client.0.smithi029.stdout:7/534: mkdir d0/d6/d4f/d66/d67/db8 0 2024-04-15T00:33:38.528 INFO:tasks.workunit.client.0.smithi029.stdout:8/538: creat d8/da/d3d/fb6 x:0 0 0 2024-04-15T00:33:38.628 INFO:tasks.workunit.client.0.smithi029.stdout:2/516: write d3/d2a/d46/d4a/f8a [3397447,24226] 0 2024-04-15T00:33:38.721 INFO:tasks.workunit.client.0.smithi029.stdout:4/532: unlink de/d2b/d59/l67 0 2024-04-15T00:33:38.784 INFO:tasks.workunit.client.0.smithi029.stdout:6/549: dread d1/d1e/d56/f62 [0,4194304] 0 2024-04-15T00:33:38.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/521: dwrite df/d29/d41/d69/d78/f6f [0,4194304] 0 2024-04-15T00:33:38.930 INFO:tasks.workunit.client.0.smithi029.stdout:0/542: read d5/d15/d1f/f73 [686499,9755] 0 2024-04-15T00:33:38.948 INFO:tasks.workunit.client.0.smithi029.stdout:0/543: read d5/db/f19 [746784,45749] 0 2024-04-15T00:33:38.954 INFO:tasks.workunit.client.0.smithi029.stdout:0/544: chown d5/db/d1a 804255818 1 2024-04-15T00:33:39.002 INFO:tasks.workunit.client.0.smithi029.stdout:7/535: mkdir d0/d6/d4f/d5d/d82/db9 0 2024-04-15T00:33:39.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/536: chown d0/d6/d4f/d5d/d87 859 1 2024-04-15T00:33:39.027 INFO:tasks.workunit.client.0.smithi029.stdout:7/537: chown d0/d6/d4f/d66/d26/d54/c86 209914 1 2024-04-15T00:33:39.038 INFO:tasks.workunit.client.0.smithi029.stdout:7/538: chown d0/d6/d1c/c7d 1 1 2024-04-15T00:33:39.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/535: dwrite d17/d2f/d44/f66 [8388608,4194304] 0 2024-04-15T00:33:39.250 INFO:tasks.workunit.client.0.smithi029.stdout:2/517: mkdir d3/dd/d2d/d61/d85/da2 0 2024-04-15T00:33:39.262 INFO:tasks.workunit.client.0.smithi029.stdout:3/536: read ff [2665178,81640] 0 2024-04-15T00:33:39.360 INFO:tasks.workunit.client.0.smithi029.stdout:9/520: write d3/d6/d9/f50 [802500,86432] 0 2024-04-15T00:33:39.753 INFO:tasks.workunit.client.0.smithi029.stdout:5/555: write d2/f11 [3324921,48930] 0 2024-04-15T00:33:39.934 INFO:tasks.workunit.client.0.smithi029.stdout:0/545: mkdir d5/db/d1a/d65/d76/daf 0 2024-04-15T00:33:39.940 INFO:tasks.workunit.client.0.smithi029.stdout:0/546: chown d5/db/d1a 12244 1 2024-04-15T00:33:40.092 INFO:tasks.workunit.client.0.smithi029.stdout:7/539: stat d0/f5a 0 2024-04-15T00:33:40.158 INFO:tasks.workunit.client.0.smithi029.stdout:2/518: dread - d3/dd/d2d/d61/f9f zero size 2024-04-15T00:33:40.247 INFO:tasks.workunit.client.0.smithi029.stdout:3/537: symlink d17/d2a/d33/d37/la5 0 2024-04-15T00:33:40.298 INFO:tasks.workunit.client.0.smithi029.stdout:9/521: fdatasync d3/d6/f13 0 2024-04-15T00:33:40.542 INFO:tasks.workunit.client.0.smithi029.stdout:4/533: rename de/df/d1e/f22 to de/d54/d71/fab 0 2024-04-15T00:33:40.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/522: fdatasync d3/d6/d9/f75 0 2024-04-15T00:33:40.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/550: write d1/d8/faf [374647,37111] 0 2024-04-15T00:33:40.788 INFO:tasks.workunit.client.0.smithi029.stdout:0/547: mkdir d5/db/db0 0 2024-04-15T00:33:40.879 INFO:tasks.workunit.client.0.smithi029.stdout:1/522: dwrite df/d29/d41/f47 [0,4194304] 0 2024-04-15T00:33:40.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/523: sync 2024-04-15T00:33:40.959 INFO:tasks.workunit.client.0.smithi029.stdout:5/556: rename d2/de/d1f/d63/d71 to d2/de/d13/daa/dc3 0 2024-04-15T00:33:40.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/540: rename d0/d6/d4f/d5d/d87 to d0/d6/d4f/d5d/d87/dba 22 2024-04-15T00:33:40.983 INFO:tasks.workunit.client.0.smithi029.stdout:4/534: chown de/d3a/c40 1739 1 2024-04-15T00:33:41.058 INFO:tasks.workunit.client.0.smithi029.stdout:0/548: creat d5/d15/d57/fb1 x:0 0 0 2024-04-15T00:33:41.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/549: stat d5/db/l83 0 2024-04-15T00:33:41.203 INFO:tasks.workunit.client.0.smithi029.stdout:1/523: chown df/d29/d41/d69/f7f 64163711 1 2024-04-15T00:33:41.290 INFO:tasks.workunit.client.0.smithi029.stdout:5/557: unlink d2/de/d1f/la9 0 2024-04-15T00:33:41.519 INFO:tasks.workunit.client.0.smithi029.stdout:3/538: getdents d17/d2a 0 2024-04-15T00:33:41.713 INFO:tasks.workunit.client.0.smithi029.stdout:1/524: mknod df/d29/d41/d96/cb7 0 2024-04-15T00:33:41.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/539: write d8/d4a/d78/d23/f59 [1203501,78781] 0 2024-04-15T00:33:41.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/558: mkdir d2/de/d1f/dc2/dc4 0 2024-04-15T00:33:42.011 INFO:tasks.workunit.client.0.smithi029.stdout:5/559: creat d2/de/d13/daa/fc5 x:0 0 0 2024-04-15T00:33:42.062 INFO:tasks.workunit.client.0.smithi029.stdout:7/541: getdents d0/d6/d4f/d66/d26 0 2024-04-15T00:33:42.199 INFO:tasks.workunit.client.0.smithi029.stdout:2/519: write d3/d2a/d46/d4a/f9e [2246903,30397] 0 2024-04-15T00:33:42.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/542: unlink d0/d6/d4f/d66/d26/faa 0 2024-04-15T00:33:42.384 INFO:tasks.workunit.client.0.smithi029.stdout:9/524: dwrite d3/d6/d9/f75 [0,4194304] 0 2024-04-15T00:33:42.516 INFO:tasks.workunit.client.0.smithi029.stdout:9/525: sync 2024-04-15T00:33:42.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/520: dread d3/d2a/d46/d95/f1e [0,4194304] 0 2024-04-15T00:33:42.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/560: dread d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fb3 [4194304,4194304] 0 2024-04-15T00:33:42.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/561: chown d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/ca7 17076 1 2024-04-15T00:33:42.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/562: sync 2024-04-15T00:33:42.831 INFO:tasks.workunit.client.0.smithi029.stdout:3/539: write d17/d2a/d46/f6c [1027188,10454] 0 2024-04-15T00:33:42.857 INFO:tasks.workunit.client.0.smithi029.stdout:8/540: write d8/d4a/d78/d23/d28/d30/d39/f4b [2368519,114402] 0 2024-04-15T00:33:42.867 INFO:tasks.workunit.client.0.smithi029.stdout:1/525: write df/d29/d41/d69/d4c/d55/f68 [941404,122087] 0 2024-04-15T00:33:42.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/543: rename d0/d6/d39/d3c/d42 to d0/d6/d4f/dbb 0 2024-04-15T00:33:42.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/526: mkdir d3/d6/d9/d15/d4a/da9 0 2024-04-15T00:33:42.999 INFO:tasks.workunit.client.0.smithi029.stdout:5/563: unlink d2/de/d13/d22/d3c/d41/d6d/f99 0 2024-04-15T00:33:43.148 INFO:tasks.workunit.client.0.smithi029.stdout:9/527: chown d3/d6/d9/d15/d62 585455 1 2024-04-15T00:33:43.205 INFO:tasks.workunit.client.0.smithi029.stdout:6/551: dwrite d1/d8/db/f37 [0,4194304] 0 2024-04-15T00:33:43.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/540: fdatasync d17/d2f/f9d 0 2024-04-15T00:33:43.309 INFO:tasks.workunit.client.0.smithi029.stdout:4/535: dwrite de/d6d/fa9 [0,4194304] 0 2024-04-15T00:33:43.342 INFO:tasks.workunit.client.0.smithi029.stdout:0/550: dwrite d5/d15/d1f/f73 [0,4194304] 0 2024-04-15T00:33:43.342 INFO:tasks.workunit.client.0.smithi029.stdout:1/526: write df/d29/d41/d69/d78/f6f [2375113,91024] 0 2024-04-15T00:33:43.443 INFO:tasks.workunit.client.0.smithi029.stdout:8/541: creat d8/d4a/d78/d23/d28/d30/fb7 x:0 0 0 2024-04-15T00:33:43.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/542: chown d8/d4a/da1 8785315 1 2024-04-15T00:33:43.490 INFO:tasks.workunit.client.0.smithi029.stdout:8/543: read d8/f38 [711635,104462] 0 2024-04-15T00:33:43.522 INFO:tasks.workunit.client.0.smithi029.stdout:2/521: creat d3/d13/d43/fa3 x:0 0 0 2024-04-15T00:33:43.569 INFO:tasks.workunit.client.0.smithi029.stdout:5/564: creat d2/de/d13/d22/d26/fc6 x:0 0 0 2024-04-15T00:33:43.580 INFO:tasks.workunit.client.0.smithi029.stdout:7/544: write d0/d6/d39/d3c/d5b/f63 [2158241,48787] 0 2024-04-15T00:33:43.676 INFO:tasks.workunit.client.0.smithi029.stdout:2/522: sync 2024-04-15T00:33:43.881 INFO:tasks.workunit.client.0.smithi029.stdout:0/551: rmdir d5/d15 39 2024-04-15T00:33:43.883 INFO:tasks.workunit.client.0.smithi029.stdout:4/536: fdatasync de/d2b/f30 0 2024-04-15T00:33:43.899 INFO:tasks.workunit.client.0.smithi029.stdout:8/544: creat d8/da/d2f/d66/fb8 x:0 0 0 2024-04-15T00:33:44.295 INFO:tasks.workunit.client.0.smithi029.stdout:9/528: write d3/d6/d9/f49 [1502282,102147] 0 2024-04-15T00:33:44.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/523: unlink d3/d2a/c70 0 2024-04-15T00:33:44.490 INFO:tasks.workunit.client.0.smithi029.stdout:1/527: creat df/d32/d90/fb8 x:0 0 0 2024-04-15T00:33:44.492 INFO:tasks.workunit.client.0.smithi029.stdout:6/552: write d1/d1e/f32 [4327741,41810] 0 2024-04-15T00:33:44.637 INFO:tasks.workunit.client.0.smithi029.stdout:3/541: dwrite d17/d2f/d44/d58/d5c/f73 [0,4194304] 0 2024-04-15T00:33:44.719 INFO:tasks.workunit.client.0.smithi029.stdout:4/537: fdatasync de/f5d 0 2024-04-15T00:33:44.737 INFO:tasks.workunit.client.0.smithi029.stdout:4/538: dread - de/d2b/d59/f70 zero size 2024-04-15T00:33:45.175 INFO:tasks.workunit.client.0.smithi029.stdout:1/528: mknod df/d29/d41/d69/d4c/d55/d80/cb9 0 2024-04-15T00:33:45.260 INFO:tasks.workunit.client.0.smithi029.stdout:0/552: creat d5/d15/d27/d51/fb2 x:0 0 0 2024-04-15T00:33:45.303 INFO:tasks.workunit.client.0.smithi029.stdout:3/542: fdatasync d17/d2f/d44/d58/d5c/d5f/f7b 0 2024-04-15T00:33:45.421 INFO:tasks.workunit.client.0.smithi029.stdout:9/529: fdatasync d3/d6/d9/d29/d60/d7f/da0/d9a/f73 0 2024-04-15T00:33:45.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/524: symlink d3/d13/d43/la4 0 2024-04-15T00:33:45.711 INFO:tasks.workunit.client.0.smithi029.stdout:2/525: stat d3/dd/d42/l63 0 2024-04-15T00:33:45.774 INFO:tasks.workunit.client.0.smithi029.stdout:7/545: dwrite d0/d6/d4f/d66/d26/d77/f96 [0,4194304] 0 2024-04-15T00:33:46.034 INFO:tasks.workunit.client.0.smithi029.stdout:3/543: dread d17/f24 [0,4194304] 0 2024-04-15T00:33:46.142 INFO:tasks.workunit.client.0.smithi029.stdout:2/526: rename d3/d2a/d46/d95/c25 to d3/d50/d51/d65/ca5 0 2024-04-15T00:33:46.143 INFO:tasks.workunit.client.0.smithi029.stdout:8/545: dwrite d8/da/d2f/d6e/f94 [0,4194304] 0 2024-04-15T00:33:46.254 INFO:tasks.workunit.client.0.smithi029.stdout:6/553: getdents d1/d8/db/d98 0 2024-04-15T00:33:46.285 INFO:tasks.workunit.client.0.smithi029.stdout:6/554: chown d1/d1e/d56/d58/d59/cb2 3547665 1 2024-04-15T00:33:46.369 INFO:tasks.workunit.client.0.smithi029.stdout:1/529: rename df/d29/d41/d69/f88 to df/d29/d41/d69/fba 0 2024-04-15T00:33:46.384 INFO:tasks.workunit.client.0.smithi029.stdout:1/530: dread - df/d29/d41/d69/f7f zero size 2024-04-15T00:33:46.428 INFO:tasks.workunit.client.0.smithi029.stdout:4/539: creat de/d54/d71/d8b/da7/fac x:0 0 0 2024-04-15T00:33:46.497 INFO:tasks.workunit.client.0.smithi029.stdout:7/546: rename d0/d6/d4f/dbb/d49/d71 to d0/d6/d4f/d5d/d65/dbc 0 2024-04-15T00:33:46.508 INFO:tasks.workunit.client.0.smithi029.stdout:7/547: dread - d0/d6/d4f/f7f zero size 2024-04-15T00:33:46.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/553: getdents d5/db/d1a/d50/da1 0 2024-04-15T00:33:46.712 INFO:tasks.workunit.client.0.smithi029.stdout:5/565: mknod d2/de/d13/cc7 0 2024-04-15T00:33:46.888 INFO:tasks.workunit.client.0.smithi029.stdout:2/527: mkdir d3/d50/d51/d65/d81/da6 0 2024-04-15T00:33:46.898 INFO:tasks.workunit.client.0.smithi029.stdout:4/540: dread f8 [4194304,4194304] 0 2024-04-15T00:33:46.953 INFO:tasks.workunit.client.0.smithi029.stdout:0/554: fsync d5/db/f19 0 2024-04-15T00:33:47.053 INFO:tasks.workunit.client.0.smithi029.stdout:3/544: creat d17/fa6 x:0 0 0 2024-04-15T00:33:47.064 INFO:tasks.workunit.client.0.smithi029.stdout:5/566: dread - d2/d1a/d2d/f76 zero size 2024-04-15T00:33:47.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/548: rename d0/d69/c6a to d0/d6/d4f/d66/d67/db8/cbd 0 2024-04-15T00:33:47.213 INFO:tasks.workunit.client.0.smithi029.stdout:8/546: link d8/da/f95 d8/d4a/d78/d87/fb9 0 2024-04-15T00:33:47.214 INFO:tasks.workunit.client.0.smithi029.stdout:6/555: link d1/d8/db/l71 d1/d8/d72/lb8 0 2024-04-15T00:33:47.255 INFO:tasks.workunit.client.0.smithi029.stdout:2/528: fsync d3/dd/d2d/d61/d85/f92 0 2024-04-15T00:33:47.314 INFO:tasks.workunit.client.0.smithi029.stdout:4/541: mknod de/df/d1e/d56/cad 0 2024-04-15T00:33:47.399 INFO:tasks.workunit.client.0.smithi029.stdout:0/555: mkdir d5/d15/d1f/d32/db3 0 2024-04-15T00:33:47.580 INFO:tasks.workunit.client.0.smithi029.stdout:5/567: mkdir d2/da5/dc8 0 2024-04-15T00:33:47.631 INFO:tasks.workunit.client.0.smithi029.stdout:9/530: write d3/d6/d9/d29/d60/d7f/da0/d9a/f36 [3381344,71321] 0 2024-04-15T00:33:47.736 INFO:tasks.workunit.client.0.smithi029.stdout:8/547: fsync d8/da/d2f/d42/f7e 0 2024-04-15T00:33:47.757 INFO:tasks.workunit.client.0.smithi029.stdout:6/556: truncate d1/d8/d72/fb3 279163 0 2024-04-15T00:33:47.919 INFO:tasks.workunit.client.0.smithi029.stdout:6/557: sync 2024-04-15T00:33:47.942 INFO:tasks.workunit.client.0.smithi029.stdout:6/558: read d1/d8/db/d7b/d91/fa4 [1797771,104786] 0 2024-04-15T00:33:47.956 INFO:tasks.workunit.client.0.smithi029.stdout:6/559: chown d1/d1e/d22/f3a 7437192 1 2024-04-15T00:33:47.968 INFO:tasks.workunit.client.0.smithi029.stdout:6/560: chown d1/d8/db/d7b/d85/lac 1 1 2024-04-15T00:33:48.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/531: link df/d29/d41/d69/d4c/d55/ca1 df/d29/d41/cbb 0 2024-04-15T00:33:48.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/531: fdatasync d3/d6/d9/d15/d4a/f72 0 2024-04-15T00:33:48.157 INFO:tasks.workunit.client.0.smithi029.stdout:7/549: fsync d0/f36 0 2024-04-15T00:33:48.187 INFO:tasks.workunit.client.0.smithi029.stdout:8/548: symlink d8/lba 0 2024-04-15T00:33:48.194 INFO:tasks.workunit.client.0.smithi029.stdout:8/549: stat d8/da/c29 0 2024-04-15T00:33:48.239 INFO:tasks.workunit.client.0.smithi029.stdout:4/542: mkdir de/d6d/d7e/d9b/dae 0 2024-04-15T00:33:48.380 INFO:tasks.workunit.client.0.smithi029.stdout:6/561: truncate d1/d8/db/f40 4860247 0 2024-04-15T00:33:48.387 INFO:tasks.workunit.client.0.smithi029.stdout:6/562: stat d1/d8/f9c 0 2024-04-15T00:33:48.399 INFO:tasks.workunit.client.0.smithi029.stdout:6/563: read - d1/d8/db/d38/f67 zero size 2024-04-15T00:33:48.989 INFO:tasks.workunit.client.0.smithi029.stdout:9/532: dread d3/f4e [0,4194304] 0 2024-04-15T00:33:49.052 INFO:tasks.workunit.client.0.smithi029.stdout:6/564: fdatasync d1/f2f 0 2024-04-15T00:33:49.277 INFO:tasks.workunit.client.0.smithi029.stdout:3/545: write d17/d2f/f71 [515486,36574] 0 2024-04-15T00:33:49.290 INFO:tasks.workunit.client.0.smithi029.stdout:5/568: write d2/de/d13/d22/d26/d36/f90 [380883,52556] 0 2024-04-15T00:33:49.293 INFO:tasks.workunit.client.0.smithi029.stdout:0/556: write d5/d15/d1f/d32/f8c [104377,62799] 0 2024-04-15T00:33:49.329 INFO:tasks.workunit.client.0.smithi029.stdout:3/546: readlink l5 0 2024-04-15T00:33:49.411 INFO:tasks.workunit.client.0.smithi029.stdout:0/557: chown d5/d15/d27/c48 1291 1 2024-04-15T00:33:49.442 INFO:tasks.workunit.client.0.smithi029.stdout:2/529: dwrite d3/d2a/d46/d95/f1e [4194304,4194304] 0 2024-04-15T00:33:49.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/543: mknod de/d54/da6/caf 0 2024-04-15T00:33:49.568 INFO:tasks.workunit.client.0.smithi029.stdout:6/565: rmdir d1 39 2024-04-15T00:33:49.856 INFO:tasks.workunit.client.0.smithi029.stdout:7/550: dwrite d0/f5a [0,4194304] 0 2024-04-15T00:33:49.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/550: dwrite d8/d4a/d78/d23/d28/f44 [0,4194304] 0 2024-04-15T00:33:50.410 INFO:tasks.workunit.client.0.smithi029.stdout:2/530: unlink d3/dd/f30 0 2024-04-15T00:33:50.425 INFO:tasks.workunit.client.0.smithi029.stdout:1/532: write df/d29/d41/d69/fba [4124684,79565] 0 2024-04-15T00:33:50.729 INFO:tasks.workunit.client.0.smithi029.stdout:7/551: rename d0/d6/da8 to d0/d6/d39/d3c/d5b/d7e/dbe 0 2024-04-15T00:33:50.735 INFO:tasks.workunit.client.0.smithi029.stdout:8/551: creat d8/d4a/d78/d23/d28/d30/d39/d77/fbb x:0 0 0 2024-04-15T00:33:50.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/547: creat d17/d2f/d76/d7f/fa7 x:0 0 0 2024-04-15T00:33:50.989 INFO:tasks.workunit.client.0.smithi029.stdout:4/544: creat de/d6d/d7e/d9b/dae/fb0 x:0 0 0 2024-04-15T00:33:51.287 INFO:tasks.workunit.client.0.smithi029.stdout:8/552: fsync d8/da/d2f/d42/f7e 0 2024-04-15T00:33:51.420 INFO:tasks.workunit.client.0.smithi029.stdout:4/545: rmdir de/d6d/d7e 39 2024-04-15T00:33:51.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/553: dread d8/da/f9c [4194304,4194304] 0 2024-04-15T00:33:51.698 INFO:tasks.workunit.client.0.smithi029.stdout:0/558: link d5/d15/l16 d5/d15/d27/d51/lb4 0 2024-04-15T00:33:51.730 INFO:tasks.workunit.client.0.smithi029.stdout:9/533: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [135547,62816] 0 2024-04-15T00:33:51.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/546: fsync de/df/d1e/d56/f9e 0 2024-04-15T00:33:51.905 INFO:tasks.workunit.client.0.smithi029.stdout:8/554: symlink d8/da/d3d/d8a/lbc 0 2024-04-15T00:33:51.909 INFO:tasks.workunit.client.0.smithi029.stdout:5/569: rmdir d2/de/d13/d22/d26 39 2024-04-15T00:33:51.912 INFO:tasks.workunit.client.0.smithi029.stdout:3/548: link ff d17/d2a/d4c/d93/fa8 0 2024-04-15T00:33:51.936 INFO:tasks.workunit.client.0.smithi029.stdout:3/549: chown d17/d2a/d46/d67 27578 1 2024-04-15T00:33:52.061 INFO:tasks.workunit.client.0.smithi029.stdout:8/555: sync 2024-04-15T00:33:52.090 INFO:tasks.workunit.client.0.smithi029.stdout:4/547: dread de/df/d1e/f2d [0,4194304] 0 2024-04-15T00:33:52.162 INFO:tasks.workunit.client.0.smithi029.stdout:5/570: truncate d2/de/d13/f2f 127534 0 2024-04-15T00:33:52.187 INFO:tasks.workunit.client.0.smithi029.stdout:2/531: getdents d3/d53 0 2024-04-15T00:33:52.198 INFO:tasks.workunit.client.0.smithi029.stdout:2/532: dread - d3/dd/f35 zero size 2024-04-15T00:33:52.430 INFO:tasks.workunit.client.0.smithi029.stdout:1/533: write df/d29/d41/d69/d4c/f75 [4601573,72051] 0 2024-04-15T00:33:52.436 INFO:tasks.workunit.client.0.smithi029.stdout:6/566: write d1/d1e/d56/d58/d5f/f65 [1477645,81403] 0 2024-04-15T00:33:52.482 INFO:tasks.workunit.client.0.smithi029.stdout:1/534: stat df/l31 0 2024-04-15T00:33:52.559 INFO:tasks.workunit.client.0.smithi029.stdout:7/552: dwrite d0/d6/f6c [4194304,4194304] 0 2024-04-15T00:33:52.643 INFO:tasks.workunit.client.0.smithi029.stdout:8/556: truncate d8/da/d3d/f86 674144 0 2024-04-15T00:33:52.647 INFO:tasks.workunit.client.0.smithi029.stdout:3/550: symlink d17/d2f/d44/la9 0 2024-04-15T00:33:52.676 INFO:tasks.workunit.client.0.smithi029.stdout:8/557: chown d8/da/d2f/d6e/l71 38938116 1 2024-04-15T00:33:52.696 INFO:tasks.workunit.client.0.smithi029.stdout:5/571: dread d2/de/d13/d22/d3c/f4b [0,4194304] 0 2024-04-15T00:33:52.824 INFO:tasks.workunit.client.0.smithi029.stdout:6/567: fsync d1/d8/db/f15 0 2024-04-15T00:33:52.902 INFO:tasks.workunit.client.0.smithi029.stdout:9/534: write d3/d6/d9/d29/d60/d7f/f82 [328197,26768] 0 2024-04-15T00:33:52.919 INFO:tasks.workunit.client.0.smithi029.stdout:0/559: dwrite d5/db/f19 [0,4194304] 0 2024-04-15T00:33:52.993 INFO:tasks.workunit.client.0.smithi029.stdout:3/551: creat d17/d2f/d44/d5a/faa x:0 0 0 2024-04-15T00:33:53.052 INFO:tasks.workunit.client.0.smithi029.stdout:8/558: symlink d8/da/d2f/d6e/d5a/lbd 0 2024-04-15T00:33:53.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/572: truncate d2/f8 611388 0 2024-04-15T00:33:53.195 INFO:tasks.workunit.client.0.smithi029.stdout:4/548: dwrite de/d6d/fa9 [4194304,4194304] 0 2024-04-15T00:33:53.335 INFO:tasks.workunit.client.0.smithi029.stdout:1/535: mknod df/d32/db2/cbc 0 2024-04-15T00:33:53.352 INFO:tasks.workunit.client.0.smithi029.stdout:1/536: stat df/d29/d41/d69/d4c/d55/d80/d94/f9c 0 2024-04-15T00:33:53.362 INFO:tasks.workunit.client.0.smithi029.stdout:1/537: chown df/d29/d41/c86 57728074 1 2024-04-15T00:33:53.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/538: chown df/f9e 29 1 2024-04-15T00:33:53.427 INFO:tasks.workunit.client.0.smithi029.stdout:7/553: rename d0/d6/d4f/d5d/d65/cb1 to d0/d6/d4f/d66/d67/d90/cbf 0 2024-04-15T00:33:53.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/560: symlink d5/d15/d68/lb5 0 2024-04-15T00:33:53.501 INFO:tasks.workunit.client.0.smithi029.stdout:7/554: chown d0/d6/d1c/l50 0 1 2024-04-15T00:33:53.507 INFO:tasks.workunit.client.0.smithi029.stdout:0/561: stat d5/d15/d1f/d32/f8c 0 2024-04-15T00:33:53.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/533: dwrite d3/d13/d43/d5a/f4b [0,4194304] 0 2024-04-15T00:33:53.609 INFO:tasks.workunit.client.0.smithi029.stdout:7/555: chown d0/d6/d39/d3c/l41 81649 1 2024-04-15T00:33:53.741 INFO:tasks.workunit.client.0.smithi029.stdout:3/552: write d17/d2a/f34 [2537450,36517] 0 2024-04-15T00:33:53.751 INFO:tasks.workunit.client.0.smithi029.stdout:3/553: stat d17/f29 0 2024-04-15T00:33:53.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/568: getdents d1/d8/db/db7 0 2024-04-15T00:33:53.921 INFO:tasks.workunit.client.0.smithi029.stdout:9/535: rename d3/d6/d9/l25 to d3/d6/d9/d29/d60/d64/d6d/d58/laa 0 2024-04-15T00:33:54.356 INFO:tasks.workunit.client.0.smithi029.stdout:0/562: mkdir d5/d15/d27/d9f/db6 0 2024-04-15T00:33:54.490 INFO:tasks.workunit.client.0.smithi029.stdout:2/534: rename d3/dd/f35 to d3/dd/fa7 0 2024-04-15T00:33:54.496 INFO:tasks.workunit.client.0.smithi029.stdout:0/563: dread d5/f7 [0,4194304] 0 2024-04-15T00:33:54.498 INFO:tasks.workunit.client.0.smithi029.stdout:5/573: write d2/d1a/d2d/f76 [497127,52482] 0 2024-04-15T00:33:54.541 INFO:tasks.workunit.client.0.smithi029.stdout:4/549: write de/d2b/d35/f69 [4237715,37659] 0 2024-04-15T00:33:54.542 INFO:tasks.workunit.client.0.smithi029.stdout:3/554: rmdir d17/d2a 39 2024-04-15T00:33:54.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/574: chown d2/de/d13/cc7 96 1 2024-04-15T00:33:54.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/559: symlink d8/d4a/d78/d23/d28/d30/db1/lbe 0 2024-04-15T00:33:54.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/536: dread d3/d6/d9/f75 [0,4194304] 0 2024-04-15T00:33:54.932 INFO:tasks.workunit.client.0.smithi029.stdout:7/556: fdatasync d0/d6/d4f/f9d 0 2024-04-15T00:33:54.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/564: unlink d5/d4c/c4f 0 2024-04-15T00:33:55.141 INFO:tasks.workunit.client.0.smithi029.stdout:2/535: creat d3/d13/d43/d5a/d4f/d99/fa8 x:0 0 0 2024-04-15T00:33:55.366 INFO:tasks.workunit.client.0.smithi029.stdout:9/537: creat d3/d6/d9/d29/d60/d7f/da0/d9a/fab x:0 0 0 2024-04-15T00:33:55.859 INFO:tasks.workunit.client.0.smithi029.stdout:4/550: truncate de/d54/d71/da3/f99 467259 0 2024-04-15T00:33:56.108 INFO:tasks.workunit.client.0.smithi029.stdout:4/551: truncate de/df/f12 4593355 0 2024-04-15T00:33:56.148 INFO:tasks.workunit.client.0.smithi029.stdout:6/569: mkdir d1/db9 0 2024-04-15T00:33:56.216 INFO:tasks.workunit.client.0.smithi029.stdout:1/539: dwrite df/d29/d41/d69/f44 [0,4194304] 0 2024-04-15T00:33:56.276 INFO:tasks.workunit.client.0.smithi029.stdout:3/555: link d17/d2a/d33/f63 d17/d2a/d33/fab 0 2024-04-15T00:33:56.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/575: creat d2/de/d13/d22/d26/d36/d4d/d70/fc9 x:0 0 0 2024-04-15T00:33:56.326 INFO:tasks.workunit.client.0.smithi029.stdout:5/576: readlink d2/de/d13/d22/d3c/d41/d6d/l85 0 2024-04-15T00:33:56.413 INFO:tasks.workunit.client.0.smithi029.stdout:4/552: mkdir de/d54/d71/d8b/db1 0 2024-04-15T00:33:56.416 INFO:tasks.workunit.client.0.smithi029.stdout:0/565: symlink d5/d15/lb7 0 2024-04-15T00:33:56.538 INFO:tasks.workunit.client.0.smithi029.stdout:8/560: symlink d8/lbf 0 2024-04-15T00:33:56.649 INFO:tasks.workunit.client.0.smithi029.stdout:2/536: link d3/d13/l19 d3/dd/da0/la9 0 2024-04-15T00:33:56.816 INFO:tasks.workunit.client.0.smithi029.stdout:4/553: creat de/d54/d71/da3/fb2 x:0 0 0 2024-04-15T00:33:56.857 INFO:tasks.workunit.client.0.smithi029.stdout:0/566: mknod d5/db/d1a/d65/cb8 0 2024-04-15T00:33:56.944 INFO:tasks.workunit.client.0.smithi029.stdout:8/561: truncate d8/da/d2f/d66/f84 143769 0 2024-04-15T00:33:57.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/567: mkdir d5/d15/d57/db9 0 2024-04-15T00:33:57.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/537: creat d3/dd/da0/faa x:0 0 0 2024-04-15T00:33:57.227 INFO:tasks.workunit.client.0.smithi029.stdout:0/568: fdatasync d5/d15/d57/d5e/fa9 0 2024-04-15T00:33:57.257 INFO:tasks.workunit.client.0.smithi029.stdout:8/562: symlink d8/da8/lc0 0 2024-04-15T00:33:57.332 INFO:tasks.workunit.client.0.smithi029.stdout:9/538: dwrite d3/d6/d9/f49 [0,4194304] 0 2024-04-15T00:33:57.549 INFO:tasks.workunit.client.0.smithi029.stdout:7/557: dwrite d0/f4e [4194304,4194304] 0 2024-04-15T00:33:57.655 INFO:tasks.workunit.client.0.smithi029.stdout:0/569: dread - d5/db/d1a/d65/d87/fac zero size 2024-04-15T00:33:57.713 INFO:tasks.workunit.client.0.smithi029.stdout:9/539: truncate d3/d6/f17 3334618 0 2024-04-15T00:33:57.840 INFO:tasks.workunit.client.0.smithi029.stdout:1/540: dwrite df/d29/d41/f85 [0,4194304] 0 2024-04-15T00:33:57.959 INFO:tasks.workunit.client.0.smithi029.stdout:2/538: getdents d3/dd/d2d/d61/d85/da2 0 2024-04-15T00:33:57.982 INFO:tasks.workunit.client.0.smithi029.stdout:6/570: write d1/d1e/f7e [588693,43326] 0 2024-04-15T00:33:57.993 INFO:tasks.workunit.client.0.smithi029.stdout:4/554: write de/d2b/d35/f3d [1183588,21035] 0 2024-04-15T00:33:58.034 INFO:tasks.workunit.client.0.smithi029.stdout:5/577: dwrite d2/de/d13/daa/fc5 [0,4194304] 0 2024-04-15T00:33:58.119 INFO:tasks.workunit.client.0.smithi029.stdout:3/556: dwrite d17/d2a/d33/f82 [0,4194304] 0 2024-04-15T00:33:58.119 INFO:tasks.workunit.client.0.smithi029.stdout:1/541: stat df/d29/d41/f45 0 2024-04-15T00:33:58.226 INFO:tasks.workunit.client.0.smithi029.stdout:8/563: mkdir d8/da/d2f/d6e/dc1 0 2024-04-15T00:33:58.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/558: truncate d0/d6/d4f/d66/d67/faf 942057 0 2024-04-15T00:33:58.244 INFO:tasks.workunit.client.0.smithi029.stdout:9/540: chown d3/d6/d9/d29/d60/d64/d6d/d58/f28 7573279 1 2024-04-15T00:33:58.268 INFO:tasks.workunit.client.0.smithi029.stdout:3/557: readlink d17/d2a/d4c/da1/la2 0 2024-04-15T00:33:58.324 INFO:tasks.workunit.client.0.smithi029.stdout:4/555: sync 2024-04-15T00:33:58.349 INFO:tasks.workunit.client.0.smithi029.stdout:5/578: dread d2/de/d13/d22/d26/d36/f45 [0,4194304] 0 2024-04-15T00:33:58.386 INFO:tasks.workunit.client.0.smithi029.stdout:9/541: sync 2024-04-15T00:33:58.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/564: sync 2024-04-15T00:33:58.672 INFO:tasks.workunit.client.0.smithi029.stdout:2/539: mkdir d3/d93/dab 0 2024-04-15T00:33:58.895 INFO:tasks.workunit.client.0.smithi029.stdout:3/558: creat d17/d2f/d76/d7f/fac x:0 0 0 2024-04-15T00:33:58.907 INFO:tasks.workunit.client.0.smithi029.stdout:5/579: mknod d2/de/d13/d22/d26/cca 0 2024-04-15T00:33:58.918 INFO:tasks.workunit.client.0.smithi029.stdout:0/570: link d5/db/c88 d5/d15/d27/d9f/cba 0 2024-04-15T00:33:58.975 INFO:tasks.workunit.client.0.smithi029.stdout:2/540: creat d3/dd/da0/fac x:0 0 0 2024-04-15T00:33:59.525 INFO:tasks.workunit.client.0.smithi029.stdout:7/559: unlink d0/d74/c93 0 2024-04-15T00:33:59.550 INFO:tasks.workunit.client.0.smithi029.stdout:6/571: dwrite d1/d8/db/d7b/d91/fa4 [0,4194304] 0 2024-04-15T00:33:59.621 INFO:tasks.workunit.client.0.smithi029.stdout:3/559: fdatasync d17/d2a/f6a 0 2024-04-15T00:33:59.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/565: link d8/d4a/c53 d8/da/d2f/d66/cc2 0 2024-04-15T00:33:59.775 INFO:tasks.workunit.client.0.smithi029.stdout:0/571: dread d5/d3e/f89 [4194304,4194304] 0 2024-04-15T00:33:59.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:33:59.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:33:59.863 INFO:tasks.workunit.client.0.smithi029.stdout:1/542: dwrite df/d29/d41/d69/d4c/d55/d80/d94/fae [0,4194304] 0 2024-04-15T00:33:59.980 INFO:tasks.workunit.client.0.smithi029.stdout:5/580: fdatasync d2/f7 0 2024-04-15T00:34:00.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/542: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:34:00.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/560: dread - d0/d6/d4f/f81 zero size 2024-04-15T00:34:00.099 INFO:tasks.workunit.client.0.smithi029.stdout:3/560: unlink d17/d2f/d76/f8b 0 2024-04-15T00:34:00.121 INFO:tasks.workunit.client.0.smithi029.stdout:4/556: write de/d54/d71/f87 [1937973,75516] 0 2024-04-15T00:34:00.133 INFO:tasks.workunit.client.0.smithi029.stdout:2/541: dread d3/dd/d42/f76 [0,4194304] 0 2024-04-15T00:34:00.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/566: chown d8/d4a/d78/d23/d28/d30/d39/d77/d82/ca3 14819953 1 2024-04-15T00:34:00.202 INFO:tasks.workunit.client.0.smithi029.stdout:2/542: chown d3/d2a/d46/c69 999278 1 2024-04-15T00:34:00.233 INFO:tasks.workunit.client.0.smithi029.stdout:2/543: chown d3/d50/d51/c77 198715 1 2024-04-15T00:34:00.276 INFO:tasks.workunit.client.0.smithi029.stdout:2/544: chown d3/d13/d43/d5a/c60 79391 1 2024-04-15T00:34:00.297 INFO:tasks.workunit.client.0.smithi029.stdout:3/561: chown d17/c28 350 1 2024-04-15T00:34:00.383 INFO:tasks.workunit.client.0.smithi029.stdout:1/543: fsync df/d29/d41/d69/d4c/d55/d59/f67 0 2024-04-15T00:34:00.462 INFO:tasks.workunit.client.0.smithi029.stdout:7/561: creat d0/d6/d4f/d66/d37/fc0 x:0 0 0 2024-04-15T00:34:00.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/557: dread de/d2b/f2c [0,4194304] 0 2024-04-15T00:34:00.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/581: rename d2/de/d13/d22/d3c/d41/d6d/f94 to d2/de/d13/d22/d3c/d41/fcb 0 2024-04-15T00:34:00.839 INFO:tasks.workunit.client.0.smithi029.stdout:6/572: creat d1/fba x:0 0 0 2024-04-15T00:34:00.971 INFO:tasks.workunit.client.0.smithi029.stdout:2/545: creat d3/d13/d43/d5a/d4f/fad x:0 0 0 2024-04-15T00:34:00.974 INFO:tasks.workunit.client.0.smithi029.stdout:3/562: mknod d17/d2a/cad 0 2024-04-15T00:34:01.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/544: fdatasync df/d29/d41/d69/f9d 0 2024-04-15T00:34:01.206 INFO:tasks.workunit.client.0.smithi029.stdout:5/582: chown d2/de/d1f/l7b 2 1 2024-04-15T00:34:01.517 INFO:tasks.workunit.client.0.smithi029.stdout:1/545: creat df/d29/fbd x:0 0 0 2024-04-15T00:34:01.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/543: write d3/d6/f87 [946573,86466] 0 2024-04-15T00:34:01.642 INFO:tasks.workunit.client.0.smithi029.stdout:0/572: dwrite d5/d15/d27/d51/d7d/faa [0,4194304] 0 2024-04-15T00:34:01.734 INFO:tasks.workunit.client.0.smithi029.stdout:4/558: rename de/d3a/c61 to de/d54/cb3 0 2024-04-15T00:34:01.780 INFO:tasks.workunit.client.0.smithi029.stdout:0/573: dread d5/d15/d27/d28/f82 [0,4194304] 0 2024-04-15T00:34:01.793 INFO:tasks.workunit.client.0.smithi029.stdout:5/583: symlink d2/de/d13/d22/d26/d36/lcc 0 2024-04-15T00:34:02.076 INFO:tasks.workunit.client.0.smithi029.stdout:4/559: dread de/df/d1e/f4c [0,4194304] 0 2024-04-15T00:34:02.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/546: getdents d3 0 2024-04-15T00:34:02.145 INFO:tasks.workunit.client.0.smithi029.stdout:8/567: dwrite d8/d4a/d78/d23/d28/d30/d39/d77/fbb [0,4194304] 0 2024-04-15T00:34:02.218 INFO:tasks.workunit.client.0.smithi029.stdout:5/584: rename d2/fa to d2/de/d1f/d63/d65/fcd 0 2024-04-15T00:34:02.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/546: dread df/d29/d41/d69/f44 [0,4194304] 0 2024-04-15T00:34:02.294 INFO:tasks.workunit.client.0.smithi029.stdout:2/547: chown d3/d13/d43/d5a/d4f/f5d 104 1 2024-04-15T00:34:02.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/574: mkdir d5/d15/d27/dbb 0 2024-04-15T00:34:02.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/562: write d0/d6/d4f/d5d/f6d [87624,53776] 0 2024-04-15T00:34:02.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/575: chown d5/d15/f1e 65464959 1 2024-04-15T00:34:02.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/560: fdatasync de/d2b/d59/f70 0 2024-04-15T00:34:02.529 INFO:tasks.workunit.client.0.smithi029.stdout:9/544: link d3/d6/d9/l33 d3/d6/d30/lac 0 2024-04-15T00:34:02.563 INFO:tasks.workunit.client.0.smithi029.stdout:6/573: dwrite d1/d8/db/d38/d6f/fa7 [0,4194304] 0 2024-04-15T00:34:02.630 INFO:tasks.workunit.client.0.smithi029.stdout:5/585: symlink d2/d1a/lce 0 2024-04-15T00:34:02.720 INFO:tasks.workunit.client.0.smithi029.stdout:3/563: dwrite d17/f20 [0,4194304] 0 2024-04-15T00:34:02.832 INFO:tasks.workunit.client.0.smithi029.stdout:8/568: mkdir d8/d4a/d78/dc3 0 2024-04-15T00:34:02.890 INFO:tasks.workunit.client.0.smithi029.stdout:2/548: mknod d3/dd/d2d/d61/cae 0 2024-04-15T00:34:03.133 INFO:tasks.workunit.client.0.smithi029.stdout:5/586: fsync d2/de/fb0 0 2024-04-15T00:34:03.140 INFO:tasks.workunit.client.0.smithi029.stdout:9/545: rmdir d3/d6/d9/d29/d60/d7f/da0 39 2024-04-15T00:34:03.314 INFO:tasks.workunit.client.0.smithi029.stdout:7/563: truncate d0/f22 2404106 0 2024-04-15T00:34:03.315 INFO:tasks.workunit.client.0.smithi029.stdout:2/549: readlink d3/d2a/d46/l4c 0 2024-04-15T00:34:03.352 INFO:tasks.workunit.client.0.smithi029.stdout:6/574: dread d1/d8/db/f44 [0,4194304] 0 2024-04-15T00:34:03.382 INFO:tasks.workunit.client.0.smithi029.stdout:2/550: readlink d3/dd/l12 0 2024-04-15T00:34:03.441 INFO:tasks.workunit.client.0.smithi029.stdout:1/547: write df/d32/d7c/fa5 [900595,37361] 0 2024-04-15T00:34:03.489 INFO:tasks.workunit.client.0.smithi029.stdout:8/569: dread d8/d4a/d78/d23/f57 [0,4194304] 0 2024-04-15T00:34:03.551 INFO:tasks.workunit.client.0.smithi029.stdout:0/576: write d5/db/f29 [989793,102164] 0 2024-04-15T00:34:03.596 INFO:tasks.workunit.client.0.smithi029.stdout:4/561: write de/d54/d58/f5b [1258100,95650] 0 2024-04-15T00:34:03.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/587: write d2/fb [3739108,125789] 0 2024-04-15T00:34:03.661 INFO:tasks.workunit.client.0.smithi029.stdout:1/548: chown df/d29/d41/d69/d4c/d55/d80/d94/f9c 24566997 1 2024-04-15T00:34:03.733 INFO:tasks.workunit.client.0.smithi029.stdout:1/549: chown df/d29/d41/d69/d4c/d7a/caa 954065555 1 2024-04-15T00:34:03.737 INFO:tasks.workunit.client.0.smithi029.stdout:9/546: dwrite d3/d6/f59 [0,4194304] 0 2024-04-15T00:34:03.847 INFO:tasks.workunit.client.0.smithi029.stdout:9/547: chown d3/d6/d9/d15/d4a/d53/l70 2 1 2024-04-15T00:34:03.978 INFO:tasks.workunit.client.0.smithi029.stdout:8/570: creat d8/da/d2f/d6e/d5a/fc4 x:0 0 0 2024-04-15T00:34:03.987 INFO:tasks.workunit.client.0.smithi029.stdout:3/564: creat d17/d2a/d46/fae x:0 0 0 2024-04-15T00:34:04.003 INFO:tasks.workunit.client.0.smithi029.stdout:5/588: creat d2/de/d13/daa/fcf x:0 0 0 2024-04-15T00:34:04.017 INFO:tasks.workunit.client.0.smithi029.stdout:0/577: chown d5/d15/d27/d51/d77/f86 24866 1 2024-04-15T00:34:04.044 INFO:tasks.workunit.client.0.smithi029.stdout:5/589: readlink d2/de/d13/d22/d3c/d41/la0 0 2024-04-15T00:34:04.162 INFO:tasks.workunit.client.0.smithi029.stdout:5/590: dread d2/de/d1f/d63/d65/f86 [0,4194304] 0 2024-04-15T00:34:04.263 INFO:tasks.workunit.client.0.smithi029.stdout:7/564: unlink d0/f59 0 2024-04-15T00:34:04.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/562: symlink de/d6d/d7e/lb4 0 2024-04-15T00:34:04.674 INFO:tasks.workunit.client.0.smithi029.stdout:8/571: creat d8/d4a/d78/d23/d28/d30/db1/fc5 x:0 0 0 2024-04-15T00:34:04.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/565: chown d0/d6/d4f/d5d/d82/cae 8074 1 2024-04-15T00:34:05.113 INFO:tasks.workunit.client.0.smithi029.stdout:0/578: symlink d5/d4c/lbc 0 2024-04-15T00:34:05.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/565: truncate d17/f5b 3599366 0 2024-04-15T00:34:05.425 INFO:tasks.workunit.client.0.smithi029.stdout:5/591: rename d2/de/d13/d22/d3c/d41/d6d/f7e to d2/de/d13/d22/d26/d36/d4d/d70/fd0 0 2024-04-15T00:34:05.555 INFO:tasks.workunit.client.0.smithi029.stdout:6/575: write d1/d1e/d56/f76 [1381606,93387] 0 2024-04-15T00:34:05.663 INFO:tasks.workunit.client.0.smithi029.stdout:1/550: write df/d29/d41/d69/d4c/f5c [455680,63603] 0 2024-04-15T00:34:05.678 INFO:tasks.workunit.client.0.smithi029.stdout:2/551: dwrite d3/dd/d42/f89 [0,4194304] 0 2024-04-15T00:34:05.743 INFO:tasks.workunit.client.0.smithi029.stdout:0/579: mkdir d5/d15/d27/dbb/dbd 0 2024-04-15T00:34:05.824 INFO:tasks.workunit.client.0.smithi029.stdout:6/576: mknod d1/d1e/d56/d58/d5f/cbb 0 2024-04-15T00:34:05.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/548: dwrite d3/d6/f61 [8388608,4194304] 0 2024-04-15T00:34:06.122 INFO:tasks.workunit.client.0.smithi029.stdout:4/563: write de/d2b/f2c [3863228,100109] 0 2024-04-15T00:34:06.127 INFO:tasks.workunit.client.0.smithi029.stdout:8/572: write d8/da/f9c [1317709,86088] 0 2024-04-15T00:34:06.230 INFO:tasks.workunit.client.0.smithi029.stdout:7/566: dwrite d0/d6/f64 [0,4194304] 0 2024-04-15T00:34:06.301 INFO:tasks.workunit.client.0.smithi029.stdout:1/551: creat df/d29/d41/d69/d78/fbe x:0 0 0 2024-04-15T00:34:06.307 INFO:tasks.workunit.client.0.smithi029.stdout:2/552: unlink d3/d2a/d46/d95/f7e 0 2024-04-15T00:34:06.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/549: fsync d3/d6/d9/d29/d60/d64/d6d/d58/f28 0 2024-04-15T00:34:06.491 INFO:tasks.workunit.client.0.smithi029.stdout:8/573: sync 2024-04-15T00:34:06.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/567: dread d0/d6/d4f/d66/d26/f2b [0,4194304] 0 2024-04-15T00:34:06.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/564: fdatasync de/d54/d71/da3/fb2 0 2024-04-15T00:34:06.587 INFO:tasks.workunit.client.0.smithi029.stdout:3/566: getdents d17/d2f/d76/d7f 0 2024-04-15T00:34:06.593 INFO:tasks.workunit.client.0.smithi029.stdout:3/567: chown d17/d2f/d84 0 1 2024-04-15T00:34:06.689 INFO:tasks.workunit.client.0.smithi029.stdout:5/592: dwrite d2/d1a/f20 [0,4194304] 0 2024-04-15T00:34:06.805 INFO:tasks.workunit.client.0.smithi029.stdout:0/580: symlink d5/db/d1a/d65/d76/daf/lbe 0 2024-04-15T00:34:06.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/577: mknod d1/db9/cbc 0 2024-04-15T00:34:06.895 INFO:tasks.workunit.client.0.smithi029.stdout:1/552: truncate df/d32/f50 1155877 0 2024-04-15T00:34:07.176 INFO:tasks.workunit.client.0.smithi029.stdout:9/550: mknod d3/d6/d9/d15/d62/cad 0 2024-04-15T00:34:07.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/568: unlink d0/d6/d4f/d66/d26/f80 0 2024-04-15T00:34:07.233 INFO:tasks.workunit.client.0.smithi029.stdout:3/568: mknod d17/d2f/d44/d58/d5c/d5f/caf 0 2024-04-15T00:34:07.390 INFO:tasks.workunit.client.0.smithi029.stdout:2/553: write d3/d2a/d46/d4a/f8a [4272584,91081] 0 2024-04-15T00:34:07.629 INFO:tasks.workunit.client.0.smithi029.stdout:7/569: creat d0/d6/d4f/d5d/d82/fc1 x:0 0 0 2024-04-15T00:34:07.637 INFO:tasks.workunit.client.0.smithi029.stdout:3/569: symlink d17/d2f/d44/d58/lb0 0 2024-04-15T00:34:07.648 INFO:tasks.workunit.client.0.smithi029.stdout:9/551: chown d3/d6/d9/d29/d60/d64/d6d/d58/c74 237 1 2024-04-15T00:34:07.866 INFO:tasks.workunit.client.0.smithi029.stdout:1/553: mkdir df/d32/dbf 0 2024-04-15T00:34:07.891 INFO:tasks.workunit.client.0.smithi029.stdout:1/554: dread df/f16 [0,4194304] 0 2024-04-15T00:34:07.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/565: write de/d6d/fa9 [8777802,44950] 0 2024-04-15T00:34:07.934 INFO:tasks.workunit.client.0.smithi029.stdout:4/566: read de/d2b/d59/f6f [2700996,45880] 0 2024-04-15T00:34:08.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/552: truncate d3/f34 1082207 0 2024-04-15T00:34:08.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/581: rmdir d5/d15/d1f/d32/db3 0 2024-04-15T00:34:08.257 INFO:tasks.workunit.client.0.smithi029.stdout:9/553: dread d3/d6/d9/d29/d60/d64/d6d/d58/f2a [0,4194304] 0 2024-04-15T00:34:08.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/578: write d1/f18 [2248090,78424] 0 2024-04-15T00:34:08.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/574: getdents d8/da/d3d/d8a 0 2024-04-15T00:34:08.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/554: readlink d3/d6/d9/l63 0 2024-04-15T00:34:08.432 INFO:tasks.workunit.client.0.smithi029.stdout:5/593: dwrite d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/f84 [0,4194304] 0 2024-04-15T00:34:08.529 INFO:tasks.workunit.client.0.smithi029.stdout:4/567: fsync de/d2b/d35/f69 0 2024-04-15T00:34:08.575 INFO:tasks.workunit.client.0.smithi029.stdout:0/582: dwrite d5/db/f29 [0,4194304] 0 2024-04-15T00:34:08.640 INFO:tasks.workunit.client.0.smithi029.stdout:2/554: link d3/d13/c90 d3/dd/da0/caf 0 2024-04-15T00:34:08.705 INFO:tasks.workunit.client.0.smithi029.stdout:7/570: write d0/d6/d4f/d66/d26/f40 [1834338,22058] 0 2024-04-15T00:34:08.815 INFO:tasks.workunit.client.0.smithi029.stdout:3/570: dwrite d17/d2f/d76/d7f/fac [0,4194304] 0 2024-04-15T00:34:09.053 INFO:tasks.workunit.client.0.smithi029.stdout:9/555: fsync d3/d6/d9/d29/d60/d64/d6d/d58/f28 0 2024-04-15T00:34:09.083 INFO:tasks.workunit.client.0.smithi029.stdout:5/594: creat d2/de/d13/d22/d3c/d41/d6d/fd1 x:0 0 0 2024-04-15T00:34:09.120 INFO:tasks.workunit.client.0.smithi029.stdout:6/579: dread d1/d1e/d22/fa6 [0,4194304] 0 2024-04-15T00:34:09.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/555: dwrite df/d29/d41/d69/d4c/d55/d59/f67 [4194304,4194304] 0 2024-04-15T00:34:09.327 INFO:tasks.workunit.client.0.smithi029.stdout:9/556: dread d3/d6/d9/f75 [0,4194304] 0 2024-04-15T00:34:09.392 INFO:tasks.workunit.client.0.smithi029.stdout:5/595: dread d2/f52 [4194304,4194304] 0 2024-04-15T00:34:09.447 INFO:tasks.workunit.client.0.smithi029.stdout:9/557: chown d3/d6/d9/d29/d60/d64/d6d/d58/l23 4807711 1 2024-04-15T00:34:09.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/568: truncate de/d54/d71/da3/fb2 872839 0 2024-04-15T00:34:09.695 INFO:tasks.workunit.client.0.smithi029.stdout:3/571: truncate d17/d2f/d44/d58/d5c/f81 317629 0 2024-04-15T00:34:09.817 INFO:tasks.workunit.client.0.smithi029.stdout:6/580: rmdir d1/d8/db/d98 39 2024-04-15T00:34:09.828 INFO:tasks.workunit.client.0.smithi029.stdout:6/581: stat d1/d8/db/d38/d6f/f9b 0 2024-04-15T00:34:10.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/555: symlink d3/dd/d2d/d61/d85/da2/lb0 0 2024-04-15T00:34:10.481 INFO:tasks.workunit.client.0.smithi029.stdout:3/572: truncate f1 4392707 0 2024-04-15T00:34:10.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/575: creat d8/d4a/d78/d23/d28/fc6 x:0 0 0 2024-04-15T00:34:10.724 INFO:tasks.workunit.client.0.smithi029.stdout:8/576: write d8/da/d2f/f61 [4234847,30390] 0 2024-04-15T00:34:10.777 INFO:tasks.workunit.client.0.smithi029.stdout:0/583: rmdir d5/d15/d27/d9f/db6 0 2024-04-15T00:34:10.932 INFO:tasks.workunit.client.0.smithi029.stdout:2/556: dread d3/dd/f31 [0,4194304] 0 2024-04-15T00:34:10.952 INFO:tasks.workunit.client.0.smithi029.stdout:2/557: chown d3/d13/d43/d5a/d4f/d99/fa8 16 1 2024-04-15T00:34:11.126 INFO:tasks.workunit.client.0.smithi029.stdout:3/573: mkdir d17/d2f/d84/db1 0 2024-04-15T00:34:11.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/556: link c5 df/d29/d41/daf/cc0 0 2024-04-15T00:34:11.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/584: mknod d5/d15/d27/d51/d7d/cbf 0 2024-04-15T00:34:11.275 INFO:tasks.workunit.client.0.smithi029.stdout:8/577: dread d8/da/f14 [0,4194304] 0 2024-04-15T00:34:11.291 INFO:tasks.workunit.client.0.smithi029.stdout:0/585: chown d5/d3e/f89 2123168 1 2024-04-15T00:34:11.405 INFO:tasks.workunit.client.0.smithi029.stdout:4/569: rename de/d6d/d7e/d9b/dae to de/d54/d71/db5 0 2024-04-15T00:34:11.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/586: dread d5/d15/d1f/d32/f61 [0,4194304] 0 2024-04-15T00:34:11.488 INFO:tasks.workunit.client.0.smithi029.stdout:9/558: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fae x:0 0 0 2024-04-15T00:34:11.576 INFO:tasks.workunit.client.0.smithi029.stdout:2/558: fsync d3/d2a/d46/d95/f6a 0 2024-04-15T00:34:11.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/571: link d0/d6/d4f/d5d/d87/da6/lad d0/d6/d4f/d5d/d65/dbc/d8e/lc2 0 2024-04-15T00:34:11.719 INFO:tasks.workunit.client.0.smithi029.stdout:1/557: mkdir df/d32/d90/dc1 0 2024-04-15T00:34:11.764 INFO:tasks.workunit.client.0.smithi029.stdout:3/574: read d17/d2a/f4e [101306,5016] 0 2024-04-15T00:34:11.834 INFO:tasks.workunit.client.0.smithi029.stdout:6/582: dwrite d1/d8/f5e [0,4194304] 0 2024-04-15T00:34:11.931 INFO:tasks.workunit.client.0.smithi029.stdout:5/596: write d2/de/d13/d22/d26/d36/d4d/d70/fd0 [188072,12408] 0 2024-04-15T00:34:12.048 INFO:tasks.workunit.client.0.smithi029.stdout:5/597: dread d2/de/f10 [0,4194304] 0 2024-04-15T00:34:12.179 INFO:tasks.workunit.client.0.smithi029.stdout:0/587: dread d5/d15/d57/f60 [0,4194304] 0 2024-04-15T00:34:12.305 INFO:tasks.workunit.client.0.smithi029.stdout:2/559: unlink d3/d2a/d46/d95/f40 0 2024-04-15T00:34:12.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/572: mkdir d0/d6/d4f/d5d/d87/da6/dc3 0 2024-04-15T00:34:12.473 INFO:tasks.workunit.client.0.smithi029.stdout:1/558: symlink df/d29/lc2 0 2024-04-15T00:34:12.517 INFO:tasks.workunit.client.0.smithi029.stdout:3/575: read ff [826304,29692] 0 2024-04-15T00:34:12.550 INFO:tasks.workunit.client.0.smithi029.stdout:8/578: creat d8/d4a/da1/fc7 x:0 0 0 2024-04-15T00:34:12.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/583: rename d1/d1e/d22/f3a to d1/d8/db/db7/fbd 0 2024-04-15T00:34:12.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/570: mkdir de/d3a/daa/db6 0 2024-04-15T00:34:12.781 INFO:tasks.workunit.client.0.smithi029.stdout:0/588: chown d5/d4c/f97 761578 1 2024-04-15T00:34:12.856 INFO:tasks.workunit.client.0.smithi029.stdout:2/560: fdatasync d3/d2a/d46/d95/f6a 0 2024-04-15T00:34:12.981 INFO:tasks.workunit.client.0.smithi029.stdout:1/559: fdatasync df/d29/fbd 0 2024-04-15T00:34:13.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/559: dwrite d3/d6/d9/d29/d60/d7f/f82 [0,4194304] 0 2024-04-15T00:34:13.099 INFO:tasks.workunit.client.0.smithi029.stdout:8/579: mknod d8/cc8 0 2024-04-15T00:34:13.146 INFO:tasks.workunit.client.0.smithi029.stdout:5/598: mkdir d2/de/d13/dd2 0 2024-04-15T00:34:13.546 INFO:tasks.workunit.client.0.smithi029.stdout:9/560: dread - d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f93 zero size 2024-04-15T00:34:13.648 INFO:tasks.workunit.client.0.smithi029.stdout:3/576: write d17/d2f/d44/f9c [12506,10344] 0 2024-04-15T00:34:13.706 INFO:tasks.workunit.client.0.smithi029.stdout:2/561: mkdir d3/d93/dab/db1 0 2024-04-15T00:34:13.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/573: creat d0/d6/d4f/d66/d26/d77/fc4 x:0 0 0 2024-04-15T00:34:13.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/560: write df/d29/d41/d69/d4c/f5c [149798,94873] 0 2024-04-15T00:34:13.923 INFO:tasks.workunit.client.0.smithi029.stdout:7/574: chown d0/d6/d39/d3c/d5b/f63 402 1 2024-04-15T00:34:13.932 INFO:tasks.workunit.client.0.smithi029.stdout:3/577: sync 2024-04-15T00:34:13.944 INFO:tasks.workunit.client.0.smithi029.stdout:6/584: dwrite d1/d1e/d22/f83 [4194304,4194304] 0 2024-04-15T00:34:14.025 INFO:tasks.workunit.client.0.smithi029.stdout:8/580: write d8/d4a/d78/d23/d28/d30/fb7 [812795,50481] 0 2024-04-15T00:34:14.067 INFO:tasks.workunit.client.0.smithi029.stdout:0/589: dwrite d5/d15/d27/d51/d7d/faa [0,4194304] 0 2024-04-15T00:34:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:5/599: symlink d2/ld3 0 2024-04-15T00:34:14.141 INFO:tasks.workunit.client.0.smithi029.stdout:2/562: symlink d3/dd/d2d/d61/d85/da2/lb2 0 2024-04-15T00:34:14.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/561: chown df/d29/d41/d69/d4c/l92 204627 1 2024-04-15T00:34:14.187 INFO:tasks.workunit.client.0.smithi029.stdout:8/581: readlink d8/d4a/d78/d23/d28/d30/l4f 0 2024-04-15T00:34:14.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/571: getdents de/d6d/d7e 0 2024-04-15T00:34:14.680 INFO:tasks.workunit.client.0.smithi029.stdout:2/563: stat d3/dd/d2d/c86 0 2024-04-15T00:34:14.783 INFO:tasks.workunit.client.0.smithi029.stdout:5/600: truncate d2/d1a/f83 1012296 0 2024-04-15T00:34:15.232 INFO:tasks.workunit.client.0.smithi029.stdout:9/561: link d3/d6/d9/d29/d60/c40 d3/d6/d9/d15/d7e/caf 0 2024-04-15T00:34:15.348 INFO:tasks.workunit.client.0.smithi029.stdout:4/572: symlink de/d54/d58/d8a/lb7 0 2024-04-15T00:34:15.521 INFO:tasks.workunit.client.0.smithi029.stdout:5/601: unlink d2/de/d13/f32 0 2024-04-15T00:34:15.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/562: rename df/d29/d41/d69/d4c/d55/cb5 to df/d32/d90/dc1/cc3 0 2024-04-15T00:34:15.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/575: creat d0/d6/d39/d3c/fc5 x:0 0 0 2024-04-15T00:34:15.718 INFO:tasks.workunit.client.0.smithi029.stdout:7/576: readlink d0/d6/d1c/l50 0 2024-04-15T00:34:15.724 INFO:tasks.workunit.client.0.smithi029.stdout:7/577: readlink d0/d6/l53 0 2024-04-15T00:34:15.823 INFO:tasks.workunit.client.0.smithi029.stdout:0/590: creat d5/d4c/fc0 x:0 0 0 2024-04-15T00:34:15.864 INFO:tasks.workunit.client.0.smithi029.stdout:6/585: link d1/d8/db/f4d d1/d8/db/d7b/fbe 0 2024-04-15T00:34:15.972 INFO:tasks.workunit.client.0.smithi029.stdout:2/564: truncate d3/d2a/d4e/f64 2266937 0 2024-04-15T00:34:15.998 INFO:tasks.workunit.client.0.smithi029.stdout:6/586: dread d1/d8/db/f50 [0,4194304] 0 2024-04-15T00:34:16.067 INFO:tasks.workunit.client.0.smithi029.stdout:5/602: unlink d2/de/d13/d22/d26/d36/f45 0 2024-04-15T00:34:16.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/603: readlink d2/de/d13/l5b 0 2024-04-15T00:34:16.163 INFO:tasks.workunit.client.0.smithi029.stdout:3/578: link d17/d2a/d4c/f70 d17/d2f/d44/d5a/fb2 0 2024-04-15T00:34:16.204 INFO:tasks.workunit.client.0.smithi029.stdout:7/578: dread - d0/d6/d4f/dbb/f9e zero size 2024-04-15T00:34:16.262 INFO:tasks.workunit.client.0.smithi029.stdout:9/562: mknod d3/d6/d9/d29/d60/d64/d6d/cb0 0 2024-04-15T00:34:16.311 INFO:tasks.workunit.client.0.smithi029.stdout:0/591: mkdir d5/db/d1a/d65/d76/daf/dc1 0 2024-04-15T00:34:16.406 INFO:tasks.workunit.client.0.smithi029.stdout:6/587: mknod d1/d8/db/d7b/d85/cbf 0 2024-04-15T00:34:16.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/588: dread d1/d8/db/f44 [0,4194304] 0 2024-04-15T00:34:16.494 INFO:tasks.workunit.client.0.smithi029.stdout:6/589: chown d1/d8/db/d7b/f93 1344415 1 2024-04-15T00:34:16.893 INFO:tasks.workunit.client.0.smithi029.stdout:8/582: dwrite d8/da/fac [0,4194304] 0 2024-04-15T00:34:17.071 INFO:tasks.workunit.client.0.smithi029.stdout:4/573: dwrite de/d3a/f4b [4194304,4194304] 0 2024-04-15T00:34:17.131 INFO:tasks.workunit.client.0.smithi029.stdout:6/590: unlink d1/d1e/d22/f6a 0 2024-04-15T00:34:17.201 INFO:tasks.workunit.client.0.smithi029.stdout:1/563: link c7 df/d29/d41/daf/cc4 0 2024-04-15T00:34:17.500 INFO:tasks.workunit.client.0.smithi029.stdout:2/565: link d3/d53/l57 d3/d13/d43/d5a/lb3 0 2024-04-15T00:34:17.578 INFO:tasks.workunit.client.0.smithi029.stdout:8/583: read - d8/fad zero size 2024-04-15T00:34:17.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/584: chown d8/lb 1005 1 2024-04-15T00:34:17.750 INFO:tasks.workunit.client.0.smithi029.stdout:8/585: sync 2024-04-15T00:34:17.806 INFO:tasks.workunit.client.0.smithi029.stdout:6/591: mknod d1/d8/d72/da3/cc0 0 2024-04-15T00:34:17.910 INFO:tasks.workunit.client.0.smithi029.stdout:5/604: link d2/f8 d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fd4 0 2024-04-15T00:34:17.910 INFO:tasks.workunit.client.0.smithi029.stdout:0/592: link d5/d15/d1f/l39 d5/d15/d27/d9f/lc2 0 2024-04-15T00:34:17.924 INFO:tasks.workunit.client.0.smithi029.stdout:5/605: stat d2/de/d1f/ca2 0 2024-04-15T00:34:18.224 INFO:tasks.workunit.client.0.smithi029.stdout:8/586: fsync d8/da/d2f/d66/f67 0 2024-04-15T00:34:18.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/574: write de/f5d [4745846,110748] 0 2024-04-15T00:34:18.361 INFO:tasks.workunit.client.0.smithi029.stdout:7/579: rename d0/f36 to d0/d6/d4f/d66/d26/d77/fc6 0 2024-04-15T00:34:18.398 INFO:tasks.workunit.client.0.smithi029.stdout:1/564: write df/d32/d7c/fa5 [1820959,36130] 0 2024-04-15T00:34:18.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/566: write d3/d13/d43/d5a/d4f/fad [781887,103830] 0 2024-04-15T00:34:18.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/567: stat d3/dd/d2d/c86 0 2024-04-15T00:34:18.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/579: link d17/d2a/d33/f56 d17/d2a/d4c/d93/fb3 0 2024-04-15T00:34:18.482 INFO:tasks.workunit.client.0.smithi029.stdout:3/580: chown d17/d2f/d84/f86 1945 1 2024-04-15T00:34:18.781 INFO:tasks.workunit.client.0.smithi029.stdout:6/592: mkdir d1/d8/db/dc1 0 2024-04-15T00:34:18.781 INFO:tasks.workunit.client.0.smithi029.stdout:4/575: creat de/d2b/d59/fb8 x:0 0 0 2024-04-15T00:34:18.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/576: chown de/df/d1e/f28 2554318 1 2024-04-15T00:34:18.813 INFO:tasks.workunit.client.0.smithi029.stdout:7/580: mknod d0/d6/d39/d3c/d5b/d7e/cc7 0 2024-04-15T00:34:18.814 INFO:tasks.workunit.client.0.smithi029.stdout:1/565: unlink df/d29/c6c 0 2024-04-15T00:34:18.839 INFO:tasks.workunit.client.0.smithi029.stdout:4/577: truncate f7 5786351 0 2024-04-15T00:34:18.982 INFO:tasks.workunit.client.0.smithi029.stdout:8/587: dwrite d8/d4a/d78/d23/fb2 [0,4194304] 0 2024-04-15T00:34:19.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/568: write d3/d13/d43/fa3 [951865,109884] 0 2024-04-15T00:34:19.178 INFO:tasks.workunit.client.0.smithi029.stdout:5/606: dwrite d2/de/d13/d22/d3c/fae [0,4194304] 0 2024-04-15T00:34:19.262 INFO:tasks.workunit.client.0.smithi029.stdout:6/593: chown d1/d8/db/d7b/cb4 221190 1 2024-04-15T00:34:19.276 INFO:tasks.workunit.client.0.smithi029.stdout:6/594: chown d1/l51 30114 1 2024-04-15T00:34:19.637 INFO:tasks.workunit.client.0.smithi029.stdout:4/578: truncate de/df/d1e/d56/f9e 4241628 0 2024-04-15T00:34:19.642 INFO:tasks.workunit.client.0.smithi029.stdout:3/581: mknod d17/d2a/cb4 0 2024-04-15T00:34:19.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/588: creat d8/da/d2f/d42/d75/fc9 x:0 0 0 2024-04-15T00:34:19.670 INFO:tasks.workunit.client.0.smithi029.stdout:2/569: mkdir d3/d13/d43/d5a/d4f/db4 0 2024-04-15T00:34:19.677 INFO:tasks.workunit.client.0.smithi029.stdout:9/563: rename d3/d6/d9/d29/d60/d64/fa5 to d3/d6/d9/d15/fb1 0 2024-04-15T00:34:19.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/595: chown d1/d8/db/f40 10 1 2024-04-15T00:34:19.735 INFO:tasks.workunit.client.0.smithi029.stdout:8/589: readlink d8/d4a/d78/d23/d28/d30/db1/lbe 0 2024-04-15T00:34:19.830 INFO:tasks.workunit.client.0.smithi029.stdout:7/581: fdatasync d0/d6/f25 0 2024-04-15T00:34:19.958 INFO:tasks.workunit.client.0.smithi029.stdout:7/582: sync 2024-04-15T00:34:20.137 INFO:tasks.workunit.client.0.smithi029.stdout:2/570: mknod d3/d13/d43/d5a/cb5 0 2024-04-15T00:34:20.149 INFO:tasks.workunit.client.0.smithi029.stdout:2/571: chown d3/f91 2009 1 2024-04-15T00:34:20.164 INFO:tasks.workunit.client.0.smithi029.stdout:6/596: fdatasync d1/fba 0 2024-04-15T00:34:20.275 INFO:tasks.workunit.client.0.smithi029.stdout:8/590: dread d8/d4a/d78/d23/d28/d30/fb7 [0,4194304] 0 2024-04-15T00:34:20.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/583: rmdir d0 39 2024-04-15T00:34:20.491 INFO:tasks.workunit.client.0.smithi029.stdout:9/564: symlink d3/d6/d9/d29/d60/d7f/lb2 0 2024-04-15T00:34:20.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/597: chown d1/d8/db/d98/c75 227721574 1 2024-04-15T00:34:20.680 INFO:tasks.workunit.client.0.smithi029.stdout:8/591: mkdir d8/d4a/d78/dca 0 2024-04-15T00:34:20.726 INFO:tasks.workunit.client.0.smithi029.stdout:6/598: sync 2024-04-15T00:34:20.736 INFO:tasks.workunit.client.0.smithi029.stdout:8/592: chown d8/d4a/d78/dca 1995 1 2024-04-15T00:34:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:1/566: dwrite df/d29/d41/d69/d78/fbe [0,4194304] 0 2024-04-15T00:34:20.822 INFO:tasks.workunit.client.0.smithi029.stdout:4/579: creat de/d6d/fb9 x:0 0 0 2024-04-15T00:34:21.079 INFO:tasks.workunit.client.0.smithi029.stdout:8/593: creat d8/d4a/fcb x:0 0 0 2024-04-15T00:34:21.139 INFO:tasks.workunit.client.0.smithi029.stdout:0/593: rename d5/d15/d27/d51/lb4 to d5/db/lc3 0 2024-04-15T00:34:21.242 INFO:tasks.workunit.client.0.smithi029.stdout:1/567: dread df/d29/d41/d69/d4c/f75 [0,4194304] 0 2024-04-15T00:34:21.402 INFO:tasks.workunit.client.0.smithi029.stdout:5/607: rename d2/de/d13/d22/d26/l66 to d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/ld5 0 2024-04-15T00:34:21.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/608: chown d2/de/d13/dd2 0 1 2024-04-15T00:34:21.570 INFO:tasks.workunit.client.0.smithi029.stdout:7/584: truncate d0/d6/d4f/d66/d26/d77/fc6 2785884 0 2024-04-15T00:34:21.581 INFO:tasks.workunit.client.0.smithi029.stdout:8/594: symlink d8/d4a/d78/dca/lcc 0 2024-04-15T00:34:21.660 INFO:tasks.workunit.client.0.smithi029.stdout:5/609: dread - d2/de/d13/d22/d26/d36/d4d/f8f zero size 2024-04-15T00:34:21.814 INFO:tasks.workunit.client.0.smithi029.stdout:3/582: dwrite f1 [0,4194304] 0 2024-04-15T00:34:21.880 INFO:tasks.workunit.client.0.smithi029.stdout:7/585: creat d0/d6/d4f/d66/d67/db8/fc8 x:0 0 0 2024-04-15T00:34:21.939 INFO:tasks.workunit.client.0.smithi029.stdout:0/594: getdents d5/db/d7b 0 2024-04-15T00:34:21.944 INFO:tasks.workunit.client.0.smithi029.stdout:2/572: write d3/d2a/d46/d95/f6a [4773302,87205] 0 2024-04-15T00:34:22.020 INFO:tasks.workunit.client.0.smithi029.stdout:4/580: rename de/d54/d58/l9f to de/df/lba 0 2024-04-15T00:34:22.146 INFO:tasks.workunit.client.0.smithi029.stdout:3/583: mkdir d17/d2f/d44/d58/d5c/d5f/db5 0 2024-04-15T00:34:22.155 INFO:tasks.workunit.client.0.smithi029.stdout:9/565: write d3/d6/d9/d29/d60/d7f/f82 [3548429,91845] 0 2024-04-15T00:34:22.168 INFO:tasks.workunit.client.0.smithi029.stdout:3/584: chown d17/d2f/d76/d7f 161498 1 2024-04-15T00:34:22.262 INFO:tasks.workunit.client.0.smithi029.stdout:0/595: dread d5/db/f29 [0,4194304] 0 2024-04-15T00:34:22.282 INFO:tasks.workunit.client.0.smithi029.stdout:2/573: creat d3/d13/d43/d5a/d4f/d99/fb6 x:0 0 0 2024-04-15T00:34:22.388 INFO:tasks.workunit.client.0.smithi029.stdout:6/599: dwrite d1/f8b [0,4194304] 0 2024-04-15T00:34:22.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/574: dread d3/d13/d43/fa3 [0,4194304] 0 2024-04-15T00:34:22.492 INFO:tasks.workunit.client.0.smithi029.stdout:1/568: write df/d29/d41/d4f/f58 [518241,121065] 0 2024-04-15T00:34:22.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/566: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb3 x:0 0 0 2024-04-15T00:34:22.748 INFO:tasks.workunit.client.0.smithi029.stdout:6/600: unlink d1/f7c 0 2024-04-15T00:34:22.814 INFO:tasks.workunit.client.0.smithi029.stdout:2/575: fdatasync d3/d2a/d46/d95/f1e 0 2024-04-15T00:34:22.832 INFO:tasks.workunit.client.0.smithi029.stdout:8/595: write d8/da/f43 [1213616,89697] 0 2024-04-15T00:34:23.028 INFO:tasks.workunit.client.0.smithi029.stdout:5/610: dwrite d2/de/fbd [0,4194304] 0 2024-04-15T00:34:23.102 INFO:tasks.workunit.client.0.smithi029.stdout:7/586: write d0/d6/f44 [645681,28871] 0 2024-04-15T00:34:23.201 INFO:tasks.workunit.client.0.smithi029.stdout:6/601: creat d1/d8/db/d38/fc2 x:0 0 0 2024-04-15T00:34:23.390 INFO:tasks.workunit.client.0.smithi029.stdout:2/576: fsync d3/d13/d43/d5a/f4b 0 2024-04-15T00:34:23.393 INFO:tasks.workunit.client.0.smithi029.stdout:1/569: mknod df/da4/cc5 0 2024-04-15T00:34:23.515 INFO:tasks.workunit.client.0.smithi029.stdout:4/581: getdents de/d2b/d59 0 2024-04-15T00:34:23.561 INFO:tasks.workunit.client.0.smithi029.stdout:3/585: dwrite d17/d2f/d76/d7f/fac [0,4194304] 0 2024-04-15T00:34:23.697 INFO:tasks.workunit.client.0.smithi029.stdout:0/596: link d5/d3e/f7a d5/db/d1a/d65/d87/fc4 0 2024-04-15T00:34:23.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/602: unlink d1/f3f 0 2024-04-15T00:34:23.838 INFO:tasks.workunit.client.0.smithi029.stdout:1/570: truncate df/f13 1131849 0 2024-04-15T00:34:23.853 INFO:tasks.workunit.client.0.smithi029.stdout:8/596: dread d8/f15 [0,4194304] 0 2024-04-15T00:34:23.868 INFO:tasks.workunit.client.0.smithi029.stdout:9/567: dwrite d3/d6/d9/d29/d60/d7f/da0/f83 [4194304,4194304] 0 2024-04-15T00:34:24.254 INFO:tasks.workunit.client.0.smithi029.stdout:3/586: unlink d17/d2a/cad 0 2024-04-15T00:34:24.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/582: fsync de/d2b/d59/f63 0 2024-04-15T00:34:24.272 INFO:tasks.workunit.client.0.smithi029.stdout:7/587: write d0/d6/d39/d3c/d5b/f63 [3646041,33697] 0 2024-04-15T00:34:24.283 INFO:tasks.workunit.client.0.smithi029.stdout:2/577: write d3/dd/f27 [1954417,128529] 0 2024-04-15T00:34:24.314 INFO:tasks.workunit.client.0.smithi029.stdout:2/578: readlink d3/d2a/l55 0 2024-04-15T00:34:24.321 INFO:tasks.workunit.client.0.smithi029.stdout:7/588: read - d0/d6/d4f/d66/d37/f99 zero size 2024-04-15T00:34:24.409 INFO:tasks.workunit.client.0.smithi029.stdout:5/611: write d2/de/d13/d22/f5e [776851,72902] 0 2024-04-15T00:34:24.432 INFO:tasks.workunit.client.0.smithi029.stdout:5/612: stat d2/de/d13/d22/d26/d36/d4d/d78/f9c 0 2024-04-15T00:34:24.919 INFO:tasks.workunit.client.0.smithi029.stdout:6/603: truncate d1/d1e/d22/f83 5281063 0 2024-04-15T00:34:24.922 INFO:tasks.workunit.client.0.smithi029.stdout:8/597: fdatasync d8/da/d3d/fa9 0 2024-04-15T00:34:24.924 INFO:tasks.workunit.client.0.smithi029.stdout:0/597: truncate d5/d15/d27/d51/d7d/faa 968070 0 2024-04-15T00:34:24.938 INFO:tasks.workunit.client.0.smithi029.stdout:9/568: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb4 x:0 0 0 2024-04-15T00:34:24.990 INFO:tasks.workunit.client.0.smithi029.stdout:2/579: symlink d3/d13/d43/d5a/d4f/d99/lb7 0 2024-04-15T00:34:25.127 INFO:tasks.workunit.client.0.smithi029.stdout:3/587: dread d17/d2a/f34 [0,4194304] 0 2024-04-15T00:34:25.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/604: dread d1/d1e/d56/d58/f8d [0,4194304] 0 2024-04-15T00:34:25.425 INFO:tasks.workunit.client.0.smithi029.stdout:8/598: creat d8/da/d3d/d8a/fcd x:0 0 0 2024-04-15T00:34:25.632 INFO:tasks.workunit.client.0.smithi029.stdout:1/571: creat df/d29/d41/fc6 x:0 0 0 2024-04-15T00:34:25.734 INFO:tasks.workunit.client.0.smithi029.stdout:3/588: fdatasync f0 0 2024-04-15T00:34:26.115 INFO:tasks.workunit.client.0.smithi029.stdout:4/583: creat de/d54/fbb x:0 0 0 2024-04-15T00:34:26.158 INFO:tasks.workunit.client.0.smithi029.stdout:1/572: truncate df/d29/d41/f4e 189265 0 2024-04-15T00:34:26.256 INFO:tasks.workunit.client.0.smithi029.stdout:3/589: mknod d17/d2a/d33/cb6 0 2024-04-15T00:34:26.264 INFO:tasks.workunit.client.0.smithi029.stdout:7/589: write d0/d6/d4f/d5d/d65/f9a [479120,115625] 0 2024-04-15T00:34:26.299 INFO:tasks.workunit.client.0.smithi029.stdout:2/580: creat d3/d13/fb8 x:0 0 0 2024-04-15T00:34:26.691 INFO:tasks.workunit.client.0.smithi029.stdout:1/573: fdatasync df/d29/d41/f85 0 2024-04-15T00:34:26.691 INFO:tasks.workunit.client.0.smithi029.stdout:5/613: creat d2/de/d13/d22/fd6 x:0 0 0 2024-04-15T00:34:26.716 INFO:tasks.workunit.client.0.smithi029.stdout:0/598: write d5/d3e/f69 [64811,30346] 0 2024-04-15T00:34:26.744 INFO:tasks.workunit.client.0.smithi029.stdout:6/605: write d1/d8/db/f48 [6686176,91252] 0 2024-04-15T00:34:26.806 INFO:tasks.workunit.client.0.smithi029.stdout:7/590: creat d0/d6/d39/d3c/d5b/d7e/fc9 x:0 0 0 2024-04-15T00:34:26.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/599: write d8/da/d2f/f61 [6343192,62579] 0 2024-04-15T00:34:26.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/569: dwrite d3/d6/d9/f22 [0,4194304] 0 2024-04-15T00:34:26.951 INFO:tasks.workunit.client.0.smithi029.stdout:5/614: sync 2024-04-15T00:34:26.984 INFO:tasks.workunit.client.0.smithi029.stdout:5/615: chown d2/de/d13/d22/d3c/d41/la0 31 1 2024-04-15T00:34:27.089 INFO:tasks.workunit.client.0.smithi029.stdout:3/590: mknod d17/d2f/d44/d58/d5c/d5f/db5/cb7 0 2024-04-15T00:34:27.251 INFO:tasks.workunit.client.0.smithi029.stdout:8/600: fdatasync d8/f2c 0 2024-04-15T00:34:27.311 INFO:tasks.workunit.client.0.smithi029.stdout:4/584: dwrite f3 [4194304,4194304] 0 2024-04-15T00:34:27.379 INFO:tasks.workunit.client.0.smithi029.stdout:7/591: symlink d0/d6/d4f/d66/d26/lca 0 2024-04-15T00:34:27.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/592: readlink d0/d6/d4f/d66/d67/d90/la0 0 2024-04-15T00:34:27.425 INFO:tasks.workunit.client.0.smithi029.stdout:9/570: read d3/f1b [3173090,37374] 0 2024-04-15T00:34:27.459 INFO:tasks.workunit.client.0.smithi029.stdout:5/616: mkdir d2/de/d13/d22/d26/dd7 0 2024-04-15T00:34:27.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/591: truncate d17/d2f/d44/d5a/faa 403597 0 2024-04-15T00:34:27.637 INFO:tasks.workunit.client.0.smithi029.stdout:1/574: rename df/d29/d41/d69/l91 to df/d29/d41/d69/d4c/d55/d80/lc7 0 2024-04-15T00:34:27.799 INFO:tasks.workunit.client.0.smithi029.stdout:8/601: truncate d8/d4a/d78/d23/fb2 809053 0 2024-04-15T00:34:27.805 INFO:tasks.workunit.client.0.smithi029.stdout:6/606: write d1/d8/d72/f78 [800987,36104] 0 2024-04-15T00:34:27.842 INFO:tasks.workunit.client.0.smithi029.stdout:8/602: read d8/da/d3d/d8a/f8e [473,67893] 0 2024-04-15T00:34:27.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/607: readlink d1/d8/db/d7b/d85/l8e 0 2024-04-15T00:34:28.080 INFO:tasks.workunit.client.0.smithi029.stdout:5/617: mknod d2/de/d13/d22/d3c/d41/d6d/cd8 0 2024-04-15T00:34:28.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/575: truncate df/f30 3085273 0 2024-04-15T00:34:28.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/581: getdents d3/dd/d2d/d61 0 2024-04-15T00:34:28.107 INFO:tasks.workunit.client.0.smithi029.stdout:4/585: symlink de/lbc 0 2024-04-15T00:34:28.420 INFO:tasks.workunit.client.0.smithi029.stdout:6/608: mkdir d1/db9/dc3 0 2024-04-15T00:34:28.433 INFO:tasks.workunit.client.0.smithi029.stdout:8/603: dread - d8/da/d2f/d6e/f9e zero size 2024-04-15T00:34:28.437 INFO:tasks.workunit.client.0.smithi029.stdout:6/609: stat d1/d8/c1b 0 2024-04-15T00:34:28.498 INFO:tasks.workunit.client.0.smithi029.stdout:8/604: dread d8/d4a/d78/d23/d28/d5f/fa4 [0,4194304] 0 2024-04-15T00:34:28.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/599: getdents d5/d15/d1f 0 2024-04-15T00:34:28.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/600: read d5/f7 [1019725,91549] 0 2024-04-15T00:34:28.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/593: write d0/d6/d4f/d66/f61 [848846,25434] 0 2024-04-15T00:34:28.772 INFO:tasks.workunit.client.0.smithi029.stdout:3/592: write d17/f24 [3210303,73455] 0 2024-04-15T00:34:28.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/610: dread - d1/d8/db/f57 zero size 2024-04-15T00:34:28.790 INFO:tasks.workunit.client.0.smithi029.stdout:9/571: dwrite d3/d6/d9/d15/f1f [0,4194304] 0 2024-04-15T00:34:28.802 INFO:tasks.workunit.client.0.smithi029.stdout:7/594: sync 2024-04-15T00:34:28.879 INFO:tasks.workunit.client.0.smithi029.stdout:8/605: rename d8/da/d2f/f4d to d8/d4a/d78/d23/d28/d30/db1/fce 0 2024-04-15T00:34:29.032 INFO:tasks.workunit.client.0.smithi029.stdout:8/606: dread d8/da/d2f/d42/f7b [0,4194304] 0 2024-04-15T00:34:29.063 INFO:tasks.workunit.client.0.smithi029.stdout:5/618: write d2/de/d13/f2f [1085663,100754] 0 2024-04-15T00:34:29.081 INFO:tasks.workunit.client.0.smithi029.stdout:1/576: mknod df/d32/dbf/cc8 0 2024-04-15T00:34:29.338 INFO:tasks.workunit.client.0.smithi029.stdout:2/582: truncate d3/dd/f27 2267076 0 2024-04-15T00:34:29.748 INFO:tasks.workunit.client.0.smithi029.stdout:0/601: write d5/db/f42 [426890,68060] 0 2024-04-15T00:34:29.905 INFO:tasks.workunit.client.0.smithi029.stdout:6/611: dread d1/d8/d72/fb3 [0,4194304] 0 2024-04-15T00:34:29.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:34:29.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:34:29.912 INFO:tasks.workunit.client.0.smithi029.stdout:0/602: dread d5/f13 [0,4194304] 0 2024-04-15T00:34:30.213 INFO:tasks.workunit.client.0.smithi029.stdout:1/577: truncate df/f38 795083 0 2024-04-15T00:34:30.224 INFO:tasks.workunit.client.0.smithi029.stdout:5/619: dread d2/d1a/f59 [0,4194304] 0 2024-04-15T00:34:30.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/586: link de/d54/d71/da3/f90 de/d54/d58/fbd 0 2024-04-15T00:34:30.392 INFO:tasks.workunit.client.0.smithi029.stdout:2/583: rename d3/d13/d43/d5a/d4f/d99 to d3/d2a/d4e/db9 0 2024-04-15T00:34:30.623 INFO:tasks.workunit.client.0.smithi029.stdout:6/612: unlink d1/d8/l6e 0 2024-04-15T00:34:30.673 INFO:tasks.workunit.client.0.smithi029.stdout:0/603: creat d5/db/d8f/fc5 x:0 0 0 2024-04-15T00:34:30.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/620: creat d2/de/d1f/d63/fd9 x:0 0 0 2024-04-15T00:34:30.948 INFO:tasks.workunit.client.0.smithi029.stdout:3/593: write d17/d83/f6d [1780515,103104] 0 2024-04-15T00:34:31.009 INFO:tasks.workunit.client.0.smithi029.stdout:6/613: creat d1/d8/db/d7b/d85/fc4 x:0 0 0 2024-04-15T00:34:31.126 INFO:tasks.workunit.client.0.smithi029.stdout:9/572: dwrite d3/d6/f9c [0,4194304] 0 2024-04-15T00:34:31.193 INFO:tasks.workunit.client.0.smithi029.stdout:7/595: write d0/d6/d4f/d5d/d87/f8c [2853854,113409] 0 2024-04-15T00:34:31.277 INFO:tasks.workunit.client.0.smithi029.stdout:9/573: dread d3/d6/d9/f75 [0,4194304] 0 2024-04-15T00:34:31.279 INFO:tasks.workunit.client.0.smithi029.stdout:3/594: read f1 [609130,94183] 0 2024-04-15T00:34:31.300 INFO:tasks.workunit.client.0.smithi029.stdout:3/595: chown d17/d2f/d3c/f74 372541 1 2024-04-15T00:34:31.370 INFO:tasks.workunit.client.0.smithi029.stdout:0/604: mkdir d5/dc6 0 2024-04-15T00:34:31.442 INFO:tasks.workunit.client.0.smithi029.stdout:9/574: sync 2024-04-15T00:34:31.608 INFO:tasks.workunit.client.0.smithi029.stdout:7/596: truncate d0/d6/d4f/d66/d26/d77/fc4 122396 0 2024-04-15T00:34:31.619 INFO:tasks.workunit.client.0.smithi029.stdout:3/596: chown d17/c19 107004 1 2024-04-15T00:34:31.733 INFO:tasks.workunit.client.0.smithi029.stdout:0/605: rmdir d5/d15/d27/d9f 39 2024-04-15T00:34:31.736 INFO:tasks.workunit.client.0.smithi029.stdout:9/575: truncate d3/f3e 340199 0 2024-04-15T00:34:32.037 INFO:tasks.workunit.client.0.smithi029.stdout:4/587: write de/d2b/d59/fb8 [876111,59563] 0 2024-04-15T00:34:32.082 INFO:tasks.workunit.client.0.smithi029.stdout:0/606: rmdir d5/d15/d1f 39 2024-04-15T00:34:32.121 INFO:tasks.workunit.client.0.smithi029.stdout:9/576: symlink d3/d6/d9/d15/d4a/lb5 0 2024-04-15T00:34:32.172 INFO:tasks.workunit.client.0.smithi029.stdout:0/607: sync 2024-04-15T00:34:32.313 INFO:tasks.workunit.client.0.smithi029.stdout:1/578: dwrite df/d29/d41/d69/d4c/d55/d59/fb0 [0,4194304] 0 2024-04-15T00:34:32.456 INFO:tasks.workunit.client.0.smithi029.stdout:8/607: dwrite d8/da/d2f/d42/f8c [0,4194304] 0 2024-04-15T00:34:32.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/597: mknod d0/d6/d4f/d66/d26/d77/d89/ccb 0 2024-04-15T00:34:32.460 INFO:tasks.workunit.client.0.smithi029.stdout:2/584: dwrite d3/d2a/d46/d95/f20 [0,4194304] 0 2024-04-15T00:34:32.552 INFO:tasks.workunit.client.0.smithi029.stdout:7/598: chown d0/d6/d4f/d66/d26/d77/f96 164 1 2024-04-15T00:34:32.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/588: rename de/df/l53 to de/d2b/d59/lbe 0 2024-04-15T00:34:32.707 INFO:tasks.workunit.client.0.smithi029.stdout:5/621: write d2/de/d13/d22/f5a [1433810,90940] 0 2024-04-15T00:34:32.709 INFO:tasks.workunit.client.0.smithi029.stdout:6/614: write d1/d1e/f27 [3332444,8842] 0 2024-04-15T00:34:32.758 INFO:tasks.workunit.client.0.smithi029.stdout:0/608: creat d5/d15/d68/fc7 x:0 0 0 2024-04-15T00:34:32.878 INFO:tasks.workunit.client.0.smithi029.stdout:2/585: creat d3/d2a/d46/d4a/fba x:0 0 0 2024-04-15T00:34:32.952 INFO:tasks.workunit.client.0.smithi029.stdout:1/579: dread df/f27 [4194304,4194304] 0 2024-04-15T00:34:32.970 INFO:tasks.workunit.client.0.smithi029.stdout:7/599: dread - d0/d6/d39/d3c/fc5 zero size 2024-04-15T00:34:33.060 INFO:tasks.workunit.client.0.smithi029.stdout:9/577: symlink d3/d6/d9/d29/lb6 0 2024-04-15T00:34:33.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/597: write d17/d2f/d44/d5a/faa [938032,100431] 0 2024-04-15T00:34:33.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/615: read - d1/d1e/d56/d58/f84 zero size 2024-04-15T00:34:33.227 INFO:tasks.workunit.client.0.smithi029.stdout:9/578: dread d3/d6/d9/fd [0,4194304] 0 2024-04-15T00:34:33.502 INFO:tasks.workunit.client.0.smithi029.stdout:4/589: write de/d54/d58/f68 [1207756,12367] 0 2024-04-15T00:34:33.565 INFO:tasks.workunit.client.0.smithi029.stdout:8/608: dwrite d8/d4a/d78/d23/d28/d30/db1/fc5 [0,4194304] 0 2024-04-15T00:34:33.664 INFO:tasks.workunit.client.0.smithi029.stdout:5/622: creat d2/de/d13/dd2/fda x:0 0 0 2024-04-15T00:34:33.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/609: creat d5/d4c/d4e/fc8 x:0 0 0 2024-04-15T00:34:33.687 INFO:tasks.workunit.client.0.smithi029.stdout:9/579: creat d3/da3/fb7 x:0 0 0 2024-04-15T00:34:33.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/610: chown d5/db/f29 28581 1 2024-04-15T00:34:33.734 INFO:tasks.workunit.client.0.smithi029.stdout:0/611: dread - d5/d4c/d4e/fc8 zero size 2024-04-15T00:34:33.932 INFO:tasks.workunit.client.0.smithi029.stdout:2/586: rename d3/d2a/d4e/f64 to d3/d2a/d4e/db9/fbb 0 2024-04-15T00:34:33.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/600: getdents d0/d6/d4f/d66/d37/db7 0 2024-04-15T00:34:33.947 INFO:tasks.workunit.client.0.smithi029.stdout:4/590: truncate de/d2b/d59/f96 562571 0 2024-04-15T00:34:33.955 INFO:tasks.workunit.client.0.smithi029.stdout:5/623: rmdir d2/de/d13/d22/d26/d36 39 2024-04-15T00:34:33.992 INFO:tasks.workunit.client.0.smithi029.stdout:2/587: read d3/f79 [377896,121698] 0 2024-04-15T00:34:34.002 INFO:tasks.workunit.client.0.smithi029.stdout:7/601: dread - d0/d6/d39/d3c/f70 zero size 2024-04-15T00:34:34.058 INFO:tasks.workunit.client.0.smithi029.stdout:5/624: dread d2/d1a/f59 [0,4194304] 0 2024-04-15T00:34:34.124 INFO:tasks.workunit.client.0.smithi029.stdout:0/612: fdatasync d5/d15/d57/d5e/f8e 0 2024-04-15T00:34:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/598: write d17/f5b [124367,56202] 0 2024-04-15T00:34:34.281 INFO:tasks.workunit.client.0.smithi029.stdout:6/616: dwrite d1/d1e/d56/f62 [0,4194304] 0 2024-04-15T00:34:34.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/617: write d1/d8/db/d7b/d85/fc4 [443104,47615] 0 2024-04-15T00:34:34.441 INFO:tasks.workunit.client.0.smithi029.stdout:9/580: mknod d3/d6/d9/d15/d4a/da9/cb8 0 2024-04-15T00:34:34.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/609: rename d8/d4a/d78/d23/d28/d30/fb7 to d8/da/d2f/d66/fcf 0 2024-04-15T00:34:34.474 INFO:tasks.workunit.client.0.smithi029.stdout:2/588: truncate d3/d13/d43/fa3 119025 0 2024-04-15T00:34:34.509 INFO:tasks.workunit.client.0.smithi029.stdout:8/610: chown d8/d4a/d78/d23/d28/d5f/f83 14305 1 2024-04-15T00:34:34.510 INFO:tasks.workunit.client.0.smithi029.stdout:2/589: chown d3/d13/d43/fa1 25 1 2024-04-15T00:34:35.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/580: getdents df/d32/dbf 0 2024-04-15T00:34:35.109 INFO:tasks.workunit.client.0.smithi029.stdout:4/591: mkdir de/d54/d71/dbf 0 2024-04-15T00:34:35.348 INFO:tasks.workunit.client.0.smithi029.stdout:8/611: read - d8/d4a/d78/d87/fb9 zero size 2024-04-15T00:34:35.404 INFO:tasks.workunit.client.0.smithi029.stdout:2/590: mknod d3/dd/d42/cbc 0 2024-04-15T00:34:35.669 INFO:tasks.workunit.client.0.smithi029.stdout:1/581: truncate df/d29/d41/d69/d4c/d55/f63 666213 0 2024-04-15T00:34:35.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/591: chown d3/d2a/d46/d95/l6b 1 1 2024-04-15T00:34:35.953 INFO:tasks.workunit.client.0.smithi029.stdout:7/602: getdents d0/d6/d4f/d66/d67 0 2024-04-15T00:34:35.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/582: read - df/d29/d41/fc6 zero size 2024-04-15T00:34:36.058 INFO:tasks.workunit.client.0.smithi029.stdout:4/592: mknod de/d2b/cc0 0 2024-04-15T00:34:36.168 INFO:tasks.workunit.client.0.smithi029.stdout:3/599: rename d17/d2f/d44/d58/d5c/d5f/db5/cb7 to d17/d2f/d44/cb8 0 2024-04-15T00:34:36.175 INFO:tasks.workunit.client.0.smithi029.stdout:5/625: creat d2/de/d13/d22/d26/d36/d4d/d70/fdb x:0 0 0 2024-04-15T00:34:36.267 INFO:tasks.workunit.client.0.smithi029.stdout:8/612: symlink d8/da/d2f/d6e/ld0 0 2024-04-15T00:34:36.335 INFO:tasks.workunit.client.0.smithi029.stdout:2/592: symlink d3/d50/d51/lbd 0 2024-04-15T00:34:36.395 INFO:tasks.workunit.client.0.smithi029.stdout:0/613: getdents d5/d15/d27 0 2024-04-15T00:34:36.466 INFO:tasks.workunit.client.0.smithi029.stdout:7/603: unlink d0/d6/d4f/d66/d26/l29 0 2024-04-15T00:34:36.628 INFO:tasks.workunit.client.0.smithi029.stdout:4/593: fdatasync de/d2b/d35/f6b 0 2024-04-15T00:34:36.683 INFO:tasks.workunit.client.0.smithi029.stdout:9/581: rename d3/d6/d9/d15/d4a/f72 to d3/d88/fb9 0 2024-04-15T00:34:36.700 INFO:tasks.workunit.client.0.smithi029.stdout:9/582: readlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/l9f 0 2024-04-15T00:34:36.708 INFO:tasks.workunit.client.0.smithi029.stdout:9/583: chown d3/d6/f87 222460470 1 2024-04-15T00:34:36.806 INFO:tasks.workunit.client.0.smithi029.stdout:5/626: mknod d2/de/d13/d22/d26/d36/d4d/cdc 0 2024-04-15T00:34:36.814 INFO:tasks.workunit.client.0.smithi029.stdout:8/613: stat d8/d4a/c53 0 2024-04-15T00:34:36.823 INFO:tasks.workunit.client.0.smithi029.stdout:5/627: stat d2/d1a/f59 0 2024-04-15T00:34:36.879 INFO:tasks.workunit.client.0.smithi029.stdout:2/593: mkdir d3/d93/dbe 0 2024-04-15T00:34:36.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/604: symlink d0/d6/d39/d3c/d5b/lcc 0 2024-04-15T00:34:37.000 INFO:tasks.workunit.client.0.smithi029.stdout:3/600: mknod d17/d2f/cb9 0 2024-04-15T00:34:37.102 INFO:tasks.workunit.client.0.smithi029.stdout:9/584: rename d3/d6/d9/d15/f1f to d3/d6/d9/d15/d4a/da9/fba 0 2024-04-15T00:34:37.213 INFO:tasks.workunit.client.0.smithi029.stdout:8/614: creat d8/da/d2f/fd1 x:0 0 0 2024-04-15T00:34:37.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/618: dwrite d1/f17 [0,4194304] 0 2024-04-15T00:34:37.364 INFO:tasks.workunit.client.0.smithi029.stdout:0/614: truncate d5/d3e/f7a 595025 0 2024-04-15T00:34:37.408 INFO:tasks.workunit.client.0.smithi029.stdout:2/594: truncate d3/dd/d42/f47 516494 0 2024-04-15T00:34:37.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/585: mkdir d3/d6/d9/d29/d60/d64/d6d/d58/d6a/dbb 0 2024-04-15T00:34:37.538 INFO:tasks.workunit.client.0.smithi029.stdout:9/586: chown d3/d6/d9/d29/d60/d64/d6d/d58/d6a/c76 6693 1 2024-04-15T00:34:37.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/619: dread d1/d8/db/f37 [0,4194304] 0 2024-04-15T00:34:37.897 INFO:tasks.workunit.client.0.smithi029.stdout:3/601: truncate d17/d2a/f36 5025072 0 2024-04-15T00:34:37.916 INFO:tasks.workunit.client.0.smithi029.stdout:9/587: truncate d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb4 125755 0 2024-04-15T00:34:37.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/588: chown d3/d6/d9/d29/d60/d7f/da0/d9a/f36 15661645 1 2024-04-15T00:34:38.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/615: symlink d8/da7/ld2 0 2024-04-15T00:34:38.004 INFO:tasks.workunit.client.0.smithi029.stdout:0/615: truncate d5/d15/d1f/f63 4372123 0 2024-04-15T00:34:38.030 INFO:tasks.workunit.client.0.smithi029.stdout:7/605: link d0/d6/d39/d3c/l41 d0/d6/d4f/d5d/d87/da6/dc3/lcd 0 2024-04-15T00:34:38.145 INFO:tasks.workunit.client.0.smithi029.stdout:6/620: fsync d1/f6 0 2024-04-15T00:34:38.220 INFO:tasks.workunit.client.0.smithi029.stdout:1/583: dwrite df/d32/f36 [0,4194304] 0 2024-04-15T00:34:38.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/589: rmdir d3/d6/d9/d29/d60 39 2024-04-15T00:34:38.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/616: rename d5/db/d7b/l9e to d5/d15/d68/lc9 0 2024-04-15T00:34:38.666 INFO:tasks.workunit.client.0.smithi029.stdout:8/616: mkdir d8/d4a/d78/d23/d28/d30/d39/d77/dd3 0 2024-04-15T00:34:38.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/606: fsync d0/d6/f18 0 2024-04-15T00:34:38.771 INFO:tasks.workunit.client.0.smithi029.stdout:4/594: dwrite de/d2b/d35/f49 [0,4194304] 0 2024-04-15T00:34:38.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/602: fdatasync d17/d2f/d44/d58/d5c/f64 0 2024-04-15T00:34:39.196 INFO:tasks.workunit.client.0.smithi029.stdout:6/621: creat d1/db9/dc3/fc5 x:0 0 0 2024-04-15T00:34:39.339 INFO:tasks.workunit.client.0.smithi029.stdout:5/628: dwrite d2/de/d13/d22/d3c/d41/fcb [0,4194304] 0 2024-04-15T00:34:39.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/595: dwrite d3/dd/d42/f89 [0,4194304] 0 2024-04-15T00:34:39.863 INFO:tasks.workunit.client.0.smithi029.stdout:3/603: dread d17/d2f/d44/d5a/faa [0,4194304] 0 2024-04-15T00:34:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:6/622: rmdir d1/d8/db/d38 39 2024-04-15T00:34:40.141 INFO:tasks.workunit.client.0.smithi029.stdout:5/629: fsync d2/d1a/f59 0 2024-04-15T00:34:40.162 INFO:tasks.workunit.client.0.smithi029.stdout:5/630: read d2/de/d13/d22/d3c/d41/fcb [387600,98680] 0 2024-04-15T00:34:40.262 INFO:tasks.workunit.client.0.smithi029.stdout:2/596: creat d3/dd/d2d/d61/d85/fbf x:0 0 0 2024-04-15T00:34:40.355 INFO:tasks.workunit.client.0.smithi029.stdout:1/584: write df/fa7 [991612,99203] 0 2024-04-15T00:34:40.404 INFO:tasks.workunit.client.0.smithi029.stdout:3/604: creat d17/d2f/d44/d58/d5c/d5f/fba x:0 0 0 2024-04-15T00:34:40.519 INFO:tasks.workunit.client.0.smithi029.stdout:0/617: dwrite d5/db/f19 [4194304,4194304] 0 2024-04-15T00:34:40.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/623: fsync d1/db9/dc3/fc5 0 2024-04-15T00:34:40.624 INFO:tasks.workunit.client.0.smithi029.stdout:4/595: write de/d2b/d35/f73 [831997,61002] 0 2024-04-15T00:34:40.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/597: mknod d3/d13/d43/d5a/cc0 0 2024-04-15T00:34:40.846 INFO:tasks.workunit.client.0.smithi029.stdout:5/631: dread d2/d1a/faf [0,4194304] 0 2024-04-15T00:34:40.892 INFO:tasks.workunit.client.0.smithi029.stdout:1/585: dread df/f4d [0,4194304] 0 2024-04-15T00:34:41.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/596: symlink de/d2b/d35/lc1 0 2024-04-15T00:34:41.595 INFO:tasks.workunit.client.0.smithi029.stdout:9/590: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/f99 [0,4194304] 0 2024-04-15T00:34:41.782 INFO:tasks.workunit.client.0.smithi029.stdout:4/597: fsync f8 0 2024-04-15T00:34:41.782 INFO:tasks.workunit.client.0.smithi029.stdout:2/598: creat d3/d13/d43/d5a/d4f/db4/fc1 x:0 0 0 2024-04-15T00:34:41.787 INFO:tasks.workunit.client.0.smithi029.stdout:4/598: stat lb 0 2024-04-15T00:34:41.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/586: creat df/d29/d41/daf/fc9 x:0 0 0 2024-04-15T00:34:41.816 INFO:tasks.workunit.client.0.smithi029.stdout:8/617: write d8/d4a/d78/d23/fb2 [806518,11457] 0 2024-04-15T00:34:41.835 INFO:tasks.workunit.client.0.smithi029.stdout:7/607: write d0/d6/d4f/d66/d26/d77/fc6 [2526910,120655] 0 2024-04-15T00:34:42.147 INFO:tasks.workunit.client.0.smithi029.stdout:0/618: write d5/d15/f4a [2014989,13757] 0 2024-04-15T00:34:42.148 INFO:tasks.workunit.client.0.smithi029.stdout:6/624: write d1/d1e/f32 [1209315,94946] 0 2024-04-15T00:34:42.381 INFO:tasks.workunit.client.0.smithi029.stdout:3/605: getdents d17/d2f/d44/d5a 0 2024-04-15T00:34:42.404 INFO:tasks.workunit.client.0.smithi029.stdout:4/599: creat de/d3a/fc2 x:0 0 0 2024-04-15T00:34:42.470 INFO:tasks.workunit.client.0.smithi029.stdout:2/599: unlink d3/d2a/d46/d4a/l5e 0 2024-04-15T00:34:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:5/632: dwrite d2/de/d13/d22/d26/d36/d4d/d78/f9c [0,4194304] 0 2024-04-15T00:34:42.617 INFO:tasks.workunit.client.0.smithi029.stdout:5/633: stat d2/d1a/f3e 0 2024-04-15T00:34:42.744 INFO:tasks.workunit.client.0.smithi029.stdout:0/619: creat d5/d15/d27/d51/d77/fca x:0 0 0 2024-04-15T00:34:42.772 INFO:tasks.workunit.client.0.smithi029.stdout:7/608: dread d0/f4e [4194304,4194304] 0 2024-04-15T00:34:42.927 INFO:tasks.workunit.client.0.smithi029.stdout:6/625: symlink d1/d1e/d56/d58/lc6 0 2024-04-15T00:34:43.039 INFO:tasks.workunit.client.0.smithi029.stdout:0/620: readlink d5/d15/l17 0 2024-04-15T00:34:43.133 INFO:tasks.workunit.client.0.smithi029.stdout:7/609: creat d0/d6/d4f/d5d/d87/fce x:0 0 0 2024-04-15T00:34:43.491 INFO:tasks.workunit.client.0.smithi029.stdout:1/587: dwrite df/d29/d41/f85 [0,4194304] 0 2024-04-15T00:34:43.612 INFO:tasks.workunit.client.0.smithi029.stdout:4/600: rename de/d54/da6 to de/d54/d71/dc3 0 2024-04-15T00:34:43.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/600: link d3/d13/d43/d5a/d4f/c7f d3/d50/d51/d65/cc2 0 2024-04-15T00:34:43.721 INFO:tasks.workunit.client.0.smithi029.stdout:0/621: getdents d5/db/d1a/d50/da1 0 2024-04-15T00:34:43.723 INFO:tasks.workunit.client.0.smithi029.stdout:9/591: dwrite d3/d88/fb9 [0,4194304] 0 2024-04-15T00:34:43.789 INFO:tasks.workunit.client.0.smithi029.stdout:3/606: dwrite d17/f24 [0,4194304] 0 2024-04-15T00:34:43.797 INFO:tasks.workunit.client.0.smithi029.stdout:5/634: write d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/f84 [3042497,76931] 0 2024-04-15T00:34:43.890 INFO:tasks.workunit.client.0.smithi029.stdout:7/610: write d0/d6/f3b [1247742,31793] 0 2024-04-15T00:34:43.940 INFO:tasks.workunit.client.0.smithi029.stdout:1/588: creat df/d32/db2/fca x:0 0 0 2024-04-15T00:34:43.986 INFO:tasks.workunit.client.0.smithi029.stdout:4/601: fdatasync f7 0 2024-04-15T00:34:44.020 INFO:tasks.workunit.client.0.smithi029.stdout:2/601: stat d3/d13/d43/d5a/d4f/l6e 0 2024-04-15T00:34:44.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/618: dwrite d8/d4a/d78/d23/d28/d5f/f9a [0,4194304] 0 2024-04-15T00:34:44.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/626: link d1/d1e/d56/c69 d1/d8/d79/cc7 0 2024-04-15T00:34:44.180 INFO:tasks.workunit.client.0.smithi029.stdout:0/622: mknod d5/db/d1a/d50/ccb 0 2024-04-15T00:34:44.200 INFO:tasks.workunit.client.0.smithi029.stdout:3/607: read - d17/d2f/d84/f86 zero size 2024-04-15T00:34:44.223 INFO:tasks.workunit.client.0.smithi029.stdout:0/623: stat d5/db/db0 0 2024-04-15T00:34:44.227 INFO:tasks.workunit.client.0.smithi029.stdout:3/608: readlink d17/d2a/d4c/l6b 0 2024-04-15T00:34:44.229 INFO:tasks.workunit.client.0.smithi029.stdout:6/627: chown d1/d8/db/f57 12438617 1 2024-04-15T00:34:44.239 INFO:tasks.workunit.client.0.smithi029.stdout:2/602: truncate d3/dd/d2d/d61/d85/fbf 367783 0 2024-04-15T00:34:44.276 INFO:tasks.workunit.client.0.smithi029.stdout:4/602: chown de/d54/d71/f84 182091053 1 2024-04-15T00:34:44.297 INFO:tasks.workunit.client.0.smithi029.stdout:9/592: dread d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [0,4194304] 0 2024-04-15T00:34:44.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/589: truncate df/d29/d41/fc6 380726 0 2024-04-15T00:34:44.538 INFO:tasks.workunit.client.0.smithi029.stdout:7/611: rename d0/d6/d4f/d66/d26/l79 to d0/d69/lcf 0 2024-04-15T00:34:44.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/612: dread - d0/d6/d4f/f9d zero size 2024-04-15T00:34:44.606 INFO:tasks.workunit.client.0.smithi029.stdout:2/603: sync 2024-04-15T00:34:44.904 INFO:tasks.workunit.client.0.smithi029.stdout:9/593: mknod d3/d6/d9/d29/d60/d64/cbc 0 2024-04-15T00:34:44.910 INFO:tasks.workunit.client.0.smithi029.stdout:5/635: write d2/f8 [1628964,129838] 0 2024-04-15T00:34:45.006 INFO:tasks.workunit.client.0.smithi029.stdout:6/628: mknod d1/d1e/d56/cc8 0 2024-04-15T00:34:45.052 INFO:tasks.workunit.client.0.smithi029.stdout:6/629: dread d1/d8/db/f50 [0,4194304] 0 2024-04-15T00:34:45.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/590: mknod df/d29/d41/d69/d4c/d7a/ccb 0 2024-04-15T00:34:45.203 INFO:tasks.workunit.client.0.smithi029.stdout:4/603: fdatasync de/df/d1e/f29 0 2024-04-15T00:34:45.213 INFO:tasks.workunit.client.0.smithi029.stdout:0/624: write d5/f13 [4288903,92210] 0 2024-04-15T00:34:45.235 INFO:tasks.workunit.client.0.smithi029.stdout:3/609: dwrite f0 [0,4194304] 0 2024-04-15T00:34:45.483 INFO:tasks.workunit.client.0.smithi029.stdout:9/594: mknod d3/d6/d9/d29/d60/d64/d6d/d58/cbd 0 2024-04-15T00:34:46.019 INFO:tasks.workunit.client.0.smithi029.stdout:8/619: mknod d8/da/cd4 0 2024-04-15T00:34:46.169 INFO:tasks.workunit.client.0.smithi029.stdout:2/604: write d3/d13/d43/d5a/d4f/fad [273863,30380] 0 2024-04-15T00:34:46.539 INFO:tasks.workunit.client.0.smithi029.stdout:2/605: creat d3/dd/d2d/d61/d85/da2/fc3 x:0 0 0 2024-04-15T00:34:46.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/636: link d2/de/d13/d22/d26/d36/c8b d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/cdd 0 2024-04-15T00:34:46.672 INFO:tasks.workunit.client.0.smithi029.stdout:2/606: creat d3/d50/fc4 x:0 0 0 2024-04-15T00:34:46.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/630: dwrite d1/d8/d72/f87 [0,4194304] 0 2024-04-15T00:34:46.762 INFO:tasks.workunit.client.0.smithi029.stdout:6/631: readlink d1/d8/db/d7b/d85/lac 0 2024-04-15T00:34:46.958 INFO:tasks.workunit.client.0.smithi029.stdout:1/591: write df/f4d [1567386,86839] 0 2024-04-15T00:34:47.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/613: rename d0/d6/f44 to d0/d6/d4f/dbb/d49/fd0 0 2024-04-15T00:34:47.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/625: dwrite d5/d15/d1f/d32/f3d [0,4194304] 0 2024-04-15T00:34:47.372 INFO:tasks.workunit.client.0.smithi029.stdout:9/595: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:34:47.378 INFO:tasks.workunit.client.0.smithi029.stdout:4/604: dwrite de/d54/d58/d8a/f98 [0,4194304] 0 2024-04-15T00:34:47.481 INFO:tasks.workunit.client.0.smithi029.stdout:6/632: mkdir d1/d1e/d56/d58/d5f/dab/dc9 0 2024-04-15T00:34:47.482 INFO:tasks.workunit.client.0.smithi029.stdout:7/614: dread - d0/d6/d4f/d66/d37/f99 zero size 2024-04-15T00:34:47.505 INFO:tasks.workunit.client.0.smithi029.stdout:2/607: fsync d3/d13/f83 0 2024-04-15T00:34:47.529 INFO:tasks.workunit.client.0.smithi029.stdout:3/610: rename d17/d2f/d44/d58/l6f to d17/d2a/d46/d67/lbb 0 2024-04-15T00:34:47.585 INFO:tasks.workunit.client.0.smithi029.stdout:5/637: dwrite d2/d1a/f3e [0,4194304] 0 2024-04-15T00:34:47.702 INFO:tasks.workunit.client.0.smithi029.stdout:7/615: chown d0/d6/d4f/d66/d37/f99 1 1 2024-04-15T00:34:47.778 INFO:tasks.workunit.client.0.smithi029.stdout:9/596: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:34:47.843 INFO:tasks.workunit.client.0.smithi029.stdout:0/626: symlink d5/d15/d57/lcc 0 2024-04-15T00:34:47.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/620: rename d8/da/d3d/d8a/f8e to d8/d4a/d78/d23/d28/d30/d39/d77/fd5 0 2024-04-15T00:34:47.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/616: sync 2024-04-15T00:34:47.924 INFO:tasks.workunit.client.0.smithi029.stdout:8/621: chown d8/d4a/d78/d23/d28/d5f/l68 124397 1 2024-04-15T00:34:47.979 INFO:tasks.workunit.client.0.smithi029.stdout:8/622: chown d8/f2c 685639 1 2024-04-15T00:34:48.002 INFO:tasks.workunit.client.0.smithi029.stdout:3/611: creat d17/d2f/d44/d58/fbc x:0 0 0 2024-04-15T00:34:48.004 INFO:tasks.workunit.client.0.smithi029.stdout:2/608: truncate d3/dd/f31 109950 0 2024-04-15T00:34:48.061 INFO:tasks.workunit.client.0.smithi029.stdout:0/627: dwrite d5/d15/d27/d51/d77/fca [0,4194304] 0 2024-04-15T00:34:48.127 INFO:tasks.workunit.client.0.smithi029.stdout:6/633: truncate d1/d8/db/d7b/d85/fc4 622495 0 2024-04-15T00:34:48.129 INFO:tasks.workunit.client.0.smithi029.stdout:8/623: chown d8/da/l46 1091 1 2024-04-15T00:34:48.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/612: dread d17/d2a/d4c/d93/fa8 [0,4194304] 0 2024-04-15T00:34:48.368 INFO:tasks.workunit.client.0.smithi029.stdout:5/638: write d2/de/d13/d22/d3c/fae [3050823,8812] 0 2024-04-15T00:34:48.392 INFO:tasks.workunit.client.0.smithi029.stdout:5/639: dread - d2/de/d13/d22/f40 zero size 2024-04-15T00:34:48.519 INFO:tasks.workunit.client.0.smithi029.stdout:7/617: fsync d0/d6/d4f/d5d/d65/dbc/f92 0 2024-04-15T00:34:48.521 INFO:tasks.workunit.client.0.smithi029.stdout:2/609: creat d3/d53/fc5 x:0 0 0 2024-04-15T00:34:48.530 INFO:tasks.workunit.client.0.smithi029.stdout:0/628: truncate d5/db/f42 268688 0 2024-04-15T00:34:48.564 INFO:tasks.workunit.client.0.smithi029.stdout:0/629: dread - d5/d15/d27/f96 zero size 2024-04-15T00:34:48.594 INFO:tasks.workunit.client.0.smithi029.stdout:0/630: dread d5/d15/d27/d51/d77/f86 [0,4194304] 0 2024-04-15T00:34:48.681 INFO:tasks.workunit.client.0.smithi029.stdout:4/605: rename de/d2b/c33 to de/d3a/cc4 0 2024-04-15T00:34:48.682 INFO:tasks.workunit.client.0.smithi029.stdout:3/613: fsync d17/d2f/d3c/f4a 0 2024-04-15T00:34:48.746 INFO:tasks.workunit.client.0.smithi029.stdout:1/592: getdents df/d29/d41/d69/d4c 0 2024-04-15T00:34:48.859 INFO:tasks.workunit.client.0.smithi029.stdout:2/610: stat d3/d13/d43/d5a/d4f/l8d 0 2024-04-15T00:34:48.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/614: dread d17/d2f/d3c/f4a [4194304,4194304] 0 2024-04-15T00:34:48.897 INFO:tasks.workunit.client.0.smithi029.stdout:3/615: dread - d17/d2f/d44/d58/d5c/d5f/f7b zero size 2024-04-15T00:34:48.911 INFO:tasks.workunit.client.0.smithi029.stdout:7/618: unlink d0/d6/d4f/d66/d67/d90/la0 0 2024-04-15T00:34:48.978 INFO:tasks.workunit.client.0.smithi029.stdout:0/631: creat d5/d15/d27/dbb/fcd x:0 0 0 2024-04-15T00:34:49.027 INFO:tasks.workunit.client.0.smithi029.stdout:3/616: dread d17/f1b [4194304,4194304] 0 2024-04-15T00:34:49.099 INFO:tasks.workunit.client.0.smithi029.stdout:9/597: dwrite d3/d6/d9/d29/d60/f6e [0,4194304] 0 2024-04-15T00:34:49.189 INFO:tasks.workunit.client.0.smithi029.stdout:6/634: rename d1/d1e/d56/d58/d5f/f65 to d1/d8/d72/da3/fca 0 2024-04-15T00:34:49.386 INFO:tasks.workunit.client.0.smithi029.stdout:1/593: dread df/d29/d41/d69/d4c/d55/f68 [0,4194304] 0 2024-04-15T00:34:49.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/624: dwrite d8/d4a/d78/d23/d28/d30/db1/fc5 [0,4194304] 0 2024-04-15T00:34:49.604 INFO:tasks.workunit.client.0.smithi029.stdout:2/611: dread d3/d13/f16 [0,4194304] 0 2024-04-15T00:34:49.740 INFO:tasks.workunit.client.0.smithi029.stdout:4/606: dwrite f4 [0,4194304] 0 2024-04-15T00:34:50.028 INFO:tasks.workunit.client.0.smithi029.stdout:3/617: chown d17/f1d 2020 1 2024-04-15T00:34:50.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/632: creat d5/db/d7b/fce x:0 0 0 2024-04-15T00:34:50.136 INFO:tasks.workunit.client.0.smithi029.stdout:9/598: readlink d3/d6/d9/d29/l37 0 2024-04-15T00:34:50.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/619: write d0/d6/d4f/d5d/d87/f8c [633326,67673] 0 2024-04-15T00:34:50.260 INFO:tasks.workunit.client.0.smithi029.stdout:0/633: dread d5/d15/d1f/f3a [0,4194304] 0 2024-04-15T00:34:50.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/640: link d2/de/fbd d2/de/fde 0 2024-04-15T00:34:50.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/625: truncate d8/da/d2f/fd1 815535 0 2024-04-15T00:34:50.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/612: dread - d3/d2a/d46/d95/f98 zero size 2024-04-15T00:34:50.575 INFO:tasks.workunit.client.0.smithi029.stdout:4/607: mknod de/d54/d71/da3/cc5 0 2024-04-15T00:34:50.931 INFO:tasks.workunit.client.0.smithi029.stdout:1/594: symlink df/d32/lcc 0 2024-04-15T00:34:50.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/620: truncate d0/d6/f25 1565921 0 2024-04-15T00:34:51.043 INFO:tasks.workunit.client.0.smithi029.stdout:0/634: symlink d5/d15/d27/lcf 0 2024-04-15T00:34:51.145 INFO:tasks.workunit.client.0.smithi029.stdout:2/613: fdatasync d3/dd/d2d/d61/d85/f92 0 2024-04-15T00:34:51.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/635: write d1/d1e/d56/d58/d59/f60 [1903262,114821] 0 2024-04-15T00:34:51.277 INFO:tasks.workunit.client.0.smithi029.stdout:1/595: fsync df/d29/f4b 0 2024-04-15T00:34:51.309 INFO:tasks.workunit.client.0.smithi029.stdout:7/621: dread d0/d6/d4f/d5d/f6d [0,4194304] 0 2024-04-15T00:34:51.695 INFO:tasks.workunit.client.0.smithi029.stdout:2/614: truncate d3/f79 1241276 0 2024-04-15T00:34:51.780 INFO:tasks.workunit.client.0.smithi029.stdout:3/618: dwrite d17/d2f/d3c/f4a [4194304,4194304] 0 2024-04-15T00:34:51.887 INFO:tasks.workunit.client.0.smithi029.stdout:1/596: mknod df/d29/d41/d69/d4c/d55/ccd 0 2024-04-15T00:34:51.988 INFO:tasks.workunit.client.0.smithi029.stdout:9/599: dwrite d3/d6/d9/d15/d4a/f4b [0,4194304] 0 2024-04-15T00:34:52.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/626: creat d8/d4a/d78/d23/d28/fd6 x:0 0 0 2024-04-15T00:34:52.076 INFO:tasks.workunit.client.0.smithi029.stdout:8/627: stat d8/d4a/d78/f6b 0 2024-04-15T00:34:52.300 INFO:tasks.workunit.client.0.smithi029.stdout:5/641: write d2/de/d13/d22/d26/d36/d4d/f8f [1003567,44516] 0 2024-04-15T00:34:52.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/628: read d8/da/f49 [130446,123381] 0 2024-04-15T00:34:52.453 INFO:tasks.workunit.client.0.smithi029.stdout:9/600: dread d3/d6/d9/d29/d60/d64/d6d/d58/f32 [0,4194304] 0 2024-04-15T00:34:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/642: dread d2/de/d13/d22/fbb [4194304,4194304] 0 2024-04-15T00:34:52.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/597: dwrite df/d29/f4b [0,4194304] 0 2024-04-15T00:34:52.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/619: rename d17/d2f/d44/d58/d5c/f81 to d17/d2a/d33/fbd 0 2024-04-15T00:34:52.725 INFO:tasks.workunit.client.0.smithi029.stdout:0/635: mknod d5/d15/d27/d51/d77/cd0 0 2024-04-15T00:34:53.038 INFO:tasks.workunit.client.0.smithi029.stdout:4/608: write de/d2b/d35/f3d [1592017,44275] 0 2024-04-15T00:34:53.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/622: write d0/d6/d4f/d66/d26/d77/f96 [1654696,51295] 0 2024-04-15T00:34:53.058 INFO:tasks.workunit.client.0.smithi029.stdout:2/615: write d3/dd/d2d/d61/d85/fbf [922000,90448] 0 2024-04-15T00:34:53.063 INFO:tasks.workunit.client.0.smithi029.stdout:6/636: write d1/d8/d79/fb5 [205509,4137] 0 2024-04-15T00:34:53.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/629: truncate d8/d4a/d78/d23/d28/d30/db1/fce 1217966 0 2024-04-15T00:34:53.532 INFO:tasks.workunit.client.0.smithi029.stdout:1/598: mknod df/d32/cce 0 2024-04-15T00:34:53.601 INFO:tasks.workunit.client.0.smithi029.stdout:9/601: dwrite d3/d6/d9/d29/d60/d7f/da0/d9a/fab [0,4194304] 0 2024-04-15T00:34:53.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/620: rename d17/d2f/l3a to d17/d2f/d76/d7f/lbe 0 2024-04-15T00:34:53.713 INFO:tasks.workunit.client.0.smithi029.stdout:4/609: write de/d6d/fb9 [1040629,126944] 0 2024-04-15T00:34:53.797 INFO:tasks.workunit.client.0.smithi029.stdout:6/637: dread d1/d8/db/db7/fbd [0,4194304] 0 2024-04-15T00:34:53.825 INFO:tasks.workunit.client.0.smithi029.stdout:0/636: truncate d5/d15/d27/f96 975417 0 2024-04-15T00:34:53.906 INFO:tasks.workunit.client.0.smithi029.stdout:1/599: creat df/da4/fcf x:0 0 0 2024-04-15T00:34:53.917 INFO:tasks.workunit.client.0.smithi029.stdout:8/630: dread d8/f7c [0,4194304] 0 2024-04-15T00:34:53.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/638: dread d1/d8/d72/fb3 [0,4194304] 0 2024-04-15T00:34:53.957 INFO:tasks.workunit.client.0.smithi029.stdout:8/631: stat d8/d4a/d78/d23/f59 0 2024-04-15T00:34:53.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/632: read - d8/da/d3d/fa9 zero size 2024-04-15T00:34:54.046 INFO:tasks.workunit.client.0.smithi029.stdout:2/616: rename d3/d93/dab to d3/dd/d42/dc6 0 2024-04-15T00:34:54.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/643: creat d2/de/d13/fdf x:0 0 0 2024-04-15T00:34:54.073 INFO:tasks.workunit.client.0.smithi029.stdout:2/617: chown d3/d2a/d46/d95 32144 1 2024-04-15T00:34:54.082 INFO:tasks.workunit.client.0.smithi029.stdout:3/621: creat d17/d2f/d44/d58/d5c/d5f/fbf x:0 0 0 2024-04-15T00:34:54.165 INFO:tasks.workunit.client.0.smithi029.stdout:9/602: symlink d3/d6/d9/d29/d60/d64/d6d/d58/lbe 0 2024-04-15T00:34:54.289 INFO:tasks.workunit.client.0.smithi029.stdout:0/637: read - d5/d15/d27/d51/fb2 zero size 2024-04-15T00:34:54.336 INFO:tasks.workunit.client.0.smithi029.stdout:7/623: dwrite d0/f1f [0,4194304] 0 2024-04-15T00:34:54.482 INFO:tasks.workunit.client.0.smithi029.stdout:9/603: sync 2024-04-15T00:34:54.493 INFO:tasks.workunit.client.0.smithi029.stdout:9/604: chown d3/d6/d9/d29/d60/d64 18 1 2024-04-15T00:34:54.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/600: rename df/d29/d41/d69/fba to df/d29/d41/d69/d4c/fd0 0 2024-04-15T00:34:54.562 INFO:tasks.workunit.client.0.smithi029.stdout:3/622: creat d17/d2a/d33/d37/fc0 x:0 0 0 2024-04-15T00:34:54.690 INFO:tasks.workunit.client.0.smithi029.stdout:2/618: dread d3/d13/d43/f8f [0,4194304] 0 2024-04-15T00:34:54.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/633: mknod d8/d4a/d78/d23/d28/cd7 0 2024-04-15T00:34:54.969 INFO:tasks.workunit.client.0.smithi029.stdout:4/610: dwrite de/df/f18 [0,4194304] 0 2024-04-15T00:34:55.154 INFO:tasks.workunit.client.0.smithi029.stdout:4/611: dread de/df/d1e/f4c [0,4194304] 0 2024-04-15T00:34:55.258 INFO:tasks.workunit.client.0.smithi029.stdout:3/623: mknod d17/d2f/d76/d7f/cc1 0 2024-04-15T00:34:55.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/638: getdents d5/d4c/d4e/da8 0 2024-04-15T00:34:55.281 INFO:tasks.workunit.client.0.smithi029.stdout:2/619: mknod d3/dd/d2d/d61/d85/da2/cc7 0 2024-04-15T00:34:55.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/639: dwrite d1/d8/db/d7b/d91/fa4 [0,4194304] 0 2024-04-15T00:34:55.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/612: rmdir de/d54/d58 39 2024-04-15T00:34:55.514 INFO:tasks.workunit.client.0.smithi029.stdout:9/605: link d3/d6/d9/d29/d60/d64/d6d/cb0 d3/d6/d9/d15/d62/cbf 0 2024-04-15T00:34:55.580 INFO:tasks.workunit.client.0.smithi029.stdout:8/634: fsync d8/da/d2f/fd1 0 2024-04-15T00:34:55.779 INFO:tasks.workunit.client.0.smithi029.stdout:9/606: stat d3/d6/d9/d29/d60/d64/d6d/c51 0 2024-04-15T00:34:55.779 INFO:tasks.workunit.client.0.smithi029.stdout:5/644: dwrite d2/de/d13/d22/d3c/f75 [0,4194304] 0 2024-04-15T00:34:55.888 INFO:tasks.workunit.client.0.smithi029.stdout:3/624: creat d17/d2f/d76/d7f/fc2 x:0 0 0 2024-04-15T00:34:55.897 INFO:tasks.workunit.client.0.smithi029.stdout:0/639: creat d5/d15/d1f/fd1 x:0 0 0 2024-04-15T00:34:56.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/624: dwrite d0/d6/d39/d3c/d5b/d7e/fb3 [0,4194304] 0 2024-04-15T00:34:56.263 INFO:tasks.workunit.client.0.smithi029.stdout:7/625: read d0/d6/d1c/fe [1391531,35815] 0 2024-04-15T00:34:56.363 INFO:tasks.workunit.client.0.smithi029.stdout:1/601: dwrite df/d29/d41/d4f/f58 [0,4194304] 0 2024-04-15T00:34:56.493 INFO:tasks.workunit.client.0.smithi029.stdout:7/626: read d0/d6/d39/d3c/d5b/d7e/fb3 [2876851,102088] 0 2024-04-15T00:34:56.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/607: unlink d3/d6/l38 0 2024-04-15T00:34:56.609 INFO:tasks.workunit.client.0.smithi029.stdout:1/602: chown df/d29/d41/d4f/f58 8688 1 2024-04-15T00:34:56.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/640: readlink d5/d15/d27/l59 0 2024-04-15T00:34:56.621 INFO:tasks.workunit.client.0.smithi029.stdout:4/613: dread de/d3a/f4b [0,4194304] 0 2024-04-15T00:34:56.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/645: dread - d2/de/d13/d22/d26/d36/fc1 zero size 2024-04-15T00:34:56.681 INFO:tasks.workunit.client.0.smithi029.stdout:1/603: chown df/d29/d41/d69/d78/l97 93868746 1 2024-04-15T00:34:56.863 INFO:tasks.workunit.client.0.smithi029.stdout:8/635: mknod d8/da/d2f/d6e/dc1/cd8 0 2024-04-15T00:34:56.885 INFO:tasks.workunit.client.0.smithi029.stdout:6/640: write d1/d8/db/db7/fbd [167605,63272] 0 2024-04-15T00:34:56.935 INFO:tasks.workunit.client.0.smithi029.stdout:7/627: rmdir d0/d6/d4f/d5d/d65/dbc/dab 39 2024-04-15T00:34:56.946 INFO:tasks.workunit.client.0.smithi029.stdout:7/628: stat d0/d6/d4f/d66/d26/f28 0 2024-04-15T00:34:57.061 INFO:tasks.workunit.client.0.smithi029.stdout:9/608: dread d3/d6/d9/d29/d60/d64/d6d/d58/f99 [0,4194304] 0 2024-04-15T00:34:57.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/646: rename d2/de/d13/d22/d26/d36/d4d/d70/d9a/f61 to d2/de/d13/d22/d26/dd7/fe0 0 2024-04-15T00:34:57.374 INFO:tasks.workunit.client.0.smithi029.stdout:4/614: symlink de/d2b/lc6 0 2024-04-15T00:34:57.645 INFO:tasks.workunit.client.0.smithi029.stdout:2/620: write d3/dd/f31 [166770,73671] 0 2024-04-15T00:34:57.688 INFO:tasks.workunit.client.0.smithi029.stdout:3/625: write d17/d83/f65 [370715,15562] 0 2024-04-15T00:34:57.720 INFO:tasks.workunit.client.0.smithi029.stdout:8/636: mknod d8/da/d2f/d6e/cd9 0 2024-04-15T00:34:57.827 INFO:tasks.workunit.client.0.smithi029.stdout:5/647: unlink d2/de/d13/d22/d26/d36/d4d/d78/f9c 0 2024-04-15T00:34:57.889 INFO:tasks.workunit.client.0.smithi029.stdout:7/629: creat d0/d6/d4f/d5d/d65/dbc/d8e/fd1 x:0 0 0 2024-04-15T00:34:57.899 INFO:tasks.workunit.client.0.smithi029.stdout:8/637: sync 2024-04-15T00:34:58.061 INFO:tasks.workunit.client.0.smithi029.stdout:9/609: symlink d3/d6/d9/d15/d9d/lc0 0 2024-04-15T00:34:58.121 INFO:tasks.workunit.client.0.smithi029.stdout:2/621: creat d3/dd/d42/dc6/fc8 x:0 0 0 2024-04-15T00:34:58.258 INFO:tasks.workunit.client.0.smithi029.stdout:1/604: dwrite df/d32/f36 [4194304,4194304] 0 2024-04-15T00:34:58.334 INFO:tasks.workunit.client.0.smithi029.stdout:8/638: symlink d8/d4a/d78/d23/d28/d5f/lda 0 2024-04-15T00:34:58.341 INFO:tasks.workunit.client.0.smithi029.stdout:9/610: truncate d3/f8a 814637 0 2024-04-15T00:34:58.349 INFO:tasks.workunit.client.0.smithi029.stdout:6/641: write d1/d1e/d56/d58/d5f/f73 [1659768,118916] 0 2024-04-15T00:34:58.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/626: creat d17/d2f/d84/db1/fc3 x:0 0 0 2024-04-15T00:34:58.404 INFO:tasks.workunit.client.0.smithi029.stdout:2/622: stat d3/dd/d42/f47 0 2024-04-15T00:34:58.529 INFO:tasks.workunit.client.0.smithi029.stdout:0/641: dwrite d5/db/d1a/d65/d87/fc4 [0,4194304] 0 2024-04-15T00:34:58.839 INFO:tasks.workunit.client.0.smithi029.stdout:4/615: write de/f3c [2150460,10063] 0 2024-04-15T00:34:58.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/639: creat d8/da/d2f/d6e/d5a/fdb x:0 0 0 2024-04-15T00:34:59.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/605: rename df/d29/d41/d69/d4c/d55 to df/d29/d41/d69/d78/dd1 0 2024-04-15T00:34:59.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/630: write d0/d6/d4f/d66/d26/f28 [1531244,51490] 0 2024-04-15T00:34:59.400 INFO:tasks.workunit.client.0.smithi029.stdout:8/640: fdatasync d8/fad 0 2024-04-15T00:34:59.521 INFO:tasks.workunit.client.0.smithi029.stdout:1/606: rmdir df/d29/d41/daf 39 2024-04-15T00:34:59.584 INFO:tasks.workunit.client.0.smithi029.stdout:9/611: chown d3/d6/d9/d29/d60/d64/d6d/f91 323664 1 2024-04-15T00:34:59.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/642: write d1/f31 [1456813,27377] 0 2024-04-15T00:34:59.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/616: dread f7 [0,4194304] 0 2024-04-15T00:34:59.716 INFO:tasks.workunit.client.0.smithi029.stdout:5/648: dwrite d2/de/d13/d22/d26/dd7/fe0 [4194304,4194304] 0 2024-04-15T00:34:59.816 INFO:tasks.workunit.client.0.smithi029.stdout:9/612: chown d3/d6/d9/d29/d60/d64/f8b 1 1 2024-04-15T00:34:59.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:34:59.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:34:59.985 INFO:tasks.workunit.client.0.smithi029.stdout:2/623: dwrite d3/dd/d42/f47 [0,4194304] 0 2024-04-15T00:34:59.988 INFO:tasks.workunit.client.0.smithi029.stdout:3/627: dwrite d17/d2a/d4c/f8c [0,4194304] 0 2024-04-15T00:35:00.122 INFO:tasks.workunit.client.0.smithi029.stdout:7/631: mknod d0/d6/d4f/dbb/cd2 0 2024-04-15T00:35:00.133 INFO:tasks.workunit.client.0.smithi029.stdout:2/624: readlink d3/l1b 0 2024-04-15T00:35:00.314 INFO:tasks.workunit.client.0.smithi029.stdout:1/607: creat df/d29/d41/d69/d4c/fd2 x:0 0 0 2024-04-15T00:35:00.316 INFO:tasks.workunit.client.0.smithi029.stdout:6/643: unlink d1/c21 0 2024-04-15T00:35:00.328 INFO:tasks.workunit.client.0.smithi029.stdout:4/617: truncate de/d3a/f42 1878834 0 2024-04-15T00:35:00.337 INFO:tasks.workunit.client.0.smithi029.stdout:9/613: mkdir d3/da3/dc1 0 2024-04-15T00:35:00.439 INFO:tasks.workunit.client.0.smithi029.stdout:5/649: dread f0 [0,4194304] 0 2024-04-15T00:35:00.548 INFO:tasks.workunit.client.0.smithi029.stdout:6/644: dread d1/d8/db/f37 [0,4194304] 0 2024-04-15T00:35:00.565 INFO:tasks.workunit.client.0.smithi029.stdout:2/625: readlink d3/d13/l19 0 2024-04-15T00:35:00.697 INFO:tasks.workunit.client.0.smithi029.stdout:3/628: symlink d17/d2a/d33/d37/lc4 0 2024-04-15T00:35:00.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/632: chown d0/d6/d4f/d66/d67/d90/cbf 868961959 1 2024-04-15T00:35:00.823 INFO:tasks.workunit.client.0.smithi029.stdout:0/642: dwrite d5/db/f42 [0,4194304] 0 2024-04-15T00:35:01.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/614: unlink d3/d6/d9/d29/d60/f6e 0 2024-04-15T00:35:01.215 INFO:tasks.workunit.client.0.smithi029.stdout:2/626: mkdir d3/d13/d43/d5a/d4f/db4/dc9 0 2024-04-15T00:35:01.226 INFO:tasks.workunit.client.0.smithi029.stdout:6/645: read d1/d1e/f7e [398653,100806] 0 2024-04-15T00:35:01.247 INFO:tasks.workunit.client.0.smithi029.stdout:2/627: chown d3/d13/d43/d5a/d4f/f5d 3978235 1 2024-04-15T00:35:01.257 INFO:tasks.workunit.client.0.smithi029.stdout:3/629: symlink d17/d2a/d4c/da1/lc5 0 2024-04-15T00:35:01.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/646: dread d1/d8/db/f50 [0,4194304] 0 2024-04-15T00:35:01.446 INFO:tasks.workunit.client.0.smithi029.stdout:6/647: dread d1/d1e/d22/fa6 [0,4194304] 0 2024-04-15T00:35:01.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/648: chown d1/d8/db/d7b 1940552 1 2024-04-15T00:35:01.468 INFO:tasks.workunit.client.0.smithi029.stdout:7/633: unlink d0/d6/d4f/d66/d26/d54/cb2 0 2024-04-15T00:35:01.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/643: creat d5/db/d1a/d50/fd2 x:0 0 0 2024-04-15T00:35:01.771 INFO:tasks.workunit.client.0.smithi029.stdout:2/628: fdatasync d3/d13/d43/d5a/d4f/f5d 0 2024-04-15T00:35:01.848 INFO:tasks.workunit.client.0.smithi029.stdout:7/634: stat d0/d6/f2c 0 2024-04-15T00:35:01.964 INFO:tasks.workunit.client.0.smithi029.stdout:0/644: unlink d5/d4c/f97 0 2024-04-15T00:35:02.049 INFO:tasks.workunit.client.0.smithi029.stdout:0/645: read d5/d15/d57/f60 [165430,82913] 0 2024-04-15T00:35:02.057 INFO:tasks.workunit.client.0.smithi029.stdout:3/630: fdatasync d17/d2a/d33/f56 0 2024-04-15T00:35:02.100 INFO:tasks.workunit.client.0.smithi029.stdout:8/641: dwrite d8/d4a/d78/d23/d28/d30/d39/d77/fd5 [0,4194304] 0 2024-04-15T00:35:02.170 INFO:tasks.workunit.client.0.smithi029.stdout:2/629: truncate d3/d13/f83 833319 0 2024-04-15T00:35:02.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/631: creat d17/d2f/d84/fc6 x:0 0 0 2024-04-15T00:35:02.728 INFO:tasks.workunit.client.0.smithi029.stdout:1/608: mkdir df/d29/dd3 0 2024-04-15T00:35:02.733 INFO:tasks.workunit.client.0.smithi029.stdout:9/615: rename d3/d6/f59 to d3/d6/d9/d29/d60/d7f/fc2 0 2024-04-15T00:35:02.852 INFO:tasks.workunit.client.0.smithi029.stdout:3/632: stat lc 0 2024-04-15T00:35:02.991 INFO:tasks.workunit.client.0.smithi029.stdout:5/650: dwrite d2/de/d13/d22/f7c [0,4194304] 0 2024-04-15T00:35:03.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/633: mknod d17/d2f/d44/d5a/cc7 0 2024-04-15T00:35:03.153 INFO:tasks.workunit.client.0.smithi029.stdout:5/651: chown d2/de/d13/d22/d3c/d41/d6d 202125304 1 2024-04-15T00:35:03.163 INFO:tasks.workunit.client.0.smithi029.stdout:1/609: dread df/f2d [0,4194304] 0 2024-04-15T00:35:03.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/618: write de/d3a/f42 [1123165,93313] 0 2024-04-15T00:35:03.380 INFO:tasks.workunit.client.0.smithi029.stdout:2/630: getdents d3/d2a/d46 0 2024-04-15T00:35:03.386 INFO:tasks.workunit.client.0.smithi029.stdout:5/652: truncate d2/de/d13/f2f 1388643 0 2024-04-15T00:35:03.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/635: write d0/d6/d4f/d66/d26/f2b [1325468,107835] 0 2024-04-15T00:35:03.401 INFO:tasks.workunit.client.0.smithi029.stdout:6/649: write d1/d8/db/f4d [713936,121157] 0 2024-04-15T00:35:03.436 INFO:tasks.workunit.client.0.smithi029.stdout:1/610: read df/d29/d41/d69/d78/dd1/d59/f67 [4367867,96328] 0 2024-04-15T00:35:03.461 INFO:tasks.workunit.client.0.smithi029.stdout:2/631: read d3/f32 [383462,123493] 0 2024-04-15T00:35:03.569 INFO:tasks.workunit.client.0.smithi029.stdout:7/636: dwrite d0/d6/d4f/d66/d26/f28 [0,4194304] 0 2024-04-15T00:35:03.799 INFO:tasks.workunit.client.0.smithi029.stdout:1/611: creat df/d32/d90/dc1/fd4 x:0 0 0 2024-04-15T00:35:03.901 INFO:tasks.workunit.client.0.smithi029.stdout:0/646: dwrite d5/d15/d1f/f3a [4194304,4194304] 0 2024-04-15T00:35:03.998 INFO:tasks.workunit.client.0.smithi029.stdout:7/637: truncate d0/d6/d4f/f5c 4344501 0 2024-04-15T00:35:04.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/650: dread d1/d8/f54 [0,4194304] 0 2024-04-15T00:35:04.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/632: dread d3/f79 [0,4194304] 0 2024-04-15T00:35:04.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/642: dwrite d8/da/d2f/d6e/f47 [0,4194304] 0 2024-04-15T00:35:04.191 INFO:tasks.workunit.client.0.smithi029.stdout:3/634: write ff [3337543,65492] 0 2024-04-15T00:35:04.341 INFO:tasks.workunit.client.0.smithi029.stdout:5/653: dread d2/de/d13/d22/d3c/d41/fcb [0,4194304] 0 2024-04-15T00:35:04.377 INFO:tasks.workunit.client.0.smithi029.stdout:4/619: write de/d2b/d59/f86 [4861989,65394] 0 2024-04-15T00:35:04.467 INFO:tasks.workunit.client.0.smithi029.stdout:8/643: creat d8/d4a/d78/dca/fdc x:0 0 0 2024-04-15T00:35:04.677 INFO:tasks.workunit.client.0.smithi029.stdout:3/635: dread d17/d2f/d76/d7f/fac [0,4194304] 0 2024-04-15T00:35:04.726 INFO:tasks.workunit.client.0.smithi029.stdout:1/612: truncate df/d29/d41/d69/d78/fb4 2552224 0 2024-04-15T00:35:04.738 INFO:tasks.workunit.client.0.smithi029.stdout:4/620: fdatasync de/f74 0 2024-04-15T00:35:04.746 INFO:tasks.workunit.client.0.smithi029.stdout:5/654: fsync d2/de/d13/d22/d26/f6f 0 2024-04-15T00:35:04.844 INFO:tasks.workunit.client.0.smithi029.stdout:3/636: creat d17/d2f/d44/d58/d5c/fc8 x:0 0 0 2024-04-15T00:35:04.929 INFO:tasks.workunit.client.0.smithi029.stdout:4/621: dwrite de/f5d [0,4194304] 0 2024-04-15T00:35:05.006 INFO:tasks.workunit.client.0.smithi029.stdout:9/616: creat d3/d6/d9/d29/d60/d64/d6d/d58/d6a/dbb/fc3 x:0 0 0 2024-04-15T00:35:05.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/638: dwrite d0/d6/d4f/f7f [0,4194304] 0 2024-04-15T00:35:05.158 INFO:tasks.workunit.client.0.smithi029.stdout:7/639: dread - d0/d6/d4f/d66/d37/f99 zero size 2024-04-15T00:35:05.218 INFO:tasks.workunit.client.0.smithi029.stdout:6/651: write d1/d8/f8c [938694,100528] 0 2024-04-15T00:35:05.360 INFO:tasks.workunit.client.0.smithi029.stdout:2/633: write d3/dd/d2d/d61/d85/fbf [1000651,60931] 0 2024-04-15T00:35:05.376 INFO:tasks.workunit.client.0.smithi029.stdout:2/634: chown d3/d13/d43/l45 154645441 1 2024-04-15T00:35:05.426 INFO:tasks.workunit.client.0.smithi029.stdout:1/613: rmdir df/d29/d41/d69/d4c 39 2024-04-15T00:35:05.474 INFO:tasks.workunit.client.0.smithi029.stdout:5/655: fsync d2/de/d13/d22/f5e 0 2024-04-15T00:35:05.545 INFO:tasks.workunit.client.0.smithi029.stdout:3/637: truncate d17/d83/f9b 69124 0 2024-04-15T00:35:05.709 INFO:tasks.workunit.client.0.smithi029.stdout:4/622: mknod de/d54/d71/db5/cc7 0 2024-04-15T00:35:05.718 INFO:tasks.workunit.client.0.smithi029.stdout:9/617: creat d3/d6/d9/d29/d60/d64/fc4 x:0 0 0 2024-04-15T00:35:05.731 INFO:tasks.workunit.client.0.smithi029.stdout:9/618: stat d3/d88/c94 0 2024-04-15T00:35:05.808 INFO:tasks.workunit.client.0.smithi029.stdout:0/647: getdents d5/d15 0 2024-04-15T00:35:05.810 INFO:tasks.workunit.client.0.smithi029.stdout:8/644: write d8/f38 [2127742,92503] 0 2024-04-15T00:35:05.834 INFO:tasks.workunit.client.0.smithi029.stdout:7/640: read d0/f22 [422470,16002] 0 2024-04-15T00:35:05.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/652: mkdir d1/d8/d79/dcb 0 2024-04-15T00:35:06.331 INFO:tasks.workunit.client.0.smithi029.stdout:3/638: truncate d17/d83/f6d 872316 0 2024-04-15T00:35:06.400 INFO:tasks.workunit.client.0.smithi029.stdout:9/619: symlink d3/da3/lc5 0 2024-04-15T00:35:06.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/620: dread d3/d6/d9/fd [0,4194304] 0 2024-04-15T00:35:06.534 INFO:tasks.workunit.client.0.smithi029.stdout:8/645: truncate d8/f2b 1068559 0 2024-04-15T00:35:06.539 INFO:tasks.workunit.client.0.smithi029.stdout:0/648: fsync d5/d15/d57/fb1 0 2024-04-15T00:35:06.541 INFO:tasks.workunit.client.0.smithi029.stdout:6/653: mknod d1/d8/db/db7/ccc 0 2024-04-15T00:35:06.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/649: dread d5/d15/d1f/d32/f49 [0,4194304] 0 2024-04-15T00:35:06.706 INFO:tasks.workunit.client.0.smithi029.stdout:5/656: symlink d2/da5/dc8/le1 0 2024-04-15T00:35:06.727 INFO:tasks.workunit.client.0.smithi029.stdout:3/639: dread - d17/d2f/f9d zero size 2024-04-15T00:35:06.727 INFO:tasks.workunit.client.0.smithi029.stdout:0/650: stat d5/db/d7b 0 2024-04-15T00:35:06.871 INFO:tasks.workunit.client.0.smithi029.stdout:8/646: dread - d8/d4a/d78/d23/faa zero size 2024-04-15T00:35:06.921 INFO:tasks.workunit.client.0.smithi029.stdout:5/657: dread d2/f17 [0,4194304] 0 2024-04-15T00:35:07.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/651: fsync d5/d15/d1f/d32/f95 0 2024-04-15T00:35:07.079 INFO:tasks.workunit.client.0.smithi029.stdout:0/652: read - d5/d15/d57/d5e/fa9 zero size 2024-04-15T00:35:07.109 INFO:tasks.workunit.client.0.smithi029.stdout:3/640: dread - d17/d2f/d84/db1/fc3 zero size 2024-04-15T00:35:07.388 INFO:tasks.workunit.client.0.smithi029.stdout:1/614: link df/d32/d90/dc1/cc3 df/d29/d41/d69/d78/dd1/d59/cd5 0 2024-04-15T00:35:07.401 INFO:tasks.workunit.client.0.smithi029.stdout:4/623: getdents de/d54/d71/d8b/da7 0 2024-04-15T00:35:07.428 INFO:tasks.workunit.client.0.smithi029.stdout:1/615: chown df/d29/d41/d69/d78/dd1/l7e 0 1 2024-04-15T00:35:07.434 INFO:tasks.workunit.client.0.smithi029.stdout:1/616: stat df/d32/l5a 0 2024-04-15T00:35:07.806 INFO:tasks.workunit.client.0.smithi029.stdout:2/635: write d3/dd/fa7 [707229,65428] 0 2024-04-15T00:35:07.808 INFO:tasks.workunit.client.0.smithi029.stdout:7/641: write d0/d6/d39/d3c/d5b/f63 [1366329,38789] 0 2024-04-15T00:35:07.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/636: chown d3/d2a/c44 7 1 2024-04-15T00:35:07.848 INFO:tasks.workunit.client.0.smithi029.stdout:2/637: readlink d3/d2a/d46/l3e 0 2024-04-15T00:35:07.908 INFO:tasks.workunit.client.0.smithi029.stdout:0/653: rmdir d5/d4c 39 2024-04-15T00:35:08.055 INFO:tasks.workunit.client.0.smithi029.stdout:1/617: creat df/d29/d41/d96/fd6 x:0 0 0 2024-04-15T00:35:08.089 INFO:tasks.workunit.client.0.smithi029.stdout:9/621: dwrite d3/d6/d9/f22 [4194304,4194304] 0 2024-04-15T00:35:08.156 INFO:tasks.workunit.client.0.smithi029.stdout:3/641: rename d17/d2a/f2c to d17/d2f/d44/d58/d5c/fc9 0 2024-04-15T00:35:08.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/658: dwrite d2/de/fbd [0,4194304] 0 2024-04-15T00:35:08.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/638: sync 2024-04-15T00:35:08.247 INFO:tasks.workunit.client.0.smithi029.stdout:6/654: getdents d1/db9/dc3 0 2024-04-15T00:35:08.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/647: getdents d8/d4a/d78/d23/d28/d30/d39 0 2024-04-15T00:35:08.431 INFO:tasks.workunit.client.0.smithi029.stdout:4/624: write de/d6d/f9d [806723,21458] 0 2024-04-15T00:35:08.448 INFO:tasks.workunit.client.0.smithi029.stdout:4/625: chown de/d54/d71/f84 5339851 1 2024-04-15T00:35:08.501 INFO:tasks.workunit.client.0.smithi029.stdout:1/618: creat df/d29/d41/d69/d78/dd1/d59/fd7 x:0 0 0 2024-04-15T00:35:08.670 INFO:tasks.workunit.client.0.smithi029.stdout:0/654: dwrite d5/d15/d1f/d32/f61 [0,4194304] 0 2024-04-15T00:35:08.902 INFO:tasks.workunit.client.0.smithi029.stdout:1/619: rename df/d29/fbd to df/d29/fd8 0 2024-04-15T00:35:08.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/648: chown d8/da/d2f/d66/fcf 1034 1 2024-04-15T00:35:09.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/639: mkdir d3/d93/dbe/dca 0 2024-04-15T00:35:09.127 INFO:tasks.workunit.client.0.smithi029.stdout:0/655: rmdir d5/db/d1a/d50 39 2024-04-15T00:35:09.134 INFO:tasks.workunit.client.0.smithi029.stdout:7/642: getdents d0/d6/d4f/d5d/d65 0 2024-04-15T00:35:09.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/620: unlink df/d29/lc2 0 2024-04-15T00:35:09.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/659: write d2/de/d13/d22/d26/d36/d4d/d70/fdb [573037,100421] 0 2024-04-15T00:35:09.344 INFO:tasks.workunit.client.0.smithi029.stdout:9/622: write d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fae [776514,94328] 0 2024-04-15T00:35:09.368 INFO:tasks.workunit.client.0.smithi029.stdout:4/626: link de/d2b/d35/c57 de/d54/d71/db5/cc8 0 2024-04-15T00:35:09.435 INFO:tasks.workunit.client.0.smithi029.stdout:8/649: mkdir d8/d4a/d78/dc3/ddd 0 2024-04-15T00:35:09.522 INFO:tasks.workunit.client.0.smithi029.stdout:3/642: dwrite d17/d2a/f32 [0,4194304] 0 2024-04-15T00:35:09.995 INFO:tasks.workunit.client.0.smithi029.stdout:5/660: truncate d2/de/f10 2242824 0 2024-04-15T00:35:09.997 INFO:tasks.workunit.client.0.smithi029.stdout:4/627: fsync de/d54/d71/da3/f90 0 2024-04-15T00:35:10.075 INFO:tasks.workunit.client.0.smithi029.stdout:9/623: dread d3/d6/d9/d15/d7e/f95 [0,4194304] 0 2024-04-15T00:35:10.149 INFO:tasks.workunit.client.0.smithi029.stdout:6/655: rename d1/d1e/d22/f83 to d1/d1e/d56/d58/fcd 0 2024-04-15T00:35:10.150 INFO:tasks.workunit.client.0.smithi029.stdout:3/643: rmdir d17/d2a/d46 39 2024-04-15T00:35:10.169 INFO:tasks.workunit.client.0.smithi029.stdout:0/656: write d5/db/d8f/f98 [3669426,31071] 0 2024-04-15T00:35:10.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/643: write d0/f1f [1478698,71256] 0 2024-04-15T00:35:10.224 INFO:tasks.workunit.client.0.smithi029.stdout:0/657: dread d5/f7 [4194304,4194304] 0 2024-04-15T00:35:10.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/661: dread - d2/de/d13/d22/fd6 zero size 2024-04-15T00:35:10.536 INFO:tasks.workunit.client.0.smithi029.stdout:5/662: readlink d2/de/d13/d22/d3c/d41/d6d/l85 0 2024-04-15T00:35:10.653 INFO:tasks.workunit.client.0.smithi029.stdout:2/640: rename d3/dd/d2d/d61/d85/da2/cc7 to d3/dd/d2d/d61/d85/ccb 0 2024-04-15T00:35:10.666 INFO:tasks.workunit.client.0.smithi029.stdout:1/621: write df/d29/d41/d69/d78/dd1/d59/fb0 [295761,93308] 0 2024-04-15T00:35:10.788 INFO:tasks.workunit.client.0.smithi029.stdout:1/622: dwrite df/d29/d41/d69/d78/dd1/d59/fb0 [0,4194304] 0 2024-04-15T00:35:11.263 INFO:tasks.workunit.client.0.smithi029.stdout:3/644: symlink d17/d2f/d44/d58/d5c/lca 0 2024-04-15T00:35:11.357 INFO:tasks.workunit.client.0.smithi029.stdout:3/645: readlink d17/d2a/d4c/da1/lc5 0 2024-04-15T00:35:11.489 INFO:tasks.workunit.client.0.smithi029.stdout:9/624: dwrite d3/d88/fb9 [4194304,4194304] 0 2024-04-15T00:35:11.497 INFO:tasks.workunit.client.0.smithi029.stdout:4/628: dwrite f2 [4194304,4194304] 0 2024-04-15T00:35:11.716 INFO:tasks.workunit.client.0.smithi029.stdout:6/656: rmdir d1/d8/db/d38/d6f 39 2024-04-15T00:35:11.804 INFO:tasks.workunit.client.0.smithi029.stdout:8/650: rename d8/da/d3d/d8a/lb4 to d8/d4a/d78/d23/d28/d30/d39/lde 0 2024-04-15T00:35:11.805 INFO:tasks.workunit.client.0.smithi029.stdout:5/663: dread d2/de/d13/d22/d26/d36/d4d/d70/d9a/f5c [0,4194304] 0 2024-04-15T00:35:11.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/641: creat d3/d2a/d46/fcc x:0 0 0 2024-04-15T00:35:11.875 INFO:tasks.workunit.client.0.smithi029.stdout:2/642: dread - d3/d2a/d46/d95/f98 zero size 2024-04-15T00:35:12.253 INFO:tasks.workunit.client.0.smithi029.stdout:4/629: unlink de/d3a/l51 0 2024-04-15T00:35:12.254 INFO:tasks.workunit.client.0.smithi029.stdout:3/646: creat d17/d2f/d44/d5a/fcb x:0 0 0 2024-04-15T00:35:12.263 INFO:tasks.workunit.client.0.smithi029.stdout:9/625: dread - d3/d6/d9/d29/d60/d64/d6d/f89 zero size 2024-04-15T00:35:12.289 INFO:tasks.workunit.client.0.smithi029.stdout:4/630: chown de/d2b/d35/l85 1412 1 2024-04-15T00:35:12.335 INFO:tasks.workunit.client.0.smithi029.stdout:6/657: rename d1/d8/db/d38/fa8 to d1/d8/d79/dcb/fce 0 2024-04-15T00:35:12.378 INFO:tasks.workunit.client.0.smithi029.stdout:8/651: creat d8/d4a/d78/d23/d28/d30/d39/fdf x:0 0 0 2024-04-15T00:35:12.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/643: creat d3/d50/fcd x:0 0 0 2024-04-15T00:35:12.486 INFO:tasks.workunit.client.0.smithi029.stdout:2/644: write d3/dd/fa7 [549843,38245] 0 2024-04-15T00:35:12.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/631: symlink de/d54/d71/db5/lc9 0 2024-04-15T00:35:12.633 INFO:tasks.workunit.client.0.smithi029.stdout:9/626: truncate d3/d6/d9/d15/d7e/f95 2188111 0 2024-04-15T00:35:12.642 INFO:tasks.workunit.client.0.smithi029.stdout:9/627: chown d3/d6/d9/f75 0 1 2024-04-15T00:35:12.809 INFO:tasks.workunit.client.0.smithi029.stdout:8/652: dread d8/da/d2f/d6e/f6f [0,4194304] 0 2024-04-15T00:35:12.886 INFO:tasks.workunit.client.0.smithi029.stdout:4/632: readlink de/d3a/la8 0 2024-04-15T00:35:12.936 INFO:tasks.workunit.client.0.smithi029.stdout:5/664: dread d2/d1a/f1c [0,4194304] 0 2024-04-15T00:35:12.988 INFO:tasks.workunit.client.0.smithi029.stdout:0/658: write d5/d4c/d4e/f80 [1206914,91853] 0 2024-04-15T00:35:13.020 INFO:tasks.workunit.client.0.smithi029.stdout:1/623: getdents df/d29/d41 0 2024-04-15T00:35:13.090 INFO:tasks.workunit.client.0.smithi029.stdout:7/644: dwrite d0/d6/d4f/f5c [0,4194304] 0 2024-04-15T00:35:13.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/653: truncate d8/da/d2f/d6e/d5a/fc4 612424 0 2024-04-15T00:35:13.217 INFO:tasks.workunit.client.0.smithi029.stdout:5/665: fsync d2/de/d13/d22/d3c/d41/f4c 0 2024-04-15T00:35:13.230 INFO:tasks.workunit.client.0.smithi029.stdout:3/647: write d17/d2f/d3c/f74 [1714704,103060] 0 2024-04-15T00:35:13.425 INFO:tasks.workunit.client.0.smithi029.stdout:9/628: symlink d3/d6/lc6 0 2024-04-15T00:35:13.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/645: truncate d0/d6/f3b 484928 0 2024-04-15T00:35:13.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/645: rename d3/dd/fa7 to d3/d2a/fce 0 2024-04-15T00:35:13.618 INFO:tasks.workunit.client.0.smithi029.stdout:0/659: dread d5/d15/d27/f2d [0,4194304] 0 2024-04-15T00:35:13.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/666: mknod d2/de/d13/dd2/ce2 0 2024-04-15T00:35:13.980 INFO:tasks.workunit.client.0.smithi029.stdout:8/654: mkdir d8/da/d3d/de0 0 2024-04-15T00:35:13.995 INFO:tasks.workunit.client.0.smithi029.stdout:4/633: rename de/d3a/f4b to de/df/d1e/d56/fca 0 2024-04-15T00:35:14.008 INFO:tasks.workunit.client.0.smithi029.stdout:7/646: mkdir d0/d6/d4f/d66/d26/dd3 0 2024-04-15T00:35:14.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/646: dread - d3/d53/fc5 zero size 2024-04-15T00:35:14.028 INFO:tasks.workunit.client.0.smithi029.stdout:8/655: readlink d8/lbf 0 2024-04-15T00:35:14.165 INFO:tasks.workunit.client.0.smithi029.stdout:6/658: link d1/d8/db/l4f d1/d1e/d56/d58/lcf 0 2024-04-15T00:35:14.167 INFO:tasks.workunit.client.0.smithi029.stdout:1/624: rmdir df/d29/dd3 0 2024-04-15T00:35:14.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/648: mknod d17/d2f/d44/d68/ccc 0 2024-04-15T00:35:14.217 INFO:tasks.workunit.client.0.smithi029.stdout:6/659: chown d1/d8/db/f23 1584436 1 2024-04-15T00:35:14.234 INFO:tasks.workunit.client.0.smithi029.stdout:6/660: stat d1/d8/db/d98/cad 0 2024-04-15T00:35:14.334 INFO:tasks.workunit.client.0.smithi029.stdout:4/634: mknod de/df/d1e/ccb 0 2024-04-15T00:35:14.417 INFO:tasks.workunit.client.0.smithi029.stdout:9/629: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fc7 x:0 0 0 2024-04-15T00:35:14.417 INFO:tasks.workunit.client.0.smithi029.stdout:7/647: rename d0/d6/d4f/d66/d37/l68 to d0/d6/d4f/d5d/ld4 0 2024-04-15T00:35:14.424 INFO:tasks.workunit.client.0.smithi029.stdout:3/649: mkdir d17/d2f/d76/d7f/dcd 0 2024-04-15T00:35:14.469 INFO:tasks.workunit.client.0.smithi029.stdout:7/648: dread d0/d6/f2c [0,4194304] 0 2024-04-15T00:35:14.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/667: unlink d2/de/d13/d22/d26/d36/l97 0 2024-04-15T00:35:14.537 INFO:tasks.workunit.client.0.smithi029.stdout:1/625: mkdir df/d29/d41/d69/d78/dd1/d59/dd9 0 2024-04-15T00:35:14.565 INFO:tasks.workunit.client.0.smithi029.stdout:1/626: readlink df/d29/d41/d69/d78/dd1/d59/l5b 0 2024-04-15T00:35:14.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/668: readlink d2/de/d13/d22/d26/d36/d4d/lb2 0 2024-04-15T00:35:14.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/669: chown d2/de/d13/d22/d26/ca3 139 1 2024-04-15T00:35:14.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/661: chown d1/d8/db/l71 3928467 1 2024-04-15T00:35:14.613 INFO:tasks.workunit.client.0.smithi029.stdout:6/662: readlink d1/d8/db/d7b/d85/l8e 0 2024-04-15T00:35:14.649 INFO:tasks.workunit.client.0.smithi029.stdout:4/635: fsync de/d2b/f62 0 2024-04-15T00:35:14.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/647: truncate d3/d13/f97 215113 0 2024-04-15T00:35:14.940 INFO:tasks.workunit.client.0.smithi029.stdout:9/630: fdatasync d3/d6/d9/f22 0 2024-04-15T00:35:14.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/649: readlink d0/l9b 0 2024-04-15T00:35:14.993 INFO:tasks.workunit.client.0.smithi029.stdout:3/650: dread d17/d2a/f36 [0,4194304] 0 2024-04-15T00:35:15.273 INFO:tasks.workunit.client.0.smithi029.stdout:1/627: read df/d29/d41/d4f/fa0 [1917782,40503] 0 2024-04-15T00:35:15.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/670: read d2/f34 [587760,4616] 0 2024-04-15T00:35:15.544 INFO:tasks.workunit.client.0.smithi029.stdout:4/636: dread - de/d54/d58/fbd zero size 2024-04-15T00:35:15.559 INFO:tasks.workunit.client.0.smithi029.stdout:2/648: dread - d3/d50/fc4 zero size 2024-04-15T00:35:15.591 INFO:tasks.workunit.client.0.smithi029.stdout:8/656: link d8/c1f d8/d4a/d78/dc3/ddd/ce1 0 2024-04-15T00:35:15.593 INFO:tasks.workunit.client.0.smithi029.stdout:3/651: rmdir d17 39 2024-04-15T00:35:15.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/660: write d5/d15/d27/d51/d7d/faa [477931,122791] 0 2024-04-15T00:35:15.605 INFO:tasks.workunit.client.0.smithi029.stdout:9/631: truncate d3/da3/fb7 937561 0 2024-04-15T00:35:15.920 INFO:tasks.workunit.client.0.smithi029.stdout:1/628: dread - df/f9e zero size 2024-04-15T00:35:15.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/663: truncate d1/d8/db/d38/f8a 1114881 0 2024-04-15T00:35:16.204 INFO:tasks.workunit.client.0.smithi029.stdout:2/649: rename d3/d13/d43/d5a/d4f/db4 to d3/d2a/d46/dcf 0 2024-04-15T00:35:16.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/637: creat de/d2b/d35/fcc x:0 0 0 2024-04-15T00:35:16.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/661: chown d5/d15/d27/d9f/la3 124961137 1 2024-04-15T00:35:16.594 INFO:tasks.workunit.client.0.smithi029.stdout:8/657: fdatasync d8/da/d2f/d6e/f9e 0 2024-04-15T00:35:16.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/671: fdatasync d2/de/d13/d22/d26/d36/d4d/f51 0 2024-04-15T00:35:16.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/672: dread d2/de/d13/d22/f5e [0,4194304] 0 2024-04-15T00:35:16.699 INFO:tasks.workunit.client.0.smithi029.stdout:2/650: read d3/d13/f83 [372754,110694] 0 2024-04-15T00:35:16.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/662: fsync d5/d15/d1f/d32/f95 0 2024-04-15T00:35:17.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/673: creat d2/de/d1f/dc2/fe3 x:0 0 0 2024-04-15T00:35:17.276 INFO:tasks.workunit.client.0.smithi029.stdout:9/632: creat d3/d6/fc8 x:0 0 0 2024-04-15T00:35:17.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/633: chown d3/d6/d9/d15/d9d/lc0 28954792 1 2024-04-15T00:35:17.374 INFO:tasks.workunit.client.0.smithi029.stdout:7/650: dwrite d0/d6/d4f/d66/d26/f2b [0,4194304] 0 2024-04-15T00:35:17.713 INFO:tasks.workunit.client.0.smithi029.stdout:7/651: mknod d0/d6/d4f/cd5 0 2024-04-15T00:35:17.720 INFO:tasks.workunit.client.0.smithi029.stdout:1/629: write df/f28 [2110903,36270] 0 2024-04-15T00:35:17.826 INFO:tasks.workunit.client.0.smithi029.stdout:6/664: write d1/d1e/d56/d58/d5f/f73 [1108625,103656] 0 2024-04-15T00:35:17.921 INFO:tasks.workunit.client.0.smithi029.stdout:0/663: mkdir d5/d15/d1f/dd3 0 2024-04-15T00:35:18.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/652: dwrite d17/d2f/d44/f66 [0,4194304] 0 2024-04-15T00:35:18.153 INFO:tasks.workunit.client.0.smithi029.stdout:7/652: unlink d0/d6/d39/d3c/fc5 0 2024-04-15T00:35:18.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/653: chown d17/d2f/d44/d5a/faa 28856192 1 2024-04-15T00:35:18.390 INFO:tasks.workunit.client.0.smithi029.stdout:4/638: mkdir de/d2b/dcd 0 2024-04-15T00:35:18.520 INFO:tasks.workunit.client.0.smithi029.stdout:0/664: mknod d5/db/db0/cd4 0 2024-04-15T00:35:18.545 INFO:tasks.workunit.client.0.smithi029.stdout:3/654: fdatasync d17/d2f/d76/f7a 0 2024-04-15T00:35:18.551 INFO:tasks.workunit.client.0.smithi029.stdout:9/634: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [360207,30848] 0 2024-04-15T00:35:18.591 INFO:tasks.workunit.client.0.smithi029.stdout:7/653: truncate d0/d6/d39/d3c/d5b/d7e/fc9 315750 0 2024-04-15T00:35:18.742 INFO:tasks.workunit.client.0.smithi029.stdout:8/658: dwrite d8/da/d2f/d6e/f47 [4194304,4194304] 0 2024-04-15T00:35:18.777 INFO:tasks.workunit.client.0.smithi029.stdout:2/651: dwrite d3/d13/f83 [0,4194304] 0 2024-04-15T00:35:18.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/639: unlink de/df/d1e/l31 0 2024-04-15T00:35:18.930 INFO:tasks.workunit.client.0.smithi029.stdout:5/674: dwrite d2/de/fde [4194304,4194304] 0 2024-04-15T00:35:18.933 INFO:tasks.workunit.client.0.smithi029.stdout:4/640: chown de/d54 704 1 2024-04-15T00:35:18.945 INFO:tasks.workunit.client.0.smithi029.stdout:1/630: write df/fa7 [1740623,20811] 0 2024-04-15T00:35:19.172 INFO:tasks.workunit.client.0.smithi029.stdout:2/652: mknod d3/d2a/d6d/cd0 0 2024-04-15T00:35:19.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/675: readlink d2/de/d13/d22/l67 0 2024-04-15T00:35:19.246 INFO:tasks.workunit.client.0.smithi029.stdout:3/655: dread d17/f1b [0,4194304] 0 2024-04-15T00:35:19.271 INFO:tasks.workunit.client.0.smithi029.stdout:2/653: dread - d3/d50/fc4 zero size 2024-04-15T00:35:19.281 INFO:tasks.workunit.client.0.smithi029.stdout:6/665: dwrite d1/d8/f3d [0,4194304] 0 2024-04-15T00:35:19.359 INFO:tasks.workunit.client.0.smithi029.stdout:9/635: mknod d3/d6/d9/d29/d60/d64/d6d/d58/d6a/cc9 0 2024-04-15T00:35:19.383 INFO:tasks.workunit.client.0.smithi029.stdout:1/631: dread - df/d29/f79 zero size 2024-04-15T00:35:19.414 INFO:tasks.workunit.client.0.smithi029.stdout:6/666: chown d1/d8/d72/fb3 0 1 2024-04-15T00:35:19.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/665: rename d5/db/f19 to d5/d4c/fd5 0 2024-04-15T00:35:19.491 INFO:tasks.workunit.client.0.smithi029.stdout:7/654: write d0/d6/d4f/d66/d26/d77/fc6 [368709,41672] 0 2024-04-15T00:35:19.569 INFO:tasks.workunit.client.0.smithi029.stdout:3/656: fsync d17/d83/f7d 0 2024-04-15T00:35:19.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/666: chown d5/db/d8f/fc5 12 1 2024-04-15T00:35:19.641 INFO:tasks.workunit.client.0.smithi029.stdout:8/659: dwrite d8/da/d2f/d6e/d5a/fdb [0,4194304] 0 2024-04-15T00:35:19.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/676: truncate d2/d1a/f1c 168025 0 2024-04-15T00:35:19.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/654: mkdir d3/dd/d42/dd1 0 2024-04-15T00:35:19.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/667: unlink d1/d8/f53 0 2024-04-15T00:35:19.745 INFO:tasks.workunit.client.0.smithi029.stdout:9/636: creat d3/d6/d9/d29/d60/d64/d6d/d58/fca x:0 0 0 2024-04-15T00:35:19.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/655: readlink d0/d6/d39/d3c/l41 0 2024-04-15T00:35:19.874 INFO:tasks.workunit.client.0.smithi029.stdout:6/668: dread d1/d1e/f32 [0,4194304] 0 2024-04-15T00:35:19.894 INFO:tasks.workunit.client.0.smithi029.stdout:7/656: chown d0/d6/d4f/d5d/d65/dbc 418 1 2024-04-15T00:35:19.994 INFO:tasks.workunit.client.0.smithi029.stdout:1/632: symlink df/d29/d41/d69/lda 0 2024-04-15T00:35:20.001 INFO:tasks.workunit.client.0.smithi029.stdout:4/641: rename de/df/f7b to de/d2b/d59/fce 0 2024-04-15T00:35:20.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/637: truncate d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb3 249729 0 2024-04-15T00:35:20.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/655: creat d3/dd/d42/dc6/db1/fd2 x:0 0 0 2024-04-15T00:35:20.648 INFO:tasks.workunit.client.0.smithi029.stdout:3/657: rename d17/d2a/d33/d37/la5 to d17/d2f/d76/d7f/dcd/lce 0 2024-04-15T00:35:20.656 INFO:tasks.workunit.client.0.smithi029.stdout:0/667: write d5/d4c/fc0 [890090,121997] 0 2024-04-15T00:35:20.675 INFO:tasks.workunit.client.0.smithi029.stdout:1/633: creat df/d29/d41/d69/d78/fdb x:0 0 0 2024-04-15T00:35:20.806 INFO:tasks.workunit.client.0.smithi029.stdout:2/656: mknod d3/d2a/d4e/db9/cd3 0 2024-04-15T00:35:20.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/660: rename d8/d4a/d78/d23/d28/d30/d39/d77/d82 to d8/da/d2f/de2 0 2024-04-15T00:35:20.966 INFO:tasks.workunit.client.0.smithi029.stdout:0/668: fsync d5/f13 0 2024-04-15T00:35:20.974 INFO:tasks.workunit.client.0.smithi029.stdout:8/661: readlink d8/laf 0 2024-04-15T00:35:21.001 INFO:tasks.workunit.client.0.smithi029.stdout:8/662: chown d8/d4a/d78/d23/c99 22 1 2024-04-15T00:35:21.242 INFO:tasks.workunit.client.0.smithi029.stdout:3/658: dread d17/d2f/d3c/f4a [4194304,4194304] 0 2024-04-15T00:35:21.637 INFO:tasks.workunit.client.0.smithi029.stdout:9/638: write d3/d6/d9/f50 [785119,105028] 0 2024-04-15T00:35:21.649 INFO:tasks.workunit.client.0.smithi029.stdout:9/639: chown d3/d88 11660572 1 2024-04-15T00:35:21.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/642: rmdir de/d6d/d7e/d9b 0 2024-04-15T00:35:21.772 INFO:tasks.workunit.client.0.smithi029.stdout:9/640: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/fca [0,4194304] 0 2024-04-15T00:35:21.864 INFO:tasks.workunit.client.0.smithi029.stdout:5/677: rename d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/ca7 to d2/de/d1f/d63/d65/ce4 0 2024-04-15T00:35:21.868 INFO:tasks.workunit.client.0.smithi029.stdout:0/669: truncate d5/d4c/d4e/fc8 604771 0 2024-04-15T00:35:21.890 INFO:tasks.workunit.client.0.smithi029.stdout:0/670: chown d5/d15/d57 521 1 2024-04-15T00:35:21.904 INFO:tasks.workunit.client.0.smithi029.stdout:8/663: truncate d8/da/d2f/d42/f7b 1898669 0 2024-04-15T00:35:22.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/634: write df/d29/d41/fc6 [1060117,41073] 0 2024-04-15T00:35:22.210 INFO:tasks.workunit.client.0.smithi029.stdout:7/657: mknod d0/cd6 0 2024-04-15T00:35:22.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/669: rename d1/f31 to d1/d8/db/d7b/d91/fd0 0 2024-04-15T00:35:22.336 INFO:tasks.workunit.client.0.smithi029.stdout:5/678: dread - d2/d1a/d2d/f6e zero size 2024-04-15T00:35:22.500 INFO:tasks.workunit.client.0.smithi029.stdout:2/657: creat d3/d13/fd4 x:0 0 0 2024-04-15T00:35:22.531 INFO:tasks.workunit.client.0.smithi029.stdout:1/635: truncate df/f1c 1497234 0 2024-04-15T00:35:22.555 INFO:tasks.workunit.client.0.smithi029.stdout:9/641: symlink d3/d6/d9/d29/lcb 0 2024-04-15T00:35:22.633 INFO:tasks.workunit.client.0.smithi029.stdout:7/658: fdatasync d0/d6/d4f/d66/d26/d77/d89/fa1 0 2024-04-15T00:35:22.686 INFO:tasks.workunit.client.0.smithi029.stdout:8/664: dread d8/da/d2f/d42/f54 [0,4194304] 0 2024-04-15T00:35:22.790 INFO:tasks.workunit.client.0.smithi029.stdout:0/671: creat d5/dc6/fd6 x:0 0 0 2024-04-15T00:35:22.798 INFO:tasks.workunit.client.0.smithi029.stdout:3/659: creat d17/d2f/d44/fcf x:0 0 0 2024-04-15T00:35:22.869 INFO:tasks.workunit.client.0.smithi029.stdout:5/679: sync 2024-04-15T00:35:23.004 INFO:tasks.workunit.client.0.smithi029.stdout:1/636: mknod df/d29/d41/d69/d78/cdc 0 2024-04-15T00:35:23.203 INFO:tasks.workunit.client.0.smithi029.stdout:2/658: truncate d3/d2a/d46/d95/f6a 3175580 0 2024-04-15T00:35:23.392 INFO:tasks.workunit.client.0.smithi029.stdout:0/672: mknod d5/d15/d57/cd7 0 2024-04-15T00:35:23.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/642: truncate d3/d6/f9c 3492696 0 2024-04-15T00:35:23.424 INFO:tasks.workunit.client.0.smithi029.stdout:0/673: chown d5/d15/d57/f60 967 1 2024-04-15T00:35:23.506 INFO:tasks.workunit.client.0.smithi029.stdout:7/659: fsync d0/f8f 0 2024-04-15T00:35:23.548 INFO:tasks.workunit.client.0.smithi029.stdout:7/660: chown d0/d6/d4f/dbb 30817573 1 2024-04-15T00:35:23.621 INFO:tasks.workunit.client.0.smithi029.stdout:4/643: dwrite de/d2b/d59/fb8 [0,4194304] 0 2024-04-15T00:35:23.718 INFO:tasks.workunit.client.0.smithi029.stdout:0/674: rename d5/db/f29 to d5/db/d1a/d65/d76/daf/fd8 0 2024-04-15T00:35:24.103 INFO:tasks.workunit.client.0.smithi029.stdout:7/661: creat d0/d6/d4f/dbb/d49/fd7 x:0 0 0 2024-04-15T00:35:24.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/643: creat d3/d6/d30/fcc x:0 0 0 2024-04-15T00:35:24.138 INFO:tasks.workunit.client.0.smithi029.stdout:6/670: dwrite d1/d8/db/d7b/d85/f8f [0,4194304] 0 2024-04-15T00:35:24.291 INFO:tasks.workunit.client.0.smithi029.stdout:7/662: dread - d0/d6/d4f/d5d/d87/fce zero size 2024-04-15T00:35:24.431 INFO:tasks.workunit.client.0.smithi029.stdout:7/663: mknod d0/d6/d39/d3c/d5b/d7e/cd8 0 2024-04-15T00:35:24.561 INFO:tasks.workunit.client.0.smithi029.stdout:0/675: link d5/d15/d27/d9f/la3 d5/db/d1a/d65/ld9 0 2024-04-15T00:35:24.739 INFO:tasks.workunit.client.0.smithi029.stdout:7/664: mkdir d0/d6/d39/d3c/d5b/dd9 0 2024-04-15T00:35:24.756 INFO:tasks.workunit.client.0.smithi029.stdout:3/660: write d17/d2a/d33/f60 [269746,23173] 0 2024-04-15T00:35:24.797 INFO:tasks.workunit.client.0.smithi029.stdout:1/637: write df/d29/d41/d69/d78/f74 [3012822,19703] 0 2024-04-15T00:35:24.800 INFO:tasks.workunit.client.0.smithi029.stdout:2/659: write d3/dd/da0/fac [207802,79856] 0 2024-04-15T00:35:24.844 INFO:tasks.workunit.client.0.smithi029.stdout:0/676: mknod d5/d15/d27/d51/d77/cda 0 2024-04-15T00:35:24.977 INFO:tasks.workunit.client.0.smithi029.stdout:8/665: dwrite d8/d4a/d78/d23/f59 [0,4194304] 0 2024-04-15T00:35:25.064 INFO:tasks.workunit.client.0.smithi029.stdout:5/680: dwrite d2/de/d1f/f6a [0,4194304] 0 2024-04-15T00:35:25.153 INFO:tasks.workunit.client.0.smithi029.stdout:4/644: write de/d2b/d35/f49 [3231781,81173] 0 2024-04-15T00:35:25.237 INFO:tasks.workunit.client.0.smithi029.stdout:0/677: dwrite d5/d4c/fc0 [0,4194304] 0 2024-04-15T00:35:25.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/671: rename d1/d8/db/d38/f39 to d1/d8/db/fd1 0 2024-04-15T00:35:25.607 INFO:tasks.workunit.client.0.smithi029.stdout:3/661: fdatasync d17/d2f/d76/d7f/fa7 0 2024-04-15T00:35:25.827 INFO:tasks.workunit.client.0.smithi029.stdout:8/666: dread d8/d4a/d78/d23/fb2 [0,4194304] 0 2024-04-15T00:35:25.876 INFO:tasks.workunit.client.0.smithi029.stdout:4/645: creat de/d54/d71/db5/fcf x:0 0 0 2024-04-15T00:35:25.952 INFO:tasks.workunit.client.0.smithi029.stdout:5/681: dread d2/de/d13/d22/d26/d36/f53 [0,4194304] 0 2024-04-15T00:35:25.986 INFO:tasks.workunit.client.0.smithi029.stdout:0/678: fsync d5/db/d1a/d65/d87/fac 0 2024-04-15T00:35:26.061 INFO:tasks.workunit.client.0.smithi029.stdout:4/646: sync 2024-04-15T00:35:26.133 INFO:tasks.workunit.client.0.smithi029.stdout:9/644: rename d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fae to d3/d6/d9/d29/d60/d64/d6d/d58/d6a/fcd 0 2024-04-15T00:35:26.303 INFO:tasks.workunit.client.0.smithi029.stdout:3/662: fsync d17/d2f/d44/d58/fbc 0 2024-04-15T00:35:26.638 INFO:tasks.workunit.client.0.smithi029.stdout:8/667: creat d8/da/d3d/d8a/fe3 x:0 0 0 2024-04-15T00:35:26.714 INFO:tasks.workunit.client.0.smithi029.stdout:5/682: creat d2/de/d13/d22/d26/d36/d4d/d78/fe5 x:0 0 0 2024-04-15T00:35:26.791 INFO:tasks.workunit.client.0.smithi029.stdout:0/679: fdatasync d5/d15/d1f/f3a 0 2024-04-15T00:35:26.979 INFO:tasks.workunit.client.0.smithi029.stdout:2/660: rename d3/d2a/d46 to d3/dd/d2d/d61/dd5 0 2024-04-15T00:35:27.085 INFO:tasks.workunit.client.0.smithi029.stdout:3/663: creat d17/d2f/d84/fd0 x:0 0 0 2024-04-15T00:35:27.128 INFO:tasks.workunit.client.0.smithi029.stdout:8/668: truncate d8/da/d3d/fb6 595712 0 2024-04-15T00:35:27.208 INFO:tasks.workunit.client.0.smithi029.stdout:1/638: write df/d32/db2/fca [500168,112499] 0 2024-04-15T00:35:27.233 INFO:tasks.workunit.client.0.smithi029.stdout:1/639: truncate df/d32/db2/fca 977536 0 2024-04-15T00:35:27.242 INFO:tasks.workunit.client.0.smithi029.stdout:0/680: mkdir d5/d15/d27/d9f/ddb 0 2024-04-15T00:35:27.255 INFO:tasks.workunit.client.0.smithi029.stdout:0/681: readlink d5/d15/d27/d51/d7d/la4 0 2024-04-15T00:35:27.333 INFO:tasks.workunit.client.0.smithi029.stdout:2/661: rename d3/d13/d43/d5a/cc0 to d3/dd/d2d/d61/dd5/d95/cd6 0 2024-04-15T00:35:27.345 INFO:tasks.workunit.client.0.smithi029.stdout:7/665: dwrite d0/d6/d4f/d5d/d65/dbc/f92 [0,4194304] 0 2024-04-15T00:35:27.421 INFO:tasks.workunit.client.0.smithi029.stdout:3/664: stat d17/d2a/c3e 0 2024-04-15T00:35:27.445 INFO:tasks.workunit.client.0.smithi029.stdout:2/662: sync 2024-04-15T00:35:27.459 INFO:tasks.workunit.client.0.smithi029.stdout:2/663: read d3/d2a/fce [464254,54668] 0 2024-04-15T00:35:27.495 INFO:tasks.workunit.client.0.smithi029.stdout:8/669: fsync d8/f7c 0 2024-04-15T00:35:27.496 INFO:tasks.workunit.client.0.smithi029.stdout:5/683: mkdir d2/de/d13/d22/de6 0 2024-04-15T00:35:27.523 INFO:tasks.workunit.client.0.smithi029.stdout:1/640: fdatasync df/f22 0 2024-04-15T00:35:27.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/682: creat d5/db/d1a/d65/d76/daf/fdc x:0 0 0 2024-04-15T00:35:27.768 INFO:tasks.workunit.client.0.smithi029.stdout:3/665: truncate d17/d2a/d33/fab 4601991 0 2024-04-15T00:35:27.772 INFO:tasks.workunit.client.0.smithi029.stdout:2/664: truncate d3/d13/d43/d5a/d4f/fad 291003 0 2024-04-15T00:35:27.790 INFO:tasks.workunit.client.0.smithi029.stdout:2/665: readlink d3/d13/d43/la4 0 2024-04-15T00:35:27.797 INFO:tasks.workunit.client.0.smithi029.stdout:6/672: write d1/d8/d72/fb3 [456470,69945] 0 2024-04-15T00:35:27.837 INFO:tasks.workunit.client.0.smithi029.stdout:6/673: chown d1/d1e/d56/cae 929052736 1 2024-04-15T00:35:27.953 INFO:tasks.workunit.client.0.smithi029.stdout:5/684: truncate d2/de/f2e 1021895 0 2024-04-15T00:35:27.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/670: dread d8/da/f88 [0,4194304] 0 2024-04-15T00:35:28.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/641: dread df/f1c [0,4194304] 0 2024-04-15T00:35:28.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/642: readlink df/d29/d41/d69/lda 0 2024-04-15T00:35:28.171 INFO:tasks.workunit.client.0.smithi029.stdout:2/666: rmdir d3/dd/d2d/d61 39 2024-04-15T00:35:28.290 INFO:tasks.workunit.client.0.smithi029.stdout:0/683: symlink d5/db/d1a/d50/ldd 0 2024-04-15T00:35:28.354 INFO:tasks.workunit.client.0.smithi029.stdout:1/643: mknod df/d32/d7c/cdd 0 2024-04-15T00:35:28.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/667: symlink d3/d50/d51/d65/ld7 0 2024-04-15T00:35:28.482 INFO:tasks.workunit.client.0.smithi029.stdout:0/684: symlink d5/db/d7b/lde 0 2024-04-15T00:35:28.555 INFO:tasks.workunit.client.0.smithi029.stdout:3/666: rename d17/d2a/d4c/l6b to d17/d2f/d44/ld1 0 2024-04-15T00:35:28.580 INFO:tasks.workunit.client.0.smithi029.stdout:2/668: dread d3/d13/d43/d5a/f4b [0,4194304] 0 2024-04-15T00:35:28.789 INFO:tasks.workunit.client.0.smithi029.stdout:9/645: write d3/f4e [9077509,20577] 0 2024-04-15T00:35:28.791 INFO:tasks.workunit.client.0.smithi029.stdout:4/647: write de/f5d [4044303,91966] 0 2024-04-15T00:35:28.794 INFO:tasks.workunit.client.0.smithi029.stdout:1/644: creat df/d29/d41/d4f/fde x:0 0 0 2024-04-15T00:35:28.891 INFO:tasks.workunit.client.0.smithi029.stdout:6/674: rename d1/d1e/d56/d58/d5f to d1/d8/db/d7b/d85/dd2 0 2024-04-15T00:35:29.137 INFO:tasks.workunit.client.0.smithi029.stdout:3/667: fsync d17/d2f/f9d 0 2024-04-15T00:35:29.349 INFO:tasks.workunit.client.0.smithi029.stdout:7/666: dwrite d0/d6/d1c/fc [0,4194304] 0 2024-04-15T00:35:29.439 INFO:tasks.workunit.client.0.smithi029.stdout:4/648: creat de/d54/d71/d8b/da7/fd0 x:0 0 0 2024-04-15T00:35:29.453 INFO:tasks.workunit.client.0.smithi029.stdout:2/669: dread d3/dd/d2d/f37 [0,4194304] 0 2024-04-15T00:35:29.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/646: truncate d3/d6/d9/f22 6312737 0 2024-04-15T00:35:29.617 INFO:tasks.workunit.client.0.smithi029.stdout:8/671: dwrite d8/f38 [0,4194304] 0 2024-04-15T00:35:29.705 INFO:tasks.workunit.client.0.smithi029.stdout:0/685: write d5/d15/d1f/d32/f93 [923799,36739] 0 2024-04-15T00:35:29.755 INFO:tasks.workunit.client.0.smithi029.stdout:5/685: dwrite d2/de/d1f/fa1 [0,4194304] 0 2024-04-15T00:35:29.860 INFO:tasks.workunit.client.0.smithi029.stdout:6/675: mkdir d1/d1e/d56/dd3 0 2024-04-15T00:35:29.886 INFO:tasks.workunit.client.0.smithi029.stdout:2/670: write d3/d2a/fce [106579,130612] 0 2024-04-15T00:35:30.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:35:30.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:35:30.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/645: link df/f21 df/d29/d41/daf/fdf 0 2024-04-15T00:35:30.046 INFO:tasks.workunit.client.0.smithi029.stdout:7/667: rename d0/d6/d1c to d0/d6/d4f/d66/d37/db7/dda 0 2024-04-15T00:35:30.058 INFO:tasks.workunit.client.0.smithi029.stdout:1/646: readlink df/l7b 0 2024-04-15T00:35:30.076 INFO:tasks.workunit.client.0.smithi029.stdout:1/647: chown df/d29/d41/d69/d78/c7d 13203 1 2024-04-15T00:35:30.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/686: mknod d2/de/d13/daa/dc3/ce7 0 2024-04-15T00:35:30.712 INFO:tasks.workunit.client.0.smithi029.stdout:6/676: chown d1/d8/db/d38/d6f 34090107 1 2024-04-15T00:35:30.770 INFO:tasks.workunit.client.0.smithi029.stdout:0/686: truncate d5/db/d1a/d50/fd2 532080 0 2024-04-15T00:35:30.772 INFO:tasks.workunit.client.0.smithi029.stdout:4/649: write de/d2b/d59/f76 [253119,39640] 0 2024-04-15T00:35:30.794 INFO:tasks.workunit.client.0.smithi029.stdout:9/647: mknod d3/d6/d9/d29/d60/d64/da8/cce 0 2024-04-15T00:35:30.822 INFO:tasks.workunit.client.0.smithi029.stdout:9/648: chown d3/d6/d9/d15/d7e 696 1 2024-04-15T00:35:30.835 INFO:tasks.workunit.client.0.smithi029.stdout:9/649: chown d3/d6/d30 2607 1 2024-04-15T00:35:30.973 INFO:tasks.workunit.client.0.smithi029.stdout:7/668: dread d0/d6/d4f/f5c [0,4194304] 0 2024-04-15T00:35:31.264 INFO:tasks.workunit.client.0.smithi029.stdout:5/687: rename d2/de/d13/daa/fcf to d2/de/d13/d22/d26/d36/d4d/d70/d8d/fe8 0 2024-04-15T00:35:31.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/650: creat de/d54/d58/fd1 x:0 0 0 2024-04-15T00:35:31.311 INFO:tasks.workunit.client.0.smithi029.stdout:4/651: chown de/d54/d58/l79 42 1 2024-04-15T00:35:31.364 INFO:tasks.workunit.client.0.smithi029.stdout:2/671: truncate d3/dd/d2d/d61/dd5/d95/f98 318619 0 2024-04-15T00:35:31.794 INFO:tasks.workunit.client.0.smithi029.stdout:8/672: dwrite d8/d4a/d78/d23/faa [0,4194304] 0 2024-04-15T00:35:31.897 INFO:tasks.workunit.client.0.smithi029.stdout:4/652: truncate de/d6d/fb9 1323208 0 2024-04-15T00:35:31.971 INFO:tasks.workunit.client.0.smithi029.stdout:3/668: getdents d17/d2a/d46 0 2024-04-15T00:35:31.975 INFO:tasks.workunit.client.0.smithi029.stdout:3/669: stat f0 0 2024-04-15T00:35:32.684 INFO:tasks.workunit.client.0.smithi029.stdout:8/673: mkdir d8/d4a/d78/de4 0 2024-04-15T00:35:32.688 INFO:tasks.workunit.client.0.smithi029.stdout:8/674: stat d8/da8 0 2024-04-15T00:35:32.762 INFO:tasks.workunit.client.0.smithi029.stdout:4/653: fdatasync de/d2b/d35/f73 0 2024-04-15T00:35:32.826 INFO:tasks.workunit.client.0.smithi029.stdout:1/648: link df/d29/d41/d69/d4c/d7a/ccb df/d29/d41/d69/d78/dd1/d80/d94/ce0 0 2024-04-15T00:35:32.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/677: getdents d1/d1e/d56/d58 0 2024-04-15T00:35:32.918 INFO:tasks.workunit.client.0.smithi029.stdout:2/672: link d3/dd/d2d/d61/f9f d3/dd/d2d/d61/dd5/d95/fd8 0 2024-04-15T00:35:32.930 INFO:tasks.workunit.client.0.smithi029.stdout:4/654: dwrite de/d2b/d59/f76 [0,4194304] 0 2024-04-15T00:35:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:8/675: fsync d8/da/d2f/d42/f8c 0 2024-04-15T00:35:33.021 INFO:tasks.workunit.client.0.smithi029.stdout:9/650: write d3/d6/d9/f75 [3770511,97705] 0 2024-04-15T00:35:33.024 INFO:tasks.workunit.client.0.smithi029.stdout:7/669: write d0/d6/d4f/d5d/f5e [1741650,57266] 0 2024-04-15T00:35:33.110 INFO:tasks.workunit.client.0.smithi029.stdout:0/687: write d5/db/f45 [1268844,74729] 0 2024-04-15T00:35:33.350 INFO:tasks.workunit.client.0.smithi029.stdout:1/649: creat df/d29/d41/d69/d4c/d7a/fe1 x:0 0 0 2024-04-15T00:35:33.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/670: link d17/f1d d17/d2f/d76/d7f/dcd/fd2 0 2024-04-15T00:35:33.451 INFO:tasks.workunit.client.0.smithi029.stdout:2/673: dread - d3/d13/fd4 zero size 2024-04-15T00:35:33.471 INFO:tasks.workunit.client.0.smithi029.stdout:7/670: mknod d0/d6/da2/cdb 0 2024-04-15T00:35:33.526 INFO:tasks.workunit.client.0.smithi029.stdout:4/655: dread de/d54/d58/f68 [0,4194304] 0 2024-04-15T00:35:33.590 INFO:tasks.workunit.client.0.smithi029.stdout:9/651: dread d3/d6/d9/d15/d7e/f95 [0,4194304] 0 2024-04-15T00:35:33.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/678: fdatasync d1/d8/db/d38/f8a 0 2024-04-15T00:35:33.733 INFO:tasks.workunit.client.0.smithi029.stdout:2/674: creat d3/dd/fd9 x:0 0 0 2024-04-15T00:35:33.799 INFO:tasks.workunit.client.0.smithi029.stdout:3/671: dread d17/d2a/d4c/f70 [0,4194304] 0 2024-04-15T00:35:33.806 INFO:tasks.workunit.client.0.smithi029.stdout:3/672: stat d17/d2a/f4e 0 2024-04-15T00:35:33.939 INFO:tasks.workunit.client.0.smithi029.stdout:5/688: dwrite d2/de/d13/d22/d3c/d41/d6d/f77 [0,4194304] 0 2024-04-15T00:35:34.040 INFO:tasks.workunit.client.0.smithi029.stdout:5/689: chown d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fd4 2 1 2024-04-15T00:35:34.114 INFO:tasks.workunit.client.0.smithi029.stdout:2/675: symlink d3/d93/lda 0 2024-04-15T00:35:34.163 INFO:tasks.workunit.client.0.smithi029.stdout:3/673: mkdir d17/d2a/d4c/dd3 0 2024-04-15T00:35:34.223 INFO:tasks.workunit.client.0.smithi029.stdout:0/688: creat d5/fdf x:0 0 0 2024-04-15T00:35:34.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/690: creat d2/de/d1f/dc2/fe9 x:0 0 0 2024-04-15T00:35:34.616 INFO:tasks.workunit.client.0.smithi029.stdout:4/656: creat de/fd2 x:0 0 0 2024-04-15T00:35:34.640 INFO:tasks.workunit.client.0.smithi029.stdout:2/676: symlink d3/d53/ldb 0 2024-04-15T00:35:34.832 INFO:tasks.workunit.client.0.smithi029.stdout:0/689: dread d5/d3e/f69 [0,4194304] 0 2024-04-15T00:35:34.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/691: unlink d2/d1a/d2d/f6e 0 2024-04-15T00:35:34.852 INFO:tasks.workunit.client.0.smithi029.stdout:1/650: write df/f22 [2281240,112356] 0 2024-04-15T00:35:34.935 INFO:tasks.workunit.client.0.smithi029.stdout:4/657: rename de/d2b/dcd to de/df/d1e/d56/dd3 0 2024-04-15T00:35:34.949 INFO:tasks.workunit.client.0.smithi029.stdout:2/677: fdatasync d3/dd/d2d/d61/dd5/f74 0 2024-04-15T00:35:34.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/676: truncate d8/d4a/d78/d23/faa 1875683 0 2024-04-15T00:35:35.162 INFO:tasks.workunit.client.0.smithi029.stdout:7/671: truncate d0/d6/d4f/d5d/f5e 855133 0 2024-04-15T00:35:35.164 INFO:tasks.workunit.client.0.smithi029.stdout:9/652: write d3/d6/d9/d29/d60/d7f/da0/d9a/f73 [1029293,87221] 0 2024-04-15T00:35:35.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/679: dwrite d1/d1e/d56/d58/fcd [0,4194304] 0 2024-04-15T00:35:35.339 INFO:tasks.workunit.client.0.smithi029.stdout:5/692: read d2/de/d13/d22/d26/dd7/fe0 [3172072,55760] 0 2024-04-15T00:35:35.459 INFO:tasks.workunit.client.0.smithi029.stdout:9/653: sync 2024-04-15T00:35:35.839 INFO:tasks.workunit.client.0.smithi029.stdout:3/674: write d17/d2f/d44/d58/d5c/f73 [3281007,9411] 0 2024-04-15T00:35:35.865 INFO:tasks.workunit.client.0.smithi029.stdout:7/672: symlink d0/d6/d4f/d5d/d87/ldc 0 2024-04-15T00:35:35.943 INFO:tasks.workunit.client.0.smithi029.stdout:0/690: symlink d5/d15/d27/dbb/le0 0 2024-04-15T00:35:35.950 INFO:tasks.workunit.client.0.smithi029.stdout:6/680: creat d1/d8/db/db7/fd4 x:0 0 0 2024-04-15T00:35:36.175 INFO:tasks.workunit.client.0.smithi029.stdout:2/678: unlink d3/d13/d43/d5a/d4f/fad 0 2024-04-15T00:35:36.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/679: stat d3/dd/d2d/d61/dd5/l3e 0 2024-04-15T00:35:36.269 INFO:tasks.workunit.client.0.smithi029.stdout:3/675: symlink d17/d2a/d46/d67/ld4 0 2024-04-15T00:35:36.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/673: symlink d0/d6/d4f/ldd 0 2024-04-15T00:35:36.611 INFO:tasks.workunit.client.0.smithi029.stdout:0/691: creat d5/db/d1a/d65/d76/fe1 x:0 0 0 2024-04-15T00:35:36.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/651: rename df/d29/d41/d69/d78/dd1/f68 to df/d32/fe2 0 2024-04-15T00:35:36.686 INFO:tasks.workunit.client.0.smithi029.stdout:1/652: dread df/d29/d41/f48 [0,4194304] 0 2024-04-15T00:35:36.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/674: mkdir d0/d6/d4f/d66/d37/dde 0 2024-04-15T00:35:36.908 INFO:tasks.workunit.client.0.smithi029.stdout:5/693: rename d2/de/d1f/f6a to d2/d1a/fea 0 2024-04-15T00:35:36.931 INFO:tasks.workunit.client.0.smithi029.stdout:5/694: chown d2/de/d13/d22/d3c/d41/c4f 9020210 1 2024-04-15T00:35:36.961 INFO:tasks.workunit.client.0.smithi029.stdout:5/695: stat d2/de/d13/d22/d26/d36/d4d/d78 0 2024-04-15T00:35:37.208 INFO:tasks.workunit.client.0.smithi029.stdout:2/680: creat d3/d13/d43/d9a/fdc x:0 0 0 2024-04-15T00:35:37.209 INFO:tasks.workunit.client.0.smithi029.stdout:1/653: creat df/d29/fe3 x:0 0 0 2024-04-15T00:35:37.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/675: unlink d0/d6/d4f/d66/d37/db7/dda/fe 0 2024-04-15T00:35:37.223 INFO:tasks.workunit.client.0.smithi029.stdout:3/676: rename d17/d2a/f4e to d17/d2a/d46/d67/fd5 0 2024-04-15T00:35:37.771 INFO:tasks.workunit.client.0.smithi029.stdout:2/681: rmdir d3/dd 39 2024-04-15T00:35:37.772 INFO:tasks.workunit.client.0.smithi029.stdout:6/681: write d1/d8/db/f4d [979325,27440] 0 2024-04-15T00:35:37.784 INFO:tasks.workunit.client.0.smithi029.stdout:0/692: rename d5/d15/d27/d51/d77/fca to d5/d15/d1f/dd3/fe2 0 2024-04-15T00:35:37.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/654: unlink df/d32/d7c/cdd 0 2024-04-15T00:35:37.874 INFO:tasks.workunit.client.0.smithi029.stdout:3/677: mkdir d17/d2a/d46/d67/dd6 0 2024-04-15T00:35:37.925 INFO:tasks.workunit.client.0.smithi029.stdout:0/693: readlink d5/db/d1a/la0 0 2024-04-15T00:35:37.939 INFO:tasks.workunit.client.0.smithi029.stdout:5/696: dread d2/de/d1f/f3b [0,4194304] 0 2024-04-15T00:35:37.952 INFO:tasks.workunit.client.0.smithi029.stdout:8/677: dwrite d8/d4a/d78/d23/d28/d30/d39/d77/fd5 [0,4194304] 0 2024-04-15T00:35:37.976 INFO:tasks.workunit.client.0.smithi029.stdout:9/654: write d3/d6/f13 [1430273,115630] 0 2024-04-15T00:35:38.079 INFO:tasks.workunit.client.0.smithi029.stdout:0/694: chown d5/d15/d1f 858624578 1 2024-04-15T00:35:38.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/695: rename d5/d15/d1f/d32 to d5/d3e/de3 0 2024-04-15T00:35:38.708 INFO:tasks.workunit.client.0.smithi029.stdout:8/678: symlink d8/d4a/d78/d23/d28/d30/d39/d77/dd3/le5 0 2024-04-15T00:35:38.762 INFO:tasks.workunit.client.0.smithi029.stdout:9/655: mknod d3/d6/d9/d15/ccf 0 2024-04-15T00:35:38.858 INFO:tasks.workunit.client.0.smithi029.stdout:0/696: rename d5/db/d1a/d65/d87/fc4 to d5/db/d1a/d65/d76/daf/fe4 0 2024-04-15T00:35:38.875 INFO:tasks.workunit.client.0.smithi029.stdout:8/679: sync 2024-04-15T00:35:38.881 INFO:tasks.workunit.client.0.smithi029.stdout:7/676: link d0/d6/d4f/dbb/d49/fd7 d0/d6/d4f/d66/d26/d77/fdf 0 2024-04-15T00:35:38.997 INFO:tasks.workunit.client.0.smithi029.stdout:9/656: dread d3/f8a [0,4194304] 0 2024-04-15T00:35:39.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/697: rename d5/d15/d57/d5e/f8e to d5/d4c/d8a/fe5 0 2024-04-15T00:35:39.126 INFO:tasks.workunit.client.0.smithi029.stdout:4/658: symlink de/ld4 0 2024-04-15T00:35:39.128 INFO:tasks.workunit.client.0.smithi029.stdout:7/677: creat d0/d6/d4f/fe0 x:0 0 0 2024-04-15T00:35:39.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/659: stat de/ld4 0 2024-04-15T00:35:39.149 INFO:tasks.workunit.client.0.smithi029.stdout:8/680: dread - d8/d4a/d78/d23/d28/fd6 zero size 2024-04-15T00:35:39.213 INFO:tasks.workunit.client.0.smithi029.stdout:6/682: link d1/d1e/f4e d1/d8/db/fd5 0 2024-04-15T00:35:39.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/682: write d3/d13/f16 [3635053,4480] 0 2024-04-15T00:35:39.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/683: readlink d3/d2a/d6d/l96 0 2024-04-15T00:35:39.633 INFO:tasks.workunit.client.0.smithi029.stdout:0/698: unlink d5/d15/d57/l72 0 2024-04-15T00:35:39.648 INFO:tasks.workunit.client.0.smithi029.stdout:0/699: chown d5/db/d1a/d65/d76/l9d 25 1 2024-04-15T00:35:39.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/681: rename d8/da/d2f/de2/ca3 to d8/d4a/d78/dc3/ddd/ce6 0 2024-04-15T00:35:39.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/683: creat d1/d8/d79/d9f/fd6 x:0 0 0 2024-04-15T00:35:39.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/655: write df/d32/db2/fca [759704,49283] 0 2024-04-15T00:35:39.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/678: dwrite d17/d2f/d3c/f3f [0,4194304] 0 2024-04-15T00:35:40.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/700: dread d5/d3e/de3/f8c [0,4194304] 0 2024-04-15T00:35:40.168 INFO:tasks.workunit.client.0.smithi029.stdout:5/697: dwrite d2/de/d13/d22/f40 [0,4194304] 0 2024-04-15T00:35:40.249 INFO:tasks.workunit.client.0.smithi029.stdout:5/698: dread - d2/de/d13/d22/d26/d36/fc1 zero size 2024-04-15T00:35:40.690 INFO:tasks.workunit.client.0.smithi029.stdout:1/656: creat df/d29/d41/d69/d78/dd1/d80/fe4 x:0 0 0 2024-04-15T00:35:40.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/678: getdents d0/d6/da2 0 2024-04-15T00:35:40.883 INFO:tasks.workunit.client.0.smithi029.stdout:3/679: creat d17/d2a/d4c/d93/fd7 x:0 0 0 2024-04-15T00:35:40.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/679: dread - d0/d6/d4f/d66/d67/f88 zero size 2024-04-15T00:35:40.916 INFO:tasks.workunit.client.0.smithi029.stdout:3/680: chown d17/d2f/d44/d58/d5c/d5f/fba 1415791874 1 2024-04-15T00:35:40.935 INFO:tasks.workunit.client.0.smithi029.stdout:0/701: chown d5/db/d1a/d65/la2 388105655 1 2024-04-15T00:35:40.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/657: write d3/d6/d9/d29/d60/d64/d6d/d58/f32 [1872107,78294] 0 2024-04-15T00:35:41.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/699: fdatasync d2/de/d13/d22/d26/d36/d4d/d70/d8d/f91 0 2024-04-15T00:35:41.251 INFO:tasks.workunit.client.0.smithi029.stdout:1/657: creat df/d29/fe5 x:0 0 0 2024-04-15T00:35:41.402 INFO:tasks.workunit.client.0.smithi029.stdout:4/660: dwrite de/d2b/d59/fce [0,4194304] 0 2024-04-15T00:35:41.615 INFO:tasks.workunit.client.0.smithi029.stdout:9/658: dread d3/d6/d9/d29/d60/d64/f69 [0,4194304] 0 2024-04-15T00:35:41.673 INFO:tasks.workunit.client.0.smithi029.stdout:6/684: dwrite d1/d8/db/d7b/f93 [0,4194304] 0 2024-04-15T00:35:41.807 INFO:tasks.workunit.client.0.smithi029.stdout:2/684: dwrite d3/dd/d42/dc6/db1/fd2 [0,4194304] 0 2024-04-15T00:35:41.937 INFO:tasks.workunit.client.0.smithi029.stdout:4/661: dread de/d2b/f21 [0,4194304] 0 2024-04-15T00:35:42.051 INFO:tasks.workunit.client.0.smithi029.stdout:7/680: link d0/d6/d4f/f81 d0/d6/d4f/d66/d37/db7/dda/fe1 0 2024-04-15T00:35:42.153 INFO:tasks.workunit.client.0.smithi029.stdout:2/685: symlink d3/d50/d51/ldd 0 2024-04-15T00:35:42.640 INFO:tasks.workunit.client.0.smithi029.stdout:2/686: dread d3/f5 [0,4194304] 0 2024-04-15T00:35:42.981 INFO:tasks.workunit.client.0.smithi029.stdout:6/685: rmdir d1/d8/db/d7b/d85/dd2/dab/dc9 0 2024-04-15T00:35:43.085 INFO:tasks.workunit.client.0.smithi029.stdout:3/681: write d17/f1d [1625405,31091] 0 2024-04-15T00:35:43.125 INFO:tasks.workunit.client.0.smithi029.stdout:0/702: dwrite d5/d15/f4a [0,4194304] 0 2024-04-15T00:35:43.196 INFO:tasks.workunit.client.0.smithi029.stdout:7/681: unlink d0/d6/d4f/cd5 0 2024-04-15T00:35:43.353 INFO:tasks.workunit.client.0.smithi029.stdout:1/658: dwrite df/f3e [0,4194304] 0 2024-04-15T00:35:43.355 INFO:tasks.workunit.client.0.smithi029.stdout:5/700: dwrite d2/de/d13/fdf [0,4194304] 0 2024-04-15T00:35:43.499 INFO:tasks.workunit.client.0.smithi029.stdout:9/659: getdents d3/d6/d9/d15/d9d 0 2024-04-15T00:35:43.508 INFO:tasks.workunit.client.0.smithi029.stdout:6/686: symlink d1/d8/db/d38/d86/ld7 0 2024-04-15T00:35:43.519 INFO:tasks.workunit.client.0.smithi029.stdout:4/662: write de/d2b/d59/f96 [467777,75830] 0 2024-04-15T00:35:43.523 INFO:tasks.workunit.client.0.smithi029.stdout:8/682: creat d8/da/fe7 x:0 0 0 2024-04-15T00:35:43.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/682: symlink d17/d2a/d46/d67/ld8 0 2024-04-15T00:35:43.573 INFO:tasks.workunit.client.0.smithi029.stdout:0/703: symlink d5/db/d1a/d50/le6 0 2024-04-15T00:35:43.630 INFO:tasks.workunit.client.0.smithi029.stdout:1/659: rename df/d29 to df/d29/d41/d96/de6 22 2024-04-15T00:35:43.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/660: chown df/d29/d41/daf/fc9 342 1 2024-04-15T00:35:43.703 INFO:tasks.workunit.client.0.smithi029.stdout:5/701: dwrite d2/de/d13/d22/d26/f6f [0,4194304] 0 2024-04-15T00:35:43.787 INFO:tasks.workunit.client.0.smithi029.stdout:1/661: readlink df/d29/d41/d69/d78/dd1/d80/d94/lad 0 2024-04-15T00:35:43.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/682: mknod d0/d6/d39/ce2 0 2024-04-15T00:35:43.986 INFO:tasks.workunit.client.0.smithi029.stdout:4/663: fdatasync de/d2b/f2a 0 2024-04-15T00:35:44.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/683: dread - d0/d6/d4f/f9d zero size 2024-04-15T00:35:44.148 INFO:tasks.workunit.client.0.smithi029.stdout:0/704: creat d5/d15/d1f/dd3/fe7 x:0 0 0 2024-04-15T00:35:44.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/662: creat df/d29/d41/daf/fe7 x:0 0 0 2024-04-15T00:35:44.152 INFO:tasks.workunit.client.0.smithi029.stdout:3/683: dread - d17/d2f/d84/fc6 zero size 2024-04-15T00:35:44.201 INFO:tasks.workunit.client.0.smithi029.stdout:5/702: mknod d2/de/d13/d22/de6/ceb 0 2024-04-15T00:35:44.321 INFO:tasks.workunit.client.0.smithi029.stdout:5/703: dwrite d2/de/d13/d22/f40 [4194304,4194304] 0 2024-04-15T00:35:44.397 INFO:tasks.workunit.client.0.smithi029.stdout:4/664: mkdir de/d54/d71/d8b/db1/dd5 0 2024-04-15T00:35:44.411 INFO:tasks.workunit.client.0.smithi029.stdout:2/687: write d3/d2a/f3a [288665,74846] 0 2024-04-15T00:35:44.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/683: write d8/da/d2f/d42/f7e [854917,93666] 0 2024-04-15T00:35:44.524 INFO:tasks.workunit.client.0.smithi029.stdout:0/705: rename d5/db/d7b/lde to d5/db/d1a/d50/da1/le8 0 2024-04-15T00:35:44.537 INFO:tasks.workunit.client.0.smithi029.stdout:7/684: fdatasync d0/d6/d4f/dbb/d49/fd7 0 2024-04-15T00:35:44.567 INFO:tasks.workunit.client.0.smithi029.stdout:1/663: dread df/d29/d41/fc6 [0,4194304] 0 2024-04-15T00:35:44.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/687: write d1/d8/db/f15 [3099525,105502] 0 2024-04-15T00:35:44.630 INFO:tasks.workunit.client.0.smithi029.stdout:0/706: chown d5/d4c/d4e/da8 46254 1 2024-04-15T00:35:44.663 INFO:tasks.workunit.client.0.smithi029.stdout:4/665: read de/f19 [1575539,113782] 0 2024-04-15T00:35:44.691 INFO:tasks.workunit.client.0.smithi029.stdout:9/660: dwrite d3/d6/fc8 [0,4194304] 0 2024-04-15T00:35:44.771 INFO:tasks.workunit.client.0.smithi029.stdout:5/704: chown d2/de/d13/d22/d26/d36/c64 734 1 2024-04-15T00:35:44.841 INFO:tasks.workunit.client.0.smithi029.stdout:1/664: mknod df/d29/d41/d96/ce8 0 2024-04-15T00:35:44.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/666: write de/df/d1e/d56/fca [37228,74865] 0 2024-04-15T00:35:44.937 INFO:tasks.workunit.client.0.smithi029.stdout:4/667: chown f7 103511 1 2024-04-15T00:35:44.957 INFO:tasks.workunit.client.0.smithi029.stdout:3/684: dwrite d17/d2f/d3c/f4a [4194304,4194304] 0 2024-04-15T00:35:45.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/688: write d3/dd/d2d/f37 [23802,84752] 0 2024-04-15T00:35:45.062 INFO:tasks.workunit.client.0.smithi029.stdout:4/668: chown de/d54/d71/db5/cc7 55 1 2024-04-15T00:35:45.065 INFO:tasks.workunit.client.0.smithi029.stdout:5/705: unlink d2/de/d13/d22/d3c/d41/la0 0 2024-04-15T00:35:45.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/688: truncate d1/d8/db/d38/f8a 1251471 0 2024-04-15T00:35:45.320 INFO:tasks.workunit.client.0.smithi029.stdout:2/689: dread d3/dd/d2d/d61/dd5/d95/f1e [4194304,4194304] 0 2024-04-15T00:35:45.340 INFO:tasks.workunit.client.0.smithi029.stdout:7/685: dwrite d0/d6/d4f/f5c [0,4194304] 0 2024-04-15T00:35:45.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/661: truncate d3/d6/d9/d29/d60/d64/d6d/d58/f2a 4113529 0 2024-04-15T00:35:45.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/707: unlink d5/d15/d27/d28/ca6 0 2024-04-15T00:35:45.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/669: fsync de/d54/d58/fbd 0 2024-04-15T00:35:45.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/708: stat d5/c7e 0 2024-04-15T00:35:45.751 INFO:tasks.workunit.client.0.smithi029.stdout:9/662: readlink d3/d6/d9/d29/l4f 0 2024-04-15T00:35:45.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/663: dread d3/d6/fc8 [0,4194304] 0 2024-04-15T00:35:45.812 INFO:tasks.workunit.client.0.smithi029.stdout:5/706: rmdir d2/de/d13/d22/de6 39 2024-04-15T00:35:45.885 INFO:tasks.workunit.client.0.smithi029.stdout:8/684: link d8/da/d2f/d6e/f94 d8/d4a/d78/d23/d28/d30/d39/d77/fe8 0 2024-04-15T00:35:45.938 INFO:tasks.workunit.client.0.smithi029.stdout:7/686: mkdir d0/d6/d4f/d66/d67/de3 0 2024-04-15T00:35:46.130 INFO:tasks.workunit.client.0.smithi029.stdout:2/690: rename d3/d50/c88 to d3/d13/d43/d5a/d4f/cde 0 2024-04-15T00:35:46.140 INFO:tasks.workunit.client.0.smithi029.stdout:2/691: chown d3/d2a/c82 1598 1 2024-04-15T00:35:46.328 INFO:tasks.workunit.client.0.smithi029.stdout:1/665: dwrite df/d29/d41/d69/f44 [0,4194304] 0 2024-04-15T00:35:46.558 INFO:tasks.workunit.client.0.smithi029.stdout:9/664: rmdir d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97 39 2024-04-15T00:35:46.778 INFO:tasks.workunit.client.0.smithi029.stdout:8/685: read d8/d4a/d78/d23/d28/d30/db1/fce [50006,43950] 0 2024-04-15T00:35:46.796 INFO:tasks.workunit.client.0.smithi029.stdout:8/686: read d8/da/fac [3850078,120160] 0 2024-04-15T00:35:46.812 INFO:tasks.workunit.client.0.smithi029.stdout:8/687: readlink d8/d4a/d78/d23/d28/d30/d39/l5e 0 2024-04-15T00:35:46.949 INFO:tasks.workunit.client.0.smithi029.stdout:2/692: creat d3/dd/da0/fdf x:0 0 0 2024-04-15T00:35:46.990 INFO:tasks.workunit.client.0.smithi029.stdout:3/685: rmdir d17/d2a/d4c/dd3 0 2024-04-15T00:35:46.997 INFO:tasks.workunit.client.0.smithi029.stdout:3/686: chown d17/l61 59259 1 2024-04-15T00:35:47.094 INFO:tasks.workunit.client.0.smithi029.stdout:0/709: mknod d5/db/d1a/d65/d76/daf/dc1/ce9 0 2024-04-15T00:35:47.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/689: dwrite d1/d8/db/f4a [0,4194304] 0 2024-04-15T00:35:47.222 INFO:tasks.workunit.client.0.smithi029.stdout:7/687: truncate d0/d6/d4f/f81 714904 0 2024-04-15T00:35:47.222 INFO:tasks.workunit.client.0.smithi029.stdout:9/665: creat d3/d6/d9/d15/d9d/fd0 x:0 0 0 2024-04-15T00:35:47.276 INFO:tasks.workunit.client.0.smithi029.stdout:0/710: dread d5/d3e/f69 [0,4194304] 0 2024-04-15T00:35:47.358 INFO:tasks.workunit.client.0.smithi029.stdout:3/687: unlink d17/d2f/d44/d58/fbc 0 2024-04-15T00:35:47.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/688: fdatasync d8/f7c 0 2024-04-15T00:35:47.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/670: write de/d2b/f21 [1760401,60931] 0 2024-04-15T00:35:47.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/690: chown d1/d8/db/fd5 27676250 1 2024-04-15T00:35:47.741 INFO:tasks.workunit.client.0.smithi029.stdout:9/666: dread d3/d6/d9/f22 [4194304,4194304] 0 2024-04-15T00:35:47.747 INFO:tasks.workunit.client.0.smithi029.stdout:9/667: chown d3/da3 522487 1 2024-04-15T00:35:47.763 INFO:tasks.workunit.client.0.smithi029.stdout:3/688: creat d17/d2a/d4c/d93/fd9 x:0 0 0 2024-04-15T00:35:47.862 INFO:tasks.workunit.client.0.smithi029.stdout:8/689: creat d8/d4a/d78/d23/d28/d5f/fe9 x:0 0 0 2024-04-15T00:35:47.873 INFO:tasks.workunit.client.0.smithi029.stdout:8/690: stat d8/da/d2f/d6e/ld0 0 2024-04-15T00:35:48.046 INFO:tasks.workunit.client.0.smithi029.stdout:4/671: fdatasync de/d2b/d35/fcc 0 2024-04-15T00:35:48.099 INFO:tasks.workunit.client.0.smithi029.stdout:0/711: symlink d5/d15/d27/lea 0 2024-04-15T00:35:48.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/691: creat d1/d8/db/d7b/d85/dd2/dab/fd8 x:0 0 0 2024-04-15T00:35:48.346 INFO:tasks.workunit.client.0.smithi029.stdout:9/668: unlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/dbb/fc3 0 2024-04-15T00:35:48.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/707: getdents d2/de/d13/d22/de6 0 2024-04-15T00:35:48.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/712: truncate d5/f62 1593034 0 2024-04-15T00:35:48.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/708: chown d2/d1a/f1c 91064888 1 2024-04-15T00:35:48.801 INFO:tasks.workunit.client.0.smithi029.stdout:0/713: creat d5/d15/d68/feb x:0 0 0 2024-04-15T00:35:48.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/709: dread d2/f7 [0,4194304] 0 2024-04-15T00:35:49.038 INFO:tasks.workunit.client.0.smithi029.stdout:4/672: link de/d54/d71/da3/fb2 de/d54/d71/d8b/fd6 0 2024-04-15T00:35:49.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/666: rename df/d29/d41/d69/d4c/d7a/fe1 to df/fe9 0 2024-04-15T00:35:49.049 INFO:tasks.workunit.client.0.smithi029.stdout:3/689: mknod d17/d2f/cda 0 2024-04-15T00:35:49.234 INFO:tasks.workunit.client.0.smithi029.stdout:5/710: mkdir d2/de/d13/d22/d3c/d41/dec 0 2024-04-15T00:35:49.295 INFO:tasks.workunit.client.0.smithi029.stdout:1/667: rmdir df/d32 39 2024-04-15T00:35:49.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/693: rename d3/lf to d3/dd/d42/dd1/le0 0 2024-04-15T00:35:49.389 INFO:tasks.workunit.client.0.smithi029.stdout:7/688: dwrite d0/f7c [0,4194304] 0 2024-04-15T00:35:49.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/691: write d8/fd [1049230,54241] 0 2024-04-15T00:35:49.696 INFO:tasks.workunit.client.0.smithi029.stdout:5/711: sync 2024-04-15T00:35:49.877 INFO:tasks.workunit.client.0.smithi029.stdout:6/692: dwrite d1/d8/db/f44 [0,4194304] 0 2024-04-15T00:35:50.008 INFO:tasks.workunit.client.0.smithi029.stdout:8/692: rename d8/d4a/d78/d23/f59 to d8/da/d3d/de0/fea 0 2024-04-15T00:35:50.156 INFO:tasks.workunit.client.0.smithi029.stdout:9/669: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [0,4194304] 0 2024-04-15T00:35:50.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/714: dwrite d5/d4c/d4e/f80 [0,4194304] 0 2024-04-15T00:35:50.434 INFO:tasks.workunit.client.0.smithi029.stdout:6/693: unlink d1/d8/db/d7b/cb4 0 2024-04-15T00:35:50.491 INFO:tasks.workunit.client.0.smithi029.stdout:0/715: stat d5/db/d1a/d65/la2 0 2024-04-15T00:35:50.562 INFO:tasks.workunit.client.0.smithi029.stdout:3/690: dwrite d17/d2a/d33/d37/fc0 [0,4194304] 0 2024-04-15T00:35:50.625 INFO:tasks.workunit.client.0.smithi029.stdout:4/673: dwrite de/d54/d71/f87 [0,4194304] 0 2024-04-15T00:35:50.719 INFO:tasks.workunit.client.0.smithi029.stdout:3/691: chown d17/d2a/d46/d67/dd6 16640428 1 2024-04-15T00:35:50.728 INFO:tasks.workunit.client.0.smithi029.stdout:4/674: write de/d2b/f21 [5081376,96423] 0 2024-04-15T00:35:50.757 INFO:tasks.workunit.client.0.smithi029.stdout:4/675: chown de/d54/d58/c9a 7215480 1 2024-04-15T00:35:50.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/694: getdents d3/dd/d42/dd1 0 2024-04-15T00:35:50.977 INFO:tasks.workunit.client.0.smithi029.stdout:8/693: mkdir d8/da/d3d/deb 0 2024-04-15T00:35:51.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/668: dwrite df/d29/d41/d69/d4c/d7a/f83 [0,4194304] 0 2024-04-15T00:35:51.169 INFO:tasks.workunit.client.0.smithi029.stdout:9/670: mknod d3/d6/d9/d29/d60/d64/d6d/d58/cd1 0 2024-04-15T00:35:51.178 INFO:tasks.workunit.client.0.smithi029.stdout:5/712: dwrite d2/de/d13/d22/d3c/fae [0,4194304] 0 2024-04-15T00:35:51.242 INFO:tasks.workunit.client.0.smithi029.stdout:0/716: mkdir d5/d54/dec 0 2024-04-15T00:35:51.278 INFO:tasks.workunit.client.0.smithi029.stdout:6/694: truncate d1/d8/f54 3671700 0 2024-04-15T00:35:51.405 INFO:tasks.workunit.client.0.smithi029.stdout:7/689: dwrite d0/d6/d4f/d66/d26/d77/fc4 [0,4194304] 0 2024-04-15T00:35:51.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/692: rename d17/f1d to d17/d2a/d46/d67/fdb 0 2024-04-15T00:35:51.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/676: creat de/d2b/d59/fd7 x:0 0 0 2024-04-15T00:35:51.502 INFO:tasks.workunit.client.0.smithi029.stdout:7/690: chown d0/f22 1 1 2024-04-15T00:35:51.681 INFO:tasks.workunit.client.0.smithi029.stdout:8/694: dread d8/da/d2f/d42/f7e [0,4194304] 0 2024-04-15T00:35:51.737 INFO:tasks.workunit.client.0.smithi029.stdout:1/669: mkdir df/d29/d41/d69/d78/dea 0 2024-04-15T00:35:51.762 INFO:tasks.workunit.client.0.smithi029.stdout:1/670: chown df/fa7 28650 1 2024-04-15T00:35:51.853 INFO:tasks.workunit.client.0.smithi029.stdout:9/671: dread d3/f1b [0,4194304] 0 2024-04-15T00:35:52.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/695: mkdir d3/d13/de1 0 2024-04-15T00:35:52.154 INFO:tasks.workunit.client.0.smithi029.stdout:8/695: symlink d8/da8/lec 0 2024-04-15T00:35:52.161 INFO:tasks.workunit.client.0.smithi029.stdout:8/696: chown d8/da/d2f/d42 29018 1 2024-04-15T00:35:52.390 INFO:tasks.workunit.client.0.smithi029.stdout:3/693: truncate d17/d2a/d33/d37/f99 199912 0 2024-04-15T00:35:52.461 INFO:tasks.workunit.client.0.smithi029.stdout:2/696: rename d3/dd/d2d/d61/dd5/l3e to d3/d93/dbe/le2 0 2024-04-15T00:35:52.709 INFO:tasks.workunit.client.0.smithi029.stdout:8/697: truncate d8/da/d2f/d66/f67 617318 0 2024-04-15T00:35:52.780 INFO:tasks.workunit.client.0.smithi029.stdout:1/671: fsync df/d29/d41/f81 0 2024-04-15T00:35:52.819 INFO:tasks.workunit.client.0.smithi029.stdout:9/672: mknod d3/da3/da7/cd2 0 2024-04-15T00:35:53.144 INFO:tasks.workunit.client.0.smithi029.stdout:3/694: rename d17/d2a/d46/d67/l78 to d17/d83/ldc 0 2024-04-15T00:35:53.236 INFO:tasks.workunit.client.0.smithi029.stdout:8/698: mkdir d8/da/d2f/d6e/dc1/ded 0 2024-04-15T00:35:53.263 INFO:tasks.workunit.client.0.smithi029.stdout:5/713: write d2/de/d13/d22/d3c/f6b [1036025,12034] 0 2024-04-15T00:35:53.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/714: chown d2/de/d13/d22/d3c/d41/c4f 538425240 1 2024-04-15T00:35:53.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/695: write d1/d8/db/db7/fbd [463683,112115] 0 2024-04-15T00:35:53.361 INFO:tasks.workunit.client.0.smithi029.stdout:0/717: link d5/d3e/de3/f61 d5/d15/d27/dbb/fed 0 2024-04-15T00:35:53.390 INFO:tasks.workunit.client.0.smithi029.stdout:0/718: read d5/f7 [1409324,100537] 0 2024-04-15T00:35:53.396 INFO:tasks.workunit.client.0.smithi029.stdout:6/696: chown d1/d8/db/d38/f68 841541450 1 2024-04-15T00:35:53.426 INFO:tasks.workunit.client.0.smithi029.stdout:3/695: creat d17/d2f/d84/db1/fdd x:0 0 0 2024-04-15T00:35:53.506 INFO:tasks.workunit.client.0.smithi029.stdout:8/699: mkdir d8/d4a/da1/dee 0 2024-04-15T00:35:53.512 INFO:tasks.workunit.client.0.smithi029.stdout:7/691: write d0/d6/d4f/d5d/d82/fc1 [443820,3649] 0 2024-04-15T00:35:53.677 INFO:tasks.workunit.client.0.smithi029.stdout:5/715: rename d2/d1a/d2d/lac to d2/de/d13/d22/d26/d36/d4d/d78/led 0 2024-04-15T00:35:53.753 INFO:tasks.workunit.client.0.smithi029.stdout:6/697: creat d1/db9/dc3/fd9 x:0 0 0 2024-04-15T00:35:53.756 INFO:tasks.workunit.client.0.smithi029.stdout:4/677: write de/df/f12 [4129549,12858] 0 2024-04-15T00:35:53.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/698: chown d1/d1e/l52 39165 1 2024-04-15T00:35:53.844 INFO:tasks.workunit.client.0.smithi029.stdout:0/719: truncate d5/dc6/fd6 1006025 0 2024-04-15T00:35:53.849 INFO:tasks.workunit.client.0.smithi029.stdout:0/720: readlink d5/d15/l17 0 2024-04-15T00:35:53.868 INFO:tasks.workunit.client.0.smithi029.stdout:3/696: truncate d17/f45 655006 0 2024-04-15T00:35:54.001 INFO:tasks.workunit.client.0.smithi029.stdout:1/672: mkdir df/d29/deb 0 2024-04-15T00:35:54.067 INFO:tasks.workunit.client.0.smithi029.stdout:9/673: creat d3/d6/d9/fd3 x:0 0 0 2024-04-15T00:35:54.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/699: dread d1/d8/f5e [0,4194304] 0 2024-04-15T00:35:54.279 INFO:tasks.workunit.client.0.smithi029.stdout:0/721: mknod d5/db/d1a/d65/d76/daf/dc1/cee 0 2024-04-15T00:35:54.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/697: unlink d17/d2f/d44/d5a/faa 0 2024-04-15T00:35:54.324 INFO:tasks.workunit.client.0.smithi029.stdout:2/697: getdents d3/dd/d42 0 2024-04-15T00:35:54.334 INFO:tasks.workunit.client.0.smithi029.stdout:2/698: chown d3/l15 19915 1 2024-04-15T00:35:54.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/699: readlink d3/d2a/d4e/db9/lb7 0 2024-04-15T00:35:54.469 INFO:tasks.workunit.client.0.smithi029.stdout:8/700: mknod d8/da/d2f/d6e/cef 0 2024-04-15T00:35:54.476 INFO:tasks.workunit.client.0.smithi029.stdout:7/692: symlink d0/d6/d39/d3c/le4 0 2024-04-15T00:35:54.530 INFO:tasks.workunit.client.0.smithi029.stdout:1/673: chown df/d32/f39 664154 1 2024-04-15T00:35:54.534 INFO:tasks.workunit.client.0.smithi029.stdout:1/674: stat df/l7b 0 2024-04-15T00:35:54.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/722: sync 2024-04-15T00:35:54.594 INFO:tasks.workunit.client.0.smithi029.stdout:5/716: mkdir d2/de/d13/d22/dee 0 2024-04-15T00:35:54.641 INFO:tasks.workunit.client.0.smithi029.stdout:6/700: fdatasync d1/d8/db/d38/fc2 0 2024-04-15T00:35:54.650 INFO:tasks.workunit.client.0.smithi029.stdout:8/701: sync 2024-04-15T00:35:54.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/701: chown d1/d8/db/d7b/d85/f8f 0 1 2024-04-15T00:35:54.807 INFO:tasks.workunit.client.0.smithi029.stdout:2/700: symlink d3/d13/d43/d5a/d4f/le3 0 2024-04-15T00:35:54.819 INFO:tasks.workunit.client.0.smithi029.stdout:2/701: readlink d3/d13/d43/d5a/d4f/l6e 0 2024-04-15T00:35:54.906 INFO:tasks.workunit.client.0.smithi029.stdout:1/675: symlink df/d32/db2/lec 0 2024-04-15T00:35:54.972 INFO:tasks.workunit.client.0.smithi029.stdout:9/674: mknod d3/d6/d9/d29/d60/d64/d6d/cd4 0 2024-04-15T00:35:54.981 INFO:tasks.workunit.client.0.smithi029.stdout:9/675: stat d3/d6/d9/d29/l98 0 2024-04-15T00:35:55.017 INFO:tasks.workunit.client.0.smithi029.stdout:5/717: truncate d2/de/d13/d22/d26/d36/f53 1727332 0 2024-04-15T00:35:55.029 INFO:tasks.workunit.client.0.smithi029.stdout:5/718: chown d2/de/d13/daa/dc3/lad 13856857 1 2024-04-15T00:35:55.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/702: chown d1/f8b 1 1 2024-04-15T00:35:55.299 INFO:tasks.workunit.client.0.smithi029.stdout:0/723: symlink d5/db/lef 0 2024-04-15T00:35:55.379 INFO:tasks.workunit.client.0.smithi029.stdout:9/676: read d3/d6/d9/d29/d60/d7f/da0/d9a/f36 [1146743,105741] 0 2024-04-15T00:35:55.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/677: sync 2024-04-15T00:35:55.570 INFO:tasks.workunit.client.0.smithi029.stdout:2/702: mkdir d3/d2a/de4 0 2024-04-15T00:35:55.650 INFO:tasks.workunit.client.0.smithi029.stdout:0/724: write d5/d15/d68/feb [640284,68179] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:6/703: dread d1/d8/db/f4a [0,4194304] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:4/678: dwrite de/d54/d71/db5/fcf [0,4194304] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:3/698: write d17/d2f/f71 [1581921,125817] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:3/699: chown fa 0 1 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/678: rmdir d3/d6/d9/d29/d60 39 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:2/703: fdatasync d3/d13/fd4 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:7/693: write d0/d6/d4f/d66/d26/f2b [1301063,67142] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:6/704: dread d1/d8/faf [0,4194304] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:1/676: dwrite df/d32/f3b [0,4194304] 0 2024-04-15T00:35:56.776 INFO:tasks.workunit.client.0.smithi029.stdout:7/694: mknod d0/d6/d39/d3c/d5b/d7e/ce5 0 2024-04-15T00:35:56.777 INFO:tasks.workunit.client.0.smithi029.stdout:8/702: write d8/da/d2f/d6e/d5a/fc4 [1454443,74633] 0 2024-04-15T00:35:56.824 INFO:tasks.workunit.client.0.smithi029.stdout:0/725: mknod d5/d15/d27/d51/d7d/cf0 0 2024-04-15T00:35:56.969 INFO:tasks.workunit.client.0.smithi029.stdout:0/726: sync 2024-04-15T00:35:57.210 INFO:tasks.workunit.client.0.smithi029.stdout:5/719: getdents d2/de/d13/d22/d26 0 2024-04-15T00:35:57.290 INFO:tasks.workunit.client.0.smithi029.stdout:9/679: truncate d3/d6/d9/d29/d60/d64/d6d/d58/f54 2467316 0 2024-04-15T00:35:57.305 INFO:tasks.workunit.client.0.smithi029.stdout:9/680: read d3/d6/d9/f2c [1364177,105974] 0 2024-04-15T00:35:57.459 INFO:tasks.workunit.client.0.smithi029.stdout:1/677: creat df/d29/d41/d69/d78/dd1/d59/fed x:0 0 0 2024-04-15T00:35:57.559 INFO:tasks.workunit.client.0.smithi029.stdout:0/727: truncate d5/d4c/f84 3921708 0 2024-04-15T00:35:57.566 INFO:tasks.workunit.client.0.smithi029.stdout:5/720: symlink d2/de/d13/daa/lef 0 2024-04-15T00:35:57.800 INFO:tasks.workunit.client.0.smithi029.stdout:7/695: creat d0/d6/d4f/d66/d37/dde/fe6 x:0 0 0 2024-04-15T00:35:57.874 INFO:tasks.workunit.client.0.smithi029.stdout:8/703: fsync d8/d4a/d78/d23/faa 0 2024-04-15T00:35:57.922 INFO:tasks.workunit.client.0.smithi029.stdout:1/678: creat df/d29/d41/d69/d78/dd1/fee x:0 0 0 2024-04-15T00:35:57.977 INFO:tasks.workunit.client.0.smithi029.stdout:4/679: getdents de/d54/d71/d8b/db1 0 2024-04-15T00:35:58.070 INFO:tasks.workunit.client.0.smithi029.stdout:5/721: truncate d2/de/d13/d22/fd6 58604 0 2024-04-15T00:35:58.176 INFO:tasks.workunit.client.0.smithi029.stdout:2/704: dwrite d3/d50/fc4 [0,4194304] 0 2024-04-15T00:35:58.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/696: fdatasync d0/d6/d4f/d66/d26/d77/f96 0 2024-04-15T00:35:58.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/680: rmdir de/d3a/daa 39 2024-04-15T00:35:58.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/728: mknod d5/d15/d27/d9f/cf1 0 2024-04-15T00:35:58.411 INFO:tasks.workunit.client.0.smithi029.stdout:5/722: fdatasync d2/de/d13/f2a 0 2024-04-15T00:35:58.861 INFO:tasks.workunit.client.0.smithi029.stdout:6/705: rmdir d1/d8/db 39 2024-04-15T00:35:58.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/697: creat d0/d6/d39/d3c/d5b/fe7 x:0 0 0 2024-04-15T00:35:58.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/700: dwrite d17/d2f/d76/d7f/dcd/fd2 [4194304,4194304] 0 2024-04-15T00:35:58.995 INFO:tasks.workunit.client.0.smithi029.stdout:2/705: truncate d3/dd/d2d/f34 298874 0 2024-04-15T00:35:59.115 INFO:tasks.workunit.client.0.smithi029.stdout:3/701: readlink d17/d2f/d3c/l9e 0 2024-04-15T00:35:59.128 INFO:tasks.workunit.client.0.smithi029.stdout:8/704: truncate d8/da/d3d/f86 1375364 0 2024-04-15T00:35:59.166 INFO:tasks.workunit.client.0.smithi029.stdout:9/681: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [0,4194304] 0 2024-04-15T00:35:59.239 INFO:tasks.workunit.client.0.smithi029.stdout:8/705: stat d8/d4a/d78/dc3/ddd 0 2024-04-15T00:35:59.255 INFO:tasks.workunit.client.0.smithi029.stdout:8/706: chown d8/da/cd4 38 1 2024-04-15T00:35:59.402 INFO:tasks.workunit.client.0.smithi029.stdout:5/723: rmdir d2/de/d13/d22/d26 39 2024-04-15T00:35:59.410 INFO:tasks.workunit.client.0.smithi029.stdout:1/679: link df/d32/dbf/cc8 df/d29/cef 0 2024-04-15T00:35:59.523 INFO:tasks.workunit.client.0.smithi029.stdout:9/682: truncate d3/d6/f13 2979936 0 2024-04-15T00:35:59.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/707: symlink d8/da/d2f/d42/d75/lf0 0 2024-04-15T00:35:59.769 INFO:tasks.workunit.client.0.smithi029.stdout:2/706: getdents d3/d2a/de4 0 2024-04-15T00:35:59.779 INFO:tasks.workunit.client.0.smithi029.stdout:2/707: dread - d3/d2a/d6d/f73 zero size 2024-04-15T00:35:59.808 INFO:tasks.workunit.client.0.smithi029.stdout:6/706: dread - d1/d8/db/db7/fd4 zero size 2024-04-15T00:35:59.850 INFO:tasks.workunit.client.0.smithi029.stdout:7/698: fsync d0/d6/d39/d3c/d5b/fe7 0 2024-04-15T00:35:59.967 INFO:tasks.workunit.client.0.smithi029.stdout:1/680: rmdir df/d29/d41/d69/d4c/d7a 39 2024-04-15T00:35:59.983 INFO:tasks.workunit.client.0.smithi029.stdout:4/681: write de/df/d1e/d56/f80 [1904579,60864] 0 2024-04-15T00:36:00.057 INFO:tasks.workunit.client.0.smithi029.stdout:8/708: symlink d8/d4a/d78/d23/d28/d30/d39/lf1 0 2024-04-15T00:36:00.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/709: dread - d8/d4a/d78/d87/fb9 zero size 2024-04-15T00:36:00.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/710: readlink d8/da/l31 0 2024-04-15T00:36:00.084 INFO:tasks.workunit.client.0.smithi029.stdout:8/711: dread - d8/fad zero size 2024-04-15T00:36:00.097 INFO:tasks.workunit.client.0.smithi029.stdout:8/712: chown d8/d4a/d78/d23/fb2 9886302 1 2024-04-15T00:36:00.113 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:36:00.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:36:00.209 INFO:tasks.workunit.client.0.smithi029.stdout:2/708: symlink d3/dd/da0/le5 0 2024-04-15T00:36:00.425 INFO:tasks.workunit.client.0.smithi029.stdout:9/683: symlink d3/d6/d9/d29/d60/d7f/ld5 0 2024-04-15T00:36:00.427 INFO:tasks.workunit.client.0.smithi029.stdout:3/702: write d17/d2f/d3c/f4a [7748951,13762] 0 2024-04-15T00:36:00.445 INFO:tasks.workunit.client.0.smithi029.stdout:0/729: link d5/db/d1a/d50/ccb d5/db/d1a/cf2 0 2024-04-15T00:36:00.629 INFO:tasks.workunit.client.0.smithi029.stdout:2/709: truncate d3/dd/d42/f89 42617 0 2024-04-15T00:36:00.700 INFO:tasks.workunit.client.0.smithi029.stdout:7/699: mknod d0/d6/d4f/d5d/d65/dbc/dab/ce8 0 2024-04-15T00:36:00.748 INFO:tasks.workunit.client.0.smithi029.stdout:3/703: fdatasync d17/f24 0 2024-04-15T00:36:00.976 INFO:tasks.workunit.client.0.smithi029.stdout:9/684: fdatasync d3/d6/d9/f75 0 2024-04-15T00:36:01.158 INFO:tasks.workunit.client.0.smithi029.stdout:8/713: fdatasync d8/da/d2f/d6e/f94 0 2024-04-15T00:36:01.173 INFO:tasks.workunit.client.0.smithi029.stdout:2/710: dread - d3/d2a/d4e/db9/fa8 zero size 2024-04-15T00:36:01.209 INFO:tasks.workunit.client.0.smithi029.stdout:6/707: write d1/d8/f3d [4864518,123315] 0 2024-04-15T00:36:01.235 INFO:tasks.workunit.client.0.smithi029.stdout:5/724: write d2/d1a/fea [3810295,97122] 0 2024-04-15T00:36:01.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/704: mkdir d17/d2f/d44/d5a/dde 0 2024-04-15T00:36:01.489 INFO:tasks.workunit.client.0.smithi029.stdout:1/681: dwrite df/d32/f36 [4194304,4194304] 0 2024-04-15T00:36:01.574 INFO:tasks.workunit.client.0.smithi029.stdout:4/682: write de/df/f18 [696109,31545] 0 2024-04-15T00:36:01.704 INFO:tasks.workunit.client.0.smithi029.stdout:8/714: fdatasync d8/d4a/d78/d23/d28/d5f/fe9 0 2024-04-15T00:36:01.707 INFO:tasks.workunit.client.0.smithi029.stdout:2/711: read - d3/dd/fd9 zero size 2024-04-15T00:36:01.729 INFO:tasks.workunit.client.0.smithi029.stdout:8/715: chown d8/da/l31 40 1 2024-04-15T00:36:02.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/683: truncate de/d2b/d59/f6f 223000 0 2024-04-15T00:36:02.275 INFO:tasks.workunit.client.0.smithi029.stdout:2/712: fsync d3/d13/f83 0 2024-04-15T00:36:02.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/713: chown d3/dd/d2d 21810 1 2024-04-15T00:36:02.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/708: mknod d1/d1e/d56/dd3/cda 0 2024-04-15T00:36:02.536 INFO:tasks.workunit.client.0.smithi029.stdout:4/684: creat de/df/d1e/d56/dd3/fd8 x:0 0 0 2024-04-15T00:36:02.655 INFO:tasks.workunit.client.0.smithi029.stdout:2/714: mknod d3/d53/ce6 0 2024-04-15T00:36:02.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/709: fsync d1/f6 0 2024-04-15T00:36:02.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/685: write d3/d6/d9/d29/d60/d64/d6d/d58/fca [2644670,83521] 0 2024-04-15T00:36:02.779 INFO:tasks.workunit.client.0.smithi029.stdout:7/700: getdents d0/d6/d4f/d66/d37/dde 0 2024-04-15T00:36:02.784 INFO:tasks.workunit.client.0.smithi029.stdout:5/725: link d2/c29 d2/de/d13/d22/d3c/cf0 0 2024-04-15T00:36:02.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/701: chown d0/d6/d39/d3c/d5b/d7e/fb3 7 1 2024-04-15T00:36:02.927 INFO:tasks.workunit.client.0.smithi029.stdout:0/730: dwrite d5/d15/d27/d28/f82 [0,4194304] 0 2024-04-15T00:36:02.996 INFO:tasks.workunit.client.0.smithi029.stdout:2/715: creat d3/d13/d43/d9a/fe7 x:0 0 0 2024-04-15T00:36:03.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/710: dread d1/d8/db/d38/f8a [0,4194304] 0 2024-04-15T00:36:03.138 INFO:tasks.workunit.client.0.smithi029.stdout:6/711: chown d1/d8/d79/d9f/ca9 88701828 1 2024-04-15T00:36:03.174 INFO:tasks.workunit.client.0.smithi029.stdout:7/702: sync 2024-04-15T00:36:03.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/685: symlink de/d54/d71/d8b/db1/dd5/ld9 0 2024-04-15T00:36:03.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/686: symlink d3/d6/d9/d29/ld6 0 2024-04-15T00:36:03.486 INFO:tasks.workunit.client.0.smithi029.stdout:6/712: truncate d1/d1e/d22/fa6 3993930 0 2024-04-15T00:36:03.606 INFO:tasks.workunit.client.0.smithi029.stdout:5/726: rename d2/de/d13/d22/d26/d36/d4d/d70/d8d/lb1 to d2/d1a/d2d/lf1 0 2024-04-15T00:36:03.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/705: link d17/d2a/d33/fbd d17/fdf 0 2024-04-15T00:36:03.789 INFO:tasks.workunit.client.0.smithi029.stdout:0/731: fdatasync d5/db/d1a/d50/fd2 0 2024-04-15T00:36:03.798 INFO:tasks.workunit.client.0.smithi029.stdout:4/686: chown de/d54/d71/d8b/fd6 206269330 1 2024-04-15T00:36:03.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/687: readlink d3/d6/d30/lac 0 2024-04-15T00:36:03.975 INFO:tasks.workunit.client.0.smithi029.stdout:8/716: dwrite d8/da/d2f/d42/f54 [0,4194304] 0 2024-04-15T00:36:04.055 INFO:tasks.workunit.client.0.smithi029.stdout:6/713: rename d1/d8/db/c19 to d1/d8/d72/da3/cdb 0 2024-04-15T00:36:04.061 INFO:tasks.workunit.client.0.smithi029.stdout:9/688: readlink d3/d6/d9/d29/l4f 0 2024-04-15T00:36:04.162 INFO:tasks.workunit.client.0.smithi029.stdout:5/727: truncate d2/f11 2331531 0 2024-04-15T00:36:04.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/682: write df/f38 [859857,18657] 0 2024-04-15T00:36:04.306 INFO:tasks.workunit.client.0.smithi029.stdout:5/728: dread d2/d1a/f59 [0,4194304] 0 2024-04-15T00:36:04.335 INFO:tasks.workunit.client.0.smithi029.stdout:6/714: symlink d1/d1e/d56/dd3/ldc 0 2024-04-15T00:36:04.343 INFO:tasks.workunit.client.0.smithi029.stdout:9/689: mknod d3/d6/d9/d15/d7e/cd7 0 2024-04-15T00:36:04.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/732: dread d5/d15/d27/d51/d7d/faa [0,4194304] 0 2024-04-15T00:36:04.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/690: dread d3/d6/d9/d29/d60/d64/f8b [0,4194304] 0 2024-04-15T00:36:04.438 INFO:tasks.workunit.client.0.smithi029.stdout:7/703: creat d0/d74/fe9 x:0 0 0 2024-04-15T00:36:04.502 INFO:tasks.workunit.client.0.smithi029.stdout:8/717: symlink d8/da/d3d/lf2 0 2024-04-15T00:36:04.632 INFO:tasks.workunit.client.0.smithi029.stdout:0/733: creat d5/db/d1a/d50/ff3 x:0 0 0 2024-04-15T00:36:04.645 INFO:tasks.workunit.client.0.smithi029.stdout:6/715: read d1/d1e/d56/f76 [718229,116407] 0 2024-04-15T00:36:04.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/718: dread d8/d4a/d78/f89 [0,4194304] 0 2024-04-15T00:36:04.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/716: chown d1/d1e/f7e 0 1 2024-04-15T00:36:04.932 INFO:tasks.workunit.client.0.smithi029.stdout:4/687: creat de/d54/fda x:0 0 0 2024-04-15T00:36:04.935 INFO:tasks.workunit.client.0.smithi029.stdout:9/691: rmdir d3/d6/d9/d15/d4a/da9 39 2024-04-15T00:36:04.967 INFO:tasks.workunit.client.0.smithi029.stdout:4/688: write de/d54/d58/f68 [2977686,126820] 0 2024-04-15T00:36:04.988 INFO:tasks.workunit.client.0.smithi029.stdout:7/704: truncate d0/d6/d4f/d66/d26/f2b 2701150 0 2024-04-15T00:36:05.031 INFO:tasks.workunit.client.0.smithi029.stdout:4/689: readlink de/d2b/d35/l85 0 2024-04-15T00:36:05.105 INFO:tasks.workunit.client.0.smithi029.stdout:2/716: dwrite d3/d2a/d4e/db9/fa8 [0,4194304] 0 2024-04-15T00:36:05.177 INFO:tasks.workunit.client.0.smithi029.stdout:8/719: mkdir d8/da/d3d/d8a/df3 0 2024-04-15T00:36:05.181 INFO:tasks.workunit.client.0.smithi029.stdout:4/690: sync 2024-04-15T00:36:05.185 INFO:tasks.workunit.client.0.smithi029.stdout:6/717: mkdir d1/d1e/d22/ddd 0 2024-04-15T00:36:05.307 INFO:tasks.workunit.client.0.smithi029.stdout:0/734: dwrite d5/db/d1a/d50/da1/f9a [0,4194304] 0 2024-04-15T00:36:05.391 INFO:tasks.workunit.client.0.smithi029.stdout:7/705: unlink d0/d6/d4f/d66/d26/d77/d89/ccb 0 2024-04-15T00:36:05.432 INFO:tasks.workunit.client.0.smithi029.stdout:7/706: stat d0/d6/d39/ce2 0 2024-04-15T00:36:05.466 INFO:tasks.workunit.client.0.smithi029.stdout:9/692: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [0,4194304] 0 2024-04-15T00:36:05.548 INFO:tasks.workunit.client.0.smithi029.stdout:6/718: rmdir d1/d8/db/d7b 39 2024-04-15T00:36:05.788 INFO:tasks.workunit.client.0.smithi029.stdout:7/707: creat d0/d69/fea x:0 0 0 2024-04-15T00:36:05.797 INFO:tasks.workunit.client.0.smithi029.stdout:3/706: dwrite f1 [0,4194304] 0 2024-04-15T00:36:05.967 INFO:tasks.workunit.client.0.smithi029.stdout:1/683: write df/f1c [1379298,16442] 0 2024-04-15T00:36:06.045 INFO:tasks.workunit.client.0.smithi029.stdout:5/729: dwrite d2/de/d13/d22/d26/f6f [4194304,4194304] 0 2024-04-15T00:36:06.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/735: write d5/d15/d1f/f73 [1823816,59861] 0 2024-04-15T00:36:06.670 INFO:tasks.workunit.client.0.smithi029.stdout:4/691: dwrite de/d54/d71/d8b/fd6 [0,4194304] 0 2024-04-15T00:36:06.737 INFO:tasks.workunit.client.0.smithi029.stdout:3/707: rename d17/d83/f65 to d17/d2f/d44/d58/d5c/d5f/db5/fe0 0 2024-04-15T00:36:06.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/730: truncate d2/f17 8170475 0 2024-04-15T00:36:06.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/720: write d8/d4a/d78/d23/f57 [5000181,108767] 0 2024-04-15T00:36:06.843 INFO:tasks.workunit.client.0.smithi029.stdout:5/731: stat d2/de/d13/daa 0 2024-04-15T00:36:06.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/721: chown d8/da7/ld2 16535 1 2024-04-15T00:36:06.915 INFO:tasks.workunit.client.0.smithi029.stdout:5/732: dread d2/de/d13/d22/f40 [4194304,4194304] 0 2024-04-15T00:36:06.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/733: stat d2/f4 0 2024-04-15T00:36:07.335 INFO:tasks.workunit.client.0.smithi029.stdout:0/736: rename d5/d3e/de3/f8c to d5/d15/d27/d9f/ddb/ff4 0 2024-04-15T00:36:07.354 INFO:tasks.workunit.client.0.smithi029.stdout:0/737: read d5/d15/d1f/f73 [223231,78818] 0 2024-04-15T00:36:07.397 INFO:tasks.workunit.client.0.smithi029.stdout:2/717: getdents d3/d50/d51/d65 0 2024-04-15T00:36:07.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/719: write d1/d8/db/f48 [6464769,63833] 0 2024-04-15T00:36:07.534 INFO:tasks.workunit.client.0.smithi029.stdout:5/734: truncate d2/de/d13/d22/d26/dd7/fe0 7493765 0 2024-04-15T00:36:07.540 INFO:tasks.workunit.client.0.smithi029.stdout:0/738: sync 2024-04-15T00:36:07.588 INFO:tasks.workunit.client.0.smithi029.stdout:1/684: creat df/d32/ff0 x:0 0 0 2024-04-15T00:36:07.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/693: dwrite d3/d6/d9/d29/d60/d64/f8b [0,4194304] 0 2024-04-15T00:36:07.799 INFO:tasks.workunit.client.0.smithi029.stdout:7/708: dwrite d0/d6/d4f/f7f [0,4194304] 0 2024-04-15T00:36:07.866 INFO:tasks.workunit.client.0.smithi029.stdout:6/720: mkdir d1/d1e/d56/dd3/dde 0 2024-04-15T00:36:07.957 INFO:tasks.workunit.client.0.smithi029.stdout:6/721: sync 2024-04-15T00:36:08.239 INFO:tasks.workunit.client.0.smithi029.stdout:0/739: rename d5/d15/d1f/dd3/fe7 to d5/d3e/ff5 0 2024-04-15T00:36:08.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/694: rmdir d3/d6/d9/d15/d62 39 2024-04-15T00:36:08.413 INFO:tasks.workunit.client.0.smithi029.stdout:3/708: getdents d17/d2f/d76/d7f 0 2024-04-15T00:36:08.431 INFO:tasks.workunit.client.0.smithi029.stdout:6/722: dread d1/d8/db/d38/f68 [0,4194304] 0 2024-04-15T00:36:08.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/709: stat d17/d83/f6d 0 2024-04-15T00:36:08.845 INFO:tasks.workunit.client.0.smithi029.stdout:0/740: mkdir d5/d15/d27/dbb/dbd/df6 0 2024-04-15T00:36:08.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/692: unlink de/d54/fa1 0 2024-04-15T00:36:08.867 INFO:tasks.workunit.client.0.smithi029.stdout:8/722: write d8/da/d2f/d66/fb8 [245380,103153] 0 2024-04-15T00:36:08.904 INFO:tasks.workunit.client.0.smithi029.stdout:8/723: stat d8/da/d2f/d6e/l71 0 2024-04-15T00:36:08.919 INFO:tasks.workunit.client.0.smithi029.stdout:8/724: chown d8/d4a/d78/d23/d28/d30/la6 6 1 2024-04-15T00:36:09.098 INFO:tasks.workunit.client.0.smithi029.stdout:3/710: mkdir d17/d2f/d76/de1 0 2024-04-15T00:36:09.186 INFO:tasks.workunit.client.0.smithi029.stdout:4/693: creat de/df/d1e/fdb x:0 0 0 2024-04-15T00:36:09.222 INFO:tasks.workunit.client.0.smithi029.stdout:2/718: dwrite d3/dd/d2d/d61/d85/fbf [0,4194304] 0 2024-04-15T00:36:09.307 INFO:tasks.workunit.client.0.smithi029.stdout:9/695: getdents d3/d6/d9/d29/d60/d64/d6d 0 2024-04-15T00:36:09.350 INFO:tasks.workunit.client.0.smithi029.stdout:2/719: read - d3/d53/fc5 zero size 2024-04-15T00:36:09.399 INFO:tasks.workunit.client.0.smithi029.stdout:0/741: dwrite d5/d3e/de3/f95 [0,4194304] 0 2024-04-15T00:36:09.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/742: readlink d5/db/d1a/d65/la2 0 2024-04-15T00:36:09.533 INFO:tasks.workunit.client.0.smithi029.stdout:8/725: creat d8/ff4 x:0 0 0 2024-04-15T00:36:09.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/735: write d2/de/d1f/dc2/fe3 [983118,88692] 0 2024-04-15T00:36:09.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/694: symlink de/d54/d58/d8a/ldc 0 2024-04-15T00:36:09.906 INFO:tasks.workunit.client.0.smithi029.stdout:1/685: dwrite df/d32/d90/dc1/fd4 [0,4194304] 0 2024-04-15T00:36:09.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/709: dwrite d0/d6/f25 [0,4194304] 0 2024-04-15T00:36:10.014 INFO:tasks.workunit.client.0.smithi029.stdout:6/723: dwrite d1/d8/d72/f87 [0,4194304] 0 2024-04-15T00:36:10.021 INFO:tasks.workunit.client.0.smithi029.stdout:5/736: read d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fb3 [5604963,101649] 0 2024-04-15T00:36:10.091 INFO:tasks.workunit.client.0.smithi029.stdout:7/710: sync 2024-04-15T00:36:10.102 INFO:tasks.workunit.client.0.smithi029.stdout:8/726: dread - d8/da/d3d/d8a/fcd zero size 2024-04-15T00:36:10.193 INFO:tasks.workunit.client.0.smithi029.stdout:9/696: write d3/f4e [2566358,121277] 0 2024-04-15T00:36:10.211 INFO:tasks.workunit.client.0.smithi029.stdout:3/711: getdents d17/d2f/d84/db1 0 2024-04-15T00:36:10.370 INFO:tasks.workunit.client.0.smithi029.stdout:2/720: creat d3/d13/d43/fe8 x:0 0 0 2024-04-15T00:36:10.386 INFO:tasks.workunit.client.0.smithi029.stdout:1/686: symlink df/d32/d7c/lf1 0 2024-04-15T00:36:10.399 INFO:tasks.workunit.client.0.smithi029.stdout:4/695: rename de/d2b/c44 to de/df/d1e/cdd 0 2024-04-15T00:36:10.405 INFO:tasks.workunit.client.0.smithi029.stdout:6/724: dread d1/d8/db/fe [0,4194304] 0 2024-04-15T00:36:10.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/743: dwrite d5/db/d1a/d65/d76/fe1 [0,4194304] 0 2024-04-15T00:36:10.571 INFO:tasks.workunit.client.0.smithi029.stdout:8/727: creat d8/d4a/d78/d23/d28/d30/d39/ff5 x:0 0 0 2024-04-15T00:36:10.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/744: stat d5/db/d1a/la0 0 2024-04-15T00:36:10.770 INFO:tasks.workunit.client.0.smithi029.stdout:5/737: dread d2/f11 [0,4194304] 0 2024-04-15T00:36:10.888 INFO:tasks.workunit.client.0.smithi029.stdout:9/697: symlink d3/d6/d9/ld8 0 2024-04-15T00:36:10.903 INFO:tasks.workunit.client.0.smithi029.stdout:2/721: dread d3/dd/d2d/d61/dd5/f74 [0,4194304] 0 2024-04-15T00:36:10.903 INFO:tasks.workunit.client.0.smithi029.stdout:6/725: mkdir d1/d1e/d56/dd3/ddf 0 2024-04-15T00:36:10.915 INFO:tasks.workunit.client.0.smithi029.stdout:4/696: dread - de/df/d1e/d56/dd3/fd8 zero size 2024-04-15T00:36:10.930 INFO:tasks.workunit.client.0.smithi029.stdout:7/711: dwrite d0/d6/f18 [0,4194304] 0 2024-04-15T00:36:10.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/745: unlink d5/d15/d1f/fd1 0 2024-04-15T00:36:11.048 INFO:tasks.workunit.client.0.smithi029.stdout:7/712: readlink d0/d6/d4f/d66/d37/db7/dda/l5f 0 2024-04-15T00:36:11.070 INFO:tasks.workunit.client.0.smithi029.stdout:3/712: link d17/d2a/d46/d67/f8a d17/d2a/d4c/fe2 0 2024-04-15T00:36:11.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/713: chown d0/d6/d4f/d66/d26/f33 603 1 2024-04-15T00:36:11.075 INFO:tasks.workunit.client.0.smithi029.stdout:5/738: readlink d2/l5 0 2024-04-15T00:36:11.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/739: readlink d2/da5/dc8/le1 0 2024-04-15T00:36:11.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/722: mknod d3/dd/d42/dd1/ce9 0 2024-04-15T00:36:11.445 INFO:tasks.workunit.client.0.smithi029.stdout:0/746: unlink d5/d15/d27/d51/d77/cd0 0 2024-04-15T00:36:11.571 INFO:tasks.workunit.client.0.smithi029.stdout:6/726: dread d1/d1e/f32 [0,4194304] 0 2024-04-15T00:36:11.662 INFO:tasks.workunit.client.0.smithi029.stdout:1/687: link df/f1c df/d29/d41/d69/d78/dd1/d80/d94/ff2 0 2024-04-15T00:36:11.666 INFO:tasks.workunit.client.0.smithi029.stdout:3/713: fdatasync d17/d2f/d76/d7f/fa7 0 2024-04-15T00:36:11.683 INFO:tasks.workunit.client.0.smithi029.stdout:1/688: stat df/d29/d41/d96 0 2024-04-15T00:36:11.725 INFO:tasks.workunit.client.0.smithi029.stdout:5/740: rmdir d2/de/d13/d22/d26/d36/d4d/d70/d9a 39 2024-04-15T00:36:11.731 INFO:tasks.workunit.client.0.smithi029.stdout:8/728: link d8/d4a/d78/d23/f57 d8/da/d2f/d42/ff6 0 2024-04-15T00:36:11.732 INFO:tasks.workunit.client.0.smithi029.stdout:7/714: symlink d0/d6/d4f/d5d/d65/leb 0 2024-04-15T00:36:11.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/729: chown d8/d4a/d78/dca/fdc 9 1 2024-04-15T00:36:11.788 INFO:tasks.workunit.client.0.smithi029.stdout:5/741: dread d2/de/d13/d22/d3c/f50 [0,4194304] 0 2024-04-15T00:36:12.187 INFO:tasks.workunit.client.0.smithi029.stdout:4/697: mkdir de/d6d/dde 0 2024-04-15T00:36:12.250 INFO:tasks.workunit.client.0.smithi029.stdout:2/723: fdatasync d3/d2a/f3a 0 2024-04-15T00:36:12.261 INFO:tasks.workunit.client.0.smithi029.stdout:2/724: chown d3/d50/d51/d65 30352 1 2024-04-15T00:36:12.314 INFO:tasks.workunit.client.0.smithi029.stdout:0/747: creat d5/d15/d27/d9f/ddb/ff7 x:0 0 0 2024-04-15T00:36:12.328 INFO:tasks.workunit.client.0.smithi029.stdout:0/748: read d5/f7 [269466,90537] 0 2024-04-15T00:36:12.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/698: dwrite d3/d6/d9/d29/d60/d7f/f82 [4194304,4194304] 0 2024-04-15T00:36:12.544 INFO:tasks.workunit.client.0.smithi029.stdout:1/689: creat df/d32/d90/dc1/ff3 x:0 0 0 2024-04-15T00:36:12.549 INFO:tasks.workunit.client.0.smithi029.stdout:3/714: truncate d17/d2f/d44/d58/d5c/d5f/fba 207557 0 2024-04-15T00:36:12.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/730: dread - d8/da/d2f/d42/d75/fc9 zero size 2024-04-15T00:36:13.116 INFO:tasks.workunit.client.0.smithi029.stdout:5/742: symlink d2/de/d13/d22/lf2 0 2024-04-15T00:36:13.280 INFO:tasks.workunit.client.0.smithi029.stdout:4/698: creat de/d6d/dde/fdf x:0 0 0 2024-04-15T00:36:13.288 INFO:tasks.workunit.client.0.smithi029.stdout:4/699: readlink de/d2b/lc6 0 2024-04-15T00:36:13.293 INFO:tasks.workunit.client.0.smithi029.stdout:4/700: chown de/lbc 1998 1 2024-04-15T00:36:13.413 INFO:tasks.workunit.client.0.smithi029.stdout:1/690: mkdir df/d29/d41/d69/d4c/df4 0 2024-04-15T00:36:13.573 INFO:tasks.workunit.client.0.smithi029.stdout:6/727: dwrite d1/d1e/f7e [0,4194304] 0 2024-04-15T00:36:13.639 INFO:tasks.workunit.client.0.smithi029.stdout:9/699: creat d3/d6/fd9 x:0 0 0 2024-04-15T00:36:13.707 INFO:tasks.workunit.client.0.smithi029.stdout:7/715: getdents d0/d6/d4f/d66/d26 0 2024-04-15T00:36:13.737 INFO:tasks.workunit.client.0.smithi029.stdout:7/716: dread d0/d6/d4f/d5d/f6d [0,4194304] 0 2024-04-15T00:36:13.785 INFO:tasks.workunit.client.0.smithi029.stdout:0/749: getdents d5/d15/d57 0 2024-04-15T00:36:13.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/728: mknod d1/db9/ce0 0 2024-04-15T00:36:13.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/715: write d17/fa6 [1024364,124971] 0 2024-04-15T00:36:13.921 INFO:tasks.workunit.client.0.smithi029.stdout:2/725: dwrite d3/dd/fd9 [0,4194304] 0 2024-04-15T00:36:13.928 INFO:tasks.workunit.client.0.smithi029.stdout:8/731: write d8/da/fe7 [943225,85926] 0 2024-04-15T00:36:14.246 INFO:tasks.workunit.client.0.smithi029.stdout:3/716: creat d17/d2f/d44/d5a/fe3 x:0 0 0 2024-04-15T00:36:14.261 INFO:tasks.workunit.client.0.smithi029.stdout:5/743: write d2/de/d13/d22/d3c/f9f [838670,22461] 0 2024-04-15T00:36:14.403 INFO:tasks.workunit.client.0.smithi029.stdout:4/701: dwrite de/df/f18 [4194304,4194304] 0 2024-04-15T00:36:14.481 INFO:tasks.workunit.client.0.smithi029.stdout:6/729: creat d1/d1e/d22/ddd/fe1 x:0 0 0 2024-04-15T00:36:14.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/717: creat d0/d6/d39/d3c/fec x:0 0 0 2024-04-15T00:36:14.498 INFO:tasks.workunit.client.0.smithi029.stdout:3/717: rmdir d17/d2f/d84 39 2024-04-15T00:36:14.580 INFO:tasks.workunit.client.0.smithi029.stdout:1/691: dwrite df/d29/d41/d69/d78/f6f [0,4194304] 0 2024-04-15T00:36:14.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/700: truncate d3/f4e 5760365 0 2024-04-15T00:36:14.763 INFO:tasks.workunit.client.0.smithi029.stdout:7/718: mkdir d0/d69/ded 0 2024-04-15T00:36:14.843 INFO:tasks.workunit.client.0.smithi029.stdout:6/730: mknod d1/d8/d72/ce2 0 2024-04-15T00:36:14.878 INFO:tasks.workunit.client.0.smithi029.stdout:7/719: chown d0/d6/d4f/d5d/d65/dbc/dab/ce8 9048 1 2024-04-15T00:36:14.919 INFO:tasks.workunit.client.0.smithi029.stdout:0/750: dwrite d5/d15/d57/f60 [0,4194304] 0 2024-04-15T00:36:15.018 INFO:tasks.workunit.client.0.smithi029.stdout:5/744: write d2/de/fb0 [462153,20846] 0 2024-04-15T00:36:15.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/692: dread - df/d29/d41/daf/fc9 zero size 2024-04-15T00:36:15.165 INFO:tasks.workunit.client.0.smithi029.stdout:2/726: dwrite d3/dd/d2d/d61/d85/da2/fc3 [0,4194304] 0 2024-04-15T00:36:15.260 INFO:tasks.workunit.client.0.smithi029.stdout:4/702: write de/d54/d71/da3/fb2 [1932946,87615] 0 2024-04-15T00:36:15.359 INFO:tasks.workunit.client.0.smithi029.stdout:1/693: dread df/d29/d41/fc6 [0,4194304] 0 2024-04-15T00:36:15.370 INFO:tasks.workunit.client.0.smithi029.stdout:8/732: dwrite d8/da/d2f/d66/f67 [0,4194304] 0 2024-04-15T00:36:15.370 INFO:tasks.workunit.client.0.smithi029.stdout:7/720: mkdir d0/d6/d39/d3c/d5b/dee 0 2024-04-15T00:36:15.568 INFO:tasks.workunit.client.0.smithi029.stdout:9/701: symlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/lda 0 2024-04-15T00:36:15.784 INFO:tasks.workunit.client.0.smithi029.stdout:0/751: creat d5/d54/dec/ff8 x:0 0 0 2024-04-15T00:36:15.813 INFO:tasks.workunit.client.0.smithi029.stdout:1/694: rmdir df/d29/d41/daf 39 2024-04-15T00:36:15.819 INFO:tasks.workunit.client.0.smithi029.stdout:6/731: write d1/d8/db/d38/f67 [508723,38195] 0 2024-04-15T00:36:16.047 INFO:tasks.workunit.client.0.smithi029.stdout:8/733: rename d8/d4a/d78/d23/d28/d30/d39/fdf to d8/da/d2f/d6e/dc1/ff7 0 2024-04-15T00:36:16.184 INFO:tasks.workunit.client.0.smithi029.stdout:2/727: write d3/d2a/d6d/f73 [684607,70844] 0 2024-04-15T00:36:16.186 INFO:tasks.workunit.client.0.smithi029.stdout:5/745: write d2/de/d13/d22/d3c/f4b [184367,58326] 0 2024-04-15T00:36:16.583 INFO:tasks.workunit.client.0.smithi029.stdout:3/718: link d17/d2f/d44/d58/d5c/d5f/fba d17/d2f/d76/d7f/fe4 0 2024-04-15T00:36:16.646 INFO:tasks.workunit.client.0.smithi029.stdout:7/721: write d0/d6/d4f/d66/d26/d77/f96 [1398999,69641] 0 2024-04-15T00:36:16.702 INFO:tasks.workunit.client.0.smithi029.stdout:0/752: dread d5/db/d1a/d65/d76/fe1 [0,4194304] 0 2024-04-15T00:36:16.808 INFO:tasks.workunit.client.0.smithi029.stdout:4/703: write de/d54/f81 [2187981,27941] 0 2024-04-15T00:36:16.840 INFO:tasks.workunit.client.0.smithi029.stdout:8/734: mknod d8/d4a/d78/d23/cf8 0 2024-04-15T00:36:17.081 INFO:tasks.workunit.client.0.smithi029.stdout:2/728: mkdir d3/d93/dbe/dea 0 2024-04-15T00:36:17.083 INFO:tasks.workunit.client.0.smithi029.stdout:9/702: truncate d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb3 765377 0 2024-04-15T00:36:17.344 INFO:tasks.workunit.client.0.smithi029.stdout:3/719: rmdir d17/d2a/d4c/da1 39 2024-04-15T00:36:17.351 INFO:tasks.workunit.client.0.smithi029.stdout:7/722: fdatasync d0/d6/d39/d3c/d5b/fa4 0 2024-04-15T00:36:17.470 INFO:tasks.workunit.client.0.smithi029.stdout:8/735: creat d8/d4a/d78/ff9 x:0 0 0 2024-04-15T00:36:17.473 INFO:tasks.workunit.client.0.smithi029.stdout:4/704: fdatasync de/d2b/d59/f86 0 2024-04-15T00:36:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:2/729: creat d3/d2a/d4e/feb x:0 0 0 2024-04-15T00:36:17.672 INFO:tasks.workunit.client.0.smithi029.stdout:2/730: dread d3/f5 [0,4194304] 0 2024-04-15T00:36:17.729 INFO:tasks.workunit.client.0.smithi029.stdout:3/720: fdatasync d17/d2a/d4c/d93/fb3 0 2024-04-15T00:36:17.739 INFO:tasks.workunit.client.0.smithi029.stdout:3/721: stat ff 0 2024-04-15T00:36:17.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/732: write d1/d8/db/d38/d86/f88 [839369,39480] 0 2024-04-15T00:36:17.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/705: creat de/d6d/dde/fe0 x:0 0 0 2024-04-15T00:36:17.934 INFO:tasks.workunit.client.0.smithi029.stdout:0/753: link d5/db/d1a/d65/cb8 d5/d15/d27/dbb/dbd/df6/cf9 0 2024-04-15T00:36:17.949 INFO:tasks.workunit.client.0.smithi029.stdout:0/754: read d5/d3e/de3/f49 [2962957,49862] 0 2024-04-15T00:36:18.012 INFO:tasks.workunit.client.0.smithi029.stdout:1/695: rmdir df/d32/db2 39 2024-04-15T00:36:18.067 INFO:tasks.workunit.client.0.smithi029.stdout:2/731: creat d3/d53/fec x:0 0 0 2024-04-15T00:36:18.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/723: write d0/d6/d4f/d66/d37/db7/dda/f57 [449232,76300] 0 2024-04-15T00:36:18.715 INFO:tasks.workunit.client.0.smithi029.stdout:5/746: dwrite d2/f95 [0,4194304] 0 2024-04-15T00:36:18.848 INFO:tasks.workunit.client.0.smithi029.stdout:2/732: symlink d3/dd/d42/dc6/db1/led 0 2024-04-15T00:36:18.853 INFO:tasks.workunit.client.0.smithi029.stdout:6/733: dread d1/d8/d72/fb3 [0,4194304] 0 2024-04-15T00:36:18.894 INFO:tasks.workunit.client.0.smithi029.stdout:3/722: creat d17/d2f/d84/db1/fe5 x:0 0 0 2024-04-15T00:36:18.959 INFO:tasks.workunit.client.0.smithi029.stdout:8/736: link d8/da/d3d/fa9 d8/da/d2f/d6e/d5a/ffa 0 2024-04-15T00:36:18.998 INFO:tasks.workunit.client.0.smithi029.stdout:6/734: chown d1/d8/faf 24380 1 2024-04-15T00:36:19.001 INFO:tasks.workunit.client.0.smithi029.stdout:4/706: dread de/d2b/d35/f49 [0,4194304] 0 2024-04-15T00:36:19.326 INFO:tasks.workunit.client.0.smithi029.stdout:0/755: truncate d5/f62 1119232 0 2024-04-15T00:36:19.329 INFO:tasks.workunit.client.0.smithi029.stdout:1/696: write df/f3e [601706,13789] 0 2024-04-15T00:36:19.337 INFO:tasks.workunit.client.0.smithi029.stdout:5/747: symlink d2/de/d13/dd2/lf3 0 2024-04-15T00:36:19.348 INFO:tasks.workunit.client.0.smithi029.stdout:3/723: symlink d17/d83/le6 0 2024-04-15T00:36:19.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/703: link d3/d6/d9/d15/d7e/l9b d3/d6/ldb 0 2024-04-15T00:36:19.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/707: truncate de/d54/d58/fd1 897342 0 2024-04-15T00:36:19.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/748: chown d2/de/d13/d22/d26/d36/d4d/f8f 61 1 2024-04-15T00:36:19.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/733: dread d3/dd/d42/dc6/db1/fd2 [0,4194304] 0 2024-04-15T00:36:19.608 INFO:tasks.workunit.client.0.smithi029.stdout:7/724: creat d0/d6/d39/d3c/fef x:0 0 0 2024-04-15T00:36:19.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/756: rmdir d5/db/d8f 39 2024-04-15T00:36:19.732 INFO:tasks.workunit.client.0.smithi029.stdout:5/749: stat d2/l3 0 2024-04-15T00:36:19.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/737: dwrite d8/da/f5b [0,4194304] 0 2024-04-15T00:36:19.860 INFO:tasks.workunit.client.0.smithi029.stdout:1/697: mknod df/d29/d41/d69/cf5 0 2024-04-15T00:36:19.862 INFO:tasks.workunit.client.0.smithi029.stdout:6/735: creat d1/d8/fe3 x:0 0 0 2024-04-15T00:36:19.950 INFO:tasks.workunit.client.0.smithi029.stdout:3/724: mknod d17/d2f/d44/d5a/dde/ce7 0 2024-04-15T00:36:19.967 INFO:tasks.workunit.client.0.smithi029.stdout:7/725: mkdir d0/d6/d4f/d66/df0 0 2024-04-15T00:36:19.984 INFO:tasks.workunit.client.0.smithi029.stdout:2/734: sync 2024-04-15T00:36:20.016 INFO:tasks.workunit.client.0.smithi029.stdout:9/704: write d3/d6/d9/d15/d4a/d53/f5b [3274979,22099] 0 2024-04-15T00:36:20.084 INFO:tasks.workunit.client.0.smithi029.stdout:2/735: chown d3/dd/d2d/d61/dd5/dcf/dc9 3380 1 2024-04-15T00:36:20.089 INFO:tasks.workunit.client.0.smithi029.stdout:4/708: dwrite f3 [0,4194304] 0 2024-04-15T00:36:20.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/757: mkdir d5/d15/d57/d5e/dfa 0 2024-04-15T00:36:20.387 INFO:tasks.workunit.client.0.smithi029.stdout:1/698: fsync df/d32/d7c/fa5 0 2024-04-15T00:36:20.395 INFO:tasks.workunit.client.0.smithi029.stdout:6/736: truncate d1/d8/db/f4d 1191131 0 2024-04-15T00:36:20.530 INFO:tasks.workunit.client.0.smithi029.stdout:4/709: fdatasync de/d2b/d59/f86 0 2024-04-15T00:36:20.535 INFO:tasks.workunit.client.0.smithi029.stdout:7/726: truncate d0/d6/d4f/d66/d37/db7/dda/fc 4970603 0 2024-04-15T00:36:20.925 INFO:tasks.workunit.client.0.smithi029.stdout:4/710: creat de/d6d/dde/fe1 x:0 0 0 2024-04-15T00:36:21.048 INFO:tasks.workunit.client.0.smithi029.stdout:5/750: write d2/de/d13/d22/d26/d36/d4d/f51 [56877,15713] 0 2024-04-15T00:36:21.103 INFO:tasks.workunit.client.0.smithi029.stdout:6/737: mkdir d1/d8/db/d38/de4 0 2024-04-15T00:36:21.109 INFO:tasks.workunit.client.0.smithi029.stdout:6/738: chown d1/c7 11 1 2024-04-15T00:36:21.176 INFO:tasks.workunit.client.0.smithi029.stdout:5/751: sync 2024-04-15T00:36:21.295 INFO:tasks.workunit.client.0.smithi029.stdout:8/738: truncate d8/da/d2f/d66/f67 2044183 0 2024-04-15T00:36:21.635 INFO:tasks.workunit.client.0.smithi029.stdout:0/758: write d5/db/d1a/d50/fd2 [1118409,9919] 0 2024-04-15T00:36:21.640 INFO:tasks.workunit.client.0.smithi029.stdout:2/736: rmdir d3/d93/dbe/dca 0 2024-04-15T00:36:21.751 INFO:tasks.workunit.client.0.smithi029.stdout:1/699: dwrite df/d29/fe5 [0,4194304] 0 2024-04-15T00:36:21.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/705: truncate d3/d6/d9/d15/d4a/d53/f5b 2727630 0 2024-04-15T00:36:21.855 INFO:tasks.workunit.client.0.smithi029.stdout:3/725: getdents d17/d2a/d46/d67 0 2024-04-15T00:36:21.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/739: mkdir d1/d1e/d56/dd3/de5 0 2024-04-15T00:36:21.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/711: creat de/d54/d71/da3/fe2 x:0 0 0 2024-04-15T00:36:21.918 INFO:tasks.workunit.client.0.smithi029.stdout:5/752: chown d2/d1a/f83 942129094 1 2024-04-15T00:36:22.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/759: creat d5/db/d1a/d65/d76/daf/ffb x:0 0 0 2024-04-15T00:36:22.595 INFO:tasks.workunit.client.0.smithi029.stdout:3/726: creat d17/d2f/d76/fe8 x:0 0 0 2024-04-15T00:36:22.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/740: creat d1/d8/d72/fe6 x:0 0 0 2024-04-15T00:36:22.737 INFO:tasks.workunit.client.0.smithi029.stdout:9/706: symlink d3/d6/d9/d29/d60/d64/ldc 0 2024-04-15T00:36:22.958 INFO:tasks.workunit.client.0.smithi029.stdout:3/727: symlink d17/d2f/d44/d68/le9 0 2024-04-15T00:36:23.110 INFO:tasks.workunit.client.0.smithi029.stdout:9/707: fdatasync d3/d6/d9/f49 0 2024-04-15T00:36:23.113 INFO:tasks.workunit.client.0.smithi029.stdout:7/727: write d0/f24 [1804383,38524] 0 2024-04-15T00:36:23.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/760: symlink d5/d4c/lfc 0 2024-04-15T00:36:23.207 INFO:tasks.workunit.client.0.smithi029.stdout:8/739: write d8/d4a/d78/d23/d28/d5f/fe9 [404593,102803] 0 2024-04-15T00:36:23.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/712: link de/d54/d58/d8a/f98 de/d6d/dde/fe3 0 2024-04-15T00:36:23.589 INFO:tasks.workunit.client.0.smithi029.stdout:7/728: dread d0/d6/d39/d3c/d5b/d7e/fb3 [0,4194304] 0 2024-04-15T00:36:23.903 INFO:tasks.workunit.client.0.smithi029.stdout:3/728: creat d17/d2a/d4c/fea x:0 0 0 2024-04-15T00:36:23.996 INFO:tasks.workunit.client.0.smithi029.stdout:7/729: getdents d0/d6/d4f/d5d/d8d 0 2024-04-15T00:36:24.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/700: dwrite df/d29/f4b [0,4194304] 0 2024-04-15T00:36:24.222 INFO:tasks.workunit.client.0.smithi029.stdout:3/729: creat d17/d2f/d76/d7f/feb x:0 0 0 2024-04-15T00:36:24.254 INFO:tasks.workunit.client.0.smithi029.stdout:7/730: fsync d0/d6/d4f/d5d/d65/dbc/f92 0 2024-04-15T00:36:24.373 INFO:tasks.workunit.client.0.smithi029.stdout:4/713: getdents de 0 2024-04-15T00:36:24.490 INFO:tasks.workunit.client.0.smithi029.stdout:5/753: dwrite d2/de/d13/d22/d3c/d41/d6d/f77 [0,4194304] 0 2024-04-15T00:36:24.561 INFO:tasks.workunit.client.0.smithi029.stdout:7/731: truncate d0/d6/d4f/d5d/d82/fc1 1265182 0 2024-04-15T00:36:24.621 INFO:tasks.workunit.client.0.smithi029.stdout:2/737: dwrite d3/dd/f27 [0,4194304] 0 2024-04-15T00:36:24.805 INFO:tasks.workunit.client.0.smithi029.stdout:6/741: write d1/f12 [2092779,94624] 0 2024-04-15T00:36:24.838 INFO:tasks.workunit.client.0.smithi029.stdout:0/761: write d5/d3e/f7a [1666107,17255] 0 2024-04-15T00:36:24.975 INFO:tasks.workunit.client.0.smithi029.stdout:5/754: mkdir d2/de/d13/d22/d26/d36/d4d/df4 0 2024-04-15T00:36:25.083 INFO:tasks.workunit.client.0.smithi029.stdout:1/701: write df/f22 [2924874,94602] 0 2024-04-15T00:36:25.086 INFO:tasks.workunit.client.0.smithi029.stdout:9/708: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/f32 [0,4194304] 0 2024-04-15T00:36:25.157 INFO:tasks.workunit.client.0.smithi029.stdout:8/740: dwrite d8/d4a/d78/d23/d28/d30/d39/d77/fbb [4194304,4194304] 0 2024-04-15T00:36:25.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/732: write d0/d6/f2c [1336650,36751] 0 2024-04-15T00:36:25.262 INFO:tasks.workunit.client.0.smithi029.stdout:2/738: write d3/dd/d42/f76 [1770671,120777] 0 2024-04-15T00:36:25.399 INFO:tasks.workunit.client.0.smithi029.stdout:4/714: dwrite de/df/d1e/f24 [0,4194304] 0 2024-04-15T00:36:25.489 INFO:tasks.workunit.client.0.smithi029.stdout:3/730: rename d17/d2a/d4c/fe2 to d17/fec 0 2024-04-15T00:36:25.492 INFO:tasks.workunit.client.0.smithi029.stdout:5/755: unlink d2/d1a/f83 0 2024-04-15T00:36:25.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/715: sync 2024-04-15T00:36:25.712 INFO:tasks.workunit.client.0.smithi029.stdout:1/702: creat df/d29/d41/d4f/ff6 x:0 0 0 2024-04-15T00:36:25.759 INFO:tasks.workunit.client.0.smithi029.stdout:7/733: fdatasync d0/d6/d4f/d66/d26/f38 0 2024-04-15T00:36:25.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/762: write d5/d15/d68/fc7 [473944,22100] 0 2024-04-15T00:36:25.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/709: dread d3/d6/d9/d15/d4a/f4b [0,4194304] 0 2024-04-15T00:36:25.993 INFO:tasks.workunit.client.0.smithi029.stdout:9/710: sync 2024-04-15T00:36:26.040 INFO:tasks.workunit.client.0.smithi029.stdout:4/716: mknod de/d54/d71/d8b/ce4 0 2024-04-15T00:36:26.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/742: dwrite d1/d8/db/d7b/d85/dd2/f73 [0,4194304] 0 2024-04-15T00:36:26.221 INFO:tasks.workunit.client.0.smithi029.stdout:2/739: write d3/d2a/f3a [1437972,96916] 0 2024-04-15T00:36:26.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/763: rmdir d5/db 39 2024-04-15T00:36:26.289 INFO:tasks.workunit.client.0.smithi029.stdout:3/731: write d17/d2f/d76/d7f/dcd/fd2 [683982,5890] 0 2024-04-15T00:36:26.342 INFO:tasks.workunit.client.0.smithi029.stdout:5/756: fdatasync d2/de/d13/d22/d3c/fae 0 2024-04-15T00:36:26.907 INFO:tasks.workunit.client.0.smithi029.stdout:1/703: dwrite df/d32/d90/dc1/fd4 [0,4194304] 0 2024-04-15T00:36:26.991 INFO:tasks.workunit.client.0.smithi029.stdout:7/734: mknod d0/d6/d4f/d5d/d82/db9/cf1 0 2024-04-15T00:36:27.140 INFO:tasks.workunit.client.0.smithi029.stdout:6/743: dread d1/d1e/d56/f62 [0,4194304] 0 2024-04-15T00:36:27.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/764: stat d5/db/d1a/d50/da1 0 2024-04-15T00:36:27.184 INFO:tasks.workunit.client.0.smithi029.stdout:3/732: creat d17/d2f/d44/d58/d5c/d5f/db5/fed x:0 0 0 2024-04-15T00:36:27.652 INFO:tasks.workunit.client.0.smithi029.stdout:1/704: mknod df/d29/cf7 0 2024-04-15T00:36:27.813 INFO:tasks.workunit.client.0.smithi029.stdout:6/744: rmdir d1/db9/dc3 39 2024-04-15T00:36:27.820 INFO:tasks.workunit.client.0.smithi029.stdout:0/765: mkdir d5/db/d1a/d65/d76/daf/dc1/dfd 0 2024-04-15T00:36:27.828 INFO:tasks.workunit.client.0.smithi029.stdout:3/733: creat d17/d2f/d76/fee x:0 0 0 2024-04-15T00:36:27.830 INFO:tasks.workunit.client.0.smithi029.stdout:9/711: write d3/d6/d9/f50 [292933,97644] 0 2024-04-15T00:36:27.951 INFO:tasks.workunit.client.0.smithi029.stdout:4/717: dwrite de/d54/d71/d8b/fd6 [0,4194304] 0 2024-04-15T00:36:27.952 INFO:tasks.workunit.client.0.smithi029.stdout:9/712: chown d3/d6/d9/d29/d60/d64/d6d/d58/c8e 22815 1 2024-04-15T00:36:28.050 INFO:tasks.workunit.client.0.smithi029.stdout:9/713: readlink d3/d6/d9/d15/d4a/lb5 0 2024-04-15T00:36:28.179 INFO:tasks.workunit.client.0.smithi029.stdout:8/741: rename d8/fd to d8/d4a/d78/d23/d28/ffb 0 2024-04-15T00:36:28.261 INFO:tasks.workunit.client.0.smithi029.stdout:2/740: dwrite d3/d50/fc4 [0,4194304] 0 2024-04-15T00:36:28.539 INFO:tasks.workunit.client.0.smithi029.stdout:1/705: fsync df/fe9 0 2024-04-15T00:36:28.575 INFO:tasks.workunit.client.0.smithi029.stdout:4/718: dread f3 [0,4194304] 0 2024-04-15T00:36:28.651 INFO:tasks.workunit.client.0.smithi029.stdout:9/714: readlink d3/d6/ldb 0 2024-04-15T00:36:28.711 INFO:tasks.workunit.client.0.smithi029.stdout:6/745: symlink d1/d8/db/le7 0 2024-04-15T00:36:28.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/742: dread d8/da/fe7 [0,4194304] 0 2024-04-15T00:36:28.933 INFO:tasks.workunit.client.0.smithi029.stdout:3/734: mknod d17/d2f/d44/cef 0 2024-04-15T00:36:28.948 INFO:tasks.workunit.client.0.smithi029.stdout:7/735: rename d0/c56 to d0/d6/d4f/dbb/d49/cf2 0 2024-04-15T00:36:28.950 INFO:tasks.workunit.client.0.smithi029.stdout:5/757: write d2/de/d13/f2f [1381546,128598] 0 2024-04-15T00:36:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:8/743: sync 2024-04-15T00:36:29.067 INFO:tasks.workunit.client.0.smithi029.stdout:4/719: dread - de/d6d/dde/fe1 zero size 2024-04-15T00:36:29.222 INFO:tasks.workunit.client.0.smithi029.stdout:9/715: unlink d3/d6/d9/d29/d60/d64/d6d/cd4 0 2024-04-15T00:36:29.291 INFO:tasks.workunit.client.0.smithi029.stdout:1/706: fdatasync df/d29/d41/daf/fe7 0 2024-04-15T00:36:29.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/758: creat d2/d1a/ff5 x:0 0 0 2024-04-15T00:36:29.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/736: mknod d0/d6/d4f/d5d/d87/cf3 0 2024-04-15T00:36:29.489 INFO:tasks.workunit.client.0.smithi029.stdout:0/766: dwrite d5/d15/d27/fab [0,4194304] 0 2024-04-15T00:36:29.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/735: rename d17/c28 to d17/d2f/d76/d7f/dcd/cf0 0 2024-04-15T00:36:29.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/720: creat de/fe5 x:0 0 0 2024-04-15T00:36:29.782 INFO:tasks.workunit.client.0.smithi029.stdout:6/746: write d1/d8/db/f48 [5497217,113896] 0 2024-04-15T00:36:29.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/747: write d1/f12 [564346,39322] 0 2024-04-15T00:36:29.922 INFO:tasks.workunit.client.0.smithi029.stdout:2/741: dwrite d3/dd/d2d/d61/f9f [0,4194304] 0 2024-04-15T00:36:30.017 INFO:tasks.workunit.client.0.smithi029.stdout:5/759: creat d2/de/d13/d22/d26/ff6 x:0 0 0 2024-04-15T00:36:30.034 INFO:tasks.workunit.client.0.smithi029.stdout:8/744: creat d8/da/d2f/d6e/dc1/ded/ffc x:0 0 0 2024-04-15T00:36:30.082 INFO:tasks.workunit.client.0.smithi029.stdout:7/737: dread d0/d6/d4f/d66/d37/db7/dda/fc [4194304,4194304] 0 2024-04-15T00:36:30.179 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:36:30.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:36:30.184 INFO:tasks.workunit.client.0.smithi029.stdout:0/767: mkdir d5/d15/d1f/dfe 0 2024-04-15T00:36:30.185 INFO:tasks.workunit.client.0.smithi029.stdout:3/736: rmdir d17/d2a/d46/d67 39 2024-04-15T00:36:30.197 INFO:tasks.workunit.client.0.smithi029.stdout:1/707: unlink df/d29/d41/d69/d78/dd1/d80/lc7 0 2024-04-15T00:36:30.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/748: creat d1/d8/db/d98/fe8 x:0 0 0 2024-04-15T00:36:30.385 INFO:tasks.workunit.client.0.smithi029.stdout:2/742: rename d3/d50/d51/d65/d81/da6 to d3/dd/d42/dc6/dee 0 2024-04-15T00:36:30.637 INFO:tasks.workunit.client.0.smithi029.stdout:7/738: read - d0/d6/d39/d3c/fef zero size 2024-04-15T00:36:30.804 INFO:tasks.workunit.client.0.smithi029.stdout:0/768: mkdir d5/d15/d68/dff 0 2024-04-15T00:36:30.858 INFO:tasks.workunit.client.0.smithi029.stdout:1/708: mknod df/d29/d41/d69/d78/dd1/d80/cf8 0 2024-04-15T00:36:30.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/709: chown df/d29/d41/d4f/f58 1121 1 2024-04-15T00:36:30.886 INFO:tasks.workunit.client.0.smithi029.stdout:6/749: mknod d1/d8/db/d7b/ce9 0 2024-04-15T00:36:30.968 INFO:tasks.workunit.client.0.smithi029.stdout:8/745: symlink d8/d4a/da1/dee/lfd 0 2024-04-15T00:36:31.237 INFO:tasks.workunit.client.0.smithi029.stdout:9/716: dwrite d3/f3e [0,4194304] 0 2024-04-15T00:36:31.306 INFO:tasks.workunit.client.0.smithi029.stdout:7/739: truncate d0/d69/fea 109032 0 2024-04-15T00:36:31.336 INFO:tasks.workunit.client.0.smithi029.stdout:1/710: creat df/d29/d41/d96/ff9 x:0 0 0 2024-04-15T00:36:31.348 INFO:tasks.workunit.client.0.smithi029.stdout:0/769: readlink d5/d15/l16 0 2024-04-15T00:36:31.396 INFO:tasks.workunit.client.0.smithi029.stdout:0/770: chown d5/d15/d27/d51/d77/c8d 1 1 2024-04-15T00:36:31.514 INFO:tasks.workunit.client.0.smithi029.stdout:6/750: symlink d1/d8/db/d38/d86/lea 0 2024-04-15T00:36:31.520 INFO:tasks.workunit.client.0.smithi029.stdout:8/746: mkdir d8/d4a/d78/d23/d28/d5f/dfe 0 2024-04-15T00:36:31.530 INFO:tasks.workunit.client.0.smithi029.stdout:2/743: truncate d3/dd/d2d/d61/dd5/d95/f6a 2680882 0 2024-04-15T00:36:31.957 INFO:tasks.workunit.client.0.smithi029.stdout:3/737: write d17/d2f/d44/f87 [62718,4938] 0 2024-04-15T00:36:32.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/760: stat d2/de/d13/d22/d26/d36/f90 0 2024-04-15T00:36:32.709 INFO:tasks.workunit.client.0.smithi029.stdout:6/751: rmdir d1/d8/d72/da3 39 2024-04-15T00:36:32.746 INFO:tasks.workunit.client.0.smithi029.stdout:2/744: dread - d3/d53/fec zero size 2024-04-15T00:36:32.808 INFO:tasks.workunit.client.0.smithi029.stdout:8/747: mknod d8/da/d2f/d6e/dc1/cff 0 2024-04-15T00:36:33.029 INFO:tasks.workunit.client.0.smithi029.stdout:4/721: rename de/df/f18 to de/d54/d71/da3/fe6 0 2024-04-15T00:36:33.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/711: unlink df/d29/d41/d69/d78/dd1/d59/cd5 0 2024-04-15T00:36:33.405 INFO:tasks.workunit.client.0.smithi029.stdout:2/745: mknod d3/dd/d2d/d61/d85/da2/cef 0 2024-04-15T00:36:33.417 INFO:tasks.workunit.client.0.smithi029.stdout:3/738: rename d17/d2a/d46/d67/fd5 to d17/d2a/d46/d67/ff1 0 2024-04-15T00:36:33.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/761: rename d2/da5/dc8/le1 to d2/de/d13/d22/d26/d36/d4d/df4/lf7 0 2024-04-15T00:36:33.834 INFO:tasks.workunit.client.0.smithi029.stdout:1/712: dread df/d29/d41/f4e [0,4194304] 0 2024-04-15T00:36:33.919 INFO:tasks.workunit.client.0.smithi029.stdout:6/752: mkdir d1/d8/d72/da3/deb 0 2024-04-15T00:36:33.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/753: readlink d1/d8/l4b 0 2024-04-15T00:36:34.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/739: mkdir d17/d2a/d33/df2 0 2024-04-15T00:36:34.155 INFO:tasks.workunit.client.0.smithi029.stdout:4/722: truncate de/d54/d58/fd1 1729318 0 2024-04-15T00:36:34.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/723: chown de/d54/d71/f87 0 1 2024-04-15T00:36:34.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/746: mknod d3/d13/de1/cf0 0 2024-04-15T00:36:34.460 INFO:tasks.workunit.client.0.smithi029.stdout:0/771: dwrite d5/d4c/fd5 [0,4194304] 0 2024-04-15T00:36:34.619 INFO:tasks.workunit.client.0.smithi029.stdout:8/748: write d8/da/f43 [621988,66027] 0 2024-04-15T00:36:34.627 INFO:tasks.workunit.client.0.smithi029.stdout:1/713: creat df/d29/d41/d69/d4c/df4/ffa x:0 0 0 2024-04-15T00:36:34.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/749: readlink d8/lb0 0 2024-04-15T00:36:34.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/717: link d3/d6/d9/d29/d60/d7f/da0/c6c d3/d6/d9/d29/d60/d64/d6d/cdd 0 2024-04-15T00:36:34.688 INFO:tasks.workunit.client.0.smithi029.stdout:8/750: dread - d8/d4a/d78/d87/fb9 zero size 2024-04-15T00:36:34.697 INFO:tasks.workunit.client.0.smithi029.stdout:1/714: chown df/d29/d41/d69/d78/dd1/d59/l5f 21 1 2024-04-15T00:36:34.708 INFO:tasks.workunit.client.0.smithi029.stdout:2/747: chown d3/d93/dbe/le2 5553822 1 2024-04-15T00:36:34.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/715: dread - df/d29/d41/daf/fe7 zero size 2024-04-15T00:36:34.852 INFO:tasks.workunit.client.0.smithi029.stdout:1/716: dwrite df/d29/d41/d69/d4c/df4/ffa [0,4194304] 0 2024-04-15T00:36:34.925 INFO:tasks.workunit.client.0.smithi029.stdout:7/740: creat d0/d6/ff4 x:0 0 0 2024-04-15T00:36:34.990 INFO:tasks.workunit.client.0.smithi029.stdout:6/754: rename d1/d1e/d56/d58/d59/cb2 to d1/cec 0 2024-04-15T00:36:35.119 INFO:tasks.workunit.client.0.smithi029.stdout:2/748: read d3/d2a/d4e/db9/fa8 [3826907,108468] 0 2024-04-15T00:36:35.233 INFO:tasks.workunit.client.0.smithi029.stdout:5/762: getdents d2/de/d1f/d63 0 2024-04-15T00:36:35.336 INFO:tasks.workunit.client.0.smithi029.stdout:4/724: dwrite de/df/d1e/d56/f9e [0,4194304] 0 2024-04-15T00:36:35.412 INFO:tasks.workunit.client.0.smithi029.stdout:0/772: write d5/d15/d68/fc7 [577316,78141] 0 2024-04-15T00:36:35.433 INFO:tasks.workunit.client.0.smithi029.stdout:0/773: stat d5/d15/d27/d51/d7d 0 2024-04-15T00:36:35.468 INFO:tasks.workunit.client.0.smithi029.stdout:2/749: sync 2024-04-15T00:36:35.620 INFO:tasks.workunit.client.0.smithi029.stdout:8/751: dwrite d8/da/d3d/f6c [4194304,4194304] 0 2024-04-15T00:36:35.703 INFO:tasks.workunit.client.0.smithi029.stdout:3/740: getdents d17/d2a/d46 0 2024-04-15T00:36:35.919 INFO:tasks.workunit.client.0.smithi029.stdout:7/741: unlink d0/d6/f3b 0 2024-04-15T00:36:35.919 INFO:tasks.workunit.client.0.smithi029.stdout:5/763: dread - d2/de/d13/d22/d26/ff6 zero size 2024-04-15T00:36:35.934 INFO:tasks.workunit.client.0.smithi029.stdout:4/725: rmdir de/df 39 2024-04-15T00:36:36.006 INFO:tasks.workunit.client.0.smithi029.stdout:2/750: truncate d3/d13/fd4 184255 0 2024-04-15T00:36:36.011 INFO:tasks.workunit.client.0.smithi029.stdout:8/752: symlink d8/da/d2f/d42/l100 0 2024-04-15T00:36:36.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/755: dwrite d1/d8/db/d7b/d85/dd2/f73 [0,4194304] 0 2024-04-15T00:36:36.170 INFO:tasks.workunit.client.0.smithi029.stdout:3/741: truncate d17/d2a/d4c/d93/fd7 996385 0 2024-04-15T00:36:36.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/764: mkdir d2/d1a/d2d/df8 0 2024-04-15T00:36:36.394 INFO:tasks.workunit.client.0.smithi029.stdout:1/717: dwrite df/f30 [0,4194304] 0 2024-04-15T00:36:36.461 INFO:tasks.workunit.client.0.smithi029.stdout:0/774: write d5/db/d1a/d65/d76/daf/fdc [246606,38588] 0 2024-04-15T00:36:36.519 INFO:tasks.workunit.client.0.smithi029.stdout:9/718: write d3/d6/d9/d29/d60/d64/d6d/d58/f28 [479294,118453] 0 2024-04-15T00:36:36.604 INFO:tasks.workunit.client.0.smithi029.stdout:3/742: mkdir d17/d2f/d76/d7f/df3 0 2024-04-15T00:36:36.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/742: write d0/d6/f64 [2985447,33071] 0 2024-04-15T00:36:36.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/743: readlink l5 0 2024-04-15T00:36:36.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/718: rmdir df 39 2024-04-15T00:36:36.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/756: write d1/d8/db/d7b/f93 [1344974,89388] 0 2024-04-15T00:36:37.079 INFO:tasks.workunit.client.0.smithi029.stdout:0/775: creat d5/db/d1a/d65/d76/daf/dc1/f100 x:0 0 0 2024-04-15T00:36:37.107 INFO:tasks.workunit.client.0.smithi029.stdout:2/751: dwrite d3/d2a/d4e/db9/fb6 [0,4194304] 0 2024-04-15T00:36:37.258 INFO:tasks.workunit.client.0.smithi029.stdout:4/726: mknod de/d6d/d7e/ce7 0 2024-04-15T00:36:37.471 INFO:tasks.workunit.client.0.smithi029.stdout:8/753: creat d8/da/d2f/d6e/f101 x:0 0 0 2024-04-15T00:36:37.485 INFO:tasks.workunit.client.0.smithi029.stdout:8/754: readlink d8/d4a/d78/d23/d28/d5f/l68 0 2024-04-15T00:36:37.793 INFO:tasks.workunit.client.0.smithi029.stdout:6/757: symlink d1/d8/db/d38/d86/led 0 2024-04-15T00:36:37.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/765: write d2/fb [4467201,44771] 0 2024-04-15T00:36:37.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/752: rename d3/d13/f83 to d3/d2a/d4e/db9/ff1 0 2024-04-15T00:36:37.917 INFO:tasks.workunit.client.0.smithi029.stdout:4/727: chown de/d54/d71/d8b/da7/fd0 1931424 1 2024-04-15T00:36:38.032 INFO:tasks.workunit.client.0.smithi029.stdout:3/744: truncate d17/d2a/d33/f63 931380 0 2024-04-15T00:36:38.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/755: rmdir d8/d4a/d78/d23/d28/d30/d39 39 2024-04-15T00:36:38.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/719: mkdir df/da4/dfb 0 2024-04-15T00:36:38.383 INFO:tasks.workunit.client.0.smithi029.stdout:5/766: rename d2/de/d13/d22/d26/d36/d4d/d70/fc9 to d2/de/d13/d22/d3c/d41/dec/ff9 0 2024-04-15T00:36:38.493 INFO:tasks.workunit.client.0.smithi029.stdout:8/756: truncate d8/da/f49 699444 0 2024-04-15T00:36:38.652 INFO:tasks.workunit.client.0.smithi029.stdout:9/719: link d3/d6/l86 d3/d6/d9/d29/d60/d64/lde 0 2024-04-15T00:36:38.746 INFO:tasks.workunit.client.0.smithi029.stdout:7/743: dwrite d0/d6/d4f/d66/d26/f40 [0,4194304] 0 2024-04-15T00:36:38.812 INFO:tasks.workunit.client.0.smithi029.stdout:4/728: truncate de/d2b/d35/f73 3148985 0 2024-04-15T00:36:38.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/744: readlink d0/d6/d4f/d5d/d65/leb 0 2024-04-15T00:36:38.894 INFO:tasks.workunit.client.0.smithi029.stdout:1/720: symlink df/lfc 0 2024-04-15T00:36:38.904 INFO:tasks.workunit.client.0.smithi029.stdout:0/776: link d5/db/d8f/c9c d5/d15/d57/db9/c101 0 2024-04-15T00:36:38.951 INFO:tasks.workunit.client.0.smithi029.stdout:2/753: creat d3/d2a/ff2 x:0 0 0 2024-04-15T00:36:39.022 INFO:tasks.workunit.client.0.smithi029.stdout:5/767: mknod d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/cfa 0 2024-04-15T00:36:39.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/745: readlink d0/d69/lcf 0 2024-04-15T00:36:39.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/777: read - d5/d3e/ff5 zero size 2024-04-15T00:36:39.331 INFO:tasks.workunit.client.0.smithi029.stdout:3/745: getdents d17/d2a/d4c/d93 0 2024-04-15T00:36:39.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/746: stat d17/d83 0 2024-04-15T00:36:39.453 INFO:tasks.workunit.client.0.smithi029.stdout:3/747: dread d17/d2f/d76/d7f/fac [0,4194304] 0 2024-04-15T00:36:39.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/768: fsync d2/f52 0 2024-04-15T00:36:39.509 INFO:tasks.workunit.client.0.smithi029.stdout:4/729: truncate de/df/d1e/f28 539158 0 2024-04-15T00:36:39.510 INFO:tasks.workunit.client.0.smithi029.stdout:7/746: creat d0/d6/d4f/d66/d67/d90/ff5 x:0 0 0 2024-04-15T00:36:39.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/721: creat df/d29/d41/d69/d4c/d7a/ffd x:0 0 0 2024-04-15T00:36:39.669 INFO:tasks.workunit.client.0.smithi029.stdout:0/778: dread d5/d15/d27/d9f/ddb/ff4 [0,4194304] 0 2024-04-15T00:36:39.732 INFO:tasks.workunit.client.0.smithi029.stdout:9/720: creat d3/d6/d9/d29/d60/d7f/fdf x:0 0 0 2024-04-15T00:36:39.734 INFO:tasks.workunit.client.0.smithi029.stdout:6/758: write d1/d1e/f61 [1275295,862] 0 2024-04-15T00:36:39.772 INFO:tasks.workunit.client.0.smithi029.stdout:3/748: unlink d17/d2f/c72 0 2024-04-15T00:36:40.046 INFO:tasks.workunit.client.0.smithi029.stdout:8/757: write d8/da/d2f/d42/f8c [1927229,115304] 0 2024-04-15T00:36:40.118 INFO:tasks.workunit.client.0.smithi029.stdout:6/759: creat d1/d8/db/d38/d86/fee x:0 0 0 2024-04-15T00:36:40.232 INFO:tasks.workunit.client.0.smithi029.stdout:3/749: mkdir d17/d2f/d44/d58/d5c/df4 0 2024-04-15T00:36:40.348 INFO:tasks.workunit.client.0.smithi029.stdout:7/747: symlink d0/d6/d4f/d66/df0/lf6 0 2024-04-15T00:36:40.467 INFO:tasks.workunit.client.0.smithi029.stdout:0/779: creat d5/d15/d27/dbb/dbd/df6/f102 x:0 0 0 2024-04-15T00:36:40.525 INFO:tasks.workunit.client.0.smithi029.stdout:5/769: dwrite d2/d1a/f2c [4194304,4194304] 0 2024-04-15T00:36:40.526 INFO:tasks.workunit.client.0.smithi029.stdout:2/754: dwrite d3/d2a/f3a [0,4194304] 0 2024-04-15T00:36:40.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/750: readlink d17/d2a/l2b 0 2024-04-15T00:36:40.825 INFO:tasks.workunit.client.0.smithi029.stdout:3/751: stat f1 0 2024-04-15T00:36:41.026 INFO:tasks.workunit.client.0.smithi029.stdout:8/758: creat d8/d4a/d78/d23/d28/d5f/dfe/f102 x:0 0 0 2024-04-15T00:36:41.130 INFO:tasks.workunit.client.0.smithi029.stdout:4/730: dwrite de/fd2 [0,4194304] 0 2024-04-15T00:36:41.199 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:36:11.709 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.206 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:36:11.717 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.210 INFO:tasks.workunit.client.0.smithi029.stdout:9/721: rmdir d3/d6/d9/d29/d60/d64/d6d/d58/d6a/dbb 0 2024-04-15T00:36:41.212 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:36:11.703 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.214 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:36:11.705 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.215 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:36:11.705 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.217 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:36:11.708 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.273 INFO:tasks.workunit.client.0.smithi029.stdout:0/780: rmdir d5/d15/d27/d51/d7d 39 2024-04-15T00:36:41.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/755: mkdir d3/d2a/d4e/df3 0 2024-04-15T00:36:41.293 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:36:11.803 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.294 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:36:11.785 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.315 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:36:11.806 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:36:41.382 INFO:tasks.workunit.client.0.smithi029.stdout:1/722: dwrite df/f21 [4194304,4194304] 0 2024-04-15T00:36:41.453 INFO:tasks.workunit.client.0.smithi029.stdout:5/770: mkdir d2/de/d13/d22/d26/d36/d4d/dfb 0 2024-04-15T00:36:41.466 INFO:tasks.workunit.client.0.smithi029.stdout:4/731: sync 2024-04-15T00:36:41.894 INFO:tasks.workunit.client.0.smithi029.stdout:6/760: creat d1/d1e/d56/fef x:0 0 0 2024-04-15T00:36:41.896 INFO:tasks.workunit.client.0.smithi029.stdout:2/756: symlink d3/d2a/d4e/db9/lf4 0 2024-04-15T00:36:41.913 INFO:tasks.workunit.client.0.smithi029.stdout:4/732: mknod de/d54/d71/d8b/da7/ce8 0 2024-04-15T00:36:42.146 INFO:tasks.workunit.client.0.smithi029.stdout:1/723: dread df/f3e [0,4194304] 0 2024-04-15T00:36:42.152 INFO:tasks.workunit.client.0.smithi029.stdout:5/771: dread d2/de/d13/fdf [0,4194304] 0 2024-04-15T00:36:42.406 INFO:tasks.workunit.client.0.smithi029.stdout:3/752: write d17/d2f/d3c/f3f [5639439,84950] 0 2024-04-15T00:36:42.468 INFO:tasks.workunit.client.0.smithi029.stdout:0/781: creat d5/d4c/d4e/da8/f103 x:0 0 0 2024-04-15T00:36:42.535 INFO:tasks.workunit.client.0.smithi029.stdout:9/722: fsync d3/d6/f9c 0 2024-04-15T00:36:42.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/761: creat d1/d8/db/db7/ff0 x:0 0 0 2024-04-15T00:36:42.703 INFO:tasks.workunit.client.0.smithi029.stdout:1/724: fdatasync df/f46 0 2024-04-15T00:36:42.741 INFO:tasks.workunit.client.0.smithi029.stdout:6/762: sync 2024-04-15T00:36:43.255 INFO:tasks.workunit.client.0.smithi029.stdout:5/772: rmdir d2/d1a/d2d 39 2024-04-15T00:36:43.257 INFO:tasks.workunit.client.0.smithi029.stdout:7/748: creat d0/d74/ff7 x:0 0 0 2024-04-15T00:36:43.358 INFO:tasks.workunit.client.0.smithi029.stdout:0/782: fsync d5/d4c/d4e/f80 0 2024-04-15T00:36:43.514 INFO:tasks.workunit.client.0.smithi029.stdout:9/723: dread d3/f34 [0,4194304] 0 2024-04-15T00:36:43.584 INFO:tasks.workunit.client.0.smithi029.stdout:1/725: creat df/d29/d41/d96/ffe x:0 0 0 2024-04-15T00:36:43.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/759: getdents d8/da/d2f 0 2024-04-15T00:36:43.685 INFO:tasks.workunit.client.0.smithi029.stdout:1/726: dread df/d29/d41/f81 [0,4194304] 0 2024-04-15T00:36:43.847 INFO:tasks.workunit.client.0.smithi029.stdout:2/757: dwrite d3/d13/d43/d9a/fdc [0,4194304] 0 2024-04-15T00:36:44.033 INFO:tasks.workunit.client.0.smithi029.stdout:5/773: unlink d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/lb6 0 2024-04-15T00:36:44.038 INFO:tasks.workunit.client.0.smithi029.stdout:0/783: mknod d5/db/d8f/c104 0 2024-04-15T00:36:44.240 INFO:tasks.workunit.client.0.smithi029.stdout:3/753: creat d17/d2a/ff5 x:0 0 0 2024-04-15T00:36:44.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/760: creat d8/d4a/d78/d23/d28/d30/db1/f103 x:0 0 0 2024-04-15T00:36:44.350 INFO:tasks.workunit.client.0.smithi029.stdout:8/761: chown d8/da/c1b 15 1 2024-04-15T00:36:44.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/762: readlink d8/da/d3d/d8a/lae 0 2024-04-15T00:36:44.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/763: readlink d8/lba 0 2024-04-15T00:36:44.448 INFO:tasks.workunit.client.0.smithi029.stdout:1/727: truncate df/d29/d41/d4f/f6e 4253793 0 2024-04-15T00:36:44.874 INFO:tasks.workunit.client.0.smithi029.stdout:8/764: rename f7 to d8/da/d2f/d66/f104 0 2024-04-15T00:36:44.891 INFO:tasks.workunit.client.0.smithi029.stdout:8/765: read - d8/d4a/d78/d23/d28/d5f/dfe/f102 zero size 2024-04-15T00:36:44.987 INFO:tasks.workunit.client.0.smithi029.stdout:6/763: link d1/d1e/d22/c9d d1/d8/db/d98/cf1 0 2024-04-15T00:36:45.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/733: dwrite de/d6d/fb9 [0,4194304] 0 2024-04-15T00:36:45.134 INFO:tasks.workunit.client.0.smithi029.stdout:5/774: rmdir d2/de/d13/d22/dee 0 2024-04-15T00:36:45.267 INFO:tasks.workunit.client.0.smithi029.stdout:6/764: truncate d1/d8/db/f3b 186079 0 2024-04-15T00:36:45.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/749: dwrite d0/d6/d4f/d66/d37/dde/fe6 [0,4194304] 0 2024-04-15T00:36:45.424 INFO:tasks.workunit.client.0.smithi029.stdout:5/775: unlink d2/d1a/fea 0 2024-04-15T00:36:45.709 INFO:tasks.workunit.client.0.smithi029.stdout:9/724: dwrite d3/f34 [4194304,4194304] 0 2024-04-15T00:36:45.830 INFO:tasks.workunit.client.0.smithi029.stdout:2/758: dwrite d3/dd/d2d/d61/dd5/d95/fd8 [0,4194304] 0 2024-04-15T00:36:45.906 INFO:tasks.workunit.client.0.smithi029.stdout:9/725: write d3/f34 [4459399,80126] 0 2024-04-15T00:36:45.968 INFO:tasks.workunit.client.0.smithi029.stdout:0/784: dwrite d5/f7 [0,4194304] 0 2024-04-15T00:36:46.059 INFO:tasks.workunit.client.0.smithi029.stdout:7/750: rename d0/d6/d4f/d66/d67/f88 to d0/d6/d39/d3c/d5b/d7e/dbe/ff8 0 2024-04-15T00:36:46.129 INFO:tasks.workunit.client.0.smithi029.stdout:3/754: dwrite d17/d2f/d44/d58/d5c/f9a [0,4194304] 0 2024-04-15T00:36:46.211 INFO:tasks.workunit.client.0.smithi029.stdout:8/766: write d8/d4a/fcb [904636,85675] 0 2024-04-15T00:36:46.217 INFO:tasks.workunit.client.0.smithi029.stdout:5/776: mkdir d2/de/d13/d22/d26/dfc 0 2024-04-15T00:36:46.219 INFO:tasks.workunit.client.0.smithi029.stdout:6/765: fdatasync d1/d8/db/f3b 0 2024-04-15T00:36:46.242 INFO:tasks.workunit.client.0.smithi029.stdout:4/734: write de/d2b/d59/f76 [808333,107663] 0 2024-04-15T00:36:46.278 INFO:tasks.workunit.client.0.smithi029.stdout:2/759: symlink d3/d13/d43/d5a/lf5 0 2024-04-15T00:36:46.427 INFO:tasks.workunit.client.0.smithi029.stdout:8/767: dread d8/da/fac [0,4194304] 0 2024-04-15T00:36:46.439 INFO:tasks.workunit.client.0.smithi029.stdout:8/768: stat d8/da/d2f/d6e/dc1/cff 0 2024-04-15T00:36:46.448 INFO:tasks.workunit.client.0.smithi029.stdout:8/769: stat d8/da/d3d/d8a/fe3 0 2024-04-15T00:36:46.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/785: mknod d5/d54/dec/c105 0 2024-04-15T00:36:46.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/770: dread - d8/da/d2f/f9b zero size 2024-04-15T00:36:46.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/726: chown d3/d6/d9/d29/d60/d64/d6d/cdd 235961 1 2024-04-15T00:36:46.484 INFO:tasks.workunit.client.0.smithi029.stdout:0/786: chown d5/f7 787954202 1 2024-04-15T00:36:46.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/751: mknod d0/d6/d4f/d5d/d82/cf9 0 2024-04-15T00:36:46.652 INFO:tasks.workunit.client.0.smithi029.stdout:1/728: dwrite df/d29/d41/d4f/f6e [0,4194304] 0 2024-04-15T00:36:46.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/777: creat d2/de/d1f/d63/ffd x:0 0 0 2024-04-15T00:36:46.814 INFO:tasks.workunit.client.0.smithi029.stdout:7/752: dread d0/d6/d4f/d66/d26/f51 [0,4194304] 0 2024-04-15T00:36:46.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/771: rmdir d8/d4a/d78/d23/d28/d30 39 2024-04-15T00:36:47.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/760: dread d3/d2a/d4e/db9/ff1 [0,4194304] 0 2024-04-15T00:36:47.086 INFO:tasks.workunit.client.0.smithi029.stdout:2/761: stat d3/dd/f31 0 2024-04-15T00:36:47.240 INFO:tasks.workunit.client.0.smithi029.stdout:9/727: chown d3/d6/d9/d29/d60/d64/d6d/f91 63240 1 2024-04-15T00:36:47.403 INFO:tasks.workunit.client.0.smithi029.stdout:6/766: fdatasync d1/d8/db/f4d 0 2024-04-15T00:36:47.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/755: write d17/d2f/d84/db1/fdd [666637,35335] 0 2024-04-15T00:36:47.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/729: creat df/d32/d90/fff x:0 0 0 2024-04-15T00:36:47.570 INFO:tasks.workunit.client.0.smithi029.stdout:7/753: symlink d0/d6/d4f/d5d/d87/da6/lfa 0 2024-04-15T00:36:47.673 INFO:tasks.workunit.client.0.smithi029.stdout:4/735: dwrite de/d54/d71/db5/fb0 [0,4194304] 0 2024-04-15T00:36:47.741 INFO:tasks.workunit.client.0.smithi029.stdout:8/772: mknod d8/d4a/da1/dee/c105 0 2024-04-15T00:36:47.765 INFO:tasks.workunit.client.0.smithi029.stdout:9/728: chown d3/d6/l7a 120 1 2024-04-15T00:36:47.953 INFO:tasks.workunit.client.0.smithi029.stdout:5/778: fdatasync d2/d1a/d2d/f76 0 2024-04-15T00:36:48.131 INFO:tasks.workunit.client.0.smithi029.stdout:6/767: dread d1/d1e/f7e [0,4194304] 0 2024-04-15T00:36:48.258 INFO:tasks.workunit.client.0.smithi029.stdout:2/762: rename d3/d2a/d4e/db9 to d3/dd/d2d/d61/df6 0 2024-04-15T00:36:48.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/773: truncate d8/d4a/da1/fc7 208798 0 2024-04-15T00:36:48.502 INFO:tasks.workunit.client.0.smithi029.stdout:9/729: unlink d3/d6/d9/d29/d60/d64/d6d/d58/lbe 0 2024-04-15T00:36:48.506 INFO:tasks.workunit.client.0.smithi029.stdout:4/736: truncate de/d54/d71/d8b/da7/fac 682033 0 2024-04-15T00:36:48.561 INFO:tasks.workunit.client.0.smithi029.stdout:5/779: dread - d2/de/d13/d22/d26/d36/d4d/d70/d8d/f91 zero size 2024-04-15T00:36:48.581 INFO:tasks.workunit.client.0.smithi029.stdout:5/780: chown d2/de/d13/d22/d26/d36/d4d/d70/d8d/fbc 51535 1 2024-04-15T00:36:48.706 INFO:tasks.workunit.client.0.smithi029.stdout:6/768: mknod d1/d8/d79/d9f/cf2 0 2024-04-15T00:36:48.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/787: getdents d5/db/d1a/d50 0 2024-04-15T00:36:48.721 INFO:tasks.workunit.client.0.smithi029.stdout:0/788: readlink d5/d15/l56 0 2024-04-15T00:36:48.755 INFO:tasks.workunit.client.0.smithi029.stdout:2/763: creat d3/d13/d43/d5a/ff7 x:0 0 0 2024-04-15T00:36:48.997 INFO:tasks.workunit.client.0.smithi029.stdout:4/737: read de/d6d/f9d [294298,10526] 0 2024-04-15T00:36:49.121 INFO:tasks.workunit.client.0.smithi029.stdout:5/781: rmdir d2/de/d13/d22/d26/d36 39 2024-04-15T00:36:49.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/774: symlink d8/d4a/d78/de4/l106 0 2024-04-15T00:36:49.326 INFO:tasks.workunit.client.0.smithi029.stdout:3/756: write d17/d2f/d44/d58/d5c/d5f/f7b [371774,63895] 0 2024-04-15T00:36:49.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/782: creat d2/de/d13/d22/d3c/d41/ffe x:0 0 0 2024-04-15T00:36:49.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/789: creat d5/d15/d68/dff/f106 x:0 0 0 2024-04-15T00:36:49.517 INFO:tasks.workunit.client.0.smithi029.stdout:1/730: dwrite df/d29/d41/f45 [0,4194304] 0 2024-04-15T00:36:49.594 INFO:tasks.workunit.client.0.smithi029.stdout:8/775: unlink d8/d4a/d78/d23/d28/d5f/fa4 0 2024-04-15T00:36:49.795 INFO:tasks.workunit.client.0.smithi029.stdout:3/757: creat d17/d2f/d76/d7f/ff6 x:0 0 0 2024-04-15T00:36:49.799 INFO:tasks.workunit.client.0.smithi029.stdout:7/754: write d0/d6/d4f/d66/d37/fc0 [270247,74106] 0 2024-04-15T00:36:50.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/731: symlink df/d29/d41/d69/d78/dd1/d59/l100 0 2024-04-15T00:36:50.072 INFO:tasks.workunit.client.0.smithi029.stdout:8/776: mkdir d8/da/d2f/d6e/dc1/ded/d107 0 2024-04-15T00:36:50.165 INFO:tasks.workunit.client.0.smithi029.stdout:3/758: write d17/d2f/d3c/f3f [3920022,50167] 0 2024-04-15T00:36:50.235 INFO:tasks.workunit.client.0.smithi029.stdout:0/790: dread d5/d15/d27/d28/f82 [0,4194304] 0 2024-04-15T00:36:50.323 INFO:tasks.workunit.client.0.smithi029.stdout:6/769: mknod d1/cf3 0 2024-04-15T00:36:50.333 INFO:tasks.workunit.client.0.smithi029.stdout:9/730: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [4669815,124083] 0 2024-04-15T00:36:50.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/764: write d3/d50/fcd [757199,77636] 0 2024-04-15T00:36:50.445 INFO:tasks.workunit.client.0.smithi029.stdout:2/765: read d3/dd/d42/f47 [826587,35004] 0 2024-04-15T00:36:50.471 INFO:tasks.workunit.client.0.smithi029.stdout:4/738: dwrite de/d2b/f2a [0,4194304] 0 2024-04-15T00:36:50.803 INFO:tasks.workunit.client.0.smithi029.stdout:8/777: symlink d8/d4a/da1/l108 0 2024-04-15T00:36:50.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/783: unlink d2/de/d13/d22/d26/d36/lcc 0 2024-04-15T00:36:50.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/755: getdents d0/d6/da2 0 2024-04-15T00:36:50.861 INFO:tasks.workunit.client.0.smithi029.stdout:0/791: read d5/db/d1a/d65/d76/daf/fd8 [5504527,59460] 0 2024-04-15T00:36:50.915 INFO:tasks.workunit.client.0.smithi029.stdout:3/759: dread d17/f5b [0,4194304] 0 2024-04-15T00:36:50.983 INFO:tasks.workunit.client.0.smithi029.stdout:2/766: symlink d3/dd/d42/dc6/dee/lf8 0 2024-04-15T00:36:51.045 INFO:tasks.workunit.client.0.smithi029.stdout:9/731: dread d3/d6/f87 [0,4194304] 0 2024-04-15T00:36:51.077 INFO:tasks.workunit.client.0.smithi029.stdout:7/756: mknod d0/d6/d4f/d66/d37/db7/dda/cfb 0 2024-04-15T00:36:51.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/792: unlink d5/db/d1a/l55 0 2024-04-15T00:36:51.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/732: write df/d29/d41/d4f/f58 [3657613,35850] 0 2024-04-15T00:36:51.196 INFO:tasks.workunit.client.0.smithi029.stdout:8/778: dread d8/da/d2f/d42/f54 [0,4194304] 0 2024-04-15T00:36:51.265 INFO:tasks.workunit.client.0.smithi029.stdout:5/784: truncate d2/de/d13/d22/d26/d36/d4d/f51 2313723 0 2024-04-15T00:36:51.366 INFO:tasks.workunit.client.0.smithi029.stdout:4/739: symlink de/d6d/le9 0 2024-04-15T00:36:51.421 INFO:tasks.workunit.client.0.smithi029.stdout:2/767: rmdir d3 39 2024-04-15T00:36:51.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/770: dwrite d1/d8/f16 [0,4194304] 0 2024-04-15T00:36:51.560 INFO:tasks.workunit.client.0.smithi029.stdout:9/732: creat d3/da3/da7/fe0 x:0 0 0 2024-04-15T00:36:51.723 INFO:tasks.workunit.client.0.smithi029.stdout:8/779: creat d8/da/d2f/d6e/d5a/f109 x:0 0 0 2024-04-15T00:36:51.798 INFO:tasks.workunit.client.0.smithi029.stdout:3/760: dwrite d17/d2f/d44/d5a/f7e [0,4194304] 0 2024-04-15T00:36:51.867 INFO:tasks.workunit.client.0.smithi029.stdout:7/757: dread d0/d6/d4f/f7f [0,4194304] 0 2024-04-15T00:36:51.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/733: fdatasync df/d29/d41/d69/d78/dd1/d80/d94/f9c 0 2024-04-15T00:36:51.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/740: fdatasync de/fd2 0 2024-04-15T00:36:51.953 INFO:tasks.workunit.client.0.smithi029.stdout:5/785: dread d2/de/d13/d22/d3c/f4b [0,4194304] 0 2024-04-15T00:36:51.965 INFO:tasks.workunit.client.0.smithi029.stdout:7/758: chown d0/d6/d4f/d66/d37/db7 296337 1 2024-04-15T00:36:52.120 INFO:tasks.workunit.client.0.smithi029.stdout:4/741: dread f4 [0,4194304] 0 2024-04-15T00:36:52.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/771: rename d1/d8/db/d7b/d85/dd2/f73 to d1/d8/d72/da3/ff4 0 2024-04-15T00:36:52.312 INFO:tasks.workunit.client.0.smithi029.stdout:0/793: write d5/db/d8f/f98 [4252039,11418] 0 2024-04-15T00:36:52.592 INFO:tasks.workunit.client.0.smithi029.stdout:8/780: rmdir d8/d4a/d78/dca 39 2024-04-15T00:36:52.698 INFO:tasks.workunit.client.0.smithi029.stdout:9/733: write d3/d6/fc8 [4102591,66356] 0 2024-04-15T00:36:52.754 INFO:tasks.workunit.client.0.smithi029.stdout:1/734: mknod df/d29/d41/d69/d78/dd1/c101 0 2024-04-15T00:36:52.841 INFO:tasks.workunit.client.0.smithi029.stdout:7/759: creat d0/d6/d4f/d66/d67/ffc x:0 0 0 2024-04-15T00:36:52.940 INFO:tasks.workunit.client.0.smithi029.stdout:5/786: unlink d2/de/d13/d22/d26/d36/d4d/lb2 0 2024-04-15T00:36:53.190 INFO:tasks.workunit.client.0.smithi029.stdout:4/742: symlink de/d54/d71/d8b/db1/lea 0 2024-04-15T00:36:53.192 INFO:tasks.workunit.client.0.smithi029.stdout:6/772: dread - d1/d8/db/d38/d86/fee zero size 2024-04-15T00:36:53.213 INFO:tasks.workunit.client.0.smithi029.stdout:0/794: creat d5/d4c/d4e/f107 x:0 0 0 2024-04-15T00:36:53.638 INFO:tasks.workunit.client.0.smithi029.stdout:2/768: mknod d3/cf9 0 2024-04-15T00:36:53.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/773: rename d1/d1e/f27 to d1/d1e/d56/dd3/ddf/ff5 0 2024-04-15T00:36:53.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/761: dwrite d17/d2a/d46/f5d [0,4194304] 0 2024-04-15T00:36:53.947 INFO:tasks.workunit.client.0.smithi029.stdout:3/762: chown d17/d83/f6d 9877 1 2024-04-15T00:36:54.191 INFO:tasks.workunit.client.0.smithi029.stdout:5/787: creat d2/de/d13/d22/d26/d36/d4d/dfb/fff x:0 0 0 2024-04-15T00:36:54.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/774: dread - d1/d8/db/fb1 zero size 2024-04-15T00:36:54.402 INFO:tasks.workunit.client.0.smithi029.stdout:3/763: symlink d17/d2f/d76/d7f/dcd/lf7 0 2024-04-15T00:36:54.574 INFO:tasks.workunit.client.0.smithi029.stdout:3/764: fsync d17/d2f/d44/d58/d5c/f9a 0 2024-04-15T00:36:54.697 INFO:tasks.workunit.client.0.smithi029.stdout:1/735: write df/d29/d41/d69/d78/fbe [4678053,26619] 0 2024-04-15T00:36:54.737 INFO:tasks.workunit.client.0.smithi029.stdout:9/734: dwrite d3/d6/d9/d29/d60/d64/f69 [0,4194304] 0 2024-04-15T00:36:54.818 INFO:tasks.workunit.client.0.smithi029.stdout:0/795: write d5/d3e/f69 [3273324,57009] 0 2024-04-15T00:36:55.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/769: link d3/dd/d2d/d61/df6/fbb d3/dd/d42/dc6/dee/ffa 0 2024-04-15T00:36:55.041 INFO:tasks.workunit.client.0.smithi029.stdout:5/788: creat d2/de/d1f/f100 x:0 0 0 2024-04-15T00:36:55.086 INFO:tasks.workunit.client.0.smithi029.stdout:2/770: read - d3/d53/fec zero size 2024-04-15T00:36:55.172 INFO:tasks.workunit.client.0.smithi029.stdout:9/735: mkdir d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1 0 2024-04-15T00:36:55.179 INFO:tasks.workunit.client.0.smithi029.stdout:8/781: dwrite d8/f2b [0,4194304] 0 2024-04-15T00:36:55.265 INFO:tasks.workunit.client.0.smithi029.stdout:8/782: chown d8/d4a/d78/d23/c3e 35034192 1 2024-04-15T00:36:55.288 INFO:tasks.workunit.client.0.smithi029.stdout:1/736: fdatasync df/d32/f50 0 2024-04-15T00:36:55.335 INFO:tasks.workunit.client.0.smithi029.stdout:4/743: write de/f5d [2635193,1536] 0 2024-04-15T00:36:55.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/775: getdents d1/db9 0 2024-04-15T00:36:55.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/771: rmdir d3/d13/d43/d5a 39 2024-04-15T00:36:55.512 INFO:tasks.workunit.client.0.smithi029.stdout:5/789: fdatasync d2/de/d13/d22/d26/d36/d4d/d70/fdb 0 2024-04-15T00:36:55.555 INFO:tasks.workunit.client.0.smithi029.stdout:7/760: write d0/d74/fe9 [1025988,328] 0 2024-04-15T00:36:55.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/765: link d17/d83/fa3 d17/d2f/d76/ff8 0 2024-04-15T00:36:55.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/737: rmdir df/d29/d41 39 2024-04-15T00:36:55.742 INFO:tasks.workunit.client.0.smithi029.stdout:4/744: fdatasync de/df/d1e/f29 0 2024-04-15T00:36:55.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/772: mknod d3/dd/d2d/d61/d85/cfb 0 2024-04-15T00:36:56.038 INFO:tasks.workunit.client.0.smithi029.stdout:0/796: dwrite d5/db/d1a/d50/ff3 [0,4194304] 0 2024-04-15T00:36:56.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/790: dread d2/de/d13/d22/d26/f6f [0,4194304] 0 2024-04-15T00:36:56.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/766: mknod d17/d83/cf9 0 2024-04-15T00:36:56.373 INFO:tasks.workunit.client.0.smithi029.stdout:7/761: mknod d0/d6/d4f/d66/d26/d77/d89/cfd 0 2024-04-15T00:36:56.448 INFO:tasks.workunit.client.0.smithi029.stdout:6/776: rename d1/d8/d72/da3/ff4 to d1/d8/db/d38/d86/ff6 0 2024-04-15T00:36:56.464 INFO:tasks.workunit.client.0.smithi029.stdout:6/777: chown d1/d1e/d56 382 1 2024-04-15T00:36:56.481 INFO:tasks.workunit.client.0.smithi029.stdout:4/745: symlink de/d54/d58/d8a/leb 0 2024-04-15T00:36:56.637 INFO:tasks.workunit.client.0.smithi029.stdout:9/736: write d3/d6/d9/f49 [549682,52752] 0 2024-04-15T00:36:56.671 INFO:tasks.workunit.client.0.smithi029.stdout:3/767: unlink d17/d2a/d33/c7c 0 2024-04-15T00:36:56.681 INFO:tasks.workunit.client.0.smithi029.stdout:3/768: chown d17/d2a/d46/d67/dd6 48296 1 2024-04-15T00:36:56.784 INFO:tasks.workunit.client.0.smithi029.stdout:5/791: creat d2/de/d13/d22/d26/d36/d4d/d70/d9a/f101 x:0 0 0 2024-04-15T00:36:56.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/773: rename d3/d53/fc5 to d3/dd/d2d/d61/df6/ffc 0 2024-04-15T00:36:57.136 INFO:tasks.workunit.client.0.smithi029.stdout:3/769: creat d17/d2f/d44/d5a/dde/ffa x:0 0 0 2024-04-15T00:36:57.142 INFO:tasks.workunit.client.0.smithi029.stdout:3/770: stat d17/fa6 0 2024-04-15T00:36:57.444 INFO:tasks.workunit.client.0.smithi029.stdout:5/792: truncate d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/fb7 28452 0 2024-04-15T00:36:57.545 INFO:tasks.workunit.client.0.smithi029.stdout:0/797: rename d5/d15/d27/d9f/cf1 to d5/d15/d57/d5e/c108 0 2024-04-15T00:36:57.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/774: symlink d3/d53/lfd 0 2024-04-15T00:36:57.633 INFO:tasks.workunit.client.0.smithi029.stdout:6/778: mkdir d1/d1e/d56/dd3/de5/df7 0 2024-04-15T00:36:57.650 INFO:tasks.workunit.client.0.smithi029.stdout:8/783: dwrite d8/da/d2f/d66/f67 [0,4194304] 0 2024-04-15T00:36:57.723 INFO:tasks.workunit.client.0.smithi029.stdout:6/779: readlink d1/d1e/d22/l90 0 2024-04-15T00:36:57.868 INFO:tasks.workunit.client.0.smithi029.stdout:9/737: unlink d3/d6/f61 0 2024-04-15T00:36:57.885 INFO:tasks.workunit.client.0.smithi029.stdout:9/738: readlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/l9f 0 2024-04-15T00:36:57.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/739: chown d3/d88/c94 1995152 1 2024-04-15T00:36:58.035 INFO:tasks.workunit.client.0.smithi029.stdout:5/793: creat d2/de/d13/d22/d26/d36/d4d/d78/f102 x:0 0 0 2024-04-15T00:36:58.042 INFO:tasks.workunit.client.0.smithi029.stdout:7/762: write d0/d6/d4f/d66/d26/f2b [2391185,56596] 0 2024-04-15T00:36:58.507 INFO:tasks.workunit.client.0.smithi029.stdout:6/780: dread d1/d8/db/d7b/d85/fc4 [0,4194304] 0 2024-04-15T00:36:58.778 INFO:tasks.workunit.client.0.smithi029.stdout:1/738: getdents df/d29/d41/d69 0 2024-04-15T00:36:58.853 INFO:tasks.workunit.client.0.smithi029.stdout:9/740: dread - d3/d6/d9/d15/fb1 zero size 2024-04-15T00:36:58.877 INFO:tasks.workunit.client.0.smithi029.stdout:4/746: dwrite de/fa4 [4194304,4194304] 0 2024-04-15T00:36:58.966 INFO:tasks.workunit.client.0.smithi029.stdout:7/763: creat d0/d6/d4f/d66/d26/d54/ffe x:0 0 0 2024-04-15T00:36:59.060 INFO:tasks.workunit.client.0.smithi029.stdout:9/741: dread d3/d6/d9/f2c [0,4194304] 0 2024-04-15T00:36:59.143 INFO:tasks.workunit.client.0.smithi029.stdout:3/771: dwrite d17/d2f/d3c/f74 [0,4194304] 0 2024-04-15T00:36:59.332 INFO:tasks.workunit.client.0.smithi029.stdout:5/794: mknod d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/c103 0 2024-04-15T00:36:59.419 INFO:tasks.workunit.client.0.smithi029.stdout:2/775: creat d3/dd/d2d/ffe x:0 0 0 2024-04-15T00:36:59.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/784: rename d8/d4a/d78/dc3/ddd to d8/da/d2f/d6e/d10a 0 2024-04-15T00:36:59.550 INFO:tasks.workunit.client.0.smithi029.stdout:4/747: sync 2024-04-15T00:36:59.621 INFO:tasks.workunit.client.0.smithi029.stdout:7/764: truncate d0/d6/d4f/d66/d26/d77/fc6 816825 0 2024-04-15T00:36:59.691 INFO:tasks.workunit.client.0.smithi029.stdout:7/765: stat d0/d6/d4f/d5d/d82/cae 0 2024-04-15T00:36:59.697 INFO:tasks.workunit.client.0.smithi029.stdout:4/748: dread f8 [4194304,4194304] 0 2024-04-15T00:36:59.794 INFO:tasks.workunit.client.0.smithi029.stdout:5/795: chown d2/de/d13/d22/d26/dd7 1045528 1 2024-04-15T00:36:59.843 INFO:tasks.workunit.client.0.smithi029.stdout:2/776: stat d3/dd/d2d/d61/d85/ccb 0 2024-04-15T00:36:59.872 INFO:tasks.workunit.client.0.smithi029.stdout:7/766: dread d0/d6/d4f/d66/d67/f73 [0,4194304] 0 2024-04-15T00:36:59.879 INFO:tasks.workunit.client.0.smithi029.stdout:8/785: truncate d8/da/d3d/f81 40485 0 2024-04-15T00:36:59.945 INFO:tasks.workunit.client.0.smithi029.stdout:2/777: chown d3/dd/d42/dd1 26648 1 2024-04-15T00:36:59.958 INFO:tasks.workunit.client.0.smithi029.stdout:7/767: readlink d0/d6/d4f/d66/d37/db7/dda/l3 0 2024-04-15T00:37:00.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/778: sync 2024-04-15T00:37:00.059 INFO:tasks.workunit.client.0.smithi029.stdout:0/798: creat d5/f109 x:0 0 0 2024-04-15T00:37:00.097 INFO:tasks.workunit.client.0.smithi029.stdout:6/781: link d1/d8/db/d7b/fbe d1/d1e/d56/dd3/de5/df7/ff8 0 2024-04-15T00:37:00.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/742: fdatasync d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb4 0 2024-04-15T00:37:00.218 INFO:tasks.workunit.client.0.smithi029.stdout:9/743: sync 2024-04-15T00:37:00.230 INFO:tasks.workunit.client.0.smithi029.stdout:7/768: creat d0/d6/d4f/d66/d7b/fff x:0 0 0 2024-04-15T00:37:00.247 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:37:00.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:37:00.251 INFO:tasks.workunit.client.0.smithi029.stdout:2/779: dread - d3/d2a/d4e/feb zero size 2024-04-15T00:37:00.382 INFO:tasks.workunit.client.0.smithi029.stdout:6/782: truncate d1/d8/f5e 2579423 0 2024-04-15T00:37:00.482 INFO:tasks.workunit.client.0.smithi029.stdout:8/786: mkdir d8/d4a/d78/d10b 0 2024-04-15T00:37:00.698 INFO:tasks.workunit.client.0.smithi029.stdout:2/780: mknod d3/dd/d2d/d61/d85/da2/cff 0 2024-04-15T00:37:00.757 INFO:tasks.workunit.client.0.smithi029.stdout:6/783: creat d1/d1e/d56/dd3/ddf/ff9 x:0 0 0 2024-04-15T00:37:00.788 INFO:tasks.workunit.client.0.smithi029.stdout:3/772: dwrite d17/d2f/d76/f7a [0,4194304] 0 2024-04-15T00:37:00.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/749: rmdir de/d54/d71/dbf 0 2024-04-15T00:37:00.927 INFO:tasks.workunit.client.0.smithi029.stdout:1/739: truncate df/d29/d41/d69/d78/fbe 3005487 0 2024-04-15T00:37:00.932 INFO:tasks.workunit.client.0.smithi029.stdout:5/796: rename d2/de/fde to d2/d1a/f104 0 2024-04-15T00:37:00.964 INFO:tasks.workunit.client.0.smithi029.stdout:5/797: dread d2/de/f10 [0,4194304] 0 2024-04-15T00:37:01.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/799: write d5/db/d8f/f98 [313363,802] 0 2024-04-15T00:37:01.282 INFO:tasks.workunit.client.0.smithi029.stdout:2/781: creat d3/dd/d42/f100 x:0 0 0 2024-04-15T00:37:01.409 INFO:tasks.workunit.client.0.smithi029.stdout:3/773: mknod d17/d2f/d76/cfb 0 2024-04-15T00:37:01.455 INFO:tasks.workunit.client.0.smithi029.stdout:1/740: mkdir df/d29/d41/d96/d102 0 2024-04-15T00:37:01.543 INFO:tasks.workunit.client.0.smithi029.stdout:8/787: mkdir d8/da/d2f/d6e/d92/d10c 0 2024-04-15T00:37:01.634 INFO:tasks.workunit.client.0.smithi029.stdout:9/744: dwrite d3/d6/d9/fd [0,4194304] 0 2024-04-15T00:37:01.698 INFO:tasks.workunit.client.0.smithi029.stdout:8/788: sync 2024-04-15T00:37:01.701 INFO:tasks.workunit.client.0.smithi029.stdout:7/769: creat d0/d6/f100 x:0 0 0 2024-04-15T00:37:01.746 INFO:tasks.workunit.client.0.smithi029.stdout:7/770: chown d0/d6/d4f/d66/d67/d90/ff5 60978 1 2024-04-15T00:37:01.838 INFO:tasks.workunit.client.0.smithi029.stdout:0/800: fsync d5/d15/d68/fc7 0 2024-04-15T00:37:01.846 INFO:tasks.workunit.client.0.smithi029.stdout:2/782: truncate d3/dd/d2d/d61/df6/fb6 2578864 0 2024-04-15T00:37:01.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/774: truncate d17/d2f/d76/d7f/dcd/fd2 5818945 0 2024-04-15T00:37:02.004 INFO:tasks.workunit.client.0.smithi029.stdout:0/801: dread d5/db/d1a/d65/d76/daf/fd8 [0,4194304] 0 2024-04-15T00:37:02.080 INFO:tasks.workunit.client.0.smithi029.stdout:1/741: creat df/d29/d41/d69/d4c/d7a/f103 x:0 0 0 2024-04-15T00:37:03.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/745: mknod d3/d6/d9/d29/d60/d64/ce2 0 2024-04-15T00:37:03.117 INFO:tasks.workunit.client.0.smithi029.stdout:6/784: link d1/d1e/d56/dd3/ldc d1/d8/d79/lfa 0 2024-04-15T00:37:03.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/771: readlink d0/d6/d4f/d5d/ld4 0 2024-04-15T00:37:03.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/742: truncate df/d29/d41/d96/ffe 366560 0 2024-04-15T00:37:03.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/798: link d2/d1a/ff5 d2/de/d1f/d63/f105 0 2024-04-15T00:37:03.185 INFO:tasks.workunit.client.0.smithi029.stdout:9/746: chown d3/d88/ca2 5985746 1 2024-04-15T00:37:03.240 INFO:tasks.workunit.client.0.smithi029.stdout:1/743: chown df/d29/d41/d69/d78/dd1/d59/c89 1901 1 2024-04-15T00:37:04.036 INFO:tasks.workunit.client.0.smithi029.stdout:4/750: dwrite de/d54/d71/da3/fe6 [0,4194304] 0 2024-04-15T00:37:04.138 INFO:tasks.workunit.client.0.smithi029.stdout:2/783: unlink d3/c39 0 2024-04-15T00:37:04.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/785: rmdir d1/d8/db/d98 39 2024-04-15T00:37:04.151 INFO:tasks.workunit.client.0.smithi029.stdout:7/772: creat d0/d6/d4f/d66/d67/f101 x:0 0 0 2024-04-15T00:37:04.167 INFO:tasks.workunit.client.0.smithi029.stdout:1/744: creat df/d29/d41/d69/d78/dd1/d59/f104 x:0 0 0 2024-04-15T00:37:04.187 INFO:tasks.workunit.client.0.smithi029.stdout:5/799: chown d2/de/d13/d22/d26/d36/lab 4167036 1 2024-04-15T00:37:04.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/773: sync 2024-04-15T00:37:04.345 INFO:tasks.workunit.client.0.smithi029.stdout:4/751: fdatasync de/d2b/d35/f6b 0 2024-04-15T00:37:04.386 INFO:tasks.workunit.client.0.smithi029.stdout:5/800: chown d2/f11 3053 1 2024-04-15T00:37:04.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/747: dread d3/d6/d9/d29/d60/d64/d6d/d58/f32 [0,4194304] 0 2024-04-15T00:37:04.749 INFO:tasks.workunit.client.0.smithi029.stdout:0/802: dwrite d5/d4c/fc0 [0,4194304] 0 2024-04-15T00:37:04.758 INFO:tasks.workunit.client.0.smithi029.stdout:8/789: dwrite d8/d4a/d78/d23/d28/d5f/f83 [4194304,4194304] 0 2024-04-15T00:37:04.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/775: dwrite d17/d2f/f39 [0,4194304] 0 2024-04-15T00:37:04.891 INFO:tasks.workunit.client.0.smithi029.stdout:2/784: dread d3/d13/f2f [0,4194304] 0 2024-04-15T00:37:05.132 INFO:tasks.workunit.client.0.smithi029.stdout:7/774: fdatasync d0/d6/d39/d3c/d5b/d7e/fb3 0 2024-04-15T00:37:05.210 INFO:tasks.workunit.client.0.smithi029.stdout:4/752: rename de/d54/d58/d8a/l94 to de/d54/d71/da3/lec 0 2024-04-15T00:37:05.288 INFO:tasks.workunit.client.0.smithi029.stdout:8/790: symlink d8/da/d3d/de0/l10d 0 2024-04-15T00:37:05.414 INFO:tasks.workunit.client.0.smithi029.stdout:8/791: sync 2024-04-15T00:37:05.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/748: creat d3/d6/d9/d15/d62/fe3 x:0 0 0 2024-04-15T00:37:05.519 INFO:tasks.workunit.client.0.smithi029.stdout:6/786: link d1/d8/db/l4f d1/d1e/d22/ddd/lfb 0 2024-04-15T00:37:05.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/775: creat d0/d69/f102 x:0 0 0 2024-04-15T00:37:05.615 INFO:tasks.workunit.client.0.smithi029.stdout:6/787: sync 2024-04-15T00:37:05.686 INFO:tasks.workunit.client.0.smithi029.stdout:8/792: symlink d8/da/d2f/d6e/dc1/l10e 0 2024-04-15T00:37:05.691 INFO:tasks.workunit.client.0.smithi029.stdout:8/793: chown d8/da/d2f/d66 90583211 1 2024-04-15T00:37:05.759 INFO:tasks.workunit.client.0.smithi029.stdout:9/749: truncate d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f93 349281 0 2024-04-15T00:37:05.812 INFO:tasks.workunit.client.0.smithi029.stdout:7/776: fdatasync d0/d6/d4f/f5c 0 2024-04-15T00:37:06.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/745: mknod df/d29/d41/d69/c105 0 2024-04-15T00:37:06.178 INFO:tasks.workunit.client.0.smithi029.stdout:5/801: dwrite d2/de/f57 [8388608,4194304] 0 2024-04-15T00:37:06.242 INFO:tasks.workunit.client.0.smithi029.stdout:5/802: chown d2/de/d13 470486985 1 2024-04-15T00:37:06.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/803: chown d2/de/d13/f19 19 1 2024-04-15T00:37:06.292 INFO:tasks.workunit.client.0.smithi029.stdout:8/794: rename d8/da/fe7 to d8/da/d2f/d6e/f10f 0 2024-04-15T00:37:06.448 INFO:tasks.workunit.client.0.smithi029.stdout:7/777: rename d0/d6/d39/d3c/d5b/d7e/dbe to d0/d6/d4f/d5d/d87/d103 0 2024-04-15T00:37:06.568 INFO:tasks.workunit.client.0.smithi029.stdout:5/804: getdents d2/d1a/d2d/df8 0 2024-04-15T00:37:06.600 INFO:tasks.workunit.client.0.smithi029.stdout:3/776: dwrite d17/d2f/d84/fc6 [0,4194304] 0 2024-04-15T00:37:06.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/803: dwrite d5/db/d1a/d65/d76/daf/ffb [0,4194304] 0 2024-04-15T00:37:06.760 INFO:tasks.workunit.client.0.smithi029.stdout:2/785: dwrite d3/dd/d2d/d61/df6/ff1 [0,4194304] 0 2024-04-15T00:37:07.006 INFO:tasks.workunit.client.0.smithi029.stdout:7/778: fsync d0/d6/d4f/d5d/f6d 0 2024-04-15T00:37:07.112 INFO:tasks.workunit.client.0.smithi029.stdout:3/777: mkdir d17/d2f/d44/d58/d5c/d5f/dfc 0 2024-04-15T00:37:07.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/788: dwrite d1/d1e/d56/f62 [0,4194304] 0 2024-04-15T00:37:07.137 INFO:tasks.workunit.client.0.smithi029.stdout:0/804: rmdir d5/db/d1a/d65/d87 39 2024-04-15T00:37:07.240 INFO:tasks.workunit.client.0.smithi029.stdout:4/753: dwrite f7 [0,4194304] 0 2024-04-15T00:37:07.252 INFO:tasks.workunit.client.0.smithi029.stdout:1/746: readlink df/d29/d41/d69/d4c/l8e 0 2024-04-15T00:37:07.279 INFO:tasks.workunit.client.0.smithi029.stdout:9/750: dwrite d3/d6/f87 [0,4194304] 0 2024-04-15T00:37:07.359 INFO:tasks.workunit.client.0.smithi029.stdout:5/805: rename d2/de/d13/cc7 to d2/de/d13/d22/d26/dd7/c106 0 2024-04-15T00:37:07.386 INFO:tasks.workunit.client.0.smithi029.stdout:8/795: getdents d8/da/d2f/d6e/d10a 0 2024-04-15T00:37:07.542 INFO:tasks.workunit.client.0.smithi029.stdout:8/796: dread d8/d4a/d78/f6b [0,4194304] 0 2024-04-15T00:37:07.589 INFO:tasks.workunit.client.0.smithi029.stdout:8/797: dread d8/da/f88 [0,4194304] 0 2024-04-15T00:37:07.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/786: mkdir d3/dd/d2d/d101 0 2024-04-15T00:37:07.742 INFO:tasks.workunit.client.0.smithi029.stdout:7/779: symlink d0/d6/d4f/d5d/d82/l104 0 2024-04-15T00:37:07.755 INFO:tasks.workunit.client.0.smithi029.stdout:7/780: dread - d0/d6/d4f/d66/d37/f99 zero size 2024-04-15T00:37:07.907 INFO:tasks.workunit.client.0.smithi029.stdout:3/778: rmdir d17/d2f/d44/d68 39 2024-04-15T00:37:07.909 INFO:tasks.workunit.client.0.smithi029.stdout:6/789: fdatasync d1/d8/db/d38/fc2 0 2024-04-15T00:37:07.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/781: sync 2024-04-15T00:37:08.029 INFO:tasks.workunit.client.0.smithi029.stdout:1/747: read - df/d29/d41/d96/ff9 zero size 2024-04-15T00:37:08.049 INFO:tasks.workunit.client.0.smithi029.stdout:3/779: sync 2024-04-15T00:37:08.179 INFO:tasks.workunit.client.0.smithi029.stdout:0/805: mknod d5/db/d1a/d65/d76/daf/dc1/c10a 0 2024-04-15T00:37:08.346 INFO:tasks.workunit.client.0.smithi029.stdout:4/754: symlink de/d6d/led 0 2024-04-15T00:37:08.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/751: symlink d3/d6/d9/le4 0 2024-04-15T00:37:08.715 INFO:tasks.workunit.client.0.smithi029.stdout:3/780: dread f15 [0,4194304] 0 2024-04-15T00:37:08.719 INFO:tasks.workunit.client.0.smithi029.stdout:0/806: mkdir d5/d4c/d4e/d10b 0 2024-04-15T00:37:08.840 INFO:tasks.workunit.client.0.smithi029.stdout:5/806: rename d2/de/d13/d22/d26/d36/c8b to d2/de/d13/daa/dc3/c107 0 2024-04-15T00:37:08.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/755: creat de/d54/d58/fee x:0 0 0 2024-04-15T00:37:09.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/807: creat d5/dc6/f10c x:0 0 0 2024-04-15T00:37:09.099 INFO:tasks.workunit.client.0.smithi029.stdout:3/781: dread - d17/d2f/d44/d58/d5c/fc8 zero size 2024-04-15T00:37:09.158 INFO:tasks.workunit.client.0.smithi029.stdout:2/787: creat d3/f102 x:0 0 0 2024-04-15T00:37:09.176 INFO:tasks.workunit.client.0.smithi029.stdout:4/756: dread - de/d54/fbb zero size 2024-04-15T00:37:09.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/807: truncate d2/de/d13/d22/d3c/d41/d6d/f81 1292680 0 2024-04-15T00:37:09.398 INFO:tasks.workunit.client.0.smithi029.stdout:9/752: unlink d3/d6/f12 0 2024-04-15T00:37:09.400 INFO:tasks.workunit.client.0.smithi029.stdout:8/798: link d8/d4a/da1/l108 d8/da/d3d/l110 0 2024-04-15T00:37:09.407 INFO:tasks.workunit.client.0.smithi029.stdout:0/808: symlink d5/db/d1a/d65/d76/daf/dc1/l10d 0 2024-04-15T00:37:09.442 INFO:tasks.workunit.client.0.smithi029.stdout:1/748: symlink df/l106 0 2024-04-15T00:37:09.451 INFO:tasks.workunit.client.0.smithi029.stdout:0/809: chown d5/d4c/d4e/f80 51 1 2024-04-15T00:37:09.670 INFO:tasks.workunit.client.0.smithi029.stdout:6/790: write d1/d8/db/fd5 [361085,116571] 0 2024-04-15T00:37:09.716 INFO:tasks.workunit.client.0.smithi029.stdout:8/799: stat d8/d4a/d78/d23/d28/d30/db1/f103 0 2024-04-15T00:37:09.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/810: creat d5/d54/dec/f10e x:0 0 0 2024-04-15T00:37:09.869 INFO:tasks.workunit.client.0.smithi029.stdout:7/782: dwrite d0/d6/d4f/d66/d7b/fff [0,4194304] 0 2024-04-15T00:37:09.937 INFO:tasks.workunit.client.0.smithi029.stdout:3/782: rename d17/d2f/d44/d68/le9 to d17/d2f/d76/de1/lfd 0 2024-04-15T00:37:09.967 INFO:tasks.workunit.client.0.smithi029.stdout:7/783: readlink d0/d6/d4f/d5d/d87/ldc 0 2024-04-15T00:37:09.975 INFO:tasks.workunit.client.0.smithi029.stdout:7/784: stat d0/d6/f2c 0 2024-04-15T00:37:10.180 INFO:tasks.workunit.client.0.smithi029.stdout:6/791: rmdir d1/db9/dc3 39 2024-04-15T00:37:10.391 INFO:tasks.workunit.client.0.smithi029.stdout:3/783: mknod d17/d2f/d44/d68/cfe 0 2024-04-15T00:37:10.408 INFO:tasks.workunit.client.0.smithi029.stdout:3/784: read d17/d2f/d76/d7f/fe4 [86359,84204] 0 2024-04-15T00:37:10.538 INFO:tasks.workunit.client.0.smithi029.stdout:8/800: mknod d8/d4a/d78/c111 0 2024-04-15T00:37:10.586 INFO:tasks.workunit.client.0.smithi029.stdout:4/757: link de/df/d1e/d56/cad de/d54/d71/cef 0 2024-04-15T00:37:10.594 INFO:tasks.workunit.client.0.smithi029.stdout:4/758: chown de/df/f12 87127 1 2024-04-15T00:37:10.605 INFO:tasks.workunit.client.0.smithi029.stdout:4/759: chown de/d54/d71/d8b/ce4 508242 1 2024-04-15T00:37:10.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/801: sync 2024-04-15T00:37:10.922 INFO:tasks.workunit.client.0.smithi029.stdout:6/792: mknod d1/d1e/d56/dd3/de5/df7/cfc 0 2024-04-15T00:37:10.930 INFO:tasks.workunit.client.0.smithi029.stdout:4/760: symlink de/d54/d71/d8b/db1/lf0 0 2024-04-15T00:37:11.058 INFO:tasks.workunit.client.0.smithi029.stdout:5/808: dwrite d2/de/d13/d22/d3c/f9f [0,4194304] 0 2024-04-15T00:37:11.136 INFO:tasks.workunit.client.0.smithi029.stdout:2/788: dwrite d3/dd/d2d/d61/df6/fb6 [0,4194304] 0 2024-04-15T00:37:11.218 INFO:tasks.workunit.client.0.smithi029.stdout:9/753: dwrite d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fc7 [0,4194304] 0 2024-04-15T00:37:11.247 INFO:tasks.workunit.client.0.smithi029.stdout:3/785: dread d17/d2f/d44/d58/d5c/d5f/f7b [0,4194304] 0 2024-04-15T00:37:11.250 INFO:tasks.workunit.client.0.smithi029.stdout:1/749: link df/d29/d41/d69/d78/dd1/ccd df/d29/d41/d69/d78/dd1/d80/c107 0 2024-04-15T00:37:11.259 INFO:tasks.workunit.client.0.smithi029.stdout:0/811: link d5/d15/f4a d5/db/d1a/d65/d76/daf/dc1/dfd/f10f 0 2024-04-15T00:37:11.318 INFO:tasks.workunit.client.0.smithi029.stdout:3/786: chown d17/d2f/d3c/c43 51 1 2024-04-15T00:37:11.330 INFO:tasks.workunit.client.0.smithi029.stdout:1/750: chown df/d29/d41/d69/d78/dd1/c66 4909 1 2024-04-15T00:37:11.413 INFO:tasks.workunit.client.0.smithi029.stdout:7/785: write d0/d6/d4f/fe0 [412365,22572] 0 2024-04-15T00:37:11.987 INFO:tasks.workunit.client.0.smithi029.stdout:8/802: dwrite d8/d4a/d78/d23/d28/fc6 [0,4194304] 0 2024-04-15T00:37:12.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/787: creat d17/d2a/d46/d67/dd6/fff x:0 0 0 2024-04-15T00:37:12.151 INFO:tasks.workunit.client.0.smithi029.stdout:2/789: dwrite d3/dd/d2d/d61/d85/fbf [0,4194304] 0 2024-04-15T00:37:12.216 INFO:tasks.workunit.client.0.smithi029.stdout:1/751: write df/da4/fcf [738622,126975] 0 2024-04-15T00:37:12.234 INFO:tasks.workunit.client.0.smithi029.stdout:1/752: readlink l6 0 2024-04-15T00:37:12.248 INFO:tasks.workunit.client.0.smithi029.stdout:1/753: dread - df/d29/d41/daf/fc9 zero size 2024-04-15T00:37:12.261 INFO:tasks.workunit.client.0.smithi029.stdout:1/754: stat df/d29/d41/d69/d4c/l8e 0 2024-04-15T00:37:12.340 INFO:tasks.workunit.client.0.smithi029.stdout:7/786: fdatasync d0/d69/fea 0 2024-04-15T00:37:12.364 INFO:tasks.workunit.client.0.smithi029.stdout:4/761: creat de/d3a/ff1 x:0 0 0 2024-04-15T00:37:12.470 INFO:tasks.workunit.client.0.smithi029.stdout:5/809: dwrite d2/de/d13/d22/d26/d36/f38 [4194304,4194304] 0 2024-04-15T00:37:13.045 INFO:tasks.workunit.client.0.smithi029.stdout:6/793: getdents d1/d8/db/d7b 0 2024-04-15T00:37:13.060 INFO:tasks.workunit.client.0.smithi029.stdout:9/754: getdents d3/d6/d9/d15 0 2024-04-15T00:37:13.133 INFO:tasks.workunit.client.0.smithi029.stdout:4/762: rmdir de/d2b/d59 39 2024-04-15T00:37:13.216 INFO:tasks.workunit.client.0.smithi029.stdout:7/787: creat d0/d6/d4f/d66/d37/db7/f105 x:0 0 0 2024-04-15T00:37:13.334 INFO:tasks.workunit.client.0.smithi029.stdout:5/810: unlink d2/de/d13/dd2/ce2 0 2024-04-15T00:37:13.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/788: unlink d17/d83/fa3 0 2024-04-15T00:37:13.480 INFO:tasks.workunit.client.0.smithi029.stdout:2/790: fsync d3/dd/d2d/d61/df6/fbb 0 2024-04-15T00:37:13.639 INFO:tasks.workunit.client.0.smithi029.stdout:1/755: symlink df/d29/deb/l108 0 2024-04-15T00:37:13.761 INFO:tasks.workunit.client.0.smithi029.stdout:4/763: write f7 [2041749,56166] 0 2024-04-15T00:37:13.989 INFO:tasks.workunit.client.0.smithi029.stdout:5/811: unlink d2/de/d13/d22/d3c/f6b 0 2024-04-15T00:37:13.994 INFO:tasks.workunit.client.0.smithi029.stdout:0/812: rename d5/db/d1a/d65/d87 to d5/db/d110 0 2024-04-15T00:37:14.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/791: mkdir d3/dd/da0/d103 0 2024-04-15T00:37:14.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/756: rmdir df/d29/d41/d96 39 2024-04-15T00:37:14.319 INFO:tasks.workunit.client.0.smithi029.stdout:4/764: symlink de/d6d/dde/lf2 0 2024-04-15T00:37:14.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/803: rename d8/d4a/d78/d23/d28/d5f/dfe to d8/da/d2f/d6e/d92/d10c/d112 0 2024-04-15T00:37:14.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/813: chown d5/d15/d68/lc9 196400172 1 2024-04-15T00:37:14.411 INFO:tasks.workunit.client.0.smithi029.stdout:0/814: stat d5/d54/dec/f10e 0 2024-04-15T00:37:14.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/812: dread d2/de/d13/d22/f5a [0,4194304] 0 2024-04-15T00:37:14.493 INFO:tasks.workunit.client.0.smithi029.stdout:1/757: mkdir df/d29/d41/d69/d78/dd1/d109 0 2024-04-15T00:37:14.692 INFO:tasks.workunit.client.0.smithi029.stdout:9/755: rename d3/d6/d9/c1d to d3/d6/d9/d15/d4a/d53/ce5 0 2024-04-15T00:37:14.803 INFO:tasks.workunit.client.0.smithi029.stdout:0/815: mknod d5/d15/d27/d9f/c111 0 2024-04-15T00:37:14.914 INFO:tasks.workunit.client.0.smithi029.stdout:1/758: mkdir df/d29/d41/d69/d78/dd1/d59/d10a 0 2024-04-15T00:37:14.960 INFO:tasks.workunit.client.0.smithi029.stdout:9/756: read d3/d6/d9/fd [294220,96775] 0 2024-04-15T00:37:14.986 INFO:tasks.workunit.client.0.smithi029.stdout:8/804: mkdir d8/d4a/d78/dca/d113 0 2024-04-15T00:37:15.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/759: dread df/f3e [0,4194304] 0 2024-04-15T00:37:15.160 INFO:tasks.workunit.client.0.smithi029.stdout:0/816: symlink d5/d15/d1f/dd3/l112 0 2024-04-15T00:37:15.275 INFO:tasks.workunit.client.0.smithi029.stdout:5/813: mkdir d2/de/d13/d22/d26/dfc/d108 0 2024-04-15T00:37:15.284 INFO:tasks.workunit.client.0.smithi029.stdout:5/814: stat d2/de/d13/d22/lf2 0 2024-04-15T00:37:15.396 INFO:tasks.workunit.client.0.smithi029.stdout:9/757: fdatasync d3/d6/d9/d29/d60/d7f/da0/d9a/f73 0 2024-04-15T00:37:15.450 INFO:tasks.workunit.client.0.smithi029.stdout:6/794: dwrite d1/d8/db/f4a [0,4194304] 0 2024-04-15T00:37:15.537 INFO:tasks.workunit.client.0.smithi029.stdout:0/817: truncate d5/d4c/d4e/f80 956251 0 2024-04-15T00:37:15.545 INFO:tasks.workunit.client.0.smithi029.stdout:8/805: dread d8/d4a/d78/d23/d28/d30/d39/f4b [0,4194304] 0 2024-04-15T00:37:15.573 INFO:tasks.workunit.client.0.smithi029.stdout:5/815: unlink d2/de/d13/f19 0 2024-04-15T00:37:15.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/816: chown d2/de/d13/d22/d3c/d41/c4f 6383404 1 2024-04-15T00:37:15.645 INFO:tasks.workunit.client.0.smithi029.stdout:2/792: getdents d3/d13/d43/d5a 0 2024-04-15T00:37:15.646 INFO:tasks.workunit.client.0.smithi029.stdout:3/789: write d17/d2f/f71 [2185820,1836] 0 2024-04-15T00:37:15.825 INFO:tasks.workunit.client.0.smithi029.stdout:7/788: creat d0/d6/d4f/f106 x:0 0 0 2024-04-15T00:37:15.969 INFO:tasks.workunit.client.0.smithi029.stdout:8/806: unlink d8/da/d2f/d6e/d5a/lbd 0 2024-04-15T00:37:16.096 INFO:tasks.workunit.client.0.smithi029.stdout:0/818: truncate d5/db/d8f/f98 4505723 0 2024-04-15T00:37:16.106 INFO:tasks.workunit.client.0.smithi029.stdout:5/817: creat d2/de/d13/d22/d26/d36/d4d/f109 x:0 0 0 2024-04-15T00:37:16.117 INFO:tasks.workunit.client.0.smithi029.stdout:4/765: dwrite de/d6d/fb9 [0,4194304] 0 2024-04-15T00:37:16.222 INFO:tasks.workunit.client.0.smithi029.stdout:2/793: creat d3/d50/d51/f104 x:0 0 0 2024-04-15T00:37:16.272 INFO:tasks.workunit.client.0.smithi029.stdout:8/807: dread d8/d4a/d78/f89 [0,4194304] 0 2024-04-15T00:37:16.344 INFO:tasks.workunit.client.0.smithi029.stdout:4/766: sync 2024-04-15T00:37:16.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/795: mkdir d1/d8/db/d98/dfd 0 2024-04-15T00:37:16.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/794: mknod d3/d93/c105 0 2024-04-15T00:37:16.569 INFO:tasks.workunit.client.0.smithi029.stdout:0/819: creat d5/d15/d27/d9f/ddb/f113 x:0 0 0 2024-04-15T00:37:16.666 INFO:tasks.workunit.client.0.smithi029.stdout:5/818: symlink d2/de/d13/d22/d3c/d41/d6d/l10a 0 2024-04-15T00:37:16.913 INFO:tasks.workunit.client.0.smithi029.stdout:1/760: dwrite df/d32/f36 [0,4194304] 0 2024-04-15T00:37:16.982 INFO:tasks.workunit.client.0.smithi029.stdout:6/796: rename d1/d8/db/db7/ccc to d1/d8/db/d38/de4/cfe 0 2024-04-15T00:37:17.009 INFO:tasks.workunit.client.0.smithi029.stdout:1/761: dread - df/d29/d41/d4f/f87 zero size 2024-04-15T00:37:17.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/819: mknod d2/de/d13/daa/dc3/c10b 0 2024-04-15T00:37:17.101 INFO:tasks.workunit.client.0.smithi029.stdout:9/758: write d3/d6/d9/d29/d60/d64/d6d/d58/f99 [3273860,82483] 0 2024-04-15T00:37:17.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/820: creat d5/db/d7b/f114 x:0 0 0 2024-04-15T00:37:17.134 INFO:tasks.workunit.client.0.smithi029.stdout:9/759: readlink d3/d6/d30/l71 0 2024-04-15T00:37:17.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/797: read d1/d8/db/db7/fbd [276685,90755] 0 2024-04-15T00:37:17.753 INFO:tasks.workunit.client.0.smithi029.stdout:3/790: dwrite d17/d2f/d44/d58/d5c/fc9 [0,4194304] 0 2024-04-15T00:37:17.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/762: dread df/d29/d41/d69/d4c/d7a/fa6 [0,4194304] 0 2024-04-15T00:37:18.047 INFO:tasks.workunit.client.0.smithi029.stdout:5/820: rename d2/de/d13/d22/d3c/d41/d6d/l10a to d2/de/d13/d22/d26/d36/d4d/dfb/l10c 0 2024-04-15T00:37:18.075 INFO:tasks.workunit.client.0.smithi029.stdout:9/760: read d3/d6/d9/f49 [1946222,8711] 0 2024-04-15T00:37:18.128 INFO:tasks.workunit.client.0.smithi029.stdout:1/763: sync 2024-04-15T00:37:18.157 INFO:tasks.workunit.client.0.smithi029.stdout:8/808: dwrite d8/d4a/d78/d23/faa [0,4194304] 0 2024-04-15T00:37:18.217 INFO:tasks.workunit.client.0.smithi029.stdout:8/809: stat d8 0 2024-04-15T00:37:18.241 INFO:tasks.workunit.client.0.smithi029.stdout:4/767: write de/d3a/fc2 [575855,103577] 0 2024-04-15T00:37:18.245 INFO:tasks.workunit.client.0.smithi029.stdout:2/795: write d3/dd/d2d/d61/dd5/d95/f20 [9790550,116537] 0 2024-04-15T00:37:18.626 INFO:tasks.workunit.client.0.smithi029.stdout:0/821: dwrite d5/d15/d27/d9f/ddb/ff4 [0,4194304] 0 2024-04-15T00:37:18.928 INFO:tasks.workunit.client.0.smithi029.stdout:3/791: dread d17/d2f/d44/f9c [0,4194304] 0 2024-04-15T00:37:19.007 INFO:tasks.workunit.client.0.smithi029.stdout:5/821: dread d2/de/d13/d22/f40 [4194304,4194304] 0 2024-04-15T00:37:19.038 INFO:tasks.workunit.client.0.smithi029.stdout:9/761: mkdir d3/d6/d9/d15/d7e/de6 0 2024-04-15T00:37:19.129 INFO:tasks.workunit.client.0.smithi029.stdout:5/822: sync 2024-04-15T00:37:19.135 INFO:tasks.workunit.client.0.smithi029.stdout:7/789: getdents d0/d6/d4f/d66/d26 0 2024-04-15T00:37:19.156 INFO:tasks.workunit.client.0.smithi029.stdout:8/810: dread - d8/d4a/d78/dca/fdc zero size 2024-04-15T00:37:19.174 INFO:tasks.workunit.client.0.smithi029.stdout:2/796: mknod d3/dd/d42/dd1/c106 0 2024-04-15T00:37:19.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/822: dread d5/d4c/fc0 [0,4194304] 0 2024-04-15T00:37:19.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/823: dread d2/d1a/f104 [4194304,4194304] 0 2024-04-15T00:37:19.745 INFO:tasks.workunit.client.0.smithi029.stdout:8/811: fdatasync d8/da/d2f/d6e/f94 0 2024-04-15T00:37:19.755 INFO:tasks.workunit.client.0.smithi029.stdout:0/823: creat d5/d4c/d8a/f115 x:0 0 0 2024-04-15T00:37:19.764 INFO:tasks.workunit.client.0.smithi029.stdout:6/798: creat d1/d8/d72/fff x:0 0 0 2024-04-15T00:37:19.784 INFO:tasks.workunit.client.0.smithi029.stdout:0/824: chown d5/db 13674373 1 2024-04-15T00:37:19.828 INFO:tasks.workunit.client.0.smithi029.stdout:1/764: creat df/d29/f10b x:0 0 0 2024-04-15T00:37:19.879 INFO:tasks.workunit.client.0.smithi029.stdout:9/762: truncate d3/da3/fb7 1512153 0 2024-04-15T00:37:19.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/763: chown d3/d6/d9/d15/d7e/cd7 212 1 2024-04-15T00:37:19.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/765: sync 2024-04-15T00:37:19.965 INFO:tasks.workunit.client.0.smithi029.stdout:7/790: write d0/d6/f64 [3206628,118586] 0 2024-04-15T00:37:20.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/768: dwrite de/d6d/dde/fe3 [0,4194304] 0 2024-04-15T00:37:20.411 INFO:tasks.workunit.client.0.smithi029.stdout:3/792: rmdir d17/d2f/d44/d58/d5c/df4 0 2024-04-15T00:37:20.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/812: creat d8/d4a/f114 x:0 0 0 2024-04-15T00:37:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:4/769: write de/fa4 [8744755,110532] 0 2024-04-15T00:37:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:9/764: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e [1822018,52385] 0 2024-04-15T00:37:20.771 INFO:tasks.workunit.client.0.smithi029.stdout:0/825: write d5/d15/d1f/f73 [4077967,86608] 0 2024-04-15T00:37:20.876 INFO:tasks.workunit.client.0.smithi029.stdout:6/799: mknod d1/d1e/d56/c100 0 2024-04-15T00:37:20.919 INFO:tasks.workunit.client.0.smithi029.stdout:8/813: fsync d8/da/d2f/d42/f7e 0 2024-04-15T00:37:20.929 INFO:tasks.workunit.client.0.smithi029.stdout:5/824: link d2/d1a/f2c d2/de/d13/d22/d26/d36/d4d/dfb/f10d 0 2024-04-15T00:37:20.950 INFO:tasks.workunit.client.0.smithi029.stdout:7/791: mkdir d0/d6/d39/d107 0 2024-04-15T00:37:21.006 INFO:tasks.workunit.client.0.smithi029.stdout:2/797: dwrite d3/d13/d43/fa3 [0,4194304] 0 2024-04-15T00:37:21.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/766: dwrite df/d32/d90/dc1/ff3 [0,4194304] 0 2024-04-15T00:37:21.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/798: readlink d3/d13/l19 0 2024-04-15T00:37:21.181 INFO:tasks.workunit.client.0.smithi029.stdout:4/770: chown de/c1a 1 1 2024-04-15T00:37:21.242 INFO:tasks.workunit.client.0.smithi029.stdout:9/765: creat d3/da3/fe7 x:0 0 0 2024-04-15T00:37:21.253 INFO:tasks.workunit.client.0.smithi029.stdout:0/826: fdatasync d5/db/f45 0 2024-04-15T00:37:21.372 INFO:tasks.workunit.client.0.smithi029.stdout:7/792: dread d0/d6/d4f/d5d/d65/dbc/f92 [0,4194304] 0 2024-04-15T00:37:21.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/793: symlink d17/d2a/d4c/da1/l100 0 2024-04-15T00:37:21.610 INFO:tasks.workunit.client.0.smithi029.stdout:1/767: dwrite df/d29/d41/d69/d4c/df4/ffa [0,4194304] 0 2024-04-15T00:37:21.612 INFO:tasks.workunit.client.0.smithi029.stdout:6/800: dwrite d1/f17 [0,4194304] 0 2024-04-15T00:37:21.735 INFO:tasks.workunit.client.0.smithi029.stdout:9/766: mkdir d3/d6/d9/d15/de8 0 2024-04-15T00:37:21.747 INFO:tasks.workunit.client.0.smithi029.stdout:7/793: fsync d0/d6/f25 0 2024-04-15T00:37:21.786 INFO:tasks.workunit.client.0.smithi029.stdout:3/794: dread - d17/d2f/d84/fd0 zero size 2024-04-15T00:37:21.871 INFO:tasks.workunit.client.0.smithi029.stdout:3/795: stat d17/d2a/d4c/f70 0 2024-04-15T00:37:21.960 INFO:tasks.workunit.client.0.smithi029.stdout:5/825: dwrite d2/de/d1f/d63/f105 [0,4194304] 0 2024-04-15T00:37:22.051 INFO:tasks.workunit.client.0.smithi029.stdout:2/799: rmdir d3/dd/da0/d103 0 2024-04-15T00:37:22.068 INFO:tasks.workunit.client.0.smithi029.stdout:6/801: rmdir d1/d8/d79/dcb 39 2024-04-15T00:37:22.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/800: chown d3/dd/d2d/d61/dd5/d4a/f9e 81354532 1 2024-04-15T00:37:22.108 INFO:tasks.workunit.client.0.smithi029.stdout:2/801: chown d3/d2a/c82 29 1 2024-04-15T00:37:22.176 INFO:tasks.workunit.client.0.smithi029.stdout:2/802: dread d3/dd/d42/dc6/dee/ffa [0,4194304] 0 2024-04-15T00:37:22.443 INFO:tasks.workunit.client.0.smithi029.stdout:7/794: write d0/d6/d4f/d66/d67/f101 [818952,50978] 0 2024-04-15T00:37:22.446 INFO:tasks.workunit.client.0.smithi029.stdout:4/771: link de/d54/c7f de/d54/d71/d8b/db1/dd5/cf3 0 2024-04-15T00:37:22.446 INFO:tasks.workunit.client.0.smithi029.stdout:0/827: link d5/d3e/de3/f49 d5/d15/d27/d9f/ddb/f116 0 2024-04-15T00:37:22.472 INFO:tasks.workunit.client.0.smithi029.stdout:5/826: mkdir d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/d10e 0 2024-04-15T00:37:22.516 INFO:tasks.workunit.client.0.smithi029.stdout:8/814: getdents d8/da/d2f/d6e 0 2024-04-15T00:37:22.641 INFO:tasks.workunit.client.0.smithi029.stdout:1/768: dwrite df/d29/d41/daf/fc9 [0,4194304] 0 2024-04-15T00:37:22.886 INFO:tasks.workunit.client.0.smithi029.stdout:2/803: rmdir d3/d93/dbe 39 2024-04-15T00:37:22.895 INFO:tasks.workunit.client.0.smithi029.stdout:6/802: creat d1/d1e/d56/d58/d59/f101 x:0 0 0 2024-04-15T00:37:22.898 INFO:tasks.workunit.client.0.smithi029.stdout:7/795: fdatasync d0/d6/ff4 0 2024-04-15T00:37:23.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/804: dread d3/dd/d2d/d61/df6/fa8 [0,4194304] 0 2024-04-15T00:37:23.185 INFO:tasks.workunit.client.0.smithi029.stdout:4/772: rename de/d6d/d7e/f82 to de/d54/d71/db5/ff4 0 2024-04-15T00:37:23.216 INFO:tasks.workunit.client.0.smithi029.stdout:3/796: write d17/d2a/d4c/d93/fb3 [2453075,53993] 0 2024-04-15T00:37:23.227 INFO:tasks.workunit.client.0.smithi029.stdout:0/828: read d5/db/d1a/d65/d76/daf/dc1/dfd/f10f [129249,27648] 0 2024-04-15T00:37:23.245 INFO:tasks.workunit.client.0.smithi029.stdout:3/797: chown d17/d2f/d44/d58/d5c 1 1 2024-04-15T00:37:23.689 INFO:tasks.workunit.client.0.smithi029.stdout:6/803: mkdir d1/d8/d72/da3/d102 0 2024-04-15T00:37:23.985 INFO:tasks.workunit.client.0.smithi029.stdout:0/829: mkdir d5/d54/dec/d117 0 2024-04-15T00:37:24.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/815: write d8/da/f88 [2251751,65919] 0 2024-04-15T00:37:24.111 INFO:tasks.workunit.client.0.smithi029.stdout:5/827: write d2/de/d13/d22/f40 [1263217,124803] 0 2024-04-15T00:37:24.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/773: symlink de/d2b/d59/lf5 0 2024-04-15T00:37:24.322 INFO:tasks.workunit.client.0.smithi029.stdout:5/828: sync 2024-04-15T00:37:24.465 INFO:tasks.workunit.client.0.smithi029.stdout:6/804: getdents d1/d8/d72/da3/deb 0 2024-04-15T00:37:24.479 INFO:tasks.workunit.client.0.smithi029.stdout:6/805: dread - d1/d8/db/fb1 zero size 2024-04-15T00:37:24.574 INFO:tasks.workunit.client.0.smithi029.stdout:8/816: creat d8/d4a/da1/dee/f115 x:0 0 0 2024-04-15T00:37:24.579 INFO:tasks.workunit.client.0.smithi029.stdout:1/769: getdents df/d29/d41/d69/d4c/df4 0 2024-04-15T00:37:24.581 INFO:tasks.workunit.client.0.smithi029.stdout:9/767: write d3/d6/d9/d15/d4a/d53/f5b [994408,53774] 0 2024-04-15T00:37:24.594 INFO:tasks.workunit.client.0.smithi029.stdout:4/774: symlink de/d6d/dde/lf6 0 2024-04-15T00:37:24.830 INFO:tasks.workunit.client.0.smithi029.stdout:8/817: dread d8/da/d2f/d42/f7b [0,4194304] 0 2024-04-15T00:37:24.856 INFO:tasks.workunit.client.0.smithi029.stdout:1/770: mkdir df/d29/d41/d69/d78/dd1/d59/d10c 0 2024-04-15T00:37:24.868 INFO:tasks.workunit.client.0.smithi029.stdout:1/771: truncate df/f1c 1891168 0 2024-04-15T00:37:24.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/768: creat d3/d6/d9/d15/d4a/d53/fe9 x:0 0 0 2024-04-15T00:37:24.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/769: truncate d3/da3/fe7 233395 0 2024-04-15T00:37:25.024 INFO:tasks.workunit.client.0.smithi029.stdout:3/798: truncate d17/d2f/d76/d7f/dcd/fd2 5371749 0 2024-04-15T00:37:25.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/829: link d2/de/d13/d22/d26/d36/d4d/dfb/fff d2/de/d13/d22/d26/d36/d4d/d70/d9a/f10f 0 2024-04-15T00:37:25.211 INFO:tasks.workunit.client.0.smithi029.stdout:8/818: read d8/da/d2f/d6e/d5a/fdb [1796765,63040] 0 2024-04-15T00:37:25.213 INFO:tasks.workunit.client.0.smithi029.stdout:5/830: dread d2/de/d13/d22/d26/d36/d4d/d70/d9a/f5c [0,4194304] 0 2024-04-15T00:37:25.238 INFO:tasks.workunit.client.0.smithi029.stdout:7/796: write d0/d6/d4f/d66/d26/d77/f96 [3986128,96036] 0 2024-04-15T00:37:25.294 INFO:tasks.workunit.client.0.smithi029.stdout:2/805: write d3/d13/d43/d9a/fe7 [795235,96527] 0 2024-04-15T00:37:25.534 INFO:tasks.workunit.client.0.smithi029.stdout:8/819: dread d8/d4a/d78/d23/d28/d30/d39/d77/fd5 [0,4194304] 0 2024-04-15T00:37:25.544 INFO:tasks.workunit.client.0.smithi029.stdout:4/775: rename de/df/d1e/f29 to de/d54/ff7 0 2024-04-15T00:37:25.778 INFO:tasks.workunit.client.0.smithi029.stdout:9/770: mknod d3/d6/d9/d15/d7e/de6/cea 0 2024-04-15T00:37:25.795 INFO:tasks.workunit.client.0.smithi029.stdout:5/831: symlink d2/d1a/d2d/df8/l110 0 2024-04-15T00:37:25.839 INFO:tasks.workunit.client.0.smithi029.stdout:1/772: rename df/f22 to df/d29/d41/daf/f10d 0 2024-04-15T00:37:25.853 INFO:tasks.workunit.client.0.smithi029.stdout:0/830: write d5/d4c/d4e/f107 [371510,113952] 0 2024-04-15T00:37:25.901 INFO:tasks.workunit.client.0.smithi029.stdout:7/797: link d0/cd6 d0/d6/d4f/d5d/d65/dbc/d8e/c108 0 2024-04-15T00:37:26.021 INFO:tasks.workunit.client.0.smithi029.stdout:4/776: rmdir de/d3a/daa 39 2024-04-15T00:37:26.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/820: mknod d8/da/d2f/d6e/dc1/ded/d107/c116 0 2024-04-15T00:37:26.133 INFO:tasks.workunit.client.0.smithi029.stdout:6/806: dwrite d1/d1e/d56/d58/fcd [4194304,4194304] 0 2024-04-15T00:37:26.370 INFO:tasks.workunit.client.0.smithi029.stdout:9/771: creat d3/d6/d9/d15/de8/feb x:0 0 0 2024-04-15T00:37:26.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/799: write fa [397480,83350] 0 2024-04-15T00:37:26.684 INFO:tasks.workunit.client.0.smithi029.stdout:0/831: creat d5/d15/d57/d5e/dfa/f118 x:0 0 0 2024-04-15T00:37:26.702 INFO:tasks.workunit.client.0.smithi029.stdout:4/777: write de/d54/d58/d8a/f98 [4463669,43108] 0 2024-04-15T00:37:26.715 INFO:tasks.workunit.client.0.smithi029.stdout:1/773: mkdir df/d29/d41/d69/d4c/d10e 0 2024-04-15T00:37:26.815 INFO:tasks.workunit.client.0.smithi029.stdout:8/821: dread - d8/d4a/d78/d23/d28/d30/db1/f103 zero size 2024-04-15T00:37:26.921 INFO:tasks.workunit.client.0.smithi029.stdout:2/806: dwrite d3/d13/d43/d5a/ff7 [0,4194304] 0 2024-04-15T00:37:26.980 INFO:tasks.workunit.client.0.smithi029.stdout:3/800: unlink d17/d2a/c3e 0 2024-04-15T00:37:26.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/832: fdatasync d5/d54/dec/ff8 0 2024-04-15T00:37:27.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/778: fdatasync de/d54/f81 0 2024-04-15T00:37:27.056 INFO:tasks.workunit.client.0.smithi029.stdout:3/801: chown d17/d2a/d4c/da1/lc5 3 1 2024-04-15T00:37:27.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/774: rmdir df/d29/d41/daf 39 2024-04-15T00:37:27.106 INFO:tasks.workunit.client.0.smithi029.stdout:5/832: write d2/f34 [500817,29407] 0 2024-04-15T00:37:27.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/775: chown df/f30 238782762 1 2024-04-15T00:37:27.133 INFO:tasks.workunit.client.0.smithi029.stdout:1/776: chown df/l7b 7102 1 2024-04-15T00:37:27.199 INFO:tasks.workunit.client.0.smithi029.stdout:7/798: write d0/d6/ff4 [612474,116240] 0 2024-04-15T00:37:27.215 INFO:tasks.workunit.client.0.smithi029.stdout:7/799: stat d0/d6/d4f/d66 0 2024-04-15T00:37:27.799 INFO:tasks.workunit.client.0.smithi029.stdout:0/833: fsync d5/db/d1a/d50/fa5 0 2024-04-15T00:37:27.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/779: dread de/d6d/fb9 [0,4194304] 0 2024-04-15T00:37:27.978 INFO:tasks.workunit.client.0.smithi029.stdout:3/802: unlink d17/d2a/d46/d67/ld8 0 2024-04-15T00:37:27.984 INFO:tasks.workunit.client.0.smithi029.stdout:8/822: mkdir d8/da/d117 0 2024-04-15T00:37:28.092 INFO:tasks.workunit.client.0.smithi029.stdout:8/823: chown d8/da/d2f/d42/f7b 452 1 2024-04-15T00:37:28.103 INFO:tasks.workunit.client.0.smithi029.stdout:6/807: dwrite d1/d8/db/f40 [0,4194304] 0 2024-04-15T00:37:28.172 INFO:tasks.workunit.client.0.smithi029.stdout:9/772: creat d3/d6/d9/fec x:0 0 0 2024-04-15T00:37:28.228 INFO:tasks.workunit.client.0.smithi029.stdout:0/834: dread - d5/dc6/f10c zero size 2024-04-15T00:37:28.579 INFO:tasks.workunit.client.0.smithi029.stdout:3/803: creat d17/d2f/d3c/f101 x:0 0 0 2024-04-15T00:37:28.598 INFO:tasks.workunit.client.0.smithi029.stdout:9/773: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fed x:0 0 0 2024-04-15T00:37:28.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/835: mknod d5/db/d110/c119 0 2024-04-15T00:37:28.728 INFO:tasks.workunit.client.0.smithi029.stdout:4/780: symlink de/d3a/lf8 0 2024-04-15T00:37:28.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/807: dwrite d3/dd/f27 [4194304,4194304] 0 2024-04-15T00:37:28.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/774: rmdir d3/da3/da7 39 2024-04-15T00:37:28.907 INFO:tasks.workunit.client.0.smithi029.stdout:3/804: unlink d17/d2a/d4c/da1/la2 0 2024-04-15T00:37:29.008 INFO:tasks.workunit.client.0.smithi029.stdout:4/781: creat de/d2b/d35/ff9 x:0 0 0 2024-04-15T00:37:29.085 INFO:tasks.workunit.client.0.smithi029.stdout:6/808: creat d1/db9/dc3/f103 x:0 0 0 2024-04-15T00:37:29.254 INFO:tasks.workunit.client.0.smithi029.stdout:2/808: creat d3/dd/d42/dc6/dee/f107 x:0 0 0 2024-04-15T00:37:29.286 INFO:tasks.workunit.client.0.smithi029.stdout:2/809: readlink d3/dd/da0/la9 0 2024-04-15T00:37:29.310 INFO:tasks.workunit.client.0.smithi029.stdout:9/775: dread d3/d6/d9/d29/d60/d64/d6d/d58/d6a/fcd [0,4194304] 0 2024-04-15T00:37:29.674 INFO:tasks.workunit.client.0.smithi029.stdout:4/782: dread de/d2b/d35/f3d [0,4194304] 0 2024-04-15T00:37:29.763 INFO:tasks.workunit.client.0.smithi029.stdout:8/824: write d8/d4a/d78/f1c [7452819,15490] 0 2024-04-15T00:37:29.767 INFO:tasks.workunit.client.0.smithi029.stdout:1/777: dwrite df/d29/d41/d4f/f58 [0,4194304] 0 2024-04-15T00:37:29.779 INFO:tasks.workunit.client.0.smithi029.stdout:5/833: dwrite d2/de/f72 [0,4194304] 0 2024-04-15T00:37:29.877 INFO:tasks.workunit.client.0.smithi029.stdout:9/776: mknod d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/cee 0 2024-04-15T00:37:29.918 INFO:tasks.workunit.client.0.smithi029.stdout:7/800: dwrite d0/f4e [4194304,4194304] 0 2024-04-15T00:37:30.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:37:30.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:37:30.336 INFO:tasks.workunit.client.0.smithi029.stdout:0/836: dwrite d5/dc6/f10c [0,4194304] 0 2024-04-15T00:37:30.413 INFO:tasks.workunit.client.0.smithi029.stdout:3/805: write f15 [1113048,125310] 0 2024-04-15T00:37:30.416 INFO:tasks.workunit.client.0.smithi029.stdout:6/809: write d1/d8/d72/f87 [2609958,88031] 0 2024-04-15T00:37:30.440 INFO:tasks.workunit.client.0.smithi029.stdout:0/837: chown d5/db/l83 7580890 1 2024-04-15T00:37:30.479 INFO:tasks.workunit.client.0.smithi029.stdout:2/810: write d3/d2a/fce [1817638,55705] 0 2024-04-15T00:37:30.508 INFO:tasks.workunit.client.0.smithi029.stdout:1/778: dread - df/d29/fe3 zero size 2024-04-15T00:37:30.521 INFO:tasks.workunit.client.0.smithi029.stdout:8/825: dread - d8/ff4 zero size 2024-04-15T00:37:30.563 INFO:tasks.workunit.client.0.smithi029.stdout:9/777: dread d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb3 [0,4194304] 0 2024-04-15T00:37:30.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/810: readlink d1/d1e/l25 0 2024-04-15T00:37:30.634 INFO:tasks.workunit.client.0.smithi029.stdout:3/806: sync 2024-04-15T00:37:30.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/801: mknod d0/c109 0 2024-04-15T00:37:30.676 INFO:tasks.workunit.client.0.smithi029.stdout:4/783: truncate de/d54/ff7 64744 0 2024-04-15T00:37:30.784 INFO:tasks.workunit.client.0.smithi029.stdout:2/811: dread d3/dd/d2d/d61/d85/f92 [0,4194304] 0 2024-04-15T00:37:30.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/838: write d5/db/d1a/d65/d76/daf/dc1/f100 [61005,71305] 0 2024-04-15T00:37:30.919 INFO:tasks.workunit.client.0.smithi029.stdout:4/784: dread de/d2b/f62 [0,4194304] 0 2024-04-15T00:37:30.966 INFO:tasks.workunit.client.0.smithi029.stdout:8/826: rmdir d8/da/d2f 39 2024-04-15T00:37:30.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/811: mkdir d1/d1e/d56/dd3/de5/d104 0 2024-04-15T00:37:30.980 INFO:tasks.workunit.client.0.smithi029.stdout:9/778: readlink d3/d6/d9/d29/l7b 0 2024-04-15T00:37:30.982 INFO:tasks.workunit.client.0.smithi029.stdout:5/834: creat d2/de/d1f/f111 x:0 0 0 2024-04-15T00:37:30.983 INFO:tasks.workunit.client.0.smithi029.stdout:1/779: truncate df/d29/d41/d69/d78/dd1/fee 916907 0 2024-04-15T00:37:31.025 INFO:tasks.workunit.client.0.smithi029.stdout:1/780: chown df/d29/d41/d69/d78/dd1/d59/fed 440 1 2024-04-15T00:37:31.052 INFO:tasks.workunit.client.0.smithi029.stdout:1/781: dread df/f16 [0,4194304] 0 2024-04-15T00:37:31.093 INFO:tasks.workunit.client.0.smithi029.stdout:8/827: sync 2024-04-15T00:37:31.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/807: mkdir d17/d2a/d46/d67/dd6/d102 0 2024-04-15T00:37:31.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/839: chown d5/d15/d27/l59 95 1 2024-04-15T00:37:31.317 INFO:tasks.workunit.client.0.smithi029.stdout:1/782: dread df/d29/d41/d69/d4c/f75 [0,4194304] 0 2024-04-15T00:37:31.403 INFO:tasks.workunit.client.0.smithi029.stdout:9/779: write d3/d6/d9/d29/d60/d7f/da0/d9a/f36 [666558,11475] 0 2024-04-15T00:37:31.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/802: dread d0/d6/d39/d3c/f55 [0,4194304] 0 2024-04-15T00:37:31.613 INFO:tasks.workunit.client.0.smithi029.stdout:3/808: mkdir d17/d2f/d44/d58/d5c/d103 0 2024-04-15T00:37:31.617 INFO:tasks.workunit.client.0.smithi029.stdout:8/828: truncate d8/da/fac 3032816 0 2024-04-15T00:37:31.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/785: fdatasync de/f19 0 2024-04-15T00:37:31.663 INFO:tasks.workunit.client.0.smithi029.stdout:8/829: chown d8/d4a/d78/d23/d28/d30/c45 12662052 1 2024-04-15T00:37:31.811 INFO:tasks.workunit.client.0.smithi029.stdout:6/812: mkdir d1/d1e/d105 0 2024-04-15T00:37:31.860 INFO:tasks.workunit.client.0.smithi029.stdout:2/812: link d3/dd/da0/le5 d3/dd/d2d/d61/dd5/dcf/dc9/l108 0 2024-04-15T00:37:31.878 INFO:tasks.workunit.client.0.smithi029.stdout:4/786: rename de/d54/d71/d8b/db1/dd5/ld9 to de/d2b/d35/lfa 0 2024-04-15T00:37:31.942 INFO:tasks.workunit.client.0.smithi029.stdout:0/840: mknod d5/d4c/d4e/d10b/c11a 0 2024-04-15T00:37:32.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/783: symlink df/d29/d41/d69/d78/dd1/d59/d10a/l10f 0 2024-04-15T00:37:32.255 INFO:tasks.workunit.client.0.smithi029.stdout:9/780: mkdir d3/d6/d9/d29/d60/def 0 2024-04-15T00:37:32.255 INFO:tasks.workunit.client.0.smithi029.stdout:7/803: creat d0/d6/d39/d3c/d5b/dd9/f10a x:0 0 0 2024-04-15T00:37:32.278 INFO:tasks.workunit.client.0.smithi029.stdout:9/781: chown d3/d6/d9/d29/d60/d7f 167632126 1 2024-04-15T00:37:32.349 INFO:tasks.workunit.client.0.smithi029.stdout:3/809: mknod d17/c104 0 2024-04-15T00:37:32.351 INFO:tasks.workunit.client.0.smithi029.stdout:2/813: fsync d3/d50/fc4 0 2024-04-15T00:37:32.382 INFO:tasks.workunit.client.0.smithi029.stdout:3/810: chown d17/d2f/d44/d68/l90 476019 1 2024-04-15T00:37:32.432 INFO:tasks.workunit.client.0.smithi029.stdout:8/830: rename d8/d4a/d78/d23/d28/d30/c32 to d8/d4a/d78/de4/c118 0 2024-04-15T00:37:32.511 INFO:tasks.workunit.client.0.smithi029.stdout:8/831: chown d8/da/c11 10623448 1 2024-04-15T00:37:32.528 INFO:tasks.workunit.client.0.smithi029.stdout:3/811: dread d17/d2f/d44/d58/d5c/f9a [0,4194304] 0 2024-04-15T00:37:33.233 INFO:tasks.workunit.client.0.smithi029.stdout:1/784: fdatasync df/d29/d41/f47 0 2024-04-15T00:37:33.248 INFO:tasks.workunit.client.0.smithi029.stdout:1/785: chown df/d29/d41/d69/d78/c7d 178 1 2024-04-15T00:37:33.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/782: unlink d3/d6/d9/d29/d60/d64/l5c 0 2024-04-15T00:37:33.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/783: chown d3/d6/d30 111374 1 2024-04-15T00:37:34.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/814: mkdir d3/dd/d2d/d61/df6/d109 0 2024-04-15T00:37:34.081 INFO:tasks.workunit.client.0.smithi029.stdout:6/813: write d1/d8/d72/da3/fca [3556128,43054] 0 2024-04-15T00:37:34.089 INFO:tasks.workunit.client.0.smithi029.stdout:0/841: fsync d5/f62 0 2024-04-15T00:37:34.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/832: unlink d8/d4a/d78/d23/c99 0 2024-04-15T00:37:34.152 INFO:tasks.workunit.client.0.smithi029.stdout:2/815: dread - d3/d2a/d4e/feb zero size 2024-04-15T00:37:34.214 INFO:tasks.workunit.client.0.smithi029.stdout:3/812: rename d17/d2f/d44/d58/d5c/d5f/caf to d17/d2f/d76/d7f/df3/c105 0 2024-04-15T00:37:34.343 INFO:tasks.workunit.client.0.smithi029.stdout:5/835: link d2/f17 d2/de/f112 0 2024-04-15T00:37:34.919 INFO:tasks.workunit.client.0.smithi029.stdout:2/816: truncate d3/dd/d2d/ffe 385203 0 2024-04-15T00:37:35.006 INFO:tasks.workunit.client.0.smithi029.stdout:9/784: rename d3/d6/d9/d29/d60/d7f/da0/d9a/f36 to d3/d6/d9/d29/d60/d7f/da0/d9a/d96/ff0 0 2024-04-15T00:37:35.126 INFO:tasks.workunit.client.0.smithi029.stdout:5/836: mkdir d2/de/d13/d22/d3c/d41/d113 0 2024-04-15T00:37:35.208 INFO:tasks.workunit.client.0.smithi029.stdout:1/786: truncate df/d32/db2/fca 1413764 0 2024-04-15T00:37:35.255 INFO:tasks.workunit.client.0.smithi029.stdout:6/814: mknod d1/d1e/d105/c106 0 2024-04-15T00:37:35.270 INFO:tasks.workunit.client.0.smithi029.stdout:1/787: dread - df/f9e zero size 2024-04-15T00:37:35.281 INFO:tasks.workunit.client.0.smithi029.stdout:4/787: symlink de/lfb 0 2024-04-15T00:37:35.301 INFO:tasks.workunit.client.0.smithi029.stdout:3/813: dread d17/d2f/f39 [0,4194304] 0 2024-04-15T00:37:35.323 INFO:tasks.workunit.client.0.smithi029.stdout:1/788: chown df/d29/fe3 276 1 2024-04-15T00:37:35.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/833: dread d8/da/d2f/d66/fb8 [0,4194304] 0 2024-04-15T00:37:35.394 INFO:tasks.workunit.client.0.smithi029.stdout:2/817: mknod d3/d50/c10a 0 2024-04-15T00:37:35.493 INFO:tasks.workunit.client.0.smithi029.stdout:7/804: dwrite d0/d6/d39/d3c/d5b/d7e/fc9 [0,4194304] 0 2024-04-15T00:37:35.732 INFO:tasks.workunit.client.0.smithi029.stdout:0/842: write d5/db/d7b/fce [399554,55402] 0 2024-04-15T00:37:35.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/785: mkdir d3/d6/d9/d29/d60/d7f/df1 0 2024-04-15T00:37:35.912 INFO:tasks.workunit.client.0.smithi029.stdout:1/789: creat df/d29/d41/d4f/f110 x:0 0 0 2024-04-15T00:37:36.349 INFO:tasks.workunit.client.0.smithi029.stdout:2/818: write d3/d13/d43/fa3 [3591055,119491] 0 2024-04-15T00:37:36.350 INFO:tasks.workunit.client.0.smithi029.stdout:4/788: write de/df/d1e/d56/f80 [1424546,110590] 0 2024-04-15T00:37:36.353 INFO:tasks.workunit.client.0.smithi029.stdout:7/805: write d0/d6/d4f/d66/d37/f7a [247952,64581] 0 2024-04-15T00:37:36.460 INFO:tasks.workunit.client.0.smithi029.stdout:6/815: dwrite d1/d8/db/d7b/d85/f8f [0,4194304] 0 2024-04-15T00:37:36.618 INFO:tasks.workunit.client.0.smithi029.stdout:9/786: truncate d3/d6/d9/d29/d60/d7f/da0/f83 9355202 0 2024-04-15T00:37:36.647 INFO:tasks.workunit.client.0.smithi029.stdout:5/837: rename d2/de/d1f/fa1 to d2/de/d13/d22/d26/f114 0 2024-04-15T00:37:36.774 INFO:tasks.workunit.client.0.smithi029.stdout:0/843: dwrite d5/d3e/ff5 [0,4194304] 0 2024-04-15T00:37:36.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/806: dread d0/d6/d4f/f81 [0,4194304] 0 2024-04-15T00:37:37.042 INFO:tasks.workunit.client.0.smithi029.stdout:4/789: dread de/d2b/d59/fce [4194304,4194304] 0 2024-04-15T00:37:37.117 INFO:tasks.workunit.client.0.smithi029.stdout:3/814: getdents d17/d2f/d44/d58/d5c 0 2024-04-15T00:37:37.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/816: mknod d1/d8/d72/c107 0 2024-04-15T00:37:37.249 INFO:tasks.workunit.client.0.smithi029.stdout:8/834: getdents d8/da/d3d 0 2024-04-15T00:37:37.257 INFO:tasks.workunit.client.0.smithi029.stdout:5/838: creat d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c/d9e/d10e/f115 x:0 0 0 2024-04-15T00:37:37.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/807: truncate d0/f7c 3652338 0 2024-04-15T00:37:37.457 INFO:tasks.workunit.client.0.smithi029.stdout:3/815: creat d17/d2f/d44/d58/d5c/f106 x:0 0 0 2024-04-15T00:37:37.683 INFO:tasks.workunit.client.0.smithi029.stdout:1/790: link df/c9b df/d29/d41/d69/d78/dd1/d59/dd9/c111 0 2024-04-15T00:37:37.694 INFO:tasks.workunit.client.0.smithi029.stdout:2/819: rename d3/d13/c90 to d3/d93/dbe/dea/c10b 0 2024-04-15T00:37:37.744 INFO:tasks.workunit.client.0.smithi029.stdout:2/820: dread d3/dd/d42/dc6/dee/ffa [0,4194304] 0 2024-04-15T00:37:37.999 INFO:tasks.workunit.client.0.smithi029.stdout:9/787: dwrite d3/d6/d9/d15/d9d/fd0 [0,4194304] 0 2024-04-15T00:37:38.099 INFO:tasks.workunit.client.0.smithi029.stdout:4/790: write de/df/d1e/d56/dd3/fd8 [528186,16583] 0 2024-04-15T00:37:38.132 INFO:tasks.workunit.client.0.smithi029.stdout:0/844: link d5/d3e/ff5 d5/d15/d27/d51/d77/f11b 0 2024-04-15T00:37:38.356 INFO:tasks.workunit.client.0.smithi029.stdout:1/791: mknod df/d29/d41/d69/d4c/df4/c112 0 2024-04-15T00:37:38.360 INFO:tasks.workunit.client.0.smithi029.stdout:6/817: write d1/d1e/d56/f62 [2445131,27189] 0 2024-04-15T00:37:38.392 INFO:tasks.workunit.client.0.smithi029.stdout:1/792: chown df/d29/d41/d69/d4c/l8e 171 1 2024-04-15T00:37:38.568 INFO:tasks.workunit.client.0.smithi029.stdout:9/788: symlink d3/d6/d9/d15/d7e/de6/lf2 0 2024-04-15T00:37:38.611 INFO:tasks.workunit.client.0.smithi029.stdout:1/793: sync 2024-04-15T00:37:38.697 INFO:tasks.workunit.client.0.smithi029.stdout:0/845: truncate d5/d15/d27/d51/d77/f86 1137212 0 2024-04-15T00:37:38.709 INFO:tasks.workunit.client.0.smithi029.stdout:0/846: chown d5/d15/d27/dbb/dbd/df6 85 1 2024-04-15T00:37:38.720 INFO:tasks.workunit.client.0.smithi029.stdout:0/847: dread - d5/d15/d27/d51/fb2 zero size 2024-04-15T00:37:38.781 INFO:tasks.workunit.client.0.smithi029.stdout:3/816: mknod d17/d2a/d33/df2/c107 0 2024-04-15T00:37:38.955 INFO:tasks.workunit.client.0.smithi029.stdout:0/848: fdatasync d5/f62 0 2024-04-15T00:37:39.109 INFO:tasks.workunit.client.0.smithi029.stdout:5/839: dwrite d2/d1a/f20 [0,4194304] 0 2024-04-15T00:37:39.177 INFO:tasks.workunit.client.0.smithi029.stdout:8/835: dwrite d8/d4a/da1/dee/f115 [0,4194304] 0 2024-04-15T00:37:39.251 INFO:tasks.workunit.client.0.smithi029.stdout:3/817: rename d17/d2f/d44/d68 to d17/d2f/d44/d58/d108 0 2024-04-15T00:37:39.323 INFO:tasks.workunit.client.0.smithi029.stdout:8/836: dread - d8/d4a/d78/dca/fdc zero size 2024-04-15T00:37:39.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/791: write de/d54/d58/fee [449507,95198] 0 2024-04-15T00:37:39.403 INFO:tasks.workunit.client.0.smithi029.stdout:1/794: write df/f4d [306103,1599] 0 2024-04-15T00:37:39.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/808: dwrite d0/d6/f8 [0,4194304] 0 2024-04-15T00:37:39.570 INFO:tasks.workunit.client.0.smithi029.stdout:1/795: readlink df/d32/l3d 0 2024-04-15T00:37:39.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/840: rmdir d2/de/d13/d22/de6 39 2024-04-15T00:37:39.748 INFO:tasks.workunit.client.0.smithi029.stdout:3/818: mkdir d17/d2a/d46/d67/dd6/d102/d109 0 2024-04-15T00:37:39.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/818: dwrite d1/d1e/d56/f89 [0,4194304] 0 2024-04-15T00:37:39.887 INFO:tasks.workunit.client.0.smithi029.stdout:9/789: dwrite d3/d6/f9c [0,4194304] 0 2024-04-15T00:37:39.899 INFO:tasks.workunit.client.0.smithi029.stdout:0/849: fdatasync d5/d15/d1f/f63 0 2024-04-15T00:37:39.914 INFO:tasks.workunit.client.0.smithi029.stdout:7/809: rmdir d0/d6/d39/d3c/d5b/d7e 39 2024-04-15T00:37:39.972 INFO:tasks.workunit.client.0.smithi029.stdout:2/821: dwrite d3/d13/f16 [4194304,4194304] 0 2024-04-15T00:37:39.991 INFO:tasks.workunit.client.0.smithi029.stdout:4/792: fsync de/fe5 0 2024-04-15T00:37:40.103 INFO:tasks.workunit.client.0.smithi029.stdout:5/841: dread - d2/de/d13/d22/d26/d36/d4d/d70/d9a/f10f zero size 2024-04-15T00:37:40.115 INFO:tasks.workunit.client.0.smithi029.stdout:0/850: chown d5/d15/d27/d28/f82 390 1 2024-04-15T00:37:40.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/842: chown d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c 12 1 2024-04-15T00:37:40.275 INFO:tasks.workunit.client.0.smithi029.stdout:9/790: fsync d3/d6/f87 0 2024-04-15T00:37:40.309 INFO:tasks.workunit.client.0.smithi029.stdout:7/810: chown d0/d6/d4f/d5d/d65/dbc/d8e/lc2 12734585 1 2024-04-15T00:37:40.440 INFO:tasks.workunit.client.0.smithi029.stdout:0/851: mkdir d5/d15/d57/d11c 0 2024-04-15T00:37:40.445 INFO:tasks.workunit.client.0.smithi029.stdout:2/822: rename d3/dd/d2d/d61/df6/fbb to d3/d2a/d6d/f10c 0 2024-04-15T00:37:40.496 INFO:tasks.workunit.client.0.smithi029.stdout:5/843: symlink d2/d1a/d2d/df8/l116 0 2024-04-15T00:37:40.577 INFO:tasks.workunit.client.0.smithi029.stdout:1/796: creat df/d29/d41/d69/d78/dd1/d59/dd9/f113 x:0 0 0 2024-04-15T00:37:40.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/852: sync 2024-04-15T00:37:40.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/819: getdents d1/d8/db/d98/dfd 0 2024-04-15T00:37:40.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/793: dwrite de/f74 [4194304,4194304] 0 2024-04-15T00:37:40.845 INFO:tasks.workunit.client.0.smithi029.stdout:8/837: getdents d8/da/d2f/d6e 0 2024-04-15T00:37:40.846 INFO:tasks.workunit.client.0.smithi029.stdout:7/811: dread - d0/d6/d4f/d66/d67/db8/fc8 zero size 2024-04-15T00:37:40.939 INFO:tasks.workunit.client.0.smithi029.stdout:5/844: mknod d2/de/d13/d22/d26/d36/d4d/d70/d8d/c117 0 2024-04-15T00:37:40.971 INFO:tasks.workunit.client.0.smithi029.stdout:0/853: readlink d5/d15/d27/d51/d7d/la7 0 2024-04-15T00:37:40.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/797: chown df/d29/d41/d69/d78/dd1/ca1 1996994 1 2024-04-15T00:37:41.118 INFO:tasks.workunit.client.0.smithi029.stdout:3/819: rename d17/d2f/d76/d7f/dcd/fd2 to d17/d2f/d44/d58/d5c/d5f/dfc/f10a 0 2024-04-15T00:37:41.184 INFO:tasks.workunit.client.0.smithi029.stdout:2/823: unlink d3/d50/d51/d65/ca5 0 2024-04-15T00:37:41.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/854: creat d5/db/d1a/d50/f11d x:0 0 0 2024-04-15T00:37:41.672 INFO:tasks.workunit.client.0.smithi029.stdout:5/845: dread d2/de/d13/d22/d26/d36/d4d/f51 [0,4194304] 0 2024-04-15T00:37:41.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/794: symlink de/d54/d71/lfc 0 2024-04-15T00:37:41.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/791: write d3/d6/d9/d29/d60/d64/d6d/d58/f54 [2063064,11768] 0 2024-04-15T00:37:41.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/824: fdatasync d3/d53/fec 0 2024-04-15T00:37:41.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/820: dwrite d1/d8/db/f40 [4194304,4194304] 0 2024-04-15T00:37:41.956 INFO:tasks.workunit.client.0.smithi029.stdout:8/838: link d8/da/f43 d8/d4a/d78/dca/f119 0 2024-04-15T00:37:41.989 INFO:tasks.workunit.client.0.smithi029.stdout:8/839: read d8/d4a/d78/d23/d28/d30/d39/d77/fd5 [1152418,8251] 0 2024-04-15T00:37:42.149 INFO:tasks.workunit.client.0.smithi029.stdout:2/825: dread d3/dd/d42/f89 [0,4194304] 0 2024-04-15T00:37:42.161 INFO:tasks.workunit.client.0.smithi029.stdout:7/812: dwrite d0/d6/d39/d3c/d5b/d7e/fb3 [0,4194304] 0 2024-04-15T00:37:42.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/792: mknod d3/d6/d9/d29/d60/d64/d6d/d58/cf3 0 2024-04-15T00:37:42.237 INFO:tasks.workunit.client.0.smithi029.stdout:0/855: write d5/dc6/f10c [3228188,131026] 0 2024-04-15T00:37:42.309 INFO:tasks.workunit.client.0.smithi029.stdout:9/793: fdatasync d3/d6/d9/d15/d9d/fd0 0 2024-04-15T00:37:42.484 INFO:tasks.workunit.client.0.smithi029.stdout:3/820: rename d17/d2a/d46/d67/lbb to d17/d2f/l10b 0 2024-04-15T00:37:42.498 INFO:tasks.workunit.client.0.smithi029.stdout:8/840: creat d8/d4a/da1/f11a x:0 0 0 2024-04-15T00:37:42.616 INFO:tasks.workunit.client.0.smithi029.stdout:2/826: mknod d3/d93/dbe/c10d 0 2024-04-15T00:37:42.757 INFO:tasks.workunit.client.0.smithi029.stdout:0/856: truncate d5/d4c/d4e/da8/f103 576150 0 2024-04-15T00:37:42.816 INFO:tasks.workunit.client.0.smithi029.stdout:1/798: getdents df/d29/d41/d96 0 2024-04-15T00:37:43.036 INFO:tasks.workunit.client.0.smithi029.stdout:4/795: creat de/df/ffd x:0 0 0 2024-04-15T00:37:43.116 INFO:tasks.workunit.client.0.smithi029.stdout:5/846: write d2/de/d13/d22/d26/d36/f53 [2046355,59421] 0 2024-04-15T00:37:43.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/821: rename d1/d1e/d56 to d1/d8/d72/da3/d102/d108 0 2024-04-15T00:37:43.451 INFO:tasks.workunit.client.0.smithi029.stdout:8/841: symlink d8/da/d2f/d66/l11b 0 2024-04-15T00:37:43.476 INFO:tasks.workunit.client.0.smithi029.stdout:3/821: dread d17/d2a/d4c/f8c [0,4194304] 0 2024-04-15T00:37:43.602 INFO:tasks.workunit.client.0.smithi029.stdout:9/794: symlink d3/d6/d9/d15/d62/lf4 0 2024-04-15T00:37:43.677 INFO:tasks.workunit.client.0.smithi029.stdout:0/857: symlink d5/dc6/l11e 0 2024-04-15T00:37:43.750 INFO:tasks.workunit.client.0.smithi029.stdout:4/796: fdatasync de/df/d1e/d56/f9e 0 2024-04-15T00:37:43.816 INFO:tasks.workunit.client.0.smithi029.stdout:1/799: dread df/d29/d41/d69/d78/f74 [0,4194304] 0 2024-04-15T00:37:43.836 INFO:tasks.workunit.client.0.smithi029.stdout:1/800: readlink df/d29/d41/d69/d78/dd1/d80/la3 0 2024-04-15T00:37:43.982 INFO:tasks.workunit.client.0.smithi029.stdout:5/847: rename d2/de/d13/d22/d26/d36/d4d/d70/d9a/d6c to d2/de/d13/d22/d26/dd7/d118 0 2024-04-15T00:37:44.002 INFO:tasks.workunit.client.0.smithi029.stdout:5/848: chown d2/de/d13/d22/d26/dd7/d118 2629161 1 2024-04-15T00:37:44.047 INFO:tasks.workunit.client.0.smithi029.stdout:6/822: mknod d1/d8/db/d98/c109 0 2024-04-15T00:37:44.084 INFO:tasks.workunit.client.0.smithi029.stdout:3/822: read d17/d2f/d44/d5a/f7e [1572785,54284] 0 2024-04-15T00:37:44.273 INFO:tasks.workunit.client.0.smithi029.stdout:2/827: mkdir d3/d2a/d4e/df3/d10e 0 2024-04-15T00:37:44.338 INFO:tasks.workunit.client.0.smithi029.stdout:0/858: creat d5/d15/d57/d5e/f11f x:0 0 0 2024-04-15T00:37:44.538 INFO:tasks.workunit.client.0.smithi029.stdout:8/842: rename d8/da/d2f/f9b to d8/da/d2f/d6e/d92/d10c/f11c 0 2024-04-15T00:37:44.654 INFO:tasks.workunit.client.0.smithi029.stdout:3/823: symlink d17/d2f/d76/d7f/dcd/l10c 0 2024-04-15T00:37:44.720 INFO:tasks.workunit.client.0.smithi029.stdout:8/843: sync 2024-04-15T00:37:44.721 INFO:tasks.workunit.client.0.smithi029.stdout:7/813: getdents d0/d6/d4f/d5d/d87/d103 0 2024-04-15T00:37:44.752 INFO:tasks.workunit.client.0.smithi029.stdout:6/823: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:37:44.757 INFO:tasks.workunit.client.0.smithi029.stdout:3/824: chown d17/d2f/d44/d5a/fcb 59293 1 2024-04-15T00:37:44.845 INFO:tasks.workunit.client.0.smithi029.stdout:6/824: sync 2024-04-15T00:37:44.892 INFO:tasks.workunit.client.0.smithi029.stdout:6/825: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:37:44.964 INFO:tasks.workunit.client.0.smithi029.stdout:0/859: dread - d5/d15/d27/d9f/ddb/ff7 zero size 2024-04-15T00:37:44.972 INFO:tasks.workunit.client.0.smithi029.stdout:0/860: readlink d5/d15/l16 0 2024-04-15T00:37:45.244 INFO:tasks.workunit.client.0.smithi029.stdout:4/797: link de/d2b/cc0 de/d2b/d35/cfe 0 2024-04-15T00:37:45.338 INFO:tasks.workunit.client.0.smithi029.stdout:4/798: sync 2024-04-15T00:37:45.675 INFO:tasks.workunit.client.0.smithi029.stdout:6/826: mknod d1/d8/db/c10a 0 2024-04-15T00:37:45.691 INFO:tasks.workunit.client.0.smithi029.stdout:5/849: write d2/de/d13/d22/f40 [962827,83725] 0 2024-04-15T00:37:45.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/850: chown d2/de/d13/daa/dc3/c98 24 1 2024-04-15T00:37:45.880 INFO:tasks.workunit.client.0.smithi029.stdout:9/795: dwrite d3/d6/d9/f2c [0,4194304] 0 2024-04-15T00:37:45.957 INFO:tasks.workunit.client.0.smithi029.stdout:2/828: dwrite d3/d50/fcd [0,4194304] 0 2024-04-15T00:37:46.038 INFO:tasks.workunit.client.0.smithi029.stdout:8/844: creat d8/d4a/d78/d23/d28/d30/f11d x:0 0 0 2024-04-15T00:37:46.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/861: write d5/d15/d57/d5e/f71 [4822974,116624] 0 2024-04-15T00:37:46.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/801: dwrite df/d29/d41/d69/f9d [0,4194304] 0 2024-04-15T00:37:46.221 INFO:tasks.workunit.client.0.smithi029.stdout:7/814: link d0/d6/d4f/d5d/d82/cf9 d0/d6/d4f/d66/c10b 0 2024-04-15T00:37:46.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/825: write d17/d83/f9b [872613,28196] 0 2024-04-15T00:37:46.242 INFO:tasks.workunit.client.0.smithi029.stdout:5/851: mknod d2/de/d13/dd2/c119 0 2024-04-15T00:37:46.243 INFO:tasks.workunit.client.0.smithi029.stdout:6/827: dread - d1/d8/d72/da3/fa5 zero size 2024-04-15T00:37:46.282 INFO:tasks.workunit.client.0.smithi029.stdout:9/796: dread - d3/d6/d9/d29/d60/d64/fc4 zero size 2024-04-15T00:37:46.406 INFO:tasks.workunit.client.0.smithi029.stdout:9/797: sync 2024-04-15T00:37:46.433 INFO:tasks.workunit.client.0.smithi029.stdout:4/799: creat de/d6d/fff x:0 0 0 2024-04-15T00:37:46.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/845: dwrite d8/d4a/d78/ff9 [0,4194304] 0 2024-04-15T00:37:46.643 INFO:tasks.workunit.client.0.smithi029.stdout:1/802: unlink df/d29/d41/d4f/ff6 0 2024-04-15T00:37:46.670 INFO:tasks.workunit.client.0.smithi029.stdout:6/828: chown d1/d8/db/c7a 2575869 1 2024-04-15T00:37:47.104 INFO:tasks.workunit.client.0.smithi029.stdout:0/862: link d5/d4c/fd5 d5/d54/dec/d117/f120 0 2024-04-15T00:37:47.110 INFO:tasks.workunit.client.0.smithi029.stdout:5/852: unlink d2/de/d13/d22/d26/d36/f37 0 2024-04-15T00:37:47.207 INFO:tasks.workunit.client.0.smithi029.stdout:0/863: sync 2024-04-15T00:37:47.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/798: write d3/d6/d9/d29/d60/d64/d6d/d58/f99 [4328998,49517] 0 2024-04-15T00:37:47.247 INFO:tasks.workunit.client.0.smithi029.stdout:4/800: write de/d54/ff7 [723576,17295] 0 2024-04-15T00:37:47.350 INFO:tasks.workunit.client.0.smithi029.stdout:5/853: mkdir d2/de/d13/d22/d26/d36/d4d/d70/d9a/d11a 0 2024-04-15T00:37:47.488 INFO:tasks.workunit.client.0.smithi029.stdout:1/803: dwrite df/d29/d41/d69/d4c/d7a/f83 [0,4194304] 0 2024-04-15T00:37:47.557 INFO:tasks.workunit.client.0.smithi029.stdout:8/846: rmdir d8/da/d3d/deb 0 2024-04-15T00:37:47.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/826: getdents d17/d83 0 2024-04-15T00:37:47.564 INFO:tasks.workunit.client.0.smithi029.stdout:2/829: dwrite d3/d13/f97 [0,4194304] 0 2024-04-15T00:37:47.593 INFO:tasks.workunit.client.0.smithi029.stdout:7/815: getdents d0/d6/d4f 0 2024-04-15T00:37:47.736 INFO:tasks.workunit.client.0.smithi029.stdout:4/801: fsync de/d2b/d35/f49 0 2024-04-15T00:37:47.736 INFO:tasks.workunit.client.0.smithi029.stdout:0/864: rename d5/d15/d27/d9f/c111 to d5/d15/d57/c121 0 2024-04-15T00:37:47.917 INFO:tasks.workunit.client.0.smithi029.stdout:6/829: getdents d1/d8/db/d38/d86 0 2024-04-15T00:37:47.926 INFO:tasks.workunit.client.0.smithi029.stdout:7/816: symlink d0/d6/da2/l10c 0 2024-04-15T00:37:48.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/847: read d8/da/d2f/d42/f7e [4964,114206] 0 2024-04-15T00:37:48.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/830: dread d3/d2a/f3a [0,4194304] 0 2024-04-15T00:37:48.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/827: creat d17/d2f/d44/d58/d5c/d5f/db5/f10d x:0 0 0 2024-04-15T00:37:48.173 INFO:tasks.workunit.client.0.smithi029.stdout:3/828: stat d17/d2f/d3c/c53 0 2024-04-15T00:37:48.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/865: rename d5/d15/d27/d28 to d5/d15/d57/d122 0 2024-04-15T00:37:48.443 INFO:tasks.workunit.client.0.smithi029.stdout:5/854: mkdir d2/de/d13/d22/d3c/d41/d113/d11b 0 2024-04-15T00:37:48.626 INFO:tasks.workunit.client.0.smithi029.stdout:7/817: rmdir d0/d6/d4f/d5d/d82 39 2024-04-15T00:37:48.640 INFO:tasks.workunit.client.0.smithi029.stdout:7/818: stat d0/d6/d4f/d66/d37/db7/dda/fe1 0 2024-04-15T00:37:48.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/848: mknod d8/da/d2f/d6e/dc1/ded/c11e 0 2024-04-15T00:37:48.766 INFO:tasks.workunit.client.0.smithi029.stdout:7/819: sync 2024-04-15T00:37:48.847 INFO:tasks.workunit.client.0.smithi029.stdout:3/829: creat d17/d2a/d4c/da1/f10e x:0 0 0 2024-04-15T00:37:48.965 INFO:tasks.workunit.client.0.smithi029.stdout:9/799: dwrite d3/d6/d9/d29/d60/d7f/da0/d9a/f73 [0,4194304] 0 2024-04-15T00:37:49.293 INFO:tasks.workunit.client.0.smithi029.stdout:5/855: mknod d2/da5/dc8/c11c 0 2024-04-15T00:37:49.331 INFO:tasks.workunit.client.0.smithi029.stdout:4/802: write de/df/d1e/f2d [3754784,28624] 0 2024-04-15T00:37:49.347 INFO:tasks.workunit.client.0.smithi029.stdout:4/803: dread - de/d54/fbb zero size 2024-04-15T00:37:49.357 INFO:tasks.workunit.client.0.smithi029.stdout:4/804: chown de/d3a/f42 50318 1 2024-04-15T00:37:49.454 INFO:tasks.workunit.client.0.smithi029.stdout:6/830: creat d1/d8/db/dc1/f10b x:0 0 0 2024-04-15T00:37:49.705 INFO:tasks.workunit.client.0.smithi029.stdout:7/820: mknod d0/d6/d4f/d66/d26/d54/c10d 0 2024-04-15T00:37:49.710 INFO:tasks.workunit.client.0.smithi029.stdout:3/830: mkdir d17/d2f/d3c/d10f 0 2024-04-15T00:37:49.770 INFO:tasks.workunit.client.0.smithi029.stdout:7/821: dread d0/d6/d39/d3c/f55 [0,4194304] 0 2024-04-15T00:37:49.885 INFO:tasks.workunit.client.0.smithi029.stdout:7/822: sync 2024-04-15T00:37:49.908 INFO:tasks.workunit.client.0.smithi029.stdout:4/805: dread de/d2b/f30 [0,4194304] 0 2024-04-15T00:37:49.913 INFO:tasks.workunit.client.0.smithi029.stdout:1/804: link df/d32/fe2 df/d29/d41/d96/f114 0 2024-04-15T00:37:49.937 INFO:tasks.workunit.client.0.smithi029.stdout:4/806: stat de/d54/d58/d8a/leb 0 2024-04-15T00:37:49.954 INFO:tasks.workunit.client.0.smithi029.stdout:6/831: creat d1/d8/db/d38/de4/f10c x:0 0 0 2024-04-15T00:37:49.975 INFO:tasks.workunit.client.0.smithi029.stdout:6/832: chown d1/d1e/f7e 97 1 2024-04-15T00:37:50.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/831: rename d3/d13/d43/d5a/lb3 to d3/d50/l10f 0 2024-04-15T00:37:50.065 INFO:tasks.workunit.client.0.smithi029.stdout:8/849: chown d8/da/d3d/c65 1862043 1 2024-04-15T00:37:50.113 INFO:tasks.workunit.client.0.smithi029.stdout:9/800: symlink d3/d6/d9/d29/d60/d7f/lf5 0 2024-04-15T00:37:50.202 INFO:tasks.workunit.client.0.smithi029.stdout:5/856: fdatasync d2/de/d13/d22/d3c/d41/dec/ff9 0 2024-04-15T00:37:50.216 INFO:tasks.workunit.client.0.smithi029.stdout:5/857: readlink d2/de/d13/daa/dc3/lad 0 2024-04-15T00:37:50.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/823: truncate d0/d6/d4f/d66/d37/f99 873970 0 2024-04-15T00:37:50.363 INFO:tasks.workunit.client.0.smithi029.stdout:4/807: fdatasync de/d2b/d35/f49 0 2024-04-15T00:37:50.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/801: fdatasync d3/d6/fc8 0 2024-04-15T00:37:50.641 INFO:tasks.workunit.client.0.smithi029.stdout:2/832: dread d3/dd/d2d/d61/dd5/d4a/f8a [4194304,4194304] 0 2024-04-15T00:37:50.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/850: dread d8/d4a/d78/d23/d28/d30/f69 [0,4194304] 0 2024-04-15T00:37:50.758 INFO:tasks.workunit.client.0.smithi029.stdout:0/866: dwrite d5/d15/d27/dbb/dbd/df6/f102 [0,4194304] 0 2024-04-15T00:37:50.857 INFO:tasks.workunit.client.0.smithi029.stdout:1/805: creat df/d29/d41/daf/f115 x:0 0 0 2024-04-15T00:37:50.952 INFO:tasks.workunit.client.0.smithi029.stdout:9/802: dread d3/d6/d9/f49 [0,4194304] 0 2024-04-15T00:37:50.959 INFO:tasks.workunit.client.0.smithi029.stdout:8/851: chown d8/d4a/d78/d23/d28/d30/d39/l5e 70608 1 2024-04-15T00:37:50.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/852: dread - d8/d4a/d78/dca/fdc zero size 2024-04-15T00:37:51.073 INFO:tasks.workunit.client.0.smithi029.stdout:0/867: rmdir d5/d15/d57/d5e 39 2024-04-15T00:37:51.211 INFO:tasks.workunit.client.0.smithi029.stdout:0/868: dread d5/d15/f4a [0,4194304] 0 2024-04-15T00:37:51.265 INFO:tasks.workunit.client.0.smithi029.stdout:8/853: creat d8/d4a/da1/dee/f11f x:0 0 0 2024-04-15T00:37:51.267 INFO:tasks.workunit.client.0.smithi029.stdout:3/831: write d17/d2f/d3c/f101 [705965,40930] 0 2024-04-15T00:37:51.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/858: rename d2/de/d13/d22/d26/dd7/d118/d9e/fb7 to d2/de/d13/f11d 0 2024-04-15T00:37:51.391 INFO:tasks.workunit.client.0.smithi029.stdout:5/859: chown d2/da5/lb9 36543 1 2024-04-15T00:37:51.464 INFO:tasks.workunit.client.0.smithi029.stdout:9/803: symlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/lf6 0 2024-04-15T00:37:51.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/833: write d1/d8/db/f40 [3711622,22659] 0 2024-04-15T00:37:51.956 INFO:tasks.workunit.client.0.smithi029.stdout:9/804: readlink d3/d6/l86 0 2024-04-15T00:37:52.159 INFO:tasks.workunit.client.0.smithi029.stdout:9/805: readlink d3/d6/d9/l63 0 2024-04-15T00:37:52.212 INFO:tasks.workunit.client.0.smithi029.stdout:4/808: dwrite f2 [4194304,4194304] 0 2024-04-15T00:37:52.321 INFO:tasks.workunit.client.0.smithi029.stdout:7/824: dwrite d0/d6/d4f/d5d/d65/dbc/d8e/fd1 [0,4194304] 0 2024-04-15T00:37:52.407 INFO:tasks.workunit.client.0.smithi029.stdout:0/869: write d5/db/d7b/f114 [991201,46127] 0 2024-04-15T00:37:52.410 INFO:tasks.workunit.client.0.smithi029.stdout:3/832: write d17/d2f/d44/d58/d5c/f73 [3181111,7910] 0 2024-04-15T00:37:52.415 INFO:tasks.workunit.client.0.smithi029.stdout:8/854: write d8/da/d2f/d6e/f47 [8614232,111283] 0 2024-04-15T00:37:52.496 INFO:tasks.workunit.client.0.smithi029.stdout:1/806: dwrite df/d29/d41/d69/d78/dd1/d80/fe4 [0,4194304] 0 2024-04-15T00:37:52.553 INFO:tasks.workunit.client.0.smithi029.stdout:2/833: dwrite d3/dd/f31 [0,4194304] 0 2024-04-15T00:37:52.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/834: creat d1/d8/d72/f10d x:0 0 0 2024-04-15T00:37:52.695 INFO:tasks.workunit.client.0.smithi029.stdout:3/833: readlink d17/d2f/d3c/l9e 0 2024-04-15T00:37:52.748 INFO:tasks.workunit.client.0.smithi029.stdout:1/807: chown df/f42 0 1 2024-04-15T00:37:52.753 INFO:tasks.workunit.client.0.smithi029.stdout:0/870: rmdir d5/d3e/de3 39 2024-04-15T00:37:52.777 INFO:tasks.workunit.client.0.smithi029.stdout:3/834: read - d17/d2a/d46/fae zero size 2024-04-15T00:37:52.812 INFO:tasks.workunit.client.0.smithi029.stdout:5/860: dwrite d2/de/d13/dd2/fda [0,4194304] 0 2024-04-15T00:37:53.004 INFO:tasks.workunit.client.0.smithi029.stdout:7/825: symlink d0/d6/d4f/d66/d7b/l10e 0 2024-04-15T00:37:53.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/809: write de/d54/d71/db5/fb0 [4765602,99061] 0 2024-04-15T00:37:53.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/855: unlink d8/d4a/d78/d23/d28/d30/c45 0 2024-04-15T00:37:53.529 INFO:tasks.workunit.client.0.smithi029.stdout:0/871: mknod d5/db/d110/c123 0 2024-04-15T00:37:53.569 INFO:tasks.workunit.client.0.smithi029.stdout:3/835: truncate d17/d2f/d44/d58/f91 308316 0 2024-04-15T00:37:53.629 INFO:tasks.workunit.client.0.smithi029.stdout:8/856: creat d8/d4a/d78/dc3/f120 x:0 0 0 2024-04-15T00:37:53.648 INFO:tasks.workunit.client.0.smithi029.stdout:2/834: dwrite d3/f5 [4194304,4194304] 0 2024-04-15T00:37:53.746 INFO:tasks.workunit.client.0.smithi029.stdout:0/872: readlink d5/d3e/de3/l9b 0 2024-04-15T00:37:53.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/857: creat d8/da/d2f/d6e/d5a/f121 x:0 0 0 2024-04-15T00:37:53.940 INFO:tasks.workunit.client.0.smithi029.stdout:9/806: dwrite d3/da3/da7/fe0 [0,4194304] 0 2024-04-15T00:37:54.053 INFO:tasks.workunit.client.0.smithi029.stdout:0/873: fdatasync d5/d3e/de3/f95 0 2024-04-15T00:37:54.159 INFO:tasks.workunit.client.0.smithi029.stdout:2/835: dread d3/dd/d2d/f7d [0,4194304] 0 2024-04-15T00:37:54.175 INFO:tasks.workunit.client.0.smithi029.stdout:2/836: chown d3/d13/d43/d5a/ff7 4008924 1 2024-04-15T00:37:54.360 INFO:tasks.workunit.client.0.smithi029.stdout:8/858: dread d8/da/d2f/d42/ff6 [0,4194304] 0 2024-04-15T00:37:54.432 INFO:tasks.workunit.client.0.smithi029.stdout:4/810: getdents de/d54/d71 0 2024-04-15T00:37:54.460 INFO:tasks.workunit.client.0.smithi029.stdout:4/811: readlink de/d54/d71/d8b/db1/lea 0 2024-04-15T00:37:54.463 INFO:tasks.workunit.client.0.smithi029.stdout:8/859: read d8/da/d2f/d6e/f10f [517062,62309] 0 2024-04-15T00:37:54.510 INFO:tasks.workunit.client.0.smithi029.stdout:2/837: mkdir d3/dd/d2d/d61/d85/da2/d110 0 2024-04-15T00:37:54.612 INFO:tasks.workunit.client.0.smithi029.stdout:9/807: mknod d3/d6/d9/d29/d60/d7f/df1/cf7 0 2024-04-15T00:37:54.742 INFO:tasks.workunit.client.0.smithi029.stdout:4/812: dread - de/d6d/fff zero size 2024-04-15T00:37:54.755 INFO:tasks.workunit.client.0.smithi029.stdout:4/813: chown de/d54/d71/da3/fe6 2601 1 2024-04-15T00:37:54.774 INFO:tasks.workunit.client.0.smithi029.stdout:8/860: mknod d8/da/d2f/de2/c122 0 2024-04-15T00:37:54.825 INFO:tasks.workunit.client.0.smithi029.stdout:6/835: write d1/d8/d72/da3/d102/d108/fef [997057,66008] 0 2024-04-15T00:37:54.928 INFO:tasks.workunit.client.0.smithi029.stdout:2/838: rmdir d3/d2a/d4e 39 2024-04-15T00:37:54.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/808: write df/d29/d41/d96/fd6 [733744,128781] 0 2024-04-15T00:37:54.940 INFO:tasks.workunit.client.0.smithi029.stdout:5/861: write d2/de/d13/d22/d3c/fb5 [4340069,44650] 0 2024-04-15T00:37:55.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/826: dwrite d0/d6/d4f/d66/d67/f73 [4194304,4194304] 0 2024-04-15T00:37:55.189 INFO:tasks.workunit.client.0.smithi029.stdout:6/836: rename d1/d8/d72/da3/d102/d108/f89 to d1/d1e/d22/ddd/f10e 0 2024-04-15T00:37:55.191 INFO:tasks.workunit.client.0.smithi029.stdout:5/862: dread d2/de/d13/d22/f5a [0,4194304] 0 2024-04-15T00:37:55.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/863: chown d2/de/d13/d22/d26/d36/d4d/d70/d8d 59 1 2024-04-15T00:37:55.341 INFO:tasks.workunit.client.0.smithi029.stdout:0/874: link d5/db/d1a/d50/fa5 d5/d15/d57/f124 0 2024-04-15T00:37:55.348 INFO:tasks.workunit.client.0.smithi029.stdout:4/814: symlink de/d6d/l100 0 2024-04-15T00:37:55.352 INFO:tasks.workunit.client.0.smithi029.stdout:1/809: truncate df/d29/d41/d4f/fa0 1763781 0 2024-04-15T00:37:55.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/861: symlink d8/da/d2f/l123 0 2024-04-15T00:37:55.582 INFO:tasks.workunit.client.0.smithi029.stdout:5/864: rmdir d2/de/d13/d22/d3c 39 2024-04-15T00:37:55.620 INFO:tasks.workunit.client.0.smithi029.stdout:6/837: truncate d1/d8/d72/da3/d102/d108/d58/d59/f101 347264 0 2024-04-15T00:37:55.633 INFO:tasks.workunit.client.0.smithi029.stdout:3/836: dwrite d17/d2f/d76/ff8 [0,4194304] 0 2024-04-15T00:37:55.699 INFO:tasks.workunit.client.0.smithi029.stdout:5/865: stat d2/de/d13/dd2/lf3 0 2024-04-15T00:37:55.707 INFO:tasks.workunit.client.0.smithi029.stdout:9/808: symlink d3/d6/d9/d29/d60/lf8 0 2024-04-15T00:37:55.766 INFO:tasks.workunit.client.0.smithi029.stdout:6/838: dread d1/d8/d72/da3/d102/d108/d58/d59/f5a [0,4194304] 0 2024-04-15T00:37:55.789 INFO:tasks.workunit.client.0.smithi029.stdout:6/839: chown d1/d8/f16 47356109 1 2024-04-15T00:37:56.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/862: symlink d8/d4a/d78/dc3/l124 0 2024-04-15T00:37:56.112 INFO:tasks.workunit.client.0.smithi029.stdout:3/837: mknod d17/d2a/d33/c110 0 2024-04-15T00:37:56.214 INFO:tasks.workunit.client.0.smithi029.stdout:0/875: truncate d5/d15/d27/f2d 1921635 0 2024-04-15T00:37:56.291 INFO:tasks.workunit.client.0.smithi029.stdout:2/839: link d3/f32 d3/d13/de1/f111 0 2024-04-15T00:37:56.300 INFO:tasks.workunit.client.0.smithi029.stdout:2/840: stat d3/dd/d2d/d61/f9f 0 2024-04-15T00:37:56.336 INFO:tasks.workunit.client.0.smithi029.stdout:5/866: unlink d2/de/d13/d22/d3c/f4b 0 2024-04-15T00:37:56.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/838: fsync d17/d83/f6d 0 2024-04-15T00:37:56.413 INFO:tasks.workunit.client.0.smithi029.stdout:8/863: mknod d8/da7/c125 0 2024-04-15T00:37:56.548 INFO:tasks.workunit.client.0.smithi029.stdout:6/840: symlink d1/d8/db/d98/dfd/l10f 0 2024-04-15T00:37:56.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/827: getdents d0/d6 0 2024-04-15T00:37:56.669 INFO:tasks.workunit.client.0.smithi029.stdout:2/841: mkdir d3/dd/da0/d112 0 2024-04-15T00:37:56.676 INFO:tasks.workunit.client.0.smithi029.stdout:2/842: readlink d3/l8 0 2024-04-15T00:37:56.781 INFO:tasks.workunit.client.0.smithi029.stdout:5/867: mknod d2/de/d13/d22/d26/d36/d4d/dfb/c11e 0 2024-04-15T00:37:56.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/839: creat d17/d2a/d46/d67/dd6/d102/f111 x:0 0 0 2024-04-15T00:37:57.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/815: write de/fd2 [158399,100634] 0 2024-04-15T00:37:57.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/816: dread - de/d2b/d35/fcc zero size 2024-04-15T00:37:57.081 INFO:tasks.workunit.client.0.smithi029.stdout:1/810: write df/d32/f50 [230465,121503] 0 2024-04-15T00:37:57.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/843: chown d3/dd/c8b 34981 1 2024-04-15T00:37:57.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/868: creat d2/da5/f11f x:0 0 0 2024-04-15T00:37:57.354 INFO:tasks.workunit.client.0.smithi029.stdout:3/840: mkdir d17/d2f/d44/d58/d5c/d5f/db5/d112 0 2024-04-15T00:37:57.389 INFO:tasks.workunit.client.0.smithi029.stdout:9/809: link d3/d6/d9/d15/de8/feb d3/d6/d9/d15/d9d/ff9 0 2024-04-15T00:37:57.393 INFO:tasks.workunit.client.0.smithi029.stdout:9/810: chown d3/da3 32693 1 2024-04-15T00:37:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:6/841: rename d1/d8/d72/da3/d102/d108/c7d to d1/d8/d72/da3/d102/d108/dd3/de5/d104/c110 0 2024-04-15T00:37:57.698 INFO:tasks.workunit.client.0.smithi029.stdout:5/869: fdatasync d2/de/d13/d22/d26/d36/f90 0 2024-04-15T00:37:57.774 INFO:tasks.workunit.client.0.smithi029.stdout:9/811: stat d3/d6/c7c 0 2024-04-15T00:37:57.783 INFO:tasks.workunit.client.0.smithi029.stdout:9/812: readlink d3/d6/d9/d29/ld6 0 2024-04-15T00:37:57.809 INFO:tasks.workunit.client.0.smithi029.stdout:1/811: getdents df/d29/d41/d69/d78/dd1/d59/d10c 0 2024-04-15T00:37:57.862 INFO:tasks.workunit.client.0.smithi029.stdout:1/812: fdatasync df/d29/d41/d69/d78/dd1/d80/fe4 0 2024-04-15T00:37:57.910 INFO:tasks.workunit.client.0.smithi029.stdout:0/876: dwrite d5/dc6/f10c [0,4194304] 0 2024-04-15T00:37:57.976 INFO:tasks.workunit.client.0.smithi029.stdout:0/877: dread - d5/d15/d57/fb1 zero size 2024-04-15T00:37:58.114 INFO:tasks.workunit.client.0.smithi029.stdout:8/864: dwrite d8/d4a/d78/d87/fb9 [0,4194304] 0 2024-04-15T00:37:58.181 INFO:tasks.workunit.client.0.smithi029.stdout:8/865: chown d8/d4a/d78/d23/d28/d5f 2633216 1 2024-04-15T00:37:58.361 INFO:tasks.workunit.client.0.smithi029.stdout:2/844: fdatasync d3/f32 0 2024-04-15T00:37:58.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/828: rename d0/d6/d4f/d66/d67/d90/cbf to d0/d6/c10f 0 2024-04-15T00:37:58.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/870: mknod d2/de/d13/d22/d3c/d41/dec/c120 0 2024-04-15T00:37:58.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/841: unlink d17/d2a/d46/d67/f8a 0 2024-04-15T00:37:58.885 INFO:tasks.workunit.client.0.smithi029.stdout:4/817: write de/df/f12 [1656464,59386] 0 2024-04-15T00:37:58.908 INFO:tasks.workunit.client.0.smithi029.stdout:0/878: mknod d5/d15/d27/d51/d7d/c125 0 2024-04-15T00:37:58.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/813: read df/d29/d41/d96/f114 [361622,98067] 0 2024-04-15T00:37:59.115 INFO:tasks.workunit.client.0.smithi029.stdout:8/866: creat d8/da/d2f/d6e/dc1/ded/f126 x:0 0 0 2024-04-15T00:37:59.263 INFO:tasks.workunit.client.0.smithi029.stdout:6/842: fsync d1/d8/f54 0 2024-04-15T00:37:59.609 INFO:tasks.workunit.client.0.smithi029.stdout:3/842: fdatasync d17/d2f/d76/d7f/fa7 0 2024-04-15T00:37:59.617 INFO:tasks.workunit.client.0.smithi029.stdout:5/871: dread d2/de/d13/d22/d26/f35 [0,4194304] 0 2024-04-15T00:37:59.835 INFO:tasks.workunit.client.0.smithi029.stdout:0/879: symlink d5/d54/l126 0 2024-04-15T00:38:00.022 INFO:tasks.workunit.client.0.smithi029.stdout:6/843: truncate d1/d8/db/f50 3590746 0 2024-04-15T00:38:00.177 INFO:tasks.workunit.client.0.smithi029.stdout:9/813: write d3/d6/d9/d15/d9d/fd0 [2545671,79912] 0 2024-04-15T00:38:00.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:38:00.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:38:00.497 INFO:tasks.workunit.client.0.smithi029.stdout:1/814: fsync df/d29/d41/d69/f44 0 2024-04-15T00:38:00.701 INFO:tasks.workunit.client.0.smithi029.stdout:6/844: mkdir d1/d8/d72/da3/d102/d108/d58/d59/d111 0 2024-04-15T00:38:00.712 INFO:tasks.workunit.client.0.smithi029.stdout:0/880: dread d5/db/d1a/d65/d76/daf/ffb [0,4194304] 0 2024-04-15T00:38:00.753 INFO:tasks.workunit.client.0.smithi029.stdout:5/872: symlink d2/de/d13/d22/d26/dfc/d108/l121 0 2024-04-15T00:38:00.797 INFO:tasks.workunit.client.0.smithi029.stdout:8/867: creat d8/da/f127 x:0 0 0 2024-04-15T00:38:00.847 INFO:tasks.workunit.client.0.smithi029.stdout:7/829: dread d0/d6/f2f [0,4194304] 0 2024-04-15T00:38:00.873 INFO:tasks.workunit.client.0.smithi029.stdout:5/873: chown d2/de/f10 475 1 2024-04-15T00:38:00.929 INFO:tasks.workunit.client.0.smithi029.stdout:2/845: dwrite d3/d50/fc4 [4194304,4194304] 0 2024-04-15T00:38:01.127 INFO:tasks.workunit.client.0.smithi029.stdout:0/881: mkdir d5/d54/d127 0 2024-04-15T00:38:01.499 INFO:tasks.workunit.client.0.smithi029.stdout:4/818: write de/d2b/d59/f70 [408968,81138] 0 2024-04-15T00:38:01.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/846: rename d3/dd/d2d/d61/df6/fa8 to d3/d13/f113 0 2024-04-15T00:38:01.835 INFO:tasks.workunit.client.0.smithi029.stdout:3/843: write d17/d2f/d3c/f3f [5001782,12151] 0 2024-04-15T00:38:01.951 INFO:tasks.workunit.client.0.smithi029.stdout:9/814: write d3/d6/d9/d15/d62/fe3 [282194,126958] 0 2024-04-15T00:38:01.956 INFO:tasks.workunit.client.0.smithi029.stdout:4/819: mknod de/d54/d71/d8b/c101 0 2024-04-15T00:38:01.966 INFO:tasks.workunit.client.0.smithi029.stdout:1/815: write df/d29/d41/d69/d78/dd1/f5e [850687,110764] 0 2024-04-15T00:38:01.992 INFO:tasks.workunit.client.0.smithi029.stdout:5/874: getdents d2/de/d13/d22/d26/d36 0 2024-04-15T00:38:02.037 INFO:tasks.workunit.client.0.smithi029.stdout:9/815: readlink d3/d6/d9/d29/d60/d64/d6d/d58/d6a/lf6 0 2024-04-15T00:38:02.095 INFO:tasks.workunit.client.0.smithi029.stdout:2/847: rmdir d3/dd/d2d/d61/dd5/dcf/dc9 39 2024-04-15T00:38:02.104 INFO:tasks.workunit.client.0.smithi029.stdout:6/845: write d1/f17 [2900308,19857] 0 2024-04-15T00:38:02.135 INFO:tasks.workunit.client.0.smithi029.stdout:7/830: write d0/d6/f25 [1078211,90704] 0 2024-04-15T00:38:02.140 INFO:tasks.workunit.client.0.smithi029.stdout:0/882: write d5/d4c/d8a/f115 [796483,109109] 0 2024-04-15T00:38:02.247 INFO:tasks.workunit.client.0.smithi029.stdout:8/868: dwrite d8/f38 [0,4194304] 0 2024-04-15T00:38:02.320 INFO:tasks.workunit.client.0.smithi029.stdout:8/869: chown d8/cc8 19 1 2024-04-15T00:38:02.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/844: mkdir d17/d2f/d44/d58/d108/d113 0 2024-04-15T00:38:02.353 INFO:tasks.workunit.client.0.smithi029.stdout:9/816: unlink d3/d6/d9/d29/d60/d64/f8b 0 2024-04-15T00:38:02.358 INFO:tasks.workunit.client.0.smithi029.stdout:5/875: creat d2/de/d13/d22/d3c/d41/d6d/f122 x:0 0 0 2024-04-15T00:38:02.388 INFO:tasks.workunit.client.0.smithi029.stdout:8/870: read d8/d4a/d78/d23/d28/d5f/f83 [1491202,56238] 0 2024-04-15T00:38:02.534 INFO:tasks.workunit.client.0.smithi029.stdout:2/848: mknod d3/d2a/d6d/c114 0 2024-04-15T00:38:02.657 INFO:tasks.workunit.client.0.smithi029.stdout:6/846: creat d1/d8/d72/da3/d102/d108/dd3/ddf/f112 x:0 0 0 2024-04-15T00:38:02.665 INFO:tasks.workunit.client.0.smithi029.stdout:4/820: mknod de/d6d/c102 0 2024-04-15T00:38:02.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/816: symlink df/d29/d41/l116 0 2024-04-15T00:38:02.691 INFO:tasks.workunit.client.0.smithi029.stdout:5/876: mkdir d2/d1a/d2d/df8/d123 0 2024-04-15T00:38:02.820 INFO:tasks.workunit.client.0.smithi029.stdout:0/883: dread d5/d15/d27/fab [0,4194304] 0 2024-04-15T00:38:03.077 INFO:tasks.workunit.client.0.smithi029.stdout:3/845: dwrite d17/d2f/d44/fcf [0,4194304] 0 2024-04-15T00:38:03.531 INFO:tasks.workunit.client.0.smithi029.stdout:7/831: write d0/d74/ff7 [75583,92288] 0 2024-04-15T00:38:03.781 INFO:tasks.workunit.client.0.smithi029.stdout:8/871: fdatasync d8/da/d3d/fb6 0 2024-04-15T00:38:03.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/817: write df/f2d [1482703,69118] 0 2024-04-15T00:38:03.835 INFO:tasks.workunit.client.0.smithi029.stdout:9/817: unlink d3/d6/d9/d29/d60/d64/d6d/cb0 0 2024-04-15T00:38:03.936 INFO:tasks.workunit.client.0.smithi029.stdout:2/849: mknod d3/d93/c115 0 2024-04-15T00:38:04.418 INFO:tasks.workunit.client.0.smithi029.stdout:1/818: fdatasync df/f15 0 2024-04-15T00:38:04.539 INFO:tasks.workunit.client.0.smithi029.stdout:9/818: symlink d3/d6/d9/d15/d9d/lfa 0 2024-04-15T00:38:04.541 INFO:tasks.workunit.client.0.smithi029.stdout:8/872: fsync d8/da/d2f/d42/d75/fc9 0 2024-04-15T00:38:04.676 INFO:tasks.workunit.client.0.smithi029.stdout:1/819: truncate df/f38 1178596 0 2024-04-15T00:38:04.713 INFO:tasks.workunit.client.0.smithi029.stdout:4/821: mkdir de/d103 0 2024-04-15T00:38:04.780 INFO:tasks.workunit.client.0.smithi029.stdout:9/819: rename d3/d6/d9/d15/d4a/d53/fe9 to d3/d6/d9/d29/d60/d7f/da0/ffb 0 2024-04-15T00:38:04.785 INFO:tasks.workunit.client.0.smithi029.stdout:6/847: write d1/d8/db/fd1 [298928,11525] 0 2024-04-15T00:38:04.833 INFO:tasks.workunit.client.0.smithi029.stdout:0/884: write d5/db/d1a/d65/d76/daf/dc1/dfd/f10f [3971477,55074] 0 2024-04-15T00:38:04.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/877: dwrite d2/de/d13/d22/d26/d36/d4d/d70/fdb [0,4194304] 0 2024-04-15T00:38:05.002 INFO:tasks.workunit.client.0.smithi029.stdout:4/822: unlink de/d3a/lf8 0 2024-04-15T00:38:05.166 INFO:tasks.workunit.client.0.smithi029.stdout:9/820: dread d3/d6/d9/d29/d60/d64/d6d/f6b [0,4194304] 0 2024-04-15T00:38:05.396 INFO:tasks.workunit.client.0.smithi029.stdout:0/885: unlink d5/db/d110/fac 0 2024-04-15T00:38:05.496 INFO:tasks.workunit.client.0.smithi029.stdout:7/832: getdents d0/d6/d39/d3c/d5b/d7e 0 2024-04-15T00:38:05.562 INFO:tasks.workunit.client.0.smithi029.stdout:4/823: dread de/d54/d71/d8b/fd6 [0,4194304] 0 2024-04-15T00:38:05.572 INFO:tasks.workunit.client.0.smithi029.stdout:4/824: read - de/d54/fbb zero size 2024-04-15T00:38:05.622 INFO:tasks.workunit.client.0.smithi029.stdout:4/825: dread de/d54/d71/da3/fb2 [0,4194304] 0 2024-04-15T00:38:05.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/820: link df/d32/cce df/d29/d41/d69/d4c/d10e/c117 0 2024-04-15T00:38:05.724 INFO:tasks.workunit.client.0.smithi029.stdout:0/886: truncate d5/d3e/de3/f95 259659 0 2024-04-15T00:38:05.795 INFO:tasks.workunit.client.0.smithi029.stdout:6/848: link d1/d8/c9e d1/d1e/d22/ddd/c113 0 2024-04-15T00:38:05.847 INFO:tasks.workunit.client.0.smithi029.stdout:4/826: mkdir de/d54/d58/d104 0 2024-04-15T00:38:05.958 INFO:tasks.workunit.client.0.smithi029.stdout:1/821: mknod df/d29/d41/d69/d78/dd1/c118 0 2024-04-15T00:38:06.007 INFO:tasks.workunit.client.0.smithi029.stdout:0/887: dread - d5/d54/dec/f10e zero size 2024-04-15T00:38:06.022 INFO:tasks.workunit.client.0.smithi029.stdout:4/827: dread f4 [0,4194304] 0 2024-04-15T00:38:06.061 INFO:tasks.workunit.client.0.smithi029.stdout:7/833: symlink d0/d6/d4f/d5d/d65/dbc/dab/l110 0 2024-04-15T00:38:06.123 INFO:tasks.workunit.client.0.smithi029.stdout:0/888: stat d5/db/lef 0 2024-04-15T00:38:06.221 INFO:tasks.workunit.client.0.smithi029.stdout:9/821: dread d3/d6/d9/d29/d60/d64/d6d/d58/f2a [0,4194304] 0 2024-04-15T00:38:06.225 INFO:tasks.workunit.client.0.smithi029.stdout:3/846: dwrite d17/d2a/d4c/f8e [0,4194304] 0 2024-04-15T00:38:06.726 INFO:tasks.workunit.client.0.smithi029.stdout:3/847: mknod d17/d2a/d46/c114 0 2024-04-15T00:38:06.732 INFO:tasks.workunit.client.0.smithi029.stdout:5/878: dwrite d2/de/f112 [8388608,4194304] 0 2024-04-15T00:38:06.735 INFO:tasks.workunit.client.0.smithi029.stdout:0/889: truncate d5/db/d1a/d50/ff3 1572345 0 2024-04-15T00:38:06.820 INFO:tasks.workunit.client.0.smithi029.stdout:4/828: write f7 [1070296,65409] 0 2024-04-15T00:38:06.912 INFO:tasks.workunit.client.0.smithi029.stdout:0/890: chown d5/d15/d68/dff/f106 36852358 1 2024-04-15T00:38:06.915 INFO:tasks.workunit.client.0.smithi029.stdout:5/879: dread - d2/de/d13/d22/d3c/d41/d6d/f122 zero size 2024-04-15T00:38:06.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/822: dwrite df/d29/d41/d69/d4c/f5c [0,4194304] 0 2024-04-15T00:38:07.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/849: rmdir d1/d8/d72/da3/d102/d108/d58/d59/d111 0 2024-04-15T00:38:07.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/834: mkdir d0/d111 0 2024-04-15T00:38:07.070 INFO:tasks.workunit.client.0.smithi029.stdout:5/880: dread - d2/de/d13/d22/d26/d36/fc1 zero size 2024-04-15T00:38:07.085 INFO:tasks.workunit.client.0.smithi029.stdout:6/850: dread - d1/d8/db/d38/d86/fee zero size 2024-04-15T00:38:07.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/850: sync 2024-04-15T00:38:07.128 INFO:tasks.workunit.client.0.smithi029.stdout:2/851: read d3/d13/d43/d5a/f4b [1897519,4848] 0 2024-04-15T00:38:07.134 INFO:tasks.workunit.client.0.smithi029.stdout:8/873: sync 2024-04-15T00:38:07.458 INFO:tasks.workunit.client.0.smithi029.stdout:5/881: truncate d2/d1a/ff5 4619166 0 2024-04-15T00:38:07.459 INFO:tasks.workunit.client.0.smithi029.stdout:1/823: creat df/d29/d41/daf/f119 x:0 0 0 2024-04-15T00:38:07.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/851: unlink d1/d8/db/d38/d86/fee 0 2024-04-15T00:38:07.575 INFO:tasks.workunit.client.0.smithi029.stdout:3/848: symlink d17/d2a/d4c/l115 0 2024-04-15T00:38:07.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/835: dread d0/d6/f6c [0,4194304] 0 2024-04-15T00:38:07.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/874: write d8/da/f49 [593967,83594] 0 2024-04-15T00:38:07.860 INFO:tasks.workunit.client.0.smithi029.stdout:6/852: creat d1/d1e/d22/ddd/f114 x:0 0 0 2024-04-15T00:38:07.869 INFO:tasks.workunit.client.0.smithi029.stdout:9/822: getdents d3/d6/d9/d29/d60/d64/d6d 0 2024-04-15T00:38:07.869 INFO:tasks.workunit.client.0.smithi029.stdout:4/829: rmdir de/d103 0 2024-04-15T00:38:08.026 INFO:tasks.workunit.client.0.smithi029.stdout:0/891: write d5/d3e/de3/f95 [1032958,63329] 0 2024-04-15T00:38:08.045 INFO:tasks.workunit.client.0.smithi029.stdout:6/853: chown d1/d8/d72/da3/d102/d108/fef 3632 1 2024-04-15T00:38:08.058 INFO:tasks.workunit.client.0.smithi029.stdout:1/824: dread df/d29/f4b [0,4194304] 0 2024-04-15T00:38:08.084 INFO:tasks.workunit.client.0.smithi029.stdout:6/854: chown d1/d8/fe3 1 1 2024-04-15T00:38:08.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/825: chown df/d29/d41/d69/d78/f74 22020 1 2024-04-15T00:38:08.146 INFO:tasks.workunit.client.0.smithi029.stdout:2/852: write d3/dd/d2d/d61/dd5/d95/f98 [1034355,52765] 0 2024-04-15T00:38:08.732 INFO:tasks.workunit.client.0.smithi029.stdout:8/875: unlink d8/d4a/d78/f1c 0 2024-04-15T00:38:08.929 INFO:tasks.workunit.client.0.smithi029.stdout:5/882: truncate d2/de/d13/d22/d26/d36/d4d/d70/d8d/fe8 374179 0 2024-04-15T00:38:08.948 INFO:tasks.workunit.client.0.smithi029.stdout:6/855: fdatasync d1/db9/dc3/f103 0 2024-04-15T00:38:08.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/853: dread - d3/d2a/d4e/feb zero size 2024-04-15T00:38:09.086 INFO:tasks.workunit.client.0.smithi029.stdout:7/836: mkdir d0/d6/d39/d3c/d5b/dee/d112 0 2024-04-15T00:38:09.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/826: dread df/f46 [4194304,4194304] 0 2024-04-15T00:38:09.271 INFO:tasks.workunit.client.0.smithi029.stdout:1/827: sync 2024-04-15T00:38:09.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/876: rmdir d8/d4a/d78/d23/d28/d5f 39 2024-04-15T00:38:09.436 INFO:tasks.workunit.client.0.smithi029.stdout:5/883: stat d2/de/d13/daa/dc3/c107 0 2024-04-15T00:38:09.450 INFO:tasks.workunit.client.0.smithi029.stdout:5/884: readlink d2/de/d13/d22/d26/d36/l58 0 2024-04-15T00:38:09.586 INFO:tasks.workunit.client.0.smithi029.stdout:4/830: dwrite f4 [0,4194304] 0 2024-04-15T00:38:09.688 INFO:tasks.workunit.client.0.smithi029.stdout:7/837: chown d0/d6/d4f/d66/d26/d54/la3 243512 1 2024-04-15T00:38:09.734 INFO:tasks.workunit.client.0.smithi029.stdout:1/828: fdatasync df/d29/d41/d69/d78/dd1/d59/dd9/f113 0 2024-04-15T00:38:09.780 INFO:tasks.workunit.client.0.smithi029.stdout:9/823: dwrite d3/d6/d9/d29/d60/d7f/da0/d9a/fab [0,4194304] 0 2024-04-15T00:38:09.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/877: creat d8/da/d2f/d6e/f128 x:0 0 0 2024-04-15T00:38:09.962 INFO:tasks.workunit.client.0.smithi029.stdout:3/849: link d17/d2f/d76/d7f/lbe d17/d2f/l116 0 2024-04-15T00:38:10.016 INFO:tasks.workunit.client.0.smithi029.stdout:4/831: fsync de/df/ffd 0 2024-04-15T00:38:10.107 INFO:tasks.workunit.client.0.smithi029.stdout:7/838: fdatasync d0/d6/d4f/dbb/d49/fd7 0 2024-04-15T00:38:10.213 INFO:tasks.workunit.client.0.smithi029.stdout:1/829: creat df/d32/d7c/f11a x:0 0 0 2024-04-15T00:38:10.327 INFO:tasks.workunit.client.0.smithi029.stdout:9/824: mkdir d3/d6/d9/d29/d60/d64/dfc 0 2024-04-15T00:38:10.333 INFO:tasks.workunit.client.0.smithi029.stdout:8/878: readlink d8/da/d3d/d8a/lbc 0 2024-04-15T00:38:10.478 INFO:tasks.workunit.client.0.smithi029.stdout:4/832: unlink de/d54/d71/da3/fb2 0 2024-04-15T00:38:10.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/885: creat d2/de/d13/d22/d26/f124 x:0 0 0 2024-04-15T00:38:10.621 INFO:tasks.workunit.client.0.smithi029.stdout:0/892: write d5/d54/dec/d117/f120 [3750134,126645] 0 2024-04-15T00:38:10.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/893: readlink d5/d15/d68/lb5 0 2024-04-15T00:38:10.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/830: truncate df/d29/d41/f81 2013817 0 2024-04-15T00:38:10.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/879: fdatasync d8/da/f127 0 2024-04-15T00:38:10.718 INFO:tasks.workunit.client.0.smithi029.stdout:9/825: dread d3/da3/da7/fe0 [0,4194304] 0 2024-04-15T00:38:10.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/880: chown d8/d4a/d78 5626 1 2024-04-15T00:38:10.778 INFO:tasks.workunit.client.0.smithi029.stdout:4/833: mknod de/df/d1e/d56/c105 0 2024-04-15T00:38:10.847 INFO:tasks.workunit.client.0.smithi029.stdout:5/886: fdatasync d2/de/d1f/f3b 0 2024-04-15T00:38:10.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/856: dwrite d1/f18 [4194304,4194304] 0 2024-04-15T00:38:11.039 INFO:tasks.workunit.client.0.smithi029.stdout:0/894: dread d5/d4c/d4e/f107 [0,4194304] 0 2024-04-15T00:38:11.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/854: dwrite d3/dd/d2d/d61/dd5/d4a/f8a [4194304,4194304] 0 2024-04-15T00:38:11.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/857: dread - d1/db9/dc3/fc5 zero size 2024-04-15T00:38:11.245 INFO:tasks.workunit.client.0.smithi029.stdout:8/881: rename d8/da/d3d/fb6 to d8/da/d2f/d6e/dc1/ded/f129 0 2024-04-15T00:38:11.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/850: write d17/d2f/d76/d7f/fac [2843284,44448] 0 2024-04-15T00:38:11.437 INFO:tasks.workunit.client.0.smithi029.stdout:2/855: creat d3/d50/d51/f116 x:0 0 0 2024-04-15T00:38:11.576 INFO:tasks.workunit.client.0.smithi029.stdout:9/826: rename d3/d6/d9/l63 to d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/lfd 0 2024-04-15T00:38:11.688 INFO:tasks.workunit.client.0.smithi029.stdout:0/895: truncate d5/dc6/fd6 1007390 0 2024-04-15T00:38:11.747 INFO:tasks.workunit.client.0.smithi029.stdout:7/839: dwrite d0/d74/ff7 [0,4194304] 0 2024-04-15T00:38:11.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/858: mknod d1/db9/c115 0 2024-04-15T00:38:11.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/827: mkdir d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe 0 2024-04-15T00:38:12.013 INFO:tasks.workunit.client.0.smithi029.stdout:1/831: write df/d32/f50 [49596,63569] 0 2024-04-15T00:38:12.291 INFO:tasks.workunit.client.0.smithi029.stdout:6/859: creat d1/d8/db/dc1/f116 x:0 0 0 2024-04-15T00:38:12.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/851: rename d17/d2f/d76/cfb to d17/d2a/d33/df2/c117 0 2024-04-15T00:38:12.465 INFO:tasks.workunit.client.0.smithi029.stdout:4/834: dwrite de/d2b/d35/f69 [0,4194304] 0 2024-04-15T00:38:12.530 INFO:tasks.workunit.client.0.smithi029.stdout:5/887: link d2/d1a/f3e d2/de/d13/d22/d26/dd7/d118/f125 0 2024-04-15T00:38:12.558 INFO:tasks.workunit.client.0.smithi029.stdout:1/832: creat df/d29/d41/d69/d78/dea/f11b x:0 0 0 2024-04-15T00:38:12.607 INFO:tasks.workunit.client.0.smithi029.stdout:1/833: dread df/f16 [0,4194304] 0 2024-04-15T00:38:12.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/888: dread d2/de/d13/d22/d26/d36/f53 [0,4194304] 0 2024-04-15T00:38:12.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/856: rename d3/d13/d43/d9a to d3/d93/dbe/d117 0 2024-04-15T00:38:12.723 INFO:tasks.workunit.client.0.smithi029.stdout:8/882: write d8/d4a/d78/ff9 [1603513,78289] 0 2024-04-15T00:38:12.725 INFO:tasks.workunit.client.0.smithi029.stdout:0/896: rmdir d5/d54/d127 0 2024-04-15T00:38:12.770 INFO:tasks.workunit.client.0.smithi029.stdout:8/883: chown d8/d4a/d78/d23/fb2 40636136 1 2024-04-15T00:38:12.905 INFO:tasks.workunit.client.0.smithi029.stdout:7/840: creat d0/d6/d4f/dbb/f113 x:0 0 0 2024-04-15T00:38:12.929 INFO:tasks.workunit.client.0.smithi029.stdout:4/835: fdatasync de/d54/d71/db5/fcf 0 2024-04-15T00:38:13.046 INFO:tasks.workunit.client.0.smithi029.stdout:5/889: symlink d2/da5/dc8/l126 0 2024-04-15T00:38:13.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/841: sync 2024-04-15T00:38:13.269 INFO:tasks.workunit.client.0.smithi029.stdout:1/834: truncate df/d29/d41/d69/d78/dd1/d80/fe4 4859334 0 2024-04-15T00:38:13.277 INFO:tasks.workunit.client.0.smithi029.stdout:9/828: rename d3/d6/d9/d15/d7e/l80 to d3/d6/d9/d29/d60/d64/lff 0 2024-04-15T00:38:13.307 INFO:tasks.workunit.client.0.smithi029.stdout:9/829: chown d3/d6/d9/d29/d60/d64/d6d/d58/f28 161205 1 2024-04-15T00:38:13.321 INFO:tasks.workunit.client.0.smithi029.stdout:9/830: chown d3/d6/d9/d29/d60/d7f/ld5 1778884 1 2024-04-15T00:38:13.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/857: creat d3/dd/d42/dc6/f118 x:0 0 0 2024-04-15T00:38:13.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/858: stat d3/dd 0 2024-04-15T00:38:13.870 INFO:tasks.workunit.client.0.smithi029.stdout:3/852: dwrite d17/d2f/d44/d58/d5c/d5f/f7b [0,4194304] 0 2024-04-15T00:38:14.499 INFO:tasks.workunit.client.0.smithi029.stdout:0/897: mknod d5/d15/d27/d51/c128 0 2024-04-15T00:38:14.515 INFO:tasks.workunit.client.0.smithi029.stdout:0/898: stat d5/db/d7b 0 2024-04-15T00:38:14.519 INFO:tasks.workunit.client.0.smithi029.stdout:9/831: dread d3/da3/fe7 [0,4194304] 0 2024-04-15T00:38:14.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/853: symlink d17/d2f/d44/d5a/dde/l118 0 2024-04-15T00:38:14.893 INFO:tasks.workunit.client.0.smithi029.stdout:6/860: link d1/d8/db/d7b/d91/ca2 d1/db9/c117 0 2024-04-15T00:38:15.317 INFO:tasks.workunit.client.0.smithi029.stdout:3/854: rename d17/d2f/f39 to d17/d2a/d33/df2/f119 0 2024-04-15T00:38:15.395 INFO:tasks.workunit.client.0.smithi029.stdout:8/884: symlink d8/da/l12a 0 2024-04-15T00:38:15.467 INFO:tasks.workunit.client.0.smithi029.stdout:1/835: creat df/d32/f11c x:0 0 0 2024-04-15T00:38:15.508 INFO:tasks.workunit.client.0.smithi029.stdout:3/855: dread d17/d2a/d4c/f70 [0,4194304] 0 2024-04-15T00:38:15.523 INFO:tasks.workunit.client.0.smithi029.stdout:9/832: symlink d3/d6/d9/d15/l100 0 2024-04-15T00:38:15.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/890: write d2/de/d13/d22/d26/d36/d4d/f51 [3032921,105151] 0 2024-04-15T00:38:15.585 INFO:tasks.workunit.client.0.smithi029.stdout:4/836: dwrite de/df/d1e/f4c [4194304,4194304] 0 2024-04-15T00:38:15.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/885: fsync d8/d4a/f114 0 2024-04-15T00:38:15.691 INFO:tasks.workunit.client.0.smithi029.stdout:6/861: creat d1/d8/d79/f118 x:0 0 0 2024-04-15T00:38:15.717 INFO:tasks.workunit.client.0.smithi029.stdout:6/862: chown d1/d8/db/d38/d86/led 0 1 2024-04-15T00:38:16.244 INFO:tasks.workunit.client.0.smithi029.stdout:4/837: rmdir de/df/d1e 39 2024-04-15T00:38:16.352 INFO:tasks.workunit.client.0.smithi029.stdout:2/859: dwrite d3/dd/d42/dc6/dee/ffa [0,4194304] 0 2024-04-15T00:38:16.354 INFO:tasks.workunit.client.0.smithi029.stdout:7/842: dwrite d0/f5a [0,4194304] 0 2024-04-15T00:38:16.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/899: dwrite d5/db/d1a/d65/d76/daf/fd8 [0,4194304] 0 2024-04-15T00:38:16.472 INFO:tasks.workunit.client.0.smithi029.stdout:3/856: write d17/d2a/d33/f82 [5105150,40346] 0 2024-04-15T00:38:16.474 INFO:tasks.workunit.client.0.smithi029.stdout:9/833: write d3/d6/d9/fd3 [937706,122992] 0 2024-04-15T00:38:16.511 INFO:tasks.workunit.client.0.smithi029.stdout:1/836: creat df/d32/f11d x:0 0 0 2024-04-15T00:38:16.529 INFO:tasks.workunit.client.0.smithi029.stdout:6/863: chown d1/d8/d72/da3/d102/d108/dd3/de5/df7/ff8 499 1 2024-04-15T00:38:16.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/900: sync 2024-04-15T00:38:16.636 INFO:tasks.workunit.client.0.smithi029.stdout:8/886: rename d8/da/d2f/d66/fb8 to d8/da/f12b 0 2024-04-15T00:38:16.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/891: dwrite d2/de/d13/d22/d26/d36/d4d/dfb/fff [0,4194304] 0 2024-04-15T00:38:16.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/887: write d8/d4a/d78/ff9 [3827570,110827] 0 2024-04-15T00:38:16.788 INFO:tasks.workunit.client.0.smithi029.stdout:2/860: creat d3/dd/da0/f119 x:0 0 0 2024-04-15T00:38:16.807 INFO:tasks.workunit.client.0.smithi029.stdout:6/864: fdatasync d1/f12 0 2024-04-15T00:38:16.848 INFO:tasks.workunit.client.0.smithi029.stdout:1/837: creat df/d29/d41/d69/d78/f11e x:0 0 0 2024-04-15T00:38:16.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/838: truncate de/d2b/d35/f49 3935063 0 2024-04-15T00:38:16.919 INFO:tasks.workunit.client.0.smithi029.stdout:4/839: chown de/d54/d71/db5/cc7 6862 1 2024-04-15T00:38:16.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/834: creat d3/d6/d9/d29/d60/d7f/da0/f101 x:0 0 0 2024-04-15T00:38:16.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/901: fdatasync d5/d4c/d8a/f115 0 2024-04-15T00:38:17.031 INFO:tasks.workunit.client.0.smithi029.stdout:9/835: sync 2024-04-15T00:38:17.072 INFO:tasks.workunit.client.0.smithi029.stdout:2/861: symlink d3/dd/l11a 0 2024-04-15T00:38:17.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/857: truncate d17/d2f/d76/fe8 672128 0 2024-04-15T00:38:17.236 INFO:tasks.workunit.client.0.smithi029.stdout:8/888: creat d8/da/d2f/d6e/dc1/ded/d107/f12c x:0 0 0 2024-04-15T00:38:17.353 INFO:tasks.workunit.client.0.smithi029.stdout:7/843: dwrite d0/f7c [0,4194304] 0 2024-04-15T00:38:17.660 INFO:tasks.workunit.client.0.smithi029.stdout:0/902: creat d5/d15/d57/d122/f129 x:0 0 0 2024-04-15T00:38:17.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/892: symlink d2/de/d13/d22/d26/dd7/d118/l127 0 2024-04-15T00:38:17.894 INFO:tasks.workunit.client.0.smithi029.stdout:8/889: rmdir d8/da/d2f/d6e/dc1/ded 39 2024-04-15T00:38:18.015 INFO:tasks.workunit.client.0.smithi029.stdout:1/838: write df/d29/d41/d69/d4c/fd2 [539021,70772] 0 2024-04-15T00:38:18.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/903: creat d5/d3e/de3/f12a x:0 0 0 2024-04-15T00:38:18.070 INFO:tasks.workunit.client.0.smithi029.stdout:4/840: write de/d54/d71/da3/fe2 [918689,15522] 0 2024-04-15T00:38:18.263 INFO:tasks.workunit.client.0.smithi029.stdout:3/858: dwrite d17/f4d [0,4194304] 0 2024-04-15T00:38:18.325 INFO:tasks.workunit.client.0.smithi029.stdout:5/893: fdatasync d2/de/d13/d22/d3c/d41/ffe 0 2024-04-15T00:38:18.816 INFO:tasks.workunit.client.0.smithi029.stdout:8/890: unlink d8/d4a/d78/d23/d28/d30/d39/l5e 0 2024-04-15T00:38:18.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/844: symlink d0/d6/d4f/d5d/d82/db9/l114 0 2024-04-15T00:38:18.970 INFO:tasks.workunit.client.0.smithi029.stdout:1/839: rmdir df/d32/d90 39 2024-04-15T00:38:18.984 INFO:tasks.workunit.client.0.smithi029.stdout:7/845: sync 2024-04-15T00:38:19.032 INFO:tasks.workunit.client.0.smithi029.stdout:9/836: creat d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f102 x:0 0 0 2024-04-15T00:38:19.086 INFO:tasks.workunit.client.0.smithi029.stdout:2/862: link d3/dd/d2d/d61/d85/fbf d3/dd/d42/dd1/f11b 0 2024-04-15T00:38:19.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/840: dread df/d29/d41/d69/d4c/fd2 [0,4194304] 0 2024-04-15T00:38:19.136 INFO:tasks.workunit.client.0.smithi029.stdout:7/846: dwrite d0/f5a [0,4194304] 0 2024-04-15T00:38:19.192 INFO:tasks.workunit.client.0.smithi029.stdout:1/841: chown c9 6 1 2024-04-15T00:38:19.199 INFO:tasks.workunit.client.0.smithi029.stdout:2/863: stat d3/dd/d42/dc6/db1 0 2024-04-15T00:38:19.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/859: unlink d17/d2f/d44/d5a/cc7 0 2024-04-15T00:38:19.294 INFO:tasks.workunit.client.0.smithi029.stdout:6/865: getdents d1/d8/db 0 2024-04-15T00:38:19.878 INFO:tasks.workunit.client.0.smithi029.stdout:2/864: mkdir d3/d2a/d6d/d11c 0 2024-04-15T00:38:20.031 INFO:tasks.workunit.client.0.smithi029.stdout:6/866: rmdir d1/d8/db/d38/de4 39 2024-04-15T00:38:20.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/841: link l5 de/d54/d58/d104/l106 0 2024-04-15T00:38:20.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/904: write d5/d15/d57/f60 [3840332,113829] 0 2024-04-15T00:38:20.170 INFO:tasks.workunit.client.0.smithi029.stdout:8/891: read d8/d4a/d78/d23/d28/d5f/f8f [3808643,44433] 0 2024-04-15T00:38:20.207 INFO:tasks.workunit.client.0.smithi029.stdout:5/894: write d2/f52 [4868885,61312] 0 2024-04-15T00:38:20.279 INFO:tasks.workunit.client.0.smithi029.stdout:2/865: rename d3/dd/da0/f119 to d3/d13/d43/d5a/f11d 0 2024-04-15T00:38:20.420 INFO:tasks.workunit.client.0.smithi029.stdout:6/867: truncate d1/d8/d72/da3/fca 2948653 0 2024-04-15T00:38:20.553 INFO:tasks.workunit.client.0.smithi029.stdout:0/905: fdatasync d5/d15/d27/d51/d77/f11b 0 2024-04-15T00:38:20.730 INFO:tasks.workunit.client.0.smithi029.stdout:4/842: rename de/d6d/dde/fe3 to de/d2b/d35/f107 0 2024-04-15T00:38:20.808 INFO:tasks.workunit.client.0.smithi029.stdout:2/866: chown d3/dd/d2d/d61/dd5/dcf/dc9/l108 472794237 1 2024-04-15T00:38:20.826 INFO:tasks.workunit.client.0.smithi029.stdout:7/847: link d0/d6/d4f/d5d/d65/leb d0/d6/d4f/d5d/d87/l115 0 2024-04-15T00:38:20.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/868: truncate d1/d8/db/fd5 1062556 0 2024-04-15T00:38:21.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/843: truncate de/d54/d71/fab 450350 0 2024-04-15T00:38:21.074 INFO:tasks.workunit.client.0.smithi029.stdout:6/869: creat d1/d8/db/f119 x:0 0 0 2024-04-15T00:38:21.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/837: write d3/f3e [4495039,122271] 0 2024-04-15T00:38:21.217 INFO:tasks.workunit.client.0.smithi029.stdout:1/842: write df/fb1 [646238,24011] 0 2024-04-15T00:38:21.242 INFO:tasks.workunit.client.0.smithi029.stdout:9/838: dread d3/d6/d9/d29/d60/d64/d6d/d58/f32 [4194304,4194304] 0 2024-04-15T00:38:21.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/839: chown d3/d6/fc8 277 1 2024-04-15T00:38:21.274 INFO:tasks.workunit.client.0.smithi029.stdout:4/844: truncate de/fe5 128155 0 2024-04-15T00:38:21.291 INFO:tasks.workunit.client.0.smithi029.stdout:9/840: read d3/da3/da7/fe0 [728889,48664] 0 2024-04-15T00:38:21.365 INFO:tasks.workunit.client.0.smithi029.stdout:3/860: dwrite d17/d2a/d4c/f70 [0,4194304] 0 2024-04-15T00:38:21.700 INFO:tasks.workunit.client.0.smithi029.stdout:2/867: getdents d3 0 2024-04-15T00:38:21.895 INFO:tasks.workunit.client.0.smithi029.stdout:8/892: write d8/d4a/d78/d23/d28/d30/db1/fce [217891,74675] 0 2024-04-15T00:38:21.897 INFO:tasks.workunit.client.0.smithi029.stdout:5/895: write d2/de/d13/d22/d3c/f50 [619816,40547] 0 2024-04-15T00:38:21.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/843: write df/d29/d41/d69/f44 [363036,122043] 0 2024-04-15T00:38:22.046 INFO:tasks.workunit.client.0.smithi029.stdout:0/906: dwrite d5/d15/d27/fab [0,4194304] 0 2024-04-15T00:38:22.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/845: mkdir de/df/d1e/d56/dd3/d108 0 2024-04-15T00:38:22.061 INFO:tasks.workunit.client.0.smithi029.stdout:3/861: creat d17/d2f/d84/f11a x:0 0 0 2024-04-15T00:38:22.067 INFO:tasks.workunit.client.0.smithi029.stdout:5/896: sync 2024-04-15T00:38:22.133 INFO:tasks.workunit.client.0.smithi029.stdout:7/848: link d0/d6/d4f/d5d/d65/dbc/dab/l110 d0/d6/d4f/d5d/l116 0 2024-04-15T00:38:22.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/841: mkdir d3/da3/d103 0 2024-04-15T00:38:22.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/893: chown d8/da/d2f/d6e/dc1/ded/d107/f12c 549726123 1 2024-04-15T00:38:22.696 INFO:tasks.workunit.client.0.smithi029.stdout:2/868: dwrite d3/f5 [0,4194304] 0 2024-04-15T00:38:22.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/862: stat d17/d2f/d44/ld1 0 2024-04-15T00:38:22.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/846: symlink de/df/d1e/d56/l109 0 2024-04-15T00:38:22.857 INFO:tasks.workunit.client.0.smithi029.stdout:0/907: creat d5/d15/d1f/f12b x:0 0 0 2024-04-15T00:38:22.969 INFO:tasks.workunit.client.0.smithi029.stdout:7/849: dread - d0/d6/d4f/d66/d67/ffc zero size 2024-04-15T00:38:23.022 INFO:tasks.workunit.client.0.smithi029.stdout:7/850: read d0/d6/d4f/d66/d37/db7/dda/fe1 [600235,47620] 0 2024-04-15T00:38:23.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/844: write df/f1c [656616,32482] 0 2024-04-15T00:38:23.334 INFO:tasks.workunit.client.0.smithi029.stdout:4/847: fdatasync de/d54/d58/f68 0 2024-04-15T00:38:23.351 INFO:tasks.workunit.client.0.smithi029.stdout:7/851: rmdir d0/d6/d4f/d5d/d82 39 2024-04-15T00:38:23.351 INFO:tasks.workunit.client.0.smithi029.stdout:6/870: dread - d1/d8/db/d38/de4/f10c zero size 2024-04-15T00:38:23.398 INFO:tasks.workunit.client.0.smithi029.stdout:4/848: chown de/d54/d58/l79 7638 1 2024-04-15T00:38:23.897 INFO:tasks.workunit.client.0.smithi029.stdout:5/897: write d2/d1a/ff5 [3916952,54329] 0 2024-04-15T00:38:24.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/852: fdatasync d0/d74/fe9 0 2024-04-15T00:38:24.044 INFO:tasks.workunit.client.0.smithi029.stdout:4/849: truncate de/d2b/f21 4046420 0 2024-04-15T00:38:24.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/845: fsync df/d32/f3f 0 2024-04-15T00:38:24.241 INFO:tasks.workunit.client.0.smithi029.stdout:8/894: dwrite d8/da/d2f/d6e/d5a/fc4 [0,4194304] 0 2024-04-15T00:38:24.312 INFO:tasks.workunit.client.0.smithi029.stdout:9/842: dwrite d3/d6/d9/d15/d9d/ff9 [0,4194304] 0 2024-04-15T00:38:24.564 INFO:tasks.workunit.client.0.smithi029.stdout:7/853: dread d0/d6/f2c [0,4194304] 0 2024-04-15T00:38:24.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/863: fdatasync d17/d2a/d46/d67/fdb 0 2024-04-15T00:38:24.860 INFO:tasks.workunit.client.0.smithi029.stdout:2/869: link d3/d13/c29 d3/d13/d43/d5a/d4f/c11e 0 2024-04-15T00:38:24.896 INFO:tasks.workunit.client.0.smithi029.stdout:8/895: rmdir d8/d4a/d78/dc3 39 2024-04-15T00:38:25.005 INFO:tasks.workunit.client.0.smithi029.stdout:6/871: creat d1/d8/db/d38/f11a x:0 0 0 2024-04-15T00:38:25.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/908: write d5/d15/d27/dbb/fed [2471549,23542] 0 2024-04-15T00:38:25.256 INFO:tasks.workunit.client.0.smithi029.stdout:1/846: creat df/d29/d41/d96/d102/f11f x:0 0 0 2024-04-15T00:38:25.276 INFO:tasks.workunit.client.0.smithi029.stdout:1/847: chown df/d29/d41/d69/d78/dd1/d80 1805175 1 2024-04-15T00:38:25.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/854: fdatasync d0/d6/f8 0 2024-04-15T00:38:25.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/909: dread - d5/d15/d68/dff/f106 zero size 2024-04-15T00:38:25.582 INFO:tasks.workunit.client.0.smithi029.stdout:8/896: unlink d8/d4a/d78/dc3/l124 0 2024-04-15T00:38:25.659 INFO:tasks.workunit.client.0.smithi029.stdout:6/872: creat d1/d8/db/d7b/d85/dd2/dab/f11b x:0 0 0 2024-04-15T00:38:25.738 INFO:tasks.workunit.client.0.smithi029.stdout:9/843: rename d3/c2f to d3/d88/c104 0 2024-04-15T00:38:25.772 INFO:tasks.workunit.client.0.smithi029.stdout:7/855: read d0/d6/d4f/d66/d67/f73 [1874835,62323] 0 2024-04-15T00:38:25.797 INFO:tasks.workunit.client.0.smithi029.stdout:7/856: stat d0/d6/d4f/d66/d26/f33 0 2024-04-15T00:38:25.886 INFO:tasks.workunit.client.0.smithi029.stdout:8/897: creat d8/da/d2f/d6e/d92/d10c/d112/f12d x:0 0 0 2024-04-15T00:38:25.982 INFO:tasks.workunit.client.0.smithi029.stdout:1/848: mkdir df/d29/d41/d120 0 2024-04-15T00:38:26.052 INFO:tasks.workunit.client.0.smithi029.stdout:6/873: creat d1/d8/db/d7b/d91/f11c x:0 0 0 2024-04-15T00:38:26.081 INFO:tasks.workunit.client.0.smithi029.stdout:9/844: truncate d3/d6/d9/d29/d60/d64/d6d/d58/f28 796771 0 2024-04-15T00:38:26.137 INFO:tasks.workunit.client.0.smithi029.stdout:0/910: truncate d5/d4c/d4e/da8/f103 52640 0 2024-04-15T00:38:26.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/874: chown d1/d8/db/d7b/d85/l8e 9092416 1 2024-04-15T00:38:26.180 INFO:tasks.workunit.client.0.smithi029.stdout:4/850: dwrite de/d3a/f42 [0,4194304] 0 2024-04-15T00:38:26.289 INFO:tasks.workunit.client.0.smithi029.stdout:9/845: dread d3/d6/d9/d15/de8/feb [0,4194304] 0 2024-04-15T00:38:26.399 INFO:tasks.workunit.client.0.smithi029.stdout:8/898: mkdir d8/da8/d12e 0 2024-04-15T00:38:26.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/898: dwrite d2/de/d13/d22/d26/dd7/d118/f125 [0,4194304] 0 2024-04-15T00:38:26.579 INFO:tasks.workunit.client.0.smithi029.stdout:3/864: dwrite d17/d2f/d76/d7f/ff6 [0,4194304] 0 2024-04-15T00:38:26.652 INFO:tasks.workunit.client.0.smithi029.stdout:5/899: stat d2/f8 0 2024-04-15T00:38:26.655 INFO:tasks.workunit.client.0.smithi029.stdout:7/857: creat d0/d6/d4f/d5d/d8d/f117 x:0 0 0 2024-04-15T00:38:26.744 INFO:tasks.workunit.client.0.smithi029.stdout:6/875: creat d1/d8/db/d38/d86/f11d x:0 0 0 2024-04-15T00:38:26.812 INFO:tasks.workunit.client.0.smithi029.stdout:4/851: mknod de/d6d/d7e/c10a 0 2024-04-15T00:38:26.842 INFO:tasks.workunit.client.0.smithi029.stdout:7/858: dread d0/d6/d39/d3c/d5b/d7e/fc9 [0,4194304] 0 2024-04-15T00:38:26.847 INFO:tasks.workunit.client.0.smithi029.stdout:4/852: stat de/d2b/d35/l85 0 2024-04-15T00:38:27.165 INFO:tasks.workunit.client.0.smithi029.stdout:2/870: rename d3/d53/ce6 to d3/d13/d43/c11f 0 2024-04-15T00:38:27.182 INFO:tasks.workunit.client.0.smithi029.stdout:0/911: mknod d5/d15/d1f/dfe/c12c 0 2024-04-15T00:38:27.264 INFO:tasks.workunit.client.0.smithi029.stdout:1/849: write df/d29/d41/daf/f119 [397470,48917] 0 2024-04-15T00:38:27.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/876: symlink d1/d1e/d105/l11e 0 2024-04-15T00:38:27.378 INFO:tasks.workunit.client.0.smithi029.stdout:7/859: symlink d0/d6/d4f/d66/l118 0 2024-04-15T00:38:27.417 INFO:tasks.workunit.client.0.smithi029.stdout:4/853: truncate de/d2b/d59/fd7 740693 0 2024-04-15T00:38:27.758 INFO:tasks.workunit.client.0.smithi029.stdout:8/899: write d8/da/d2f/d66/f67 [1412535,2473] 0 2024-04-15T00:38:27.914 INFO:tasks.workunit.client.0.smithi029.stdout:0/912: mknod d5/db/db0/c12d 0 2024-04-15T00:38:27.943 INFO:tasks.workunit.client.0.smithi029.stdout:5/900: write d2/de/d13/d22/d3c/d41/f5d [361583,61957] 0 2024-04-15T00:38:28.004 INFO:tasks.workunit.client.0.smithi029.stdout:5/901: dread d2/de/d13/d22/f5e [0,4194304] 0 2024-04-15T00:38:28.119 INFO:tasks.workunit.client.0.smithi029.stdout:6/877: dread d1/d8/d72/da3/fca [0,4194304] 0 2024-04-15T00:38:28.193 INFO:tasks.workunit.client.0.smithi029.stdout:4/854: fdatasync de/fd2 0 2024-04-15T00:38:28.197 INFO:tasks.workunit.client.0.smithi029.stdout:8/900: mkdir d8/d12f 0 2024-04-15T00:38:28.207 INFO:tasks.workunit.client.0.smithi029.stdout:3/865: creat d17/d2a/d46/f11b x:0 0 0 2024-04-15T00:38:28.240 INFO:tasks.workunit.client.0.smithi029.stdout:8/901: chown d8/da/d2f/d6e/l71 114 1 2024-04-15T00:38:28.259 INFO:tasks.workunit.client.0.smithi029.stdout:5/902: sync 2024-04-15T00:38:28.322 INFO:tasks.workunit.client.0.smithi029.stdout:9/846: link d3/d6/d9/d29/d60/d64/lde d3/l105 0 2024-04-15T00:38:28.385 INFO:tasks.workunit.client.0.smithi029.stdout:7/860: symlink d0/d6/d4f/dbb/l119 0 2024-04-15T00:38:28.473 INFO:tasks.workunit.client.0.smithi029.stdout:2/871: dwrite d3/d13/f97 [0,4194304] 0 2024-04-15T00:38:29.111 INFO:tasks.workunit.client.0.smithi029.stdout:8/902: fsync d8/da/d2f/d6e/d5a/fdb 0 2024-04-15T00:38:29.190 INFO:tasks.workunit.client.0.smithi029.stdout:0/913: dwrite d5/db/d1a/d50/f11d [0,4194304] 0 2024-04-15T00:38:29.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/872: creat d3/dd/da0/f120 x:0 0 0 2024-04-15T00:38:29.404 INFO:tasks.workunit.client.0.smithi029.stdout:9/847: dread d3/d6/d9/d29/d60/d7f/da0/d9a/f73 [0,4194304] 0 2024-04-15T00:38:29.796 INFO:tasks.workunit.client.0.smithi029.stdout:8/903: dread d8/da/d3d/de0/fea [0,4194304] 0 2024-04-15T00:38:29.797 INFO:tasks.workunit.client.0.smithi029.stdout:0/914: symlink d5/db/d1a/d65/d76/daf/l12e 0 2024-04-15T00:38:29.847 INFO:tasks.workunit.client.0.smithi029.stdout:1/850: getdents df/d32/d7c 0 2024-04-15T00:38:29.971 INFO:tasks.workunit.client.0.smithi029.stdout:4/855: symlink de/d3a/daa/db6/l10b 0 2024-04-15T00:38:29.971 INFO:tasks.workunit.client.0.smithi029.stdout:9/848: dread - d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fed zero size 2024-04-15T00:38:30.181 INFO:tasks.workunit.client.0.smithi029.stdout:3/866: dwrite d17/d2a/d4c/da1/f10e [0,4194304] 0 2024-04-15T00:38:30.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:38:30.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:38:30.431 INFO:tasks.workunit.client.0.smithi029.stdout:5/903: write d2/de/d1f/d63/d65/f86 [1010515,78722] 0 2024-04-15T00:38:30.450 INFO:tasks.workunit.client.0.smithi029.stdout:2/873: write d3/dd/d2d/d61/dd5/dcf/fc1 [511676,56795] 0 2024-04-15T00:38:30.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/861: link d0/d6/d4f/d5d/d87/da6/lad d0/d6/d39/d3c/d5b/d7e/l11a 0 2024-04-15T00:38:30.479 INFO:tasks.workunit.client.0.smithi029.stdout:6/878: link d1/d8/d72/fff d1/d8/db/d98/f11f 0 2024-04-15T00:38:30.488 INFO:tasks.workunit.client.0.smithi029.stdout:9/849: dread - d3/d6/d30/fcc zero size 2024-04-15T00:38:30.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/904: dread d8/d4a/d78/d23/d28/d30/db1/fce [0,4194304] 0 2024-04-15T00:38:30.599 INFO:tasks.workunit.client.0.smithi029.stdout:4/856: mknod de/df/d1e/c10c 0 2024-04-15T00:38:30.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/867: rmdir d17/d2a/d46/d67/dd6 39 2024-04-15T00:38:30.923 INFO:tasks.workunit.client.0.smithi029.stdout:1/851: mknod df/d29/c121 0 2024-04-15T00:38:30.941 INFO:tasks.workunit.client.0.smithi029.stdout:5/904: creat d2/de/d13/d22/d3c/d41/dec/f128 x:0 0 0 2024-04-15T00:38:31.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/868: mknod d17/d2f/d44/d5a/c11c 0 2024-04-15T00:38:31.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/915: link d5/d3e/c5f d5/d4c/d4e/da8/c12f 0 2024-04-15T00:38:31.440 INFO:tasks.workunit.client.0.smithi029.stdout:7/862: write d0/d6/d4f/d66/d37/db7/dda/fc [2580203,55912] 0 2024-04-15T00:38:31.584 INFO:tasks.workunit.client.0.smithi029.stdout:2/874: dwrite d3/dd/d2d/d61/dd5/d4a/f8a [0,4194304] 0 2024-04-15T00:38:31.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/850: dwrite d3/d6/d9/d15/d9d/fd0 [0,4194304] 0 2024-04-15T00:38:31.790 INFO:tasks.workunit.client.0.smithi029.stdout:1/852: write df/d29/d41/f4e [578387,11896] 0 2024-04-15T00:38:31.802 INFO:tasks.workunit.client.0.smithi029.stdout:0/916: unlink d5/d15/d68/feb 0 2024-04-15T00:38:31.830 INFO:tasks.workunit.client.0.smithi029.stdout:9/851: stat d3/d6/l7a 0 2024-04-15T00:38:31.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/857: rename de/f5d to de/d2b/f10d 0 2024-04-15T00:38:32.057 INFO:tasks.workunit.client.0.smithi029.stdout:8/905: dwrite d8/d4a/d78/d23/d28/d30/db1/fc5 [0,4194304] 0 2024-04-15T00:38:32.181 INFO:tasks.workunit.client.0.smithi029.stdout:6/879: dwrite d1/d8/db/fb1 [0,4194304] 0 2024-04-15T00:38:32.260 INFO:tasks.workunit.client.0.smithi029.stdout:1/853: unlink df/d29/d41/f48 0 2024-04-15T00:38:32.325 INFO:tasks.workunit.client.0.smithi029.stdout:5/905: dwrite d2/de/d13/d22/d26/d36/d4d/d70/d8d/f91 [0,4194304] 0 2024-04-15T00:38:32.402 INFO:tasks.workunit.client.0.smithi029.stdout:4/858: fsync de/d54/d71/da3/fe2 0 2024-04-15T00:38:32.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/869: symlink d17/d2a/d46/d67/dd6/d102/d109/l11d 0 2024-04-15T00:38:32.478 INFO:tasks.workunit.client.0.smithi029.stdout:7/863: dwrite d0/d6/f18 [4194304,4194304] 0 2024-04-15T00:38:32.552 INFO:tasks.workunit.client.0.smithi029.stdout:2/875: truncate d3/d13/d43/d5a/d4f/f5d 791646 0 2024-04-15T00:38:32.564 INFO:tasks.workunit.client.0.smithi029.stdout:7/864: readlink d0/d6/d4f/d66/l118 0 2024-04-15T00:38:32.624 INFO:tasks.workunit.client.0.smithi029.stdout:9/852: creat d3/d6/d9/d15/d4a/da9/f106 x:0 0 0 2024-04-15T00:38:32.624 INFO:tasks.workunit.client.0.smithi029.stdout:0/917: fsync d5/d15/d27/dbb/dbd/df6/f102 0 2024-04-15T00:38:32.657 INFO:tasks.workunit.client.0.smithi029.stdout:0/918: readlink d5/db/d1a/la0 0 2024-04-15T00:38:32.730 INFO:tasks.workunit.client.0.smithi029.stdout:8/906: mknod d8/d4a/d78/d23/d28/d30/d39/d77/c130 0 2024-04-15T00:38:32.992 INFO:tasks.workunit.client.0.smithi029.stdout:6/880: mkdir d1/d8/d72/da3/d102/d108/dd3/de5/df7/d120 0 2024-04-15T00:38:33.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/876: mkdir d3/d13/d43/d5a/d4f/d121 0 2024-04-15T00:38:33.202 INFO:tasks.workunit.client.0.smithi029.stdout:2/877: dwrite d3/dd/d2d/d61/dd5/dcf/fc1 [0,4194304] 0 2024-04-15T00:38:33.401 INFO:tasks.workunit.client.0.smithi029.stdout:7/865: dread d0/d6/d4f/d5d/d87/f8c [0,4194304] 0 2024-04-15T00:38:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:3/870: unlink d17/d2f/d84/c89 0 2024-04-15T00:38:33.449 INFO:tasks.workunit.client.0.smithi029.stdout:4/859: write de/d6d/fff [611767,105347] 0 2024-04-15T00:38:33.484 INFO:tasks.workunit.client.0.smithi029.stdout:5/906: dwrite d2/de/f57 [8388608,4194304] 0 2024-04-15T00:38:33.551 INFO:tasks.workunit.client.0.smithi029.stdout:6/881: rename d1/d8/db/d38/d86/ld7 to d1/d8/db/d7b/d85/l121 0 2024-04-15T00:38:33.919 INFO:tasks.workunit.client.0.smithi029.stdout:9/853: write d3/d6/d9/d29/d60/d7f/da0/d9a/f73 [1668500,92757] 0 2024-04-15T00:38:34.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/919: dwrite d5/d15/d27/d51/fb2 [0,4194304] 0 2024-04-15T00:38:34.201 INFO:tasks.workunit.client.0.smithi029.stdout:8/907: dwrite d8/fad [0,4194304] 0 2024-04-15T00:38:34.278 INFO:tasks.workunit.client.0.smithi029.stdout:2/878: creat d3/dd/d2d/d61/d85/da2/f122 x:0 0 0 2024-04-15T00:38:34.510 INFO:tasks.workunit.client.0.smithi029.stdout:4/860: truncate de/d54/fda 120245 0 2024-04-15T00:38:34.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/907: truncate d2/f4 2508123 0 2024-04-15T00:38:34.528 INFO:tasks.workunit.client.0.smithi029.stdout:5/908: chown d2/d1a/d2d/c4e 111635456 1 2024-04-15T00:38:34.538 INFO:tasks.workunit.client.0.smithi029.stdout:5/909: chown d2/de/d1f/l3a 854 1 2024-04-15T00:38:34.607 INFO:tasks.workunit.client.0.smithi029.stdout:9/854: dread d3/d6/d9/f50 [0,4194304] 0 2024-04-15T00:38:34.806 INFO:tasks.workunit.client.0.smithi029.stdout:0/920: creat d5/d15/d27/dbb/dbd/f130 x:0 0 0 2024-04-15T00:38:34.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/882: mkdir d1/d8/d72/da3/d102/d108/d122 0 2024-04-15T00:38:34.904 INFO:tasks.workunit.client.0.smithi029.stdout:9/855: sync 2024-04-15T00:38:34.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/854: link df/d29/fd8 df/d32/f122 0 2024-04-15T00:38:35.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/879: creat d3/dd/d2d/d61/df6/d109/f123 x:0 0 0 2024-04-15T00:38:35.060 INFO:tasks.workunit.client.0.smithi029.stdout:4/861: mknod de/d3a/c10e 0 2024-04-15T00:38:35.114 INFO:tasks.workunit.client.0.smithi029.stdout:0/921: dread d5/d15/d27/fab [0,4194304] 0 2024-04-15T00:38:35.173 INFO:tasks.workunit.client.0.smithi029.stdout:6/883: mkdir d1/d8/db/d7b/d85/dd2/dab/d123 0 2024-04-15T00:38:35.246 INFO:tasks.workunit.client.0.smithi029.stdout:1/855: dread - df/d29/d41/d4f/fde zero size 2024-04-15T00:38:35.348 INFO:tasks.workunit.client.0.smithi029.stdout:2/880: fsync d3/dd/d2d/d61/dd5/d95/f1e 0 2024-04-15T00:38:35.349 INFO:tasks.workunit.client.0.smithi029.stdout:4/862: symlink de/d6d/dde/l10f 0 2024-04-15T00:38:35.380 INFO:tasks.workunit.client.0.smithi029.stdout:1/856: dread df/f42 [0,4194304] 0 2024-04-15T00:38:35.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/908: getdents d8/da/d2f/d6e/d5a 0 2024-04-15T00:38:35.951 INFO:tasks.workunit.client.0.smithi029.stdout:1/857: dread df/d29/d41/d69/d4c/fd0 [0,4194304] 0 2024-04-15T00:38:36.346 INFO:tasks.workunit.client.0.smithi029.stdout:3/871: dwrite d17/f24 [0,4194304] 0 2024-04-15T00:38:36.411 INFO:tasks.workunit.client.0.smithi029.stdout:7/866: dwrite d0/d6/d4f/f106 [0,4194304] 0 2024-04-15T00:38:36.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/910: write d2/de/d13/d22/d26/f124 [759161,124967] 0 2024-04-15T00:38:36.514 INFO:tasks.workunit.client.0.smithi029.stdout:6/884: rmdir d1/d8/d79 39 2024-04-15T00:38:36.542 INFO:tasks.workunit.client.0.smithi029.stdout:4/863: write de/d2b/d59/f76 [1956969,97089] 0 2024-04-15T00:38:36.546 INFO:tasks.workunit.client.0.smithi029.stdout:2/881: write d3/dd/d42/dc6/f118 [224019,38348] 0 2024-04-15T00:38:36.608 INFO:tasks.workunit.client.0.smithi029.stdout:1/858: mknod df/d29/d41/d4f/c123 0 2024-04-15T00:38:36.768 INFO:tasks.workunit.client.0.smithi029.stdout:3/872: rmdir d17/d2f/d44/d5a/dde 39 2024-04-15T00:38:36.788 INFO:tasks.workunit.client.0.smithi029.stdout:2/882: chown d3/d2a/l7a 135 1 2024-04-15T00:38:36.894 INFO:tasks.workunit.client.0.smithi029.stdout:0/922: dwrite d5/d4c/d4e/f107 [0,4194304] 0 2024-04-15T00:38:36.939 INFO:tasks.workunit.client.0.smithi029.stdout:7/867: symlink d0/d6/d4f/d66/d37/dde/l11b 0 2024-04-15T00:38:36.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/856: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f93 [0,4194304] 0 2024-04-15T00:38:36.967 INFO:tasks.workunit.client.0.smithi029.stdout:6/885: symlink d1/d8/db/d98/l124 0 2024-04-15T00:38:37.048 INFO:tasks.workunit.client.0.smithi029.stdout:8/909: dwrite d8/d4a/d78/f89 [0,4194304] 0 2024-04-15T00:38:37.124 INFO:tasks.workunit.client.0.smithi029.stdout:5/911: read d2/de/d1f/d63/d65/fcd [408980,48744] 0 2024-04-15T00:38:37.176 INFO:tasks.workunit.client.0.smithi029.stdout:4/864: dread de/d54/d58/fd1 [0,4194304] 0 2024-04-15T00:38:37.191 INFO:tasks.workunit.client.0.smithi029.stdout:6/886: chown d1/db9/dc3/fd9 0 1 2024-04-15T00:38:37.304 INFO:tasks.workunit.client.0.smithi029.stdout:3/873: creat d17/d2a/d33/f11e x:0 0 0 2024-04-15T00:38:37.322 INFO:tasks.workunit.client.0.smithi029.stdout:1/859: write df/d29/d41/d4f/fde [40890,120861] 0 2024-04-15T00:38:37.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/912: dread d2/de/f57 [0,4194304] 0 2024-04-15T00:38:37.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/860: chown df/lfc 441105542 1 2024-04-15T00:38:37.615 INFO:tasks.workunit.client.0.smithi029.stdout:7/868: mkdir d0/d6/d4f/dbb/d49/d11c 0 2024-04-15T00:38:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:0/923: dread d5/d15/f4a [0,4194304] 0 2024-04-15T00:38:37.770 INFO:tasks.workunit.client.0.smithi029.stdout:2/883: dwrite d3/d13/d43/f5f [0,4194304] 0 2024-04-15T00:38:37.771 INFO:tasks.workunit.client.0.smithi029.stdout:9/857: readlink d3/d6/d9/d15/d62/l66 0 2024-04-15T00:38:37.896 INFO:tasks.workunit.client.0.smithi029.stdout:0/924: dread d5/d15/d27/d51/d7d/faa [0,4194304] 0 2024-04-15T00:38:38.037 INFO:tasks.workunit.client.0.smithi029.stdout:5/913: rename d2/de/fbd to d2/d1a/d2d/f129 0 2024-04-15T00:38:38.120 INFO:tasks.workunit.client.0.smithi029.stdout:2/884: dread d3/d13/d43/f8f [0,4194304] 0 2024-04-15T00:38:38.294 INFO:tasks.workunit.client.0.smithi029.stdout:7/869: truncate d0/d6/d4f/d66/d67/f101 1539580 0 2024-04-15T00:38:38.307 INFO:tasks.workunit.client.0.smithi029.stdout:4/865: link de/df/f12 de/d6d/dde/f110 0 2024-04-15T00:38:38.319 INFO:tasks.workunit.client.0.smithi029.stdout:0/925: dread d5/d3e/ff5 [0,4194304] 0 2024-04-15T00:38:38.374 INFO:tasks.workunit.client.0.smithi029.stdout:1/861: dwrite df/d32/f93 [0,4194304] 0 2024-04-15T00:38:38.440 INFO:tasks.workunit.client.0.smithi029.stdout:2/885: fdatasync d3/dd/d42/dc6/f118 0 2024-04-15T00:38:38.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/887: getdents d1/d1e/d105 0 2024-04-15T00:38:38.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/910: dwrite d8/da/d3d/f81 [0,4194304] 0 2024-04-15T00:38:38.565 INFO:tasks.workunit.client.0.smithi029.stdout:9/858: mknod d3/d6/c107 0 2024-04-15T00:38:38.565 INFO:tasks.workunit.client.0.smithi029.stdout:0/926: chown d5/d15/d1f/f3a 2327173 1 2024-04-15T00:38:38.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/870: readlink d0/d6/d4f/d5d/d65/dbc/l75 0 2024-04-15T00:38:38.656 INFO:tasks.workunit.client.0.smithi029.stdout:6/888: read d1/d8/d72/da3/d102/d108/dd3/de5/df7/ff8 [491486,85241] 0 2024-04-15T00:38:38.876 INFO:tasks.workunit.client.0.smithi029.stdout:3/874: getdents d17/d2f/d44/d58/d5c 0 2024-04-15T00:38:38.912 INFO:tasks.workunit.client.0.smithi029.stdout:4/866: creat de/d2b/d59/f111 x:0 0 0 2024-04-15T00:38:38.969 INFO:tasks.workunit.client.0.smithi029.stdout:1/862: fdatasync df/f46 0 2024-04-15T00:38:38.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/863: readlink l6 0 2024-04-15T00:38:39.009 INFO:tasks.workunit.client.0.smithi029.stdout:5/914: creat d2/de/f12a x:0 0 0 2024-04-15T00:38:39.024 INFO:tasks.workunit.client.0.smithi029.stdout:5/915: chown d2/de/d13/d22/d26/dfc/d108 3069 1 2024-04-15T00:38:39.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/875: sync 2024-04-15T00:38:39.134 INFO:tasks.workunit.client.0.smithi029.stdout:2/886: unlink d3/d53/ldb 0 2024-04-15T00:38:39.164 INFO:tasks.workunit.client.0.smithi029.stdout:2/887: write d3/dd/d2d/d61/df6/d109/f123 [342461,72886] 0 2024-04-15T00:38:39.204 INFO:tasks.workunit.client.0.smithi029.stdout:2/888: dread d3/d13/de1/f111 [0,4194304] 0 2024-04-15T00:38:39.239 INFO:tasks.workunit.client.0.smithi029.stdout:9/859: mkdir d3/d6/d9/d29/d60/d7f/da0/d108 0 2024-04-15T00:38:39.307 INFO:tasks.workunit.client.0.smithi029.stdout:0/927: truncate d5/db/f45 2264287 0 2024-04-15T00:38:39.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/889: truncate d1/d1e/d22/ddd/f114 246234 0 2024-04-15T00:38:39.405 INFO:tasks.workunit.client.0.smithi029.stdout:4/867: chown de/d2b/d35/cfe 1 1 2024-04-15T00:38:39.591 INFO:tasks.workunit.client.0.smithi029.stdout:3/876: mknod d17/d2f/d76/d7f/c11f 0 2024-04-15T00:38:39.604 INFO:tasks.workunit.client.0.smithi029.stdout:3/877: chown d17/d2f/d76/d7f/dcd/l10c 966 1 2024-04-15T00:38:39.735 INFO:tasks.workunit.client.0.smithi029.stdout:2/889: fdatasync d3/dd/d2d/d61/dd5/fcc 0 2024-04-15T00:38:39.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/871: mknod d0/d6/d39/d107/c11d 0 2024-04-15T00:38:39.760 INFO:tasks.workunit.client.0.smithi029.stdout:7/872: chown d0/d6/d39/d3c/fec 1649250 1 2024-04-15T00:38:40.028 INFO:tasks.workunit.client.0.smithi029.stdout:0/928: unlink d5/db/d1a/d65/l7f 0 2024-04-15T00:38:40.194 INFO:tasks.workunit.client.0.smithi029.stdout:4/868: chown de/d2b/d35/f107 3 1 2024-04-15T00:38:40.217 INFO:tasks.workunit.client.0.smithi029.stdout:5/916: creat d2/de/d13/d22/d26/d36/d4d/d70/d9a/d11a/f12b x:0 0 0 2024-04-15T00:38:40.422 INFO:tasks.workunit.client.0.smithi029.stdout:9/860: creat d3/d6/d9/d29/d60/d7f/da0/d108/f109 x:0 0 0 2024-04-15T00:38:40.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/861: chown d3/d6/d30/fcc 17 1 2024-04-15T00:38:40.478 INFO:tasks.workunit.client.0.smithi029.stdout:0/929: rmdir d5/d4c/d4e/d10b 39 2024-04-15T00:38:40.923 INFO:tasks.workunit.client.0.smithi029.stdout:1/864: creat df/f124 x:0 0 0 2024-04-15T00:38:40.923 INFO:tasks.workunit.client.0.smithi029.stdout:5/917: truncate d2/de/fb0 470955 0 2024-04-15T00:38:40.923 INFO:tasks.workunit.client.0.smithi029.stdout:7/873: symlink d0/d6/d4f/d5d/d87/da6/dc3/l11e 0 2024-04-15T00:38:41.029 INFO:tasks.workunit.client.0.smithi029.stdout:8/911: write d8/da/d2f/d66/f84 [151430,76235] 0 2024-04-15T00:38:41.196 INFO:tasks.workunit.client.0.smithi029.stdout:4/869: mkdir de/d54/d71/d8b/da7/d112 0 2024-04-15T00:38:41.290 INFO:tasks.workunit.client.0.smithi029.stdout:8/912: rename d8/d4a/d78/c111 to d8/d4a/d78/d10b/c131 0 2024-04-15T00:38:41.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/874: symlink d0/d6/d39/d3c/l11f 0 2024-04-15T00:38:41.447 INFO:tasks.workunit.client.0.smithi029.stdout:4/870: creat de/d54/d71/f113 x:0 0 0 2024-04-15T00:38:41.484 INFO:tasks.workunit.client.0.smithi029.stdout:8/913: creat d8/d4a/d78/d23/d28/d30/d39/f132 x:0 0 0 2024-04-15T00:38:41.595 INFO:tasks.workunit.client.0.smithi029.stdout:7/875: sync 2024-04-15T00:38:41.789 INFO:tasks.workunit.client.0.smithi029.stdout:2/890: write d3/d53/fec [656461,92205] 0 2024-04-15T00:38:41.790 INFO:tasks.workunit.client.0.smithi029.stdout:6/890: write d1/f92 [88699,21857] 0 2024-04-15T00:38:41.812 INFO:tasks.workunit.client.0.smithi029.stdout:4/871: write f7 [1214944,63380] 0 2024-04-15T00:38:41.837 INFO:tasks.workunit.client.0.smithi029.stdout:4/872: readlink de/d3a/la8 0 2024-04-15T00:38:41.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/891: read - d3/dd/d2d/d61/dd5/fcc zero size 2024-04-15T00:38:41.867 INFO:tasks.workunit.client.0.smithi029.stdout:2/892: stat d3/dd/d2d/d61/d85/ccb 0 2024-04-15T00:38:41.882 INFO:tasks.workunit.client.0.smithi029.stdout:2/893: dread - d3/dd/d2d/d61/dd5/d4a/f66 zero size 2024-04-15T00:38:41.912 INFO:tasks.workunit.client.0.smithi029.stdout:3/878: write d17/d2a/d46/f5d [3094878,19414] 0 2024-04-15T00:38:42.010 INFO:tasks.workunit.client.0.smithi029.stdout:8/914: write d8/d4a/d78/d23/d28/d30/db1/f103 [978471,119724] 0 2024-04-15T00:38:42.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/918: write d2/de/d1f/f111 [752873,24181] 0 2024-04-15T00:38:42.116 INFO:tasks.workunit.client.0.smithi029.stdout:9/862: dwrite d3/d6/d9/fec [0,4194304] 0 2024-04-15T00:38:42.133 INFO:tasks.workunit.client.0.smithi029.stdout:6/891: mknod d1/d8/db/d98/c125 0 2024-04-15T00:38:42.201 INFO:tasks.workunit.client.0.smithi029.stdout:7/876: creat d0/d6/d39/d107/f120 x:0 0 0 2024-04-15T00:38:42.387 INFO:tasks.workunit.client.0.smithi029.stdout:0/930: dwrite d5/d3e/de3/f95 [0,4194304] 0 2024-04-15T00:38:42.389 INFO:tasks.workunit.client.0.smithi029.stdout:2/894: mknod d3/dd/d2d/d61/d85/da2/d110/c124 0 2024-04-15T00:38:42.401 INFO:tasks.workunit.client.0.smithi029.stdout:8/915: creat d8/d4a/d78/d23/f133 x:0 0 0 2024-04-15T00:38:42.411 INFO:tasks.workunit.client.0.smithi029.stdout:1/865: dwrite df/f4d [0,4194304] 0 2024-04-15T00:38:42.570 INFO:tasks.workunit.client.0.smithi029.stdout:2/895: fdatasync d3/d13/d43/f5f 0 2024-04-15T00:38:42.583 INFO:tasks.workunit.client.0.smithi029.stdout:8/916: stat d8/da/d2f/d42/c63 0 2024-04-15T00:38:42.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/917: stat d8/da/l31 0 2024-04-15T00:38:42.613 INFO:tasks.workunit.client.0.smithi029.stdout:8/918: chown d8/da/d117 1527415177 1 2024-04-15T00:38:42.800 INFO:tasks.workunit.client.0.smithi029.stdout:3/879: creat d17/d2f/d44/f120 x:0 0 0 2024-04-15T00:38:42.805 INFO:tasks.workunit.client.0.smithi029.stdout:5/919: truncate d2/de/d1f/d63/fd9 985682 0 2024-04-15T00:38:42.826 INFO:tasks.workunit.client.0.smithi029.stdout:9/863: chown d3/d6/d9/d15/d62/fe3 3 1 2024-04-15T00:38:42.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/866: creat df/d29/d41/d69/d78/dd1/f125 x:0 0 0 2024-04-15T00:38:42.972 INFO:tasks.workunit.client.0.smithi029.stdout:2/896: rename d3/d2a/d6d/f10c to d3/d2a/d4e/f125 0 2024-04-15T00:38:43.026 INFO:tasks.workunit.client.0.smithi029.stdout:8/919: creat d8/f134 x:0 0 0 2024-04-15T00:38:43.389 INFO:tasks.workunit.client.0.smithi029.stdout:3/880: rename d17/d2a/d46/d67/c80 to d17/d2a/d46/d67/dd6/d102/d109/c121 0 2024-04-15T00:38:43.426 INFO:tasks.workunit.client.0.smithi029.stdout:1/867: creat df/d29/d41/d69/d78/dd1/d59/f126 x:0 0 0 2024-04-15T00:38:43.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/897: truncate d3/dd/d42/dc6/db1/fd2 3120725 0 2024-04-15T00:38:43.460 INFO:tasks.workunit.client.0.smithi029.stdout:4/873: getdents de/d54/d71/d8b/db1 0 2024-04-15T00:38:43.788 INFO:tasks.workunit.client.0.smithi029.stdout:7/877: write d0/d6/d4f/d66/f61 [577054,89012] 0 2024-04-15T00:38:43.815 INFO:tasks.workunit.client.0.smithi029.stdout:6/892: write d1/d8/db/f4a [3817531,40249] 0 2024-04-15T00:38:43.968 INFO:tasks.workunit.client.0.smithi029.stdout:0/931: creat d5/db/d1a/d65/f131 x:0 0 0 2024-04-15T00:38:44.031 INFO:tasks.workunit.client.0.smithi029.stdout:3/881: dread d17/d2f/d44/f87 [0,4194304] 0 2024-04-15T00:38:44.128 INFO:tasks.workunit.client.0.smithi029.stdout:4/874: truncate de/d54/d58/fee 1029561 0 2024-04-15T00:38:44.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/882: chown d17/d2f/d44/d58/d5c/d5f/db5/fed 85 1 2024-04-15T00:38:44.170 INFO:tasks.workunit.client.0.smithi029.stdout:2/898: dread d3/dd/d2d/d61/dd5/d95/f20 [8388608,4194304] 0 2024-04-15T00:38:44.192 INFO:tasks.workunit.client.0.smithi029.stdout:3/883: chown d17/l61 30669154 1 2024-04-15T00:38:44.562 INFO:tasks.workunit.client.0.smithi029.stdout:5/920: getdents d2 0 2024-04-15T00:38:44.568 INFO:tasks.workunit.client.0.smithi029.stdout:7/878: mknod d0/d6/da2/c121 0 2024-04-15T00:38:44.718 INFO:tasks.workunit.client.0.smithi029.stdout:3/884: unlink d17/d2f/d76/ff8 0 2024-04-15T00:38:44.728 INFO:tasks.workunit.client.0.smithi029.stdout:3/885: stat d17/d2f/d76/d7f 0 2024-04-15T00:38:44.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/886: dread d17/d2a/d33/d37/f41 [0,4194304] 0 2024-04-15T00:38:45.190 INFO:tasks.workunit.client.0.smithi029.stdout:9/864: dwrite d3/d6/d9/d29/d60/d7f/fc2 [0,4194304] 0 2024-04-15T00:38:45.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/932: rename d5/dc6/f10c to d5/d4c/f132 0 2024-04-15T00:38:45.307 INFO:tasks.workunit.client.0.smithi029.stdout:7/879: creat d0/d6/d4f/d5d/d82/f122 x:0 0 0 2024-04-15T00:38:45.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/920: dwrite d8/da/d3d/fa9 [0,4194304] 0 2024-04-15T00:38:45.490 INFO:tasks.workunit.client.0.smithi029.stdout:2/899: link d3/dd/f31 d3/dd/d2d/d61/d85/da2/f126 0 2024-04-15T00:38:45.497 INFO:tasks.workunit.client.0.smithi029.stdout:6/893: write d1/d8/d72/da3/d102/d108/dd3/de5/df7/ff8 [1013913,32232] 0 2024-04-15T00:38:45.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/887: mknod d17/d2a/c122 0 2024-04-15T00:38:45.610 INFO:tasks.workunit.client.0.smithi029.stdout:4/875: rename de/d6d/c102 to de/df/d1e/d56/dd3/d108/c114 0 2024-04-15T00:38:46.121 INFO:tasks.workunit.client.0.smithi029.stdout:0/933: fdatasync d5/d15/d27/d51/d77/f11b 0 2024-04-15T00:38:46.133 INFO:tasks.workunit.client.0.smithi029.stdout:8/921: fdatasync d8/d4a/da1/f11a 0 2024-04-15T00:38:46.165 INFO:tasks.workunit.client.0.smithi029.stdout:8/922: chown d8/da/d3d 35 1 2024-04-15T00:38:46.207 INFO:tasks.workunit.client.0.smithi029.stdout:7/880: dread d0/d6/d4f/d5d/f5e [0,4194304] 0 2024-04-15T00:38:46.226 INFO:tasks.workunit.client.0.smithi029.stdout:7/881: chown d0/d6/d39/d3c/d5b/d7e/fc9 5479772 1 2024-04-15T00:38:46.345 INFO:tasks.workunit.client.0.smithi029.stdout:2/900: rename d3/d13/d43/f8f to d3/d53/f127 0 2024-04-15T00:38:46.357 INFO:tasks.workunit.client.0.smithi029.stdout:5/921: write d2/de/d13/d22/f40 [11592544,81894] 0 2024-04-15T00:38:46.363 INFO:tasks.workunit.client.0.smithi029.stdout:1/868: rmdir df/d29/d41/d69 39 2024-04-15T00:38:46.555 INFO:tasks.workunit.client.0.smithi029.stdout:0/934: read d5/db/d1a/d50/da1/f9a [3167943,83412] 0 2024-04-15T00:38:46.881 INFO:tasks.workunit.client.0.smithi029.stdout:5/922: mknod d2/da5/dc8/c12c 0 2024-04-15T00:38:46.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/894: write d1/d1e/f61 [8069331,121841] 0 2024-04-15T00:38:46.908 INFO:tasks.workunit.client.0.smithi029.stdout:3/888: write d17/f4d [1668157,100268] 0 2024-04-15T00:38:47.004 INFO:tasks.workunit.client.0.smithi029.stdout:2/901: dread d3/dd/d2d/d61/dd5/d95/f98 [0,4194304] 0 2024-04-15T00:38:47.016 INFO:tasks.workunit.client.0.smithi029.stdout:9/865: write d3/d6/d9/d15/fb1 [105268,20690] 0 2024-04-15T00:38:47.072 INFO:tasks.workunit.client.0.smithi029.stdout:7/882: creat d0/d6/f123 x:0 0 0 2024-04-15T00:38:47.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/876: dwrite de/d54/d71/db5/fb0 [0,4194304] 0 2024-04-15T00:38:47.165 INFO:tasks.workunit.client.0.smithi029.stdout:0/935: rename d5/d15/d57/f60 to d5/d4c/d4e/f133 0 2024-04-15T00:38:47.238 INFO:tasks.workunit.client.0.smithi029.stdout:1/869: write df/f46 [7470522,34774] 0 2024-04-15T00:38:47.300 INFO:tasks.workunit.client.0.smithi029.stdout:8/923: dwrite d8/da/d2f/f61 [4194304,4194304] 0 2024-04-15T00:38:47.370 INFO:tasks.workunit.client.0.smithi029.stdout:5/923: fsync d2/de/d13/d22/d26/d36/d4d/d70/fd0 0 2024-04-15T00:38:47.496 INFO:tasks.workunit.client.0.smithi029.stdout:2/902: mknod d3/d13/de1/c128 0 2024-04-15T00:38:47.526 INFO:tasks.workunit.client.0.smithi029.stdout:9/866: read d3/d6/d9/d15/d9d/fd0 [1747234,57524] 0 2024-04-15T00:38:47.552 INFO:tasks.workunit.client.0.smithi029.stdout:4/877: chown de/df/d1e/d56/dd3/d108/c114 140 1 2024-04-15T00:38:47.817 INFO:tasks.workunit.client.0.smithi029.stdout:8/924: mknod d8/da/d2f/d6e/dc1/ded/c135 0 2024-04-15T00:38:47.839 INFO:tasks.workunit.client.0.smithi029.stdout:5/924: creat d2/de/d13/d22/d26/d36/d4d/d78/f12d x:0 0 0 2024-04-15T00:38:47.842 INFO:tasks.workunit.client.0.smithi029.stdout:7/883: write d0/f22 [1126287,61691] 0 2024-04-15T00:38:47.849 INFO:tasks.workunit.client.0.smithi029.stdout:6/895: write d1/d8/d72/da3/d102/d108/d58/fcd [7599391,42597] 0 2024-04-15T00:38:48.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/896: sync 2024-04-15T00:38:48.299 INFO:tasks.workunit.client.0.smithi029.stdout:1/870: symlink df/d29/d41/d69/d78/dea/l127 0 2024-04-15T00:38:48.310 INFO:tasks.workunit.client.0.smithi029.stdout:4/878: truncate de/df/d1e/d56/f80 1591155 0 2024-04-15T00:38:48.476 INFO:tasks.workunit.client.0.smithi029.stdout:5/925: rmdir d2/de/d13/d22/d26/d36/d4d/dfb 39 2024-04-15T00:38:48.481 INFO:tasks.workunit.client.0.smithi029.stdout:6/897: mkdir d1/d8/db/d38/d86/d126 0 2024-04-15T00:38:48.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/926: chown d2/de/d13/d22/d3c/d41/d6d/f77 376677773 1 2024-04-15T00:38:48.655 INFO:tasks.workunit.client.0.smithi029.stdout:4/879: mkdir de/d54/d71/d8b/db1/dd5/d115 0 2024-04-15T00:38:48.760 INFO:tasks.workunit.client.0.smithi029.stdout:1/871: dread df/fb1 [0,4194304] 0 2024-04-15T00:38:48.803 INFO:tasks.workunit.client.0.smithi029.stdout:0/936: dwrite d5/d4c/d8a/fe5 [0,4194304] 0 2024-04-15T00:38:49.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/903: write d3/dd/d2d/d61/dd5/dcf/fc1 [4818058,25608] 0 2024-04-15T00:38:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:8/925: write d8/da/d2f/d6e/f9e [70044,13229] 0 2024-04-15T00:38:49.492 INFO:tasks.workunit.client.0.smithi029.stdout:3/889: getdents d17/d2f/d44/d5a/dde 0 2024-04-15T00:38:49.492 INFO:tasks.workunit.client.0.smithi029.stdout:9/867: rename d3/d6/d9/d29/ld6 to d3/da3/l10a 0 2024-04-15T00:38:49.514 INFO:tasks.workunit.client.0.smithi029.stdout:4/880: readlink de/d54/d71/d8b/l8c 0 2024-04-15T00:38:49.528 INFO:tasks.workunit.client.0.smithi029.stdout:3/890: chown l5 15 1 2024-04-15T00:38:49.545 INFO:tasks.workunit.client.0.smithi029.stdout:9/868: stat d3/d6/d9/d29/d60/c78 0 2024-04-15T00:38:49.618 INFO:tasks.workunit.client.0.smithi029.stdout:8/926: truncate d8/d4a/fcb 294257 0 2024-04-15T00:38:49.855 INFO:tasks.workunit.client.0.smithi029.stdout:5/927: symlink d2/de/d13/l12e 0 2024-04-15T00:38:49.912 INFO:tasks.workunit.client.0.smithi029.stdout:1/872: mknod df/d29/d41/d69/d78/dd1/d109/c128 0 2024-04-15T00:38:50.002 INFO:tasks.workunit.client.0.smithi029.stdout:4/881: dread - de/df/d1e/fdb zero size 2024-04-15T00:38:50.028 INFO:tasks.workunit.client.0.smithi029.stdout:0/937: truncate d5/d15/d27/f96 1004284 0 2024-04-15T00:38:50.208 INFO:tasks.workunit.client.0.smithi029.stdout:6/898: creat d1/d8/d72/da3/d102/d108/f127 x:0 0 0 2024-04-15T00:38:50.219 INFO:tasks.workunit.client.0.smithi029.stdout:6/899: chown d1/d8/db/d7b/d85 494711 1 2024-04-15T00:38:50.344 INFO:tasks.workunit.client.0.smithi029.stdout:5/928: fsync d2/de/d13/d22/d3c/d41/f4c 0 2024-04-15T00:38:50.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/904: link d3/dd/da0/fac d3/dd/d42/f129 0 2024-04-15T00:38:50.496 INFO:tasks.workunit.client.0.smithi029.stdout:4/882: mknod de/df/d1e/d56/dd3/c116 0 2024-04-15T00:38:50.641 INFO:tasks.workunit.client.0.smithi029.stdout:9/869: truncate d3/da3/fb7 2141106 0 2024-04-15T00:38:50.646 INFO:tasks.workunit.client.0.smithi029.stdout:6/900: truncate d1/f92 1378104 0 2024-04-15T00:38:50.667 INFO:tasks.workunit.client.0.smithi029.stdout:9/870: chown d3/d6/d9/d29/d60/d64/ce2 75 1 2024-04-15T00:38:50.788 INFO:tasks.workunit.client.0.smithi029.stdout:2/905: chown d3/d13/d43/d5a/d4f/c7f 5 1 2024-04-15T00:38:51.051 INFO:tasks.workunit.client.0.smithi029.stdout:9/871: truncate d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/f9e 4057076 0 2024-04-15T00:38:51.088 INFO:tasks.workunit.client.0.smithi029.stdout:6/901: dwrite d1/d8/db/fd1 [4194304,4194304] 0 2024-04-15T00:38:51.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/884: dwrite d0/d6/d39/d3c/d5b/dd9/f10a [0,4194304] 0 2024-04-15T00:38:51.424 INFO:tasks.workunit.client.0.smithi029.stdout:2/906: creat d3/dd/da0/f12a x:0 0 0 2024-04-15T00:38:51.511 INFO:tasks.workunit.client.0.smithi029.stdout:3/891: write d17/d2f/d44/d5a/f7e [4591782,40994] 0 2024-04-15T00:38:51.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/902: creat d1/d8/db/d7b/d85/dd2/dab/f128 x:0 0 0 2024-04-15T00:38:51.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/927: dwrite d8/da/d2f/d42/d75/fc9 [0,4194304] 0 2024-04-15T00:38:51.924 INFO:tasks.workunit.client.0.smithi029.stdout:3/892: fdatasync d17/d2f/d84/db1/fdd 0 2024-04-15T00:38:51.998 INFO:tasks.workunit.client.0.smithi029.stdout:1/873: dwrite df/f16 [0,4194304] 0 2024-04-15T00:38:52.140 INFO:tasks.workunit.client.0.smithi029.stdout:1/874: readlink df/d29/d41/d69/d78/dd1/d59/d10a/l10f 0 2024-04-15T00:38:52.185 INFO:tasks.workunit.client.0.smithi029.stdout:5/929: write d2/de/d13/d22/d26/d36/d4d/d70/fdb [4818304,31292] 0 2024-04-15T00:38:52.195 INFO:tasks.workunit.client.0.smithi029.stdout:3/893: dwrite d17/d2f/d44/d5a/f7e [4194304,4194304] 0 2024-04-15T00:38:52.260 INFO:tasks.workunit.client.0.smithi029.stdout:6/903: mknod d1/d8/db/c129 0 2024-04-15T00:38:52.380 INFO:tasks.workunit.client.0.smithi029.stdout:4/883: dwrite de/d54/d71/f87 [0,4194304] 0 2024-04-15T00:38:52.389 INFO:tasks.workunit.client.0.smithi029.stdout:5/930: sync 2024-04-15T00:38:52.470 INFO:tasks.workunit.client.0.smithi029.stdout:8/928: creat d8/da/d117/f136 x:0 0 0 2024-04-15T00:38:52.573 INFO:tasks.workunit.client.0.smithi029.stdout:7/885: link d0/d6/d4f/d5d/ld4 d0/d6/d4f/d5d/d87/l124 0 2024-04-15T00:38:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/929: dread d8/da/d2f/d42/d75/fc9 [0,4194304] 0 2024-04-15T00:38:52.618 INFO:tasks.workunit.client.0.smithi029.stdout:6/904: dread d1/d8/f8c [0,4194304] 0 2024-04-15T00:38:52.637 INFO:tasks.workunit.client.0.smithi029.stdout:5/931: creat d2/d1a/d2d/f12f x:0 0 0 2024-04-15T00:38:52.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/932: sync 2024-04-15T00:38:52.769 INFO:tasks.workunit.client.0.smithi029.stdout:0/938: mknod d5/c134 0 2024-04-15T00:38:52.775 INFO:tasks.workunit.client.0.smithi029.stdout:4/884: rename de/df/d1e/f2d to de/d6d/d7e/f117 0 2024-04-15T00:38:52.942 INFO:tasks.workunit.client.0.smithi029.stdout:9/872: write d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb4 [281615,127654] 0 2024-04-15T00:38:53.160 INFO:tasks.workunit.client.0.smithi029.stdout:8/930: readlink d8/da/d3d/l110 0 2024-04-15T00:38:53.234 INFO:tasks.workunit.client.0.smithi029.stdout:6/905: truncate d1/d8/d72/da3/d102/d108/d58/d59/f60 1117810 0 2024-04-15T00:38:53.242 INFO:tasks.workunit.client.0.smithi029.stdout:2/907: write d3/dd/d2d/d61/d85/da2/f126 [3062013,25933] 0 2024-04-15T00:38:53.362 INFO:tasks.workunit.client.0.smithi029.stdout:0/939: creat d5/d4c/d8a/f135 x:0 0 0 2024-04-15T00:38:53.489 INFO:tasks.workunit.client.0.smithi029.stdout:3/894: creat d17/f123 x:0 0 0 2024-04-15T00:38:53.522 INFO:tasks.workunit.client.0.smithi029.stdout:8/931: fsync d8/da/d2f/d6e/d5a/f109 0 2024-04-15T00:38:53.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/932: chown d8/d4a/d78/d23/d28/f44 3742 1 2024-04-15T00:38:53.665 INFO:tasks.workunit.client.0.smithi029.stdout:1/875: write df/d29/d41/d69/d4c/f75 [1776679,46759] 0 2024-04-15T00:38:53.730 INFO:tasks.workunit.client.0.smithi029.stdout:4/885: symlink de/d6d/l118 0 2024-04-15T00:38:53.772 INFO:tasks.workunit.client.0.smithi029.stdout:9/873: mkdir d3/d6/d9/d15/d62/d10b 0 2024-04-15T00:38:53.981 INFO:tasks.workunit.client.0.smithi029.stdout:0/940: mkdir d5/db/d1a/d65/d76/daf/dc1/d136 0 2024-04-15T00:38:54.296 INFO:tasks.workunit.client.0.smithi029.stdout:7/886: write d0/d6/d4f/d5d/d65/f9a [449214,87318] 0 2024-04-15T00:38:54.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/933: write d2/de/d13/d22/d26/d36/d4d/d70/d8d/fe8 [1318312,7966] 0 2024-04-15T00:38:54.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/906: mkdir d1/d8/db/d12a 0 2024-04-15T00:38:54.853 INFO:tasks.workunit.client.0.smithi029.stdout:1/876: dread df/da4/fcf [0,4194304] 0 2024-04-15T00:38:54.904 INFO:tasks.workunit.client.0.smithi029.stdout:9/874: rmdir d3/d6/d9/d29/d60/d7f/da0/d108 39 2024-04-15T00:38:55.050 INFO:tasks.workunit.client.0.smithi029.stdout:3/895: symlink d17/d2a/d46/d67/l124 0 2024-04-15T00:38:55.258 INFO:tasks.workunit.client.0.smithi029.stdout:5/934: stat d2/de/d13/d22/d26/d36/d4d/dfb/fff 0 2024-04-15T00:38:55.279 INFO:tasks.workunit.client.0.smithi029.stdout:2/908: link d3/dd/d2d/d61/dd5/d4a/f9e d3/dd/d42/dc6/dee/f12b 0 2024-04-15T00:38:55.438 INFO:tasks.workunit.client.0.smithi029.stdout:1/877: chown df/d32/d90/dc1/fd4 189382510 1 2024-04-15T00:38:55.499 INFO:tasks.workunit.client.0.smithi029.stdout:3/896: fdatasync d17/d2f/d84/db1/fc3 0 2024-04-15T00:38:55.550 INFO:tasks.workunit.client.0.smithi029.stdout:5/935: chown d2/de/d13/d22/d26/ff6 730734900 1 2024-04-15T00:38:55.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/909: rmdir d3/dd/d2d/d61/df6/d109 39 2024-04-15T00:38:55.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/907: truncate d1/d8/f5e 664630 0 2024-04-15T00:38:55.659 INFO:tasks.workunit.client.0.smithi029.stdout:4/886: link de/d54/d71/d8b/db1/dd5/cf3 de/d6d/d7e/c119 0 2024-04-15T00:38:55.782 INFO:tasks.workunit.client.0.smithi029.stdout:4/887: sync 2024-04-15T00:38:55.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/878: creat df/d29/d41/d69/d78/dd1/d59/f129 x:0 0 0 2024-04-15T00:38:55.954 INFO:tasks.workunit.client.0.smithi029.stdout:7/887: rename d0/d6/d4f/d66/d37/db7/dda/cfb to d0/d6/d4f/d66/d26/d77/c125 0 2024-04-15T00:38:56.109 INFO:tasks.workunit.client.0.smithi029.stdout:7/888: dread d0/d6/d4f/d66/d26/f28 [0,4194304] 0 2024-04-15T00:38:56.109 INFO:tasks.workunit.client.0.smithi029.stdout:2/910: stat d3/dd/da0/caf 0 2024-04-15T00:38:56.220 INFO:tasks.workunit.client.0.smithi029.stdout:8/933: dwrite d8/da/d2f/d42/f7e [0,4194304] 0 2024-04-15T00:38:56.283 INFO:tasks.workunit.client.0.smithi029.stdout:3/897: symlink d17/d2f/d76/l125 0 2024-04-15T00:38:56.319 INFO:tasks.workunit.client.0.smithi029.stdout:6/908: creat d1/d8/db/d7b/f12b x:0 0 0 2024-04-15T00:38:56.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/911: chown d3/dd/d2d/d61/df6/ffc 0 1 2024-04-15T00:38:56.373 INFO:tasks.workunit.client.0.smithi029.stdout:2/912: write d3/dd/f31 [3566539,61044] 0 2024-04-15T00:38:56.391 INFO:tasks.workunit.client.0.smithi029.stdout:7/889: symlink d0/d6/d4f/d66/d67/l126 0 2024-04-15T00:38:56.444 INFO:tasks.workunit.client.0.smithi029.stdout:1/879: mknod df/d32/c12a 0 2024-04-15T00:38:56.527 INFO:tasks.workunit.client.0.smithi029.stdout:1/880: chown df/d29/d41/d69/d78/dd1/f5e 107046893 1 2024-04-15T00:38:56.566 INFO:tasks.workunit.client.0.smithi029.stdout:0/941: dwrite d5/d15/d57/d122/f129 [0,4194304] 0 2024-04-15T00:38:56.663 INFO:tasks.workunit.client.0.smithi029.stdout:6/909: dread - d1/db9/dc3/fd9 zero size 2024-04-15T00:38:56.759 INFO:tasks.workunit.client.0.smithi029.stdout:9/875: rename d3/d6/d9/d15/d9d/lfa to d3/d6/d9/d29/l10c 0 2024-04-15T00:38:56.803 INFO:tasks.workunit.client.0.smithi029.stdout:8/934: mknod d8/d4a/d78/dca/d113/c137 0 2024-04-15T00:38:56.899 INFO:tasks.workunit.client.0.smithi029.stdout:3/898: fdatasync d17/d2a/d33/d37/f99 0 2024-04-15T00:38:57.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/942: fdatasync d5/db/d8f/fc5 0 2024-04-15T00:38:57.156 INFO:tasks.workunit.client.0.smithi029.stdout:1/881: readlink df/d29/d41/d69/l6d 0 2024-04-15T00:38:57.273 INFO:tasks.workunit.client.0.smithi029.stdout:9/876: truncate d3/d6/d9/fd 641278 0 2024-04-15T00:38:57.282 INFO:tasks.workunit.client.0.smithi029.stdout:1/882: sync 2024-04-15T00:38:57.362 INFO:tasks.workunit.client.0.smithi029.stdout:8/935: symlink d8/da/d2f/d6e/l138 0 2024-04-15T00:38:57.362 INFO:tasks.workunit.client.0.smithi029.stdout:6/910: dread d1/d8/d72/da3/d102/d108/d58/fcd [0,4194304] 0 2024-04-15T00:38:57.411 INFO:tasks.workunit.client.0.smithi029.stdout:1/883: chown df/d29/d41/d69/d78/dd1/d59/fb0 509828 1 2024-04-15T00:38:57.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/899: symlink d17/d2a/d33/df2/l126 0 2024-04-15T00:38:57.448 INFO:tasks.workunit.client.0.smithi029.stdout:2/913: link d3/d2a/c8c d3/dd/da0/c12c 0 2024-04-15T00:38:57.540 INFO:tasks.workunit.client.0.smithi029.stdout:4/888: write de/d54/d71/f84 [286581,126085] 0 2024-04-15T00:38:57.590 INFO:tasks.workunit.client.0.smithi029.stdout:9/877: dread d3/d6/d9/d29/d60/d64/d6d/d58/f28 [0,4194304] 0 2024-04-15T00:38:57.683 INFO:tasks.workunit.client.0.smithi029.stdout:8/936: mknod d8/d4a/d78/d23/d28/d5f/c139 0 2024-04-15T00:38:57.683 INFO:tasks.workunit.client.0.smithi029.stdout:6/911: creat d1/d1e/d22/f12c x:0 0 0 2024-04-15T00:38:57.704 INFO:tasks.workunit.client.0.smithi029.stdout:1/884: truncate df/f28 1856838 0 2024-04-15T00:38:57.729 INFO:tasks.workunit.client.0.smithi029.stdout:2/914: rmdir d3/dd/d42/dc6/dee 39 2024-04-15T00:38:57.784 INFO:tasks.workunit.client.0.smithi029.stdout:3/900: mkdir d17/d2a/d46/d67/dd6/d127 0 2024-04-15T00:38:57.924 INFO:tasks.workunit.client.0.smithi029.stdout:5/936: rename d2/de/d1f/dc2/fe3 to d2/de/d13/d22/d26/f130 0 2024-04-15T00:38:57.993 INFO:tasks.workunit.client.0.smithi029.stdout:9/878: read d3/d6/d9/d15/de8/feb [1642595,7963] 0 2024-04-15T00:38:58.443 INFO:tasks.workunit.client.0.smithi029.stdout:6/912: symlink d1/db9/dc3/l12d 0 2024-04-15T00:38:58.451 INFO:tasks.workunit.client.0.smithi029.stdout:1/885: creat df/d29/d41/d69/d4c/d7a/f12b x:0 0 0 2024-04-15T00:38:58.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/890: rename d0/d6/d4f/d66/d67/c85 to d0/d6/d4f/d66/d37/db7/c127 0 2024-04-15T00:38:58.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/937: dread d2/f52 [4194304,4194304] 0 2024-04-15T00:38:59.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/891: dread d0/d6/f2f [0,4194304] 0 2024-04-15T00:38:59.346 INFO:tasks.workunit.client.0.smithi029.stdout:4/889: write f8 [5600185,56172] 0 2024-04-15T00:38:59.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/943: dwrite d5/db/d1a/d50/ff3 [0,4194304] 0 2024-04-15T00:38:59.489 INFO:tasks.workunit.client.0.smithi029.stdout:1/886: fsync df/d29/d41/d69/d78/fbe 0 2024-04-15T00:38:59.581 INFO:tasks.workunit.client.0.smithi029.stdout:9/879: creat d3/da3/f10d x:0 0 0 2024-04-15T00:38:59.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/892: dread d0/d6/d4f/d5d/f6d [0,4194304] 0 2024-04-15T00:38:59.617 INFO:tasks.workunit.client.0.smithi029.stdout:3/901: link d17/d2f/d44/d58/d5c/l69 d17/d2a/d46/l128 0 2024-04-15T00:38:59.645 INFO:tasks.workunit.client.0.smithi029.stdout:3/902: dread - d17/d2f/d84/f86 zero size 2024-04-15T00:38:59.827 INFO:tasks.workunit.client.0.smithi029.stdout:4/890: dread de/d54/d58/f68 [0,4194304] 0 2024-04-15T00:38:59.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/880: truncate d3/d6/d9/d29/d60/d64/d6d/d58/f2a 2115363 0 2024-04-15T00:39:00.302 INFO:tasks.workunit.client.0.smithi029.stdout:1/887: mkdir df/d12c 0 2024-04-15T00:39:00.305 INFO:tasks.workunit.client.0.smithi029.stdout:4/891: unlink de/d54/d71/dc3/caf 0 2024-04-15T00:39:00.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/913: dwrite d1/d8/d72/f78 [0,4194304] 0 2024-04-15T00:39:00.511 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:39:00.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:39:01.093 INFO:tasks.workunit.client.0.smithi029.stdout:9/881: mkdir d3/d6/d9/d15/d4a/d10e 0 2024-04-15T00:39:01.223 INFO:tasks.workunit.client.0.smithi029.stdout:7/893: dwrite d0/d6/d4f/d66/d37/f7a [0,4194304] 0 2024-04-15T00:39:01.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/894: dread - d0/d6/d4f/d66/d67/d90/ff5 zero size 2024-04-15T00:39:01.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/937: rename d8/d4a/d78/dca/f119 to d8/d4a/f13a 0 2024-04-15T00:39:01.650 INFO:tasks.workunit.client.0.smithi029.stdout:9/882: mknod d3/d6/d9/d29/d60/d64/dfc/c10f 0 2024-04-15T00:39:01.668 INFO:tasks.workunit.client.0.smithi029.stdout:9/883: stat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fc7 0 2024-04-15T00:39:01.792 INFO:tasks.workunit.client.0.smithi029.stdout:2/915: rename d3/d13/d43/d5a/d4f to d3/d2a/de4/d12d 0 2024-04-15T00:39:01.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/884: mkdir d3/d6/d9/d29/d60/d64/d6d/d58/d110 0 2024-04-15T00:39:02.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/944: creat d5/f137 x:0 0 0 2024-04-15T00:39:02.105 INFO:tasks.workunit.client.0.smithi029.stdout:4/892: write de/d2b/d59/f86 [287783,46294] 0 2024-04-15T00:39:02.184 INFO:tasks.workunit.client.0.smithi029.stdout:3/903: creat d17/d2f/d44/f129 x:0 0 0 2024-04-15T00:39:02.190 INFO:tasks.workunit.client.0.smithi029.stdout:1/888: write df/d29/d41/d69/d4c/d7a/f103 [1026869,115675] 0 2024-04-15T00:39:02.245 INFO:tasks.workunit.client.0.smithi029.stdout:2/916: symlink d3/d50/d51/d65/l12e 0 2024-04-15T00:39:02.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/904: mkdir d17/d2f/d84/db1/d12a 0 2024-04-15T00:39:02.860 INFO:tasks.workunit.client.0.smithi029.stdout:5/938: rename d2/f17 to d2/de/d13/d22/d26/d36/d4d/df4/f131 0 2024-04-15T00:39:02.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/889: creat df/da4/dfb/f12d x:0 0 0 2024-04-15T00:39:03.248 INFO:tasks.workunit.client.0.smithi029.stdout:4/893: write de/d2b/d59/fb8 [368857,121883] 0 2024-04-15T00:39:03.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/914: dwrite d1/d8/db/d38/fc2 [0,4194304] 0 2024-04-15T00:39:03.318 INFO:tasks.workunit.client.0.smithi029.stdout:8/938: dwrite d8/d4a/d78/d23/d28/d30/f11d [0,4194304] 0 2024-04-15T00:39:03.325 INFO:tasks.workunit.client.0.smithi029.stdout:7/895: dwrite d0/f5a [0,4194304] 0 2024-04-15T00:39:03.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/917: getdents d3/d2a/d6d 0 2024-04-15T00:39:03.494 INFO:tasks.workunit.client.0.smithi029.stdout:1/890: creat df/d29/d41/d69/d4c/df4/f12e x:0 0 0 2024-04-15T00:39:03.565 INFO:tasks.workunit.client.0.smithi029.stdout:9/885: dwrite d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fc7 [0,4194304] 0 2024-04-15T00:39:03.779 INFO:tasks.workunit.client.0.smithi029.stdout:7/896: fdatasync d0/d6/d4f/d5d/d87/d103/ff8 0 2024-04-15T00:39:03.781 INFO:tasks.workunit.client.0.smithi029.stdout:0/945: dwrite d5/d15/d57/d5e/f11f [0,4194304] 0 2024-04-15T00:39:03.786 INFO:tasks.workunit.client.0.smithi029.stdout:8/939: truncate d8/d4a/d78/d23/f133 1034907 0 2024-04-15T00:39:03.897 INFO:tasks.workunit.client.0.smithi029.stdout:0/946: chown d5/d15/d1f/f12b 298765 1 2024-04-15T00:39:04.002 INFO:tasks.workunit.client.0.smithi029.stdout:4/894: dwrite de/fe5 [0,4194304] 0 2024-04-15T00:39:04.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/915: rename d1/c41 to d1/d8/d72/da3/d102/d108/dd3/de5/df7/c12e 0 2024-04-15T00:39:04.416 INFO:tasks.workunit.client.0.smithi029.stdout:1/891: truncate df/d32/f11c 958561 0 2024-04-15T00:39:04.539 INFO:tasks.workunit.client.0.smithi029.stdout:3/905: link d17/d2a/d46/fae d17/d2f/d44/d58/d5c/d103/f12b 0 2024-04-15T00:39:04.779 INFO:tasks.workunit.client.0.smithi029.stdout:5/939: mknod d2/de/d13/d22/d26/d36/d4d/dfb/c132 0 2024-04-15T00:39:04.784 INFO:tasks.workunit.client.0.smithi029.stdout:7/897: fdatasync d0/f24 0 2024-04-15T00:39:04.815 INFO:tasks.workunit.client.0.smithi029.stdout:8/940: dread - d8/d4a/d78/dc3/f120 zero size 2024-04-15T00:39:05.127 INFO:tasks.workunit.client.0.smithi029.stdout:6/916: dread d1/d1e/f61 [0,4194304] 0 2024-04-15T00:39:05.169 INFO:tasks.workunit.client.0.smithi029.stdout:1/892: mkdir df/d29/d41/d69/d4c/d7a/d12f 0 2024-04-15T00:39:05.533 INFO:tasks.workunit.client.0.smithi029.stdout:7/898: mknod d0/d6/d4f/d66/d67/db8/c128 0 2024-04-15T00:39:05.551 INFO:tasks.workunit.client.0.smithi029.stdout:8/941: creat d8/d4a/d78/dca/f13b x:0 0 0 2024-04-15T00:39:05.618 INFO:tasks.workunit.client.0.smithi029.stdout:2/918: getdents d3/dd/d2d/d61 0 2024-04-15T00:39:05.776 INFO:tasks.workunit.client.0.smithi029.stdout:1/893: unlink df/d29/d41/d69/d4c/l99 0 2024-04-15T00:39:05.781 INFO:tasks.workunit.client.0.smithi029.stdout:9/886: write d3/d6/d9/d29/d60/d7f/f82 [3425121,39088] 0 2024-04-15T00:39:05.913 INFO:tasks.workunit.client.0.smithi029.stdout:7/899: sync 2024-04-15T00:39:05.930 INFO:tasks.workunit.client.0.smithi029.stdout:7/900: chown d0/d6/d4f/d66/d26 736 1 2024-04-15T00:39:06.007 INFO:tasks.workunit.client.0.smithi029.stdout:0/947: write d5/d15/d1f/f63 [1031919,105800] 0 2024-04-15T00:39:06.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/894: rename df/d29/d41/d69/d78/dd1/l7e to df/d29/d41/d96/l130 0 2024-04-15T00:39:06.207 INFO:tasks.workunit.client.0.smithi029.stdout:7/901: truncate d0/d6/d39/d3c/d5b/fa4 2047252 0 2024-04-15T00:39:06.326 INFO:tasks.workunit.client.0.smithi029.stdout:4/895: dwrite de/d2b/d35/fcc [0,4194304] 0 2024-04-15T00:39:06.406 INFO:tasks.workunit.client.0.smithi029.stdout:1/895: chown df/d29/d41/d69/d78/dd1/d80/c107 0 1 2024-04-15T00:39:06.459 INFO:tasks.workunit.client.0.smithi029.stdout:7/902: fsync d0/d6/d4f/d5d/f5e 0 2024-04-15T00:39:06.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/896: chown de/d6d/dde 0 1 2024-04-15T00:39:06.478 INFO:tasks.workunit.client.0.smithi029.stdout:5/940: getdents d2/da5 0 2024-04-15T00:39:06.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/948: dread d5/d3e/f89 [0,4194304] 0 2024-04-15T00:39:06.651 INFO:tasks.workunit.client.0.smithi029.stdout:3/906: write d17/f45 [505284,37422] 0 2024-04-15T00:39:06.746 INFO:tasks.workunit.client.0.smithi029.stdout:2/919: write d3/d13/fb8 [935037,41700] 0 2024-04-15T00:39:06.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/896: mknod df/d32/d90/c131 0 2024-04-15T00:39:06.956 INFO:tasks.workunit.client.0.smithi029.stdout:4/897: creat de/d6d/d7e/f11a x:0 0 0 2024-04-15T00:39:06.970 INFO:tasks.workunit.client.0.smithi029.stdout:7/903: fdatasync d0/d6/d4f/d66/d37/db7/dda/f57 0 2024-04-15T00:39:07.003 INFO:tasks.workunit.client.0.smithi029.stdout:6/917: dwrite d1/d8/d72/da3/fa5 [0,4194304] 0 2024-04-15T00:39:07.083 INFO:tasks.workunit.client.0.smithi029.stdout:9/887: dwrite d3/d6/d9/d29/d60/d64/fc4 [0,4194304] 0 2024-04-15T00:39:07.201 INFO:tasks.workunit.client.0.smithi029.stdout:0/949: dread - d5/d15/d27/d9f/ddb/f113 zero size 2024-04-15T00:39:07.226 INFO:tasks.workunit.client.0.smithi029.stdout:8/942: dwrite d8/da/d2f/d6e/dc1/ded/f126 [0,4194304] 0 2024-04-15T00:39:07.303 INFO:tasks.workunit.client.0.smithi029.stdout:2/920: dread - d3/d13/d43/fa1 zero size 2024-04-15T00:39:07.305 INFO:tasks.workunit.client.0.smithi029.stdout:8/943: chown d8/d4a/da1/f11a 159930153 1 2024-04-15T00:39:07.335 INFO:tasks.workunit.client.0.smithi029.stdout:8/944: stat d8/da/d3d/d8a/f9f 0 2024-04-15T00:39:07.438 INFO:tasks.workunit.client.0.smithi029.stdout:3/907: mknod d17/d2f/d44/d58/d5c/d5f/c12c 0 2024-04-15T00:39:07.445 INFO:tasks.workunit.client.0.smithi029.stdout:5/941: write d2/de/d13/d22/d26/d36/d4d/d70/fb8 [4423626,55376] 0 2024-04-15T00:39:07.585 INFO:tasks.workunit.client.0.smithi029.stdout:5/942: sync 2024-04-15T00:39:07.887 INFO:tasks.workunit.client.0.smithi029.stdout:7/904: unlink d0/d6/d4f/d66/d26/d54/la3 0 2024-04-15T00:39:07.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/898: truncate de/d2b/d35/f3d 2385404 0 2024-04-15T00:39:07.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/888: unlink d3/d6/d9/d29/d60/d7f/da0/d9a/c42 0 2024-04-15T00:39:07.907 INFO:tasks.workunit.client.0.smithi029.stdout:0/950: rename d5/db/db0 to d5/db/d1a/d65/d76/daf/dc1/d136/d138 0 2024-04-15T00:39:07.915 INFO:tasks.workunit.client.0.smithi029.stdout:8/945: symlink d8/d4a/d78/d23/d28/d5f/l13c 0 2024-04-15T00:39:07.966 INFO:tasks.workunit.client.0.smithi029.stdout:7/905: dread - d0/d6/d39/d3c/fef zero size 2024-04-15T00:39:07.976 INFO:tasks.workunit.client.0.smithi029.stdout:8/946: chown d8/da/d2f/d42/d75 22870624 1 2024-04-15T00:39:08.277 INFO:tasks.workunit.client.0.smithi029.stdout:1/897: write df/d29/d41/d69/d78/f6f [4150949,17756] 0 2024-04-15T00:39:08.291 INFO:tasks.workunit.client.0.smithi029.stdout:6/918: unlink d1/db9/cbc 0 2024-04-15T00:39:08.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/921: dwrite d3/dd/d2d/d61/dd5/d4a/f8a [0,4194304] 0 2024-04-15T00:39:08.449 INFO:tasks.workunit.client.0.smithi029.stdout:2/922: chown d3/d2a/de4/d12d/l6e 3408952 1 2024-04-15T00:39:08.609 INFO:tasks.workunit.client.0.smithi029.stdout:3/908: rename d17/d2f/d84/db1/fdd to d17/d2f/d76/d7f/dcd/f12d 0 2024-04-15T00:39:08.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/951: symlink d5/db/d1a/d65/d76/daf/dc1/d136/d138/l139 0 2024-04-15T00:39:08.622 INFO:tasks.workunit.client.0.smithi029.stdout:4/899: dread - de/d6d/dde/fdf zero size 2024-04-15T00:39:08.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/906: fsync d0/d6/d39/d3c/d5b/d7e/fb3 0 2024-04-15T00:39:08.675 INFO:tasks.workunit.client.0.smithi029.stdout:1/898: rmdir df/d29/d41/d69/d78/dd1/d80/d94 39 2024-04-15T00:39:09.129 INFO:tasks.workunit.client.0.smithi029.stdout:9/889: creat d3/da3/d103/f111 x:0 0 0 2024-04-15T00:39:09.150 INFO:tasks.workunit.client.0.smithi029.stdout:4/900: creat de/df/d1e/d56/dd3/f11b x:0 0 0 2024-04-15T00:39:09.206 INFO:tasks.workunit.client.0.smithi029.stdout:1/899: fsync df/d29/d41/d69/d4c/f75 0 2024-04-15T00:39:09.208 INFO:tasks.workunit.client.0.smithi029.stdout:7/907: readlink d0/d6/d4f/d5d/ld4 0 2024-04-15T00:39:09.404 INFO:tasks.workunit.client.0.smithi029.stdout:0/952: dread d5/d4c/fd5 [0,4194304] 0 2024-04-15T00:39:09.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/919: dwrite d1/d8/db/f40 [4194304,4194304] 0 2024-04-15T00:39:09.734 INFO:tasks.workunit.client.0.smithi029.stdout:2/923: write d3/dd/d2d/d61/dd5/d95/f6a [183022,58518] 0 2024-04-15T00:39:09.828 INFO:tasks.workunit.client.0.smithi029.stdout:3/909: symlink d17/d2a/l12e 0 2024-04-15T00:39:09.934 INFO:tasks.workunit.client.0.smithi029.stdout:8/947: creat d8/da/d2f/d6e/dc1/f13d x:0 0 0 2024-04-15T00:39:10.268 INFO:tasks.workunit.client.0.smithi029.stdout:9/890: truncate d3/f8a 394797 0 2024-04-15T00:39:10.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/908: dread d0/d6/d4f/d66/d26/f2b [0,4194304] 0 2024-04-15T00:39:10.370 INFO:tasks.workunit.client.0.smithi029.stdout:5/943: rename d2/da5/dc8/c11c to d2/de/d13/d22/c133 0 2024-04-15T00:39:10.422 INFO:tasks.workunit.client.0.smithi029.stdout:8/948: mknod d8/d4a/d78/dca/c13e 0 2024-04-15T00:39:10.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/920: rmdir d1/d8/d79/d9f 39 2024-04-15T00:39:10.717 INFO:tasks.workunit.client.0.smithi029.stdout:0/953: rename d5/d54/dec/f10e to d5/db/d1a/d65/d76/daf/dc1/dfd/f13a 0 2024-04-15T00:39:10.773 INFO:tasks.workunit.client.0.smithi029.stdout:7/909: fsync d0/d6/d4f/d5d/d87/fce 0 2024-04-15T00:39:10.971 INFO:tasks.workunit.client.0.smithi029.stdout:8/949: creat d8/da/d2f/d6e/f13f x:0 0 0 2024-04-15T00:39:11.213 INFO:tasks.workunit.client.0.smithi029.stdout:2/924: rename d3/dd/d2d/d61/d85/da2/fc3 to d3/dd/da0/d112/f12f 0 2024-04-15T00:39:11.289 INFO:tasks.workunit.client.0.smithi029.stdout:0/954: chown d5/db/d1a/d50/ccb 1665889 1 2024-04-15T00:39:11.333 INFO:tasks.workunit.client.0.smithi029.stdout:0/955: dread d5/d3e/ff5 [0,4194304] 0 2024-04-15T00:39:11.380 INFO:tasks.workunit.client.0.smithi029.stdout:7/910: mkdir d0/d6/d4f/d66/d67/d129 0 2024-04-15T00:39:11.521 INFO:tasks.workunit.client.0.smithi029.stdout:3/910: link d17/d2f/d84/fc6 d17/d2f/d84/db1/d12a/f12f 0 2024-04-15T00:39:11.678 INFO:tasks.workunit.client.0.smithi029.stdout:3/911: dread d17/d2a/d46/d67/fdb [0,4194304] 0 2024-04-15T00:39:11.683 INFO:tasks.workunit.client.0.smithi029.stdout:6/921: fsync d1/d1e/d22/ddd/f114 0 2024-04-15T00:39:11.802 INFO:tasks.workunit.client.0.smithi029.stdout:0/956: mkdir d5/d15/d57/d5e/dfa/d13b 0 2024-04-15T00:39:11.813 INFO:tasks.workunit.client.0.smithi029.stdout:0/957: chown d5/d15/d1f/f73 343 1 2024-04-15T00:39:11.860 INFO:tasks.workunit.client.0.smithi029.stdout:9/891: link d3/d6/l5a d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe/l112 0 2024-04-15T00:39:11.928 INFO:tasks.workunit.client.0.smithi029.stdout:3/912: rmdir d17/d2a/d4c/da1 39 2024-04-15T00:39:12.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/925: creat d3/d2a/d4e/df3/d10e/f130 x:0 0 0 2024-04-15T00:39:12.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/911: dread d0/d6/d4f/d66/d26/f40 [0,4194304] 0 2024-04-15T00:39:12.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/912: chown d0/d6/d4f/d5d 4 1 2024-04-15T00:39:12.112 INFO:tasks.workunit.client.0.smithi029.stdout:4/901: dwrite de/d54/d71/d8b/fd6 [0,4194304] 0 2024-04-15T00:39:12.275 INFO:tasks.workunit.client.0.smithi029.stdout:1/900: dwrite df/d29/d41/d69/d78/dd1/d80/d94/fae [0,4194304] 0 2024-04-15T00:39:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:3/913: stat d17/d2a/d46/l8f 0 2024-04-15T00:39:12.645 INFO:tasks.workunit.client.0.smithi029.stdout:2/926: dread - d3/dd/da0/f120 zero size 2024-04-15T00:39:12.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/902: rename de/d2b/d59/f111 to de/d3a/daa/db6/f11c 0 2024-04-15T00:39:12.792 INFO:tasks.workunit.client.0.smithi029.stdout:3/914: symlink d17/d2a/d33/df2/l130 0 2024-04-15T00:39:12.807 INFO:tasks.workunit.client.0.smithi029.stdout:5/944: dwrite d2/de/d13/d22/d3c/f9f [0,4194304] 0 2024-04-15T00:39:12.930 INFO:tasks.workunit.client.0.smithi029.stdout:8/950: dwrite d8/da/d2f/d42/f7e [0,4194304] 0 2024-04-15T00:39:13.045 INFO:tasks.workunit.client.0.smithi029.stdout:5/945: sync 2024-04-15T00:39:13.138 INFO:tasks.workunit.client.0.smithi029.stdout:0/958: write d5/d3e/de3/f43 [1130694,23481] 0 2024-04-15T00:39:13.138 INFO:tasks.workunit.client.0.smithi029.stdout:1/901: creat df/d29/d41/d69/d78/dd1/d59/d10c/f132 x:0 0 0 2024-04-15T00:39:13.263 INFO:tasks.workunit.client.0.smithi029.stdout:7/913: truncate d0/d6/f25 4839147 0 2024-04-15T00:39:13.390 INFO:tasks.workunit.client.0.smithi029.stdout:7/914: stat d0/d6/d4f/d5d/d65/dbc/d8e/fd1 0 2024-04-15T00:39:13.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/903: dread de/df/d1e/f24 [0,4194304] 0 2024-04-15T00:39:13.573 INFO:tasks.workunit.client.0.smithi029.stdout:2/927: dwrite d3/dd/d42/dc6/f118 [0,4194304] 0 2024-04-15T00:39:13.639 INFO:tasks.workunit.client.0.smithi029.stdout:9/892: dwrite d3/d6/d30/fcc [0,4194304] 0 2024-04-15T00:39:13.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/922: link d1/d8/d72/da3/d102/d108/c69 d1/d1e/d22/ddd/c12f 0 2024-04-15T00:39:13.725 INFO:tasks.workunit.client.0.smithi029.stdout:8/951: rename d8/d4a/d78/c21 to d8/da/d2f/de2/c140 0 2024-04-15T00:39:13.737 INFO:tasks.workunit.client.0.smithi029.stdout:5/946: mkdir d2/de/d1f/dc2/d134 0 2024-04-15T00:39:13.992 INFO:tasks.workunit.client.0.smithi029.stdout:3/915: dread d17/d2f/d84/f8d [0,4194304] 0 2024-04-15T00:39:14.063 INFO:tasks.workunit.client.0.smithi029.stdout:0/959: dwrite d5/d15/d27/d51/d7d/faa [0,4194304] 0 2024-04-15T00:39:14.204 INFO:tasks.workunit.client.0.smithi029.stdout:7/915: creat d0/d6/d4f/d5d/d82/f12a x:0 0 0 2024-04-15T00:39:14.214 INFO:tasks.workunit.client.0.smithi029.stdout:2/928: dread - d3/dd/d42/dc6/fc8 zero size 2024-04-15T00:39:14.240 INFO:tasks.workunit.client.0.smithi029.stdout:6/923: chown d1/d8/db/l45 345563 1 2024-04-15T00:39:14.517 INFO:tasks.workunit.client.0.smithi029.stdout:1/902: truncate df/d32/f11c 924730 0 2024-04-15T00:39:14.529 INFO:tasks.workunit.client.0.smithi029.stdout:1/903: chown df/d29/d41/d4f/f58 3620886 1 2024-04-15T00:39:14.723 INFO:tasks.workunit.client.0.smithi029.stdout:0/960: mkdir d5/db/d1a/d65/d76/daf/dc1/dfd/d13c 0 2024-04-15T00:39:14.750 INFO:tasks.workunit.client.0.smithi029.stdout:4/904: write de/d2b/d35/f107 [2566698,41355] 0 2024-04-15T00:39:14.806 INFO:tasks.workunit.client.0.smithi029.stdout:5/947: write d2/de/d13/d22/d3c/d41/fcb [2528102,4407] 0 2024-04-15T00:39:15.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/929: mknod d3/dd/d2d/d61/d85/da2/c131 0 2024-04-15T00:39:15.032 INFO:tasks.workunit.client.0.smithi029.stdout:2/930: readlink d3/d2a/l33 0 2024-04-15T00:39:15.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/904: creat df/d29/d41/d69/d78/dd1/d80/d94/f133 x:0 0 0 2024-04-15T00:39:15.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/905: creat de/d54/d71/f11d x:0 0 0 2024-04-15T00:39:15.266 INFO:tasks.workunit.client.0.smithi029.stdout:5/948: readlink d2/de/d13/d22/d26/d36/d4d/dfb/l10c 0 2024-04-15T00:39:15.654 INFO:tasks.workunit.client.0.smithi029.stdout:7/916: truncate d0/d6/d4f/d66/d67/f101 1629413 0 2024-04-15T00:39:15.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/905: dread df/d29/fe5 [0,4194304] 0 2024-04-15T00:39:15.868 INFO:tasks.workunit.client.0.smithi029.stdout:4/906: fsync f4 0 2024-04-15T00:39:15.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/893: link d3/d6/d9/d29/d60/d7f/da0/d9a/fab d3/d6/d9/d15/d4a/f113 0 2024-04-15T00:39:15.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/949: dread d2/de/f10 [0,4194304] 0 2024-04-15T00:39:16.051 INFO:tasks.workunit.client.0.smithi029.stdout:3/916: dwrite d17/d2a/d4c/f8c [4194304,4194304] 0 2024-04-15T00:39:16.116 INFO:tasks.workunit.client.0.smithi029.stdout:3/917: chown d17/d2a/d4c/c59 14 1 2024-04-15T00:39:16.128 INFO:tasks.workunit.client.0.smithi029.stdout:1/906: mknod df/d29/d41/d96/d102/c134 0 2024-04-15T00:39:16.184 INFO:tasks.workunit.client.0.smithi029.stdout:4/907: mkdir de/d54/d58/d11e 0 2024-04-15T00:39:16.296 INFO:tasks.workunit.client.0.smithi029.stdout:8/952: link d8/d4a/d78/d23/d28/d30/d39/ff5 d8/da/f141 0 2024-04-15T00:39:16.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/950: dread d2/de/f72 [0,4194304] 0 2024-04-15T00:39:16.425 INFO:tasks.workunit.client.0.smithi029.stdout:0/961: write d5/d15/d68/fc7 [919864,21139] 0 2024-04-15T00:39:16.429 INFO:tasks.workunit.client.0.smithi029.stdout:3/918: dread - d17/d2f/d44/d58/d5c/d5f/db5/fed zero size 2024-04-15T00:39:16.453 INFO:tasks.workunit.client.0.smithi029.stdout:1/907: mknod df/d29/d41/d69/d4c/df4/c135 0 2024-04-15T00:39:16.550 INFO:tasks.workunit.client.0.smithi029.stdout:9/894: mknod d3/d6/d9/d15/c114 0 2024-04-15T00:39:16.752 INFO:tasks.workunit.client.0.smithi029.stdout:0/962: creat d5/d15/d27/d51/d77/f13d x:0 0 0 2024-04-15T00:39:16.935 INFO:tasks.workunit.client.0.smithi029.stdout:1/908: dread df/d29/d41/f81 [0,4194304] 0 2024-04-15T00:39:17.085 INFO:tasks.workunit.client.0.smithi029.stdout:6/924: dwrite d1/d8/db/fb1 [0,4194304] 0 2024-04-15T00:39:17.185 INFO:tasks.workunit.client.0.smithi029.stdout:0/963: fsync d5/d4c/d4e/fc8 0 2024-04-15T00:39:17.263 INFO:tasks.workunit.client.0.smithi029.stdout:2/931: dwrite d3/dd/d2d/d61/dd5/d95/f98 [0,4194304] 0 2024-04-15T00:39:17.324 INFO:tasks.workunit.client.0.smithi029.stdout:2/932: stat d3/d50 0 2024-04-15T00:39:17.338 INFO:tasks.workunit.client.0.smithi029.stdout:4/908: mkdir de/d11f 0 2024-04-15T00:39:17.344 INFO:tasks.workunit.client.0.smithi029.stdout:7/917: write d0/d69/f102 [235307,95286] 0 2024-04-15T00:39:17.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/925: dread d1/d8/d72/f78 [0,4194304] 0 2024-04-15T00:39:17.500 INFO:tasks.workunit.client.0.smithi029.stdout:6/926: stat d1/d8/d72/da3/d102/d108/dd3/de5/df7 0 2024-04-15T00:39:17.635 INFO:tasks.workunit.client.0.smithi029.stdout:4/909: rmdir de/d54/d58/d104 39 2024-04-15T00:39:17.642 INFO:tasks.workunit.client.0.smithi029.stdout:7/918: mknod d0/d6/d4f/d5d/d65/dbc/d8e/c12b 0 2024-04-15T00:39:17.838 INFO:tasks.workunit.client.0.smithi029.stdout:5/951: write d2/de/d13/d22/d26/d36/d4d/f51 [2687489,26288] 0 2024-04-15T00:39:17.846 INFO:tasks.workunit.client.0.smithi029.stdout:9/895: write d3/f4e [4387505,9734] 0 2024-04-15T00:39:17.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/919: write d17/d2f/d44/d58/d5c/f9a [3208877,79014] 0 2024-04-15T00:39:17.891 INFO:tasks.workunit.client.0.smithi029.stdout:1/909: write df/f2d [1318765,47476] 0 2024-04-15T00:39:18.034 INFO:tasks.workunit.client.0.smithi029.stdout:7/919: unlink d0/d6/d39/d107/c11d 0 2024-04-15T00:39:18.093 INFO:tasks.workunit.client.0.smithi029.stdout:4/910: truncate de/d2b/d35/f69 4369558 0 2024-04-15T00:39:18.230 INFO:tasks.workunit.client.0.smithi029.stdout:8/953: dwrite d8/da/d2f/d66/f104 [0,4194304] 0 2024-04-15T00:39:18.348 INFO:tasks.workunit.client.0.smithi029.stdout:0/964: dwrite d5/d15/d27/d51/fb2 [0,4194304] 0 2024-04-15T00:39:18.400 INFO:tasks.workunit.client.0.smithi029.stdout:2/933: dwrite d3/dd/d42/dc6/fc8 [0,4194304] 0 2024-04-15T00:39:18.554 INFO:tasks.workunit.client.0.smithi029.stdout:6/927: dwrite d1/d8/db/d38/d6f/fa7 [4194304,4194304] 0 2024-04-15T00:39:18.702 INFO:tasks.workunit.client.0.smithi029.stdout:3/920: write d17/d2f/d76/d7f/ff6 [588193,90156] 0 2024-04-15T00:39:18.716 INFO:tasks.workunit.client.0.smithi029.stdout:1/910: rename df/d29/d41/f45 to df/d29/d41/d69/d4c/d10e/f136 0 2024-04-15T00:39:18.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/954: mkdir d8/d4a/d78/dca/d142 0 2024-04-15T00:39:18.979 INFO:tasks.workunit.client.0.smithi029.stdout:1/911: sync 2024-04-15T00:39:19.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/920: creat d0/d6/d4f/d66/d67/d129/f12c x:0 0 0 2024-04-15T00:39:19.037 INFO:tasks.workunit.client.0.smithi029.stdout:5/952: write d2/d1a/f104 [7933491,115467] 0 2024-04-15T00:39:19.087 INFO:tasks.workunit.client.0.smithi029.stdout:7/921: chown d0/f8f 0 1 2024-04-15T00:39:19.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/896: rename d3/d6/d9/d15/d4a/lb5 to d3/d6/d9/d15/d4a/l115 0 2024-04-15T00:39:19.120 INFO:tasks.workunit.client.0.smithi029.stdout:0/965: symlink d5/d4c/d4e/l13e 0 2024-04-15T00:39:19.128 INFO:tasks.workunit.client.0.smithi029.stdout:8/955: mknod d8/d4a/d78/dca/c143 0 2024-04-15T00:39:19.161 INFO:tasks.workunit.client.0.smithi029.stdout:3/921: write ff [166676,52422] 0 2024-04-15T00:39:19.216 INFO:tasks.workunit.client.0.smithi029.stdout:2/934: dwrite d3/d13/f97 [4194304,4194304] 0 2024-04-15T00:39:19.318 INFO:tasks.workunit.client.0.smithi029.stdout:6/928: creat d1/d8/d79/d9f/f130 x:0 0 0 2024-04-15T00:39:19.327 INFO:tasks.workunit.client.0.smithi029.stdout:3/922: readlink d17/d2f/d44/d5a/dde/l118 0 2024-04-15T00:39:19.674 INFO:tasks.workunit.client.0.smithi029.stdout:4/911: rename de/d2b/d35/f73 to de/d54/d71/d8b/da7/d112/f120 0 2024-04-15T00:39:19.842 INFO:tasks.workunit.client.0.smithi029.stdout:5/953: symlink d2/de/d13/d22/d3c/d41/d6d/l135 0 2024-04-15T00:39:20.026 INFO:tasks.workunit.client.0.smithi029.stdout:8/956: rmdir d8/da/d2f/d6e/d92 39 2024-04-15T00:39:20.159 INFO:tasks.workunit.client.0.smithi029.stdout:6/929: mknod d1/d8/db/d38/d6f/c131 0 2024-04-15T00:39:20.159 INFO:tasks.workunit.client.0.smithi029.stdout:2/935: creat d3/dd/d2d/d61/d85/da2/f132 x:0 0 0 2024-04-15T00:39:20.397 INFO:tasks.workunit.client.0.smithi029.stdout:3/923: rename d17/d2f/d44/fcf to d17/d2a/d4c/d93/f131 0 2024-04-15T00:39:20.417 INFO:tasks.workunit.client.0.smithi029.stdout:3/924: stat d17/d2a/d4c/f8e 0 2024-04-15T00:39:20.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/925: chown d17/d2f/d44/d58/d5c/d5f 2063 1 2024-04-15T00:39:20.470 INFO:tasks.workunit.client.0.smithi029.stdout:5/954: mkdir d2/de/d13/d22/d26/d36/d4d/dfb/d136 0 2024-04-15T00:39:20.833 INFO:tasks.workunit.client.0.smithi029.stdout:9/897: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe/f116 x:0 0 0 2024-04-15T00:39:20.989 INFO:tasks.workunit.client.0.smithi029.stdout:6/930: symlink d1/d8/d72/da3/d102/d108/dd3/de5/l132 0 2024-04-15T00:39:21.116 INFO:tasks.workunit.client.0.smithi029.stdout:6/931: dread d1/d8/db/d7b/d91/fa4 [0,4194304] 0 2024-04-15T00:39:21.138 INFO:tasks.workunit.client.0.smithi029.stdout:2/936: rename d3/dd/d2d/d61/dd5/d95/f1e to d3/dd/d2d/d61/dd5/d4a/f133 0 2024-04-15T00:39:21.146 INFO:tasks.workunit.client.0.smithi029.stdout:7/922: write d0/d6/d4f/d5d/d8d/f117 [24936,122507] 0 2024-04-15T00:39:21.235 INFO:tasks.workunit.client.0.smithi029.stdout:2/937: chown d3/dd/d2d/d61/d85/ccb 367365671 1 2024-04-15T00:39:21.299 INFO:tasks.workunit.client.0.smithi029.stdout:5/955: dread d2/de/d13/d22/d26/d36/d4d/dfb/fff [0,4194304] 0 2024-04-15T00:39:21.372 INFO:tasks.workunit.client.0.smithi029.stdout:1/912: mknod df/d29/c137 0 2024-04-15T00:39:21.560 INFO:tasks.workunit.client.0.smithi029.stdout:8/957: fsync d8/d4a/d78/d23/d28/ffb 0 2024-04-15T00:39:21.640 INFO:tasks.workunit.client.0.smithi029.stdout:4/912: dwrite f2 [0,4194304] 0 2024-04-15T00:39:21.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/932: dread d1/d8/db/fd5 [0,4194304] 0 2024-04-15T00:39:21.756 INFO:tasks.workunit.client.0.smithi029.stdout:7/923: mknod d0/d6/d4f/d5d/d87/da6/c12d 0 2024-04-15T00:39:21.840 INFO:tasks.workunit.client.0.smithi029.stdout:2/938: fdatasync d3/f38 0 2024-04-15T00:39:21.856 INFO:tasks.workunit.client.0.smithi029.stdout:5/956: chown d2/de/d13/d22/d26/f130 458453 1 2024-04-15T00:39:21.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/939: chown d3/d93/c105 26 1 2024-04-15T00:39:21.911 INFO:tasks.workunit.client.0.smithi029.stdout:0/966: getdents d5/d15/d68 0 2024-04-15T00:39:21.993 INFO:tasks.workunit.client.0.smithi029.stdout:8/958: dread - d8/d4a/d78/dca/f13b zero size 2024-04-15T00:39:22.066 INFO:tasks.workunit.client.0.smithi029.stdout:3/926: write d17/d2a/d33/d37/f99 [607127,85725] 0 2024-04-15T00:39:22.091 INFO:tasks.workunit.client.0.smithi029.stdout:7/924: chown d0/d6/d4f/d5d/d65/dbc/c76 667249 1 2024-04-15T00:39:22.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/933: truncate d1/d8/db/d38/f11a 671736 0 2024-04-15T00:39:22.252 INFO:tasks.workunit.client.0.smithi029.stdout:5/957: unlink d2/de/d13/d22/d26/d36/d4d/d70/fb8 0 2024-04-15T00:39:22.274 INFO:tasks.workunit.client.0.smithi029.stdout:2/940: dread d3/d2a/d4e/f125 [0,4194304] 0 2024-04-15T00:39:22.338 INFO:tasks.workunit.client.0.smithi029.stdout:9/898: creat d3/d6/d9/d15/f117 x:0 0 0 2024-04-15T00:39:22.360 INFO:tasks.workunit.client.0.smithi029.stdout:9/899: write d3/d6/d9/d15/f117 [261333,31538] 0 2024-04-15T00:39:22.503 INFO:tasks.workunit.client.0.smithi029.stdout:8/959: dread d8/d4a/d78/ff9 [0,4194304] 0 2024-04-15T00:39:22.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/927: dread - d17/d2f/d44/f120 zero size 2024-04-15T00:39:22.561 INFO:tasks.workunit.client.0.smithi029.stdout:3/928: stat d17/d2f/f71 0 2024-04-15T00:39:22.588 INFO:tasks.workunit.client.0.smithi029.stdout:4/913: truncate de/d54/d71/fab 43300 0 2024-04-15T00:39:22.768 INFO:tasks.workunit.client.0.smithi029.stdout:2/941: creat d3/dd/d2d/d61/dd5/d4a/f134 x:0 0 0 2024-04-15T00:39:22.813 INFO:tasks.workunit.client.0.smithi029.stdout:1/913: creat df/d29/d41/d69/d4c/f138 x:0 0 0 2024-04-15T00:39:23.091 INFO:tasks.workunit.client.0.smithi029.stdout:4/914: unlink de/d6d/l6e 0 2024-04-15T00:39:23.092 INFO:tasks.workunit.client.0.smithi029.stdout:3/929: fdatasync d17/d2a/d46/d67/dd6/d102/f111 0 2024-04-15T00:39:23.093 INFO:tasks.workunit.client.0.smithi029.stdout:9/900: dread - d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f102 zero size 2024-04-15T00:39:23.126 INFO:tasks.workunit.client.0.smithi029.stdout:1/914: fsync df/d29/d41/d4f/f6e 0 2024-04-15T00:39:23.176 INFO:tasks.workunit.client.0.smithi029.stdout:1/915: chown df/d29/d41/d69/d4c/df4 446331 1 2024-04-15T00:39:23.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/925: rename d0/d6/d4f/d66/f61 to d0/d6/d4f/d5d/d65/dbc/f12e 0 2024-04-15T00:39:23.607 INFO:tasks.workunit.client.0.smithi029.stdout:6/934: write d1/d8/f54 [3267337,5346] 0 2024-04-15T00:39:23.718 INFO:tasks.workunit.client.0.smithi029.stdout:0/967: getdents d5/d15/d27/d9f/ddb 0 2024-04-15T00:39:23.726 INFO:tasks.workunit.client.0.smithi029.stdout:0/968: chown d5/d15/d57/d122 1626822798 1 2024-04-15T00:39:23.740 INFO:tasks.workunit.client.0.smithi029.stdout:8/960: write d8/d4a/d78/d23/d28/f44 [2315115,51315] 0 2024-04-15T00:39:23.905 INFO:tasks.workunit.client.0.smithi029.stdout:4/915: fdatasync de/d6d/dde/f110 0 2024-04-15T00:39:23.913 INFO:tasks.workunit.client.0.smithi029.stdout:9/901: creat d3/d6/d9/d15/de8/f118 x:0 0 0 2024-04-15T00:39:23.980 INFO:tasks.workunit.client.0.smithi029.stdout:1/916: symlink df/d29/d41/d69/d78/dd1/d109/l139 0 2024-04-15T00:39:24.009 INFO:tasks.workunit.client.0.smithi029.stdout:2/942: dwrite d3/dd/d2d/d61/dd5/f74 [0,4194304] 0 2024-04-15T00:39:24.031 INFO:tasks.workunit.client.0.smithi029.stdout:5/958: getdents d2/d1a 0 2024-04-15T00:39:24.168 INFO:tasks.workunit.client.0.smithi029.stdout:8/961: dread - d8/d4a/d78/d23/d28/d30/d39/f132 zero size 2024-04-15T00:39:24.266 INFO:tasks.workunit.client.0.smithi029.stdout:0/969: dread d5/d4c/d8a/f115 [0,4194304] 0 2024-04-15T00:39:24.316 INFO:tasks.workunit.client.0.smithi029.stdout:4/916: fsync de/d3a/fc2 0 2024-04-15T00:39:24.335 INFO:tasks.workunit.client.0.smithi029.stdout:1/917: readlink df/d29/d41/d69/lda 0 2024-04-15T00:39:24.364 INFO:tasks.workunit.client.0.smithi029.stdout:2/943: dread d3/d13/f97 [0,4194304] 0 2024-04-15T00:39:24.986 INFO:tasks.workunit.client.0.smithi029.stdout:7/926: dwrite d0/d6/f2f [0,4194304] 0 2024-04-15T00:39:25.049 INFO:tasks.workunit.client.0.smithi029.stdout:6/935: mkdir d1/d8/d133 0 2024-04-15T00:39:25.274 INFO:tasks.workunit.client.0.smithi029.stdout:3/930: rename d17/d2f/d44/f129 to d17/d2f/d44/f132 0 2024-04-15T00:39:25.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/962: dwrite d8/da/d2f/d42/ff6 [8388608,4194304] 0 2024-04-15T00:39:25.514 INFO:tasks.workunit.client.0.smithi029.stdout:4/917: creat de/d54/d71/d8b/db1/dd5/f121 x:0 0 0 2024-04-15T00:39:25.554 INFO:tasks.workunit.client.0.smithi029.stdout:2/944: mkdir d3/d13/de1/d135 0 2024-04-15T00:39:25.617 INFO:tasks.workunit.client.0.smithi029.stdout:7/927: mknod d0/d69/c12f 0 2024-04-15T00:39:25.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/959: truncate d2/f52 3409546 0 2024-04-15T00:39:25.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/945: dread d3/d13/d43/d5a/f4b [0,4194304] 0 2024-04-15T00:39:25.851 INFO:tasks.workunit.client.0.smithi029.stdout:6/936: unlink d1/d8/d72/fff 0 2024-04-15T00:39:26.006 INFO:tasks.workunit.client.0.smithi029.stdout:3/931: mknod d17/d2f/d44/d5a/dde/c133 0 2024-04-15T00:39:26.014 INFO:tasks.workunit.client.0.smithi029.stdout:3/932: chown d17/d2f/c5e 236597 1 2024-04-15T00:39:26.083 INFO:tasks.workunit.client.0.smithi029.stdout:9/902: creat d3/da3/f119 x:0 0 0 2024-04-15T00:39:26.190 INFO:tasks.workunit.client.0.smithi029.stdout:3/933: dread d17/d2f/d44/d58/d5c/fc9 [0,4194304] 0 2024-04-15T00:39:26.276 INFO:tasks.workunit.client.0.smithi029.stdout:5/960: creat d2/de/d1f/d63/f137 x:0 0 0 2024-04-15T00:39:26.335 INFO:tasks.workunit.client.0.smithi029.stdout:2/946: unlink d3/d2a/c44 0 2024-04-15T00:39:26.372 INFO:tasks.workunit.client.0.smithi029.stdout:7/928: truncate d0/d6/d4f/d5d/d82/f122 962677 0 2024-04-15T00:39:26.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/929: read d0/d6/d4f/d66/d26/f51 [1167057,79398] 0 2024-04-15T00:39:26.412 INFO:tasks.workunit.client.0.smithi029.stdout:7/930: stat d0/d6/d4f/d66/d26/d77/d89 0 2024-04-15T00:39:26.426 INFO:tasks.workunit.client.0.smithi029.stdout:6/937: symlink d1/d8/d72/da3/d102/d108/d58/l134 0 2024-04-15T00:39:26.444 INFO:tasks.workunit.client.0.smithi029.stdout:6/938: chown d1/d1e/d105/l11e 38683 1 2024-04-15T00:39:26.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/970: rename d5/db/l3c to d5/d4c/d4e/d10b/l13f 0 2024-04-15T00:39:26.732 INFO:tasks.workunit.client.0.smithi029.stdout:4/918: mkdir de/d11f/d122 0 2024-04-15T00:39:26.792 INFO:tasks.workunit.client.0.smithi029.stdout:5/961: creat d2/de/d13/d22/d3c/d41/dec/f138 x:0 0 0 2024-04-15T00:39:26.895 INFO:tasks.workunit.client.0.smithi029.stdout:2/947: creat d3/dd/d2d/d61/dd5/dcf/dc9/f136 x:0 0 0 2024-04-15T00:39:26.975 INFO:tasks.workunit.client.0.smithi029.stdout:6/939: mkdir d1/d1e/d22/ddd/d135 0 2024-04-15T00:39:27.062 INFO:tasks.workunit.client.0.smithi029.stdout:5/962: sync 2024-04-15T00:39:27.076 INFO:tasks.workunit.client.0.smithi029.stdout:5/963: chown d2/de/d13/d22/d3c/d41/c4f 2 1 2024-04-15T00:39:27.113 INFO:tasks.workunit.client.0.smithi029.stdout:8/963: rename d8/da/d3d/d8a/lbc to d8/da/d2f/d6e/d10a/l144 0 2024-04-15T00:39:27.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/934: getdents d17/d2f/d44/d58/d108/d113 0 2024-04-15T00:39:27.220 INFO:tasks.workunit.client.0.smithi029.stdout:4/919: mkdir de/d54/d71/d8b/da7/d123 0 2024-04-15T00:39:27.263 INFO:tasks.workunit.client.0.smithi029.stdout:2/948: creat d3/d2a/de4/f137 x:0 0 0 2024-04-15T00:39:27.477 INFO:tasks.workunit.client.0.smithi029.stdout:5/964: chown d2/de/d13/d22/d3c/d41/d6d/f81 21444 1 2024-04-15T00:39:27.735 INFO:tasks.workunit.client.0.smithi029.stdout:0/971: mknod d5/d4c/d4e/c140 0 2024-04-15T00:39:27.741 INFO:tasks.workunit.client.0.smithi029.stdout:3/935: creat d17/d2a/d46/d67/dd6/f134 x:0 0 0 2024-04-15T00:39:27.763 INFO:tasks.workunit.client.0.smithi029.stdout:4/920: truncate de/fe5 243304 0 2024-04-15T00:39:27.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/949: mkdir d3/d50/d51/d65/d138 0 2024-04-15T00:39:27.851 INFO:tasks.workunit.client.0.smithi029.stdout:7/931: link d0/f24 d0/d6/d4f/d66/d67/d129/f130 0 2024-04-15T00:39:27.946 INFO:tasks.workunit.client.0.smithi029.stdout:1/918: dwrite df/f38 [0,4194304] 0 2024-04-15T00:39:28.020 INFO:tasks.workunit.client.0.smithi029.stdout:5/965: dread d2/de/d13/d22/d26/d36/d4d/f8f [0,4194304] 0 2024-04-15T00:39:28.024 INFO:tasks.workunit.client.0.smithi029.stdout:8/964: fsync d8/da/fac 0 2024-04-15T00:39:28.197 INFO:tasks.workunit.client.0.smithi029.stdout:4/921: mkdir de/d2b/d35/d124 0 2024-04-15T00:39:28.228 INFO:tasks.workunit.client.0.smithi029.stdout:3/936: dread d17/f29 [0,4194304] 0 2024-04-15T00:39:28.297 INFO:tasks.workunit.client.0.smithi029.stdout:9/903: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/fcd [508814,117871] 0 2024-04-15T00:39:28.702 INFO:tasks.workunit.client.0.smithi029.stdout:5/966: rename d2/de/d13/d22/d26/d36/d4d/dfb/fff to d2/da5/f139 0 2024-04-15T00:39:28.774 INFO:tasks.workunit.client.0.smithi029.stdout:2/950: truncate d3/dd/da0/fac 1185183 0 2024-04-15T00:39:29.024 INFO:tasks.workunit.client.0.smithi029.stdout:6/940: dwrite d1/d8/db/d7b/d85/dd2/dab/f128 [0,4194304] 0 2024-04-15T00:39:29.091 INFO:tasks.workunit.client.0.smithi029.stdout:5/967: unlink f0 0 2024-04-15T00:39:29.253 INFO:tasks.workunit.client.0.smithi029.stdout:9/904: symlink d3/d6/d9/d29/d60/d7f/l11a 0 2024-04-15T00:39:29.266 INFO:tasks.workunit.client.0.smithi029.stdout:1/919: creat df/f13a x:0 0 0 2024-04-15T00:39:29.404 INFO:tasks.workunit.client.0.smithi029.stdout:1/920: sync 2024-04-15T00:39:29.446 INFO:tasks.workunit.client.0.smithi029.stdout:0/972: write d5/d3e/de3/f3d [4398170,86982] 0 2024-04-15T00:39:29.545 INFO:tasks.workunit.client.0.smithi029.stdout:7/932: dwrite d0/f4e [0,4194304] 0 2024-04-15T00:39:29.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/905: stat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe/l112 0 2024-04-15T00:39:29.982 INFO:tasks.workunit.client.0.smithi029.stdout:8/965: getdents d8/da7 0 2024-04-15T00:39:30.056 INFO:tasks.workunit.client.0.smithi029.stdout:3/937: rename d17/d2f/d44/c50 to d17/d2a/d46/d67/c135 0 2024-04-15T00:39:30.062 INFO:tasks.workunit.client.0.smithi029.stdout:4/922: write de/d54/d71/d8b/fd6 [4869523,30233] 0 2024-04-15T00:39:30.190 INFO:tasks.workunit.client.0.smithi029.stdout:1/921: truncate df/d29/d41/fc6 735486 0 2024-04-15T00:39:30.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/973: mkdir d5/d3e/de3/d141 0 2024-04-15T00:39:30.283 INFO:tasks.workunit.client.0.smithi029.stdout:2/951: write d3/dd/d2d/d61/dd5/dcf/fc1 [473237,25760] 0 2024-04-15T00:39:30.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/933: fsync d0/d6/d4f/d66/d26/d77/d89/fa1 0 2024-04-15T00:39:30.434 INFO:tasks.workunit.client.0.smithi029.stdout:2/952: dread d3/dd/d2d/f7d [0,4194304] 0 2024-04-15T00:39:30.435 INFO:tasks.workunit.client.0.smithi029.stdout:9/906: dread - d3/da3/f10d zero size 2024-04-15T00:39:30.445 INFO:tasks.workunit.client.0.smithi029.stdout:7/934: readlink d0/d6/d4f/d5d/d87/l124 0 2024-04-15T00:39:30.555 INFO:tasks.workunit.client.0.smithi029.stdout:9/907: sync 2024-04-15T00:39:30.563 INFO:tasks.workunit.client.0.smithi029.stdout:8/966: dread - d8/d4a/da1/dee/f11f zero size 2024-04-15T00:39:30.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:39:30.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:39:30.590 INFO:tasks.workunit.client.0.smithi029.stdout:8/967: chown d8/da/d2f/d6e/d5a/f109 993148 1 2024-04-15T00:39:30.602 INFO:tasks.workunit.client.0.smithi029.stdout:4/923: creat de/d11f/f125 x:0 0 0 2024-04-15T00:39:30.801 INFO:tasks.workunit.client.0.smithi029.stdout:6/941: rmdir d1/d1e/d22/ddd/d135 0 2024-04-15T00:39:30.919 INFO:tasks.workunit.client.0.smithi029.stdout:5/968: link d2/de/d13/d22/d3c/f75 d2/de/d1f/dc2/d134/f13a 0 2024-04-15T00:39:31.029 INFO:tasks.workunit.client.0.smithi029.stdout:0/974: creat d5/d15/f142 x:0 0 0 2024-04-15T00:39:31.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/968: rename d8/d4a/d78/d23/d28/f44 to d8/d4a/d78/d10b/f145 0 2024-04-15T00:39:31.399 INFO:tasks.workunit.client.0.smithi029.stdout:3/938: creat d17/d2f/d44/d58/d108/d113/f136 x:0 0 0 2024-04-15T00:39:31.590 INFO:tasks.workunit.client.0.smithi029.stdout:0/975: fsync d5/db/d7b/f114 0 2024-04-15T00:39:31.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/953: mkdir d3/d2a/de4/d12d/d121/d139 0 2024-04-15T00:39:31.688 INFO:tasks.workunit.client.0.smithi029.stdout:7/935: truncate d0/d6/d4f/d66/d37/f99 349944 0 2024-04-15T00:39:32.072 INFO:tasks.workunit.client.0.smithi029.stdout:0/976: rmdir d5/d15/d57 39 2024-04-15T00:39:32.202 INFO:tasks.workunit.client.0.smithi029.stdout:7/936: creat d0/d6/d4f/d5d/d65/f131 x:0 0 0 2024-04-15T00:39:32.342 INFO:tasks.workunit.client.0.smithi029.stdout:0/977: chown d5/d15/d57/d5e/c8b 31153996 1 2024-04-15T00:39:32.410 INFO:tasks.workunit.client.0.smithi029.stdout:0/978: dread - d5/d15/d57/d5e/fa9 zero size 2024-04-15T00:39:32.498 INFO:tasks.workunit.client.0.smithi029.stdout:0/979: stat d5/d15/d27/lea 0 2024-04-15T00:39:32.522 INFO:tasks.workunit.client.0.smithi029.stdout:2/954: dread d3/dd/d42/dc6/dee/f12b [0,4194304] 0 2024-04-15T00:39:32.564 INFO:tasks.workunit.client.0.smithi029.stdout:0/980: chown d5/d15/c25 192590680 1 2024-04-15T00:39:32.581 INFO:tasks.workunit.client.0.smithi029.stdout:1/922: dwrite df/f19 [0,4194304] 0 2024-04-15T00:39:32.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/908: write d3/d6/d9/d29/d60/d7f/f82 [3037193,65672] 0 2024-04-15T00:39:32.801 INFO:tasks.workunit.client.0.smithi029.stdout:2/955: mknod d3/d53/c13a 0 2024-04-15T00:39:32.902 INFO:tasks.workunit.client.0.smithi029.stdout:0/981: mkdir d5/d15/d27/dbb/d143 0 2024-04-15T00:39:32.937 INFO:tasks.workunit.client.0.smithi029.stdout:4/924: dwrite de/d54/d71/f84 [0,4194304] 0 2024-04-15T00:39:32.996 INFO:tasks.workunit.client.0.smithi029.stdout:6/942: dwrite d1/d8/f3d [4194304,4194304] 0 2024-04-15T00:39:32.999 INFO:tasks.workunit.client.0.smithi029.stdout:2/956: chown d3/dd/d2d/d61/dd5/c72 49 1 2024-04-15T00:39:33.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/909: mkdir d3/d6/d30/d11b 0 2024-04-15T00:39:33.144 INFO:tasks.workunit.client.0.smithi029.stdout:5/969: chown d2/de/d13/d22/d26/d36/d4d/dfb 0 1 2024-04-15T00:39:33.183 INFO:tasks.workunit.client.0.smithi029.stdout:2/957: chown d3/dd/d2d/d61/d85/cfb 2807 1 2024-04-15T00:39:33.207 INFO:tasks.workunit.client.0.smithi029.stdout:4/925: dread de/d54/d58/f68 [0,4194304] 0 2024-04-15T00:39:33.323 INFO:tasks.workunit.client.0.smithi029.stdout:3/939: write d17/d2a/d33/f63 [521695,14496] 0 2024-04-15T00:39:33.346 INFO:tasks.workunit.client.0.smithi029.stdout:7/937: write d0/d6/d4f/d66/d26/f2b [3310811,102328] 0 2024-04-15T00:39:33.462 INFO:tasks.workunit.client.0.smithi029.stdout:8/969: dwrite d8/d4a/f13a [0,4194304] 0 2024-04-15T00:39:33.626 INFO:tasks.workunit.client.0.smithi029.stdout:8/970: sync 2024-04-15T00:39:33.738 INFO:tasks.workunit.client.0.smithi029.stdout:6/943: creat d1/d8/db/d7b/d85/f136 x:0 0 0 2024-04-15T00:39:33.755 INFO:tasks.workunit.client.0.smithi029.stdout:0/982: mknod d5/db/d1a/d65/d76/daf/dc1/d136/d138/c144 0 2024-04-15T00:39:33.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/926: symlink de/d3a/daa/db6/l126 0 2024-04-15T00:39:33.807 INFO:tasks.workunit.client.0.smithi029.stdout:1/923: rename df/f28 to df/d29/f13b 0 2024-04-15T00:39:33.809 INFO:tasks.workunit.client.0.smithi029.stdout:3/940: rmdir d17/d2a/d46/d67/dd6/d102 39 2024-04-15T00:39:33.815 INFO:tasks.workunit.client.0.smithi029.stdout:8/971: sync 2024-04-15T00:39:33.858 INFO:tasks.workunit.client.0.smithi029.stdout:8/972: readlink d8/da8/lec 0 2024-04-15T00:39:33.863 INFO:tasks.workunit.client.0.smithi029.stdout:6/944: dread d1/d8/f3d [4194304,4194304] 0 2024-04-15T00:39:33.871 INFO:tasks.workunit.client.0.smithi029.stdout:4/927: chown de/d54/d58/l79 11 1 2024-04-15T00:39:34.150 INFO:tasks.workunit.client.0.smithi029.stdout:2/958: rename d3/d2a/de4/d12d/le3 to d3/d2a/d4e/l13b 0 2024-04-15T00:39:34.427 INFO:tasks.workunit.client.0.smithi029.stdout:8/973: fsync d8/d4a/d78/d23/d28/d30/d39/d77/fd5 0 2024-04-15T00:39:34.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/938: write d0/d6/d4f/dbb/d49/fd7 [144121,74436] 0 2024-04-15T00:39:34.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/970: dwrite d2/da5/f11f [0,4194304] 0 2024-04-15T00:39:34.830 INFO:tasks.workunit.client.0.smithi029.stdout:5/971: readlink d2/de/d13/d22/d26/dd7/d118/l127 0 2024-04-15T00:39:34.858 INFO:tasks.workunit.client.0.smithi029.stdout:0/983: dwrite d5/d15/d27/dbb/fed [0,4194304] 0 2024-04-15T00:39:34.942 INFO:tasks.workunit.client.0.smithi029.stdout:1/924: dwrite df/d29/d41/d4f/f110 [0,4194304] 0 2024-04-15T00:39:35.074 INFO:tasks.workunit.client.0.smithi029.stdout:0/984: chown d5/db/d7b/fce 155385928 1 2024-04-15T00:39:35.190 INFO:tasks.workunit.client.0.smithi029.stdout:3/941: dwrite d17/d2f/d44/d58/d5c/d5f/db5/fed [0,4194304] 0 2024-04-15T00:39:35.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/928: dwrite de/df/d1e/d56/dd3/f11b [0,4194304] 0 2024-04-15T00:39:35.310 INFO:tasks.workunit.client.0.smithi029.stdout:8/974: creat d8/d4a/f146 x:0 0 0 2024-04-15T00:39:35.380 INFO:tasks.workunit.client.0.smithi029.stdout:9/910: getdents d3/da3/da7 0 2024-04-15T00:39:35.744 INFO:tasks.workunit.client.0.smithi029.stdout:1/925: dread df/d29/d41/f47 [0,4194304] 0 2024-04-15T00:39:36.072 INFO:tasks.workunit.client.0.smithi029.stdout:4/929: rmdir de/d54/d58/d104 39 2024-04-15T00:39:36.147 INFO:tasks.workunit.client.0.smithi029.stdout:6/945: rename d1/d8/db/dc1 to d1/d8/db/d38/de4/d137 0 2024-04-15T00:39:36.195 INFO:tasks.workunit.client.0.smithi029.stdout:9/911: symlink d3/d88/l11c 0 2024-04-15T00:39:36.306 INFO:tasks.workunit.client.0.smithi029.stdout:1/926: unlink df/f15 0 2024-04-15T00:39:36.361 INFO:tasks.workunit.client.0.smithi029.stdout:3/942: symlink d17/d2a/l137 0 2024-04-15T00:39:36.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/943: chown d17/d2f/d44/d58/d5c/d5f/fba 1600989 1 2024-04-15T00:39:36.407 INFO:tasks.workunit.client.0.smithi029.stdout:7/939: creat d0/d6/d39/f132 x:0 0 0 2024-04-15T00:39:36.444 INFO:tasks.workunit.client.0.smithi029.stdout:8/975: fdatasync d8/d4a/d78/d23/f133 0 2024-04-15T00:39:36.549 INFO:tasks.workunit.client.0.smithi029.stdout:6/946: fdatasync d1/d8/db/d7b/d85/f8f 0 2024-04-15T00:39:36.629 INFO:tasks.workunit.client.0.smithi029.stdout:9/912: mknod d3/d6/d9/d15/d9d/c11d 0 2024-04-15T00:39:36.767 INFO:tasks.workunit.client.0.smithi029.stdout:5/972: dwrite d2/de/d13/d22/d3c/d41/d6d/fd1 [0,4194304] 0 2024-04-15T00:39:36.808 INFO:tasks.workunit.client.0.smithi029.stdout:9/913: sync 2024-04-15T00:39:36.851 INFO:tasks.workunit.client.0.smithi029.stdout:7/940: symlink d0/d6/d4f/d66/l133 0 2024-04-15T00:39:36.855 INFO:tasks.workunit.client.0.smithi029.stdout:0/985: write d5/d3e/ff5 [2629939,15860] 0 2024-04-15T00:39:37.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/959: getdents d3/dd/d2d/d61/df6/d109 0 2024-04-15T00:39:37.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/927: mkdir df/d32/d13c 0 2024-04-15T00:39:37.193 INFO:tasks.workunit.client.0.smithi029.stdout:5/973: creat d2/de/d13/d22/d26/d36/f13b x:0 0 0 2024-04-15T00:39:37.486 INFO:tasks.workunit.client.0.smithi029.stdout:7/941: unlink d0/d6/d4f/d5d/d82/cae 0 2024-04-15T00:39:37.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/986: truncate d5/fdf 896036 0 2024-04-15T00:39:37.506 INFO:tasks.workunit.client.0.smithi029.stdout:6/947: rename d1/c55 to d1/d8/db/d7b/d85/dd2/dab/d123/c138 0 2024-04-15T00:39:37.600 INFO:tasks.workunit.client.0.smithi029.stdout:1/928: creat df/d29/d41/d69/d78/f13d x:0 0 0 2024-04-15T00:39:37.641 INFO:tasks.workunit.client.0.smithi029.stdout:4/930: write de/d6d/fff [1518489,91439] 0 2024-04-15T00:39:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:4/931: chown de/d54/d71/f84 201972794 1 2024-04-15T00:39:37.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/976: getdents d8/da/d117 0 2024-04-15T00:39:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:7/942: fdatasync d0/d6/d4f/d66/d67/ffc 0 2024-04-15T00:39:38.086 INFO:tasks.workunit.client.0.smithi029.stdout:0/987: dread d5/d4c/d4e/f133 [0,4194304] 0 2024-04-15T00:39:38.107 INFO:tasks.workunit.client.0.smithi029.stdout:0/988: chown d5/d15/d68/dff 5712119 1 2024-04-15T00:39:38.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/977: truncate d8/da/f5b 3649450 0 2024-04-15T00:39:38.133 INFO:tasks.workunit.client.0.smithi029.stdout:2/960: creat d3/dd/d2d/f13c x:0 0 0 2024-04-15T00:39:38.136 INFO:tasks.workunit.client.0.smithi029.stdout:3/944: write d17/d2a/d33/df2/f119 [3249538,54007] 0 2024-04-15T00:39:38.348 INFO:tasks.workunit.client.0.smithi029.stdout:6/948: write d1/d8/db/d38/f67 [1062523,19984] 0 2024-04-15T00:39:38.427 INFO:tasks.workunit.client.0.smithi029.stdout:9/914: dwrite d3/d6/d9/d29/d60/d64/d6d/d58/f99 [0,4194304] 0 2024-04-15T00:39:38.496 INFO:tasks.workunit.client.0.smithi029.stdout:9/915: chown d3/d6/d9/d15/d9d/fd0 1413365 1 2024-04-15T00:39:38.515 INFO:tasks.workunit.client.0.smithi029.stdout:1/929: write df/d29/d41/f4e [930275,130802] 0 2024-04-15T00:39:38.539 INFO:tasks.workunit.client.0.smithi029.stdout:7/943: rename d0/d6/d4f/d5d/d65/dbc/l75 to d0/d6/d39/d3c/d5b/dd9/l134 0 2024-04-15T00:39:38.565 INFO:tasks.workunit.client.0.smithi029.stdout:8/978: chown d8/d4a/d78/d23/la5 412581 1 2024-04-15T00:39:38.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/949: dread - d1/d8/d72/da3/faa zero size 2024-04-15T00:39:38.683 INFO:tasks.workunit.client.0.smithi029.stdout:5/974: chown d2/de/d13/d22/d26/d36/d4d/dfb 13810 1 2024-04-15T00:39:38.737 INFO:tasks.workunit.client.0.smithi029.stdout:4/932: creat de/d54/d58/f127 x:0 0 0 2024-04-15T00:39:38.754 INFO:tasks.workunit.client.0.smithi029.stdout:1/930: dread df/d29/d41/d69/d78/f74 [0,4194304] 0 2024-04-15T00:39:38.778 INFO:tasks.workunit.client.0.smithi029.stdout:1/931: readlink df/d29/d41/d69/lda 0 2024-04-15T00:39:38.802 INFO:tasks.workunit.client.0.smithi029.stdout:0/989: mknod d5/db/c145 0 2024-04-15T00:39:38.895 INFO:tasks.workunit.client.0.smithi029.stdout:2/961: dwrite d3/dd/d2d/f37 [0,4194304] 0 2024-04-15T00:39:39.016 INFO:tasks.workunit.client.0.smithi029.stdout:8/979: unlink d8/da/d2f/d6e/dc1/cd8 0 2024-04-15T00:39:39.179 INFO:tasks.workunit.client.0.smithi029.stdout:1/932: symlink df/d29/d41/d96/l13e 0 2024-04-15T00:39:39.201 INFO:tasks.workunit.client.0.smithi029.stdout:5/975: read d2/de/d13/d22/d26/dd7/d118/d9e/fd4 [2086189,75313] 0 2024-04-15T00:39:39.219 INFO:tasks.workunit.client.0.smithi029.stdout:0/990: rename d5/d15/d27/d51/c128 to d5/d15/d27/dbb/d143/c146 0 2024-04-15T00:39:39.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/916: symlink d3/d6/d9/d29/d60/d64/d6d/d58/d110/l11e 0 2024-04-15T00:39:39.419 INFO:tasks.workunit.client.0.smithi029.stdout:8/980: creat d8/da/d2f/d6e/d5a/f147 x:0 0 0 2024-04-15T00:39:39.424 INFO:tasks.workunit.client.0.smithi029.stdout:4/933: symlink de/d6d/l128 0 2024-04-15T00:39:39.442 INFO:tasks.workunit.client.0.smithi029.stdout:2/962: read d3/dd/da0/d112/f12f [3962488,40072] 0 2024-04-15T00:39:39.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/945: link d17/d2f/d44/d5a/c11c d17/d2f/d44/c138 0 2024-04-15T00:39:39.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/963: chown d3/d2a/de4/d12d/l8d 0 1 2024-04-15T00:39:39.602 INFO:tasks.workunit.client.0.smithi029.stdout:4/934: sync 2024-04-15T00:39:39.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/933: creat df/d29/d41/d96/f13f x:0 0 0 2024-04-15T00:39:39.757 INFO:tasks.workunit.client.0.smithi029.stdout:5/976: mkdir d2/de/d13/d22/d3c/d41/dec/d13c 0 2024-04-15T00:39:39.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/991: dread d5/d3e/de3/f95 [0,4194304] 0 2024-04-15T00:39:40.121 INFO:tasks.workunit.client.0.smithi029.stdout:7/944: dwrite d0/d6/d4f/d66/d67/d129/f130 [0,4194304] 0 2024-04-15T00:39:40.287 INFO:tasks.workunit.client.0.smithi029.stdout:6/950: dwrite d1/d8/db/f3b [0,4194304] 0 2024-04-15T00:39:40.386 INFO:tasks.workunit.client.0.smithi029.stdout:2/964: readlink d3/d2a/l6f 0 2024-04-15T00:39:40.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/917: creat d3/d6/d9/d15/d62/d10b/f11f x:0 0 0 2024-04-15T00:39:40.858 INFO:tasks.workunit.client.0.smithi029.stdout:0/992: mknod d5/d15/d27/dbb/d143/c147 0 2024-04-15T00:39:41.243 INFO:tasks.workunit.client.0.smithi029.stdout:2/965: mknod d3/d93/dbe/d117/c13d 0 2024-04-15T00:39:41.261 INFO:tasks.workunit.client.0.smithi029.stdout:8/981: write d8/d4a/d78/d23/d28/d5f/f9a [3325565,118832] 0 2024-04-15T00:39:41.386 INFO:tasks.workunit.client.0.smithi029.stdout:0/993: fdatasync d5/d15/d1f/f73 0 2024-04-15T00:39:41.393 INFO:tasks.workunit.client.0.smithi029.stdout:7/945: truncate d0/d6/f2c 2181754 0 2024-04-15T00:39:41.478 INFO:tasks.workunit.client.0.smithi029.stdout:6/951: symlink d1/d8/db/l139 0 2024-04-15T00:39:41.521 INFO:tasks.workunit.client.0.smithi029.stdout:2/966: symlink d3/dd/da0/d112/l13e 0 2024-04-15T00:39:41.687 INFO:tasks.workunit.client.0.smithi029.stdout:3/946: dwrite d17/d2a/d4c/f8e [0,4194304] 0 2024-04-15T00:39:41.698 INFO:tasks.workunit.client.0.smithi029.stdout:4/935: dwrite de/d2b/d59/fce [4194304,4194304] 0 2024-04-15T00:39:41.797 INFO:tasks.workunit.client.0.smithi029.stdout:9/918: creat d3/d6/d9/d29/d60/def/f120 x:0 0 0 2024-04-15T00:39:41.875 INFO:tasks.workunit.client.0.smithi029.stdout:1/934: dwrite df/d29/d41/d69/d78/dd1/d59/fd7 [0,4194304] 0 2024-04-15T00:39:41.937 INFO:tasks.workunit.client.0.smithi029.stdout:8/982: mkdir d8/da/d2f/d6e/d92/d10c/d148 0 2024-04-15T00:39:41.969 INFO:tasks.workunit.client.0.smithi029.stdout:9/919: sync 2024-04-15T00:39:41.982 INFO:tasks.workunit.client.0.smithi029.stdout:9/920: chown d3/d6/d9/d15/d7e/l9b 3474 1 2024-04-15T00:39:42.093 INFO:tasks.workunit.client.0.smithi029.stdout:3/947: mkdir d17/d2a/d33/d139 0 2024-04-15T00:39:42.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/936: dread de/d3a/fc2 [0,4194304] 0 2024-04-15T00:39:42.235 INFO:tasks.workunit.client.0.smithi029.stdout:6/952: mknod d1/d8/db/d38/d86/d126/c13a 0 2024-04-15T00:39:42.256 INFO:tasks.workunit.client.0.smithi029.stdout:8/983: mknod d8/d4a/c149 0 2024-04-15T00:39:42.280 INFO:tasks.workunit.client.0.smithi029.stdout:3/948: dread d17/d2a/f34 [0,4194304] 0 2024-04-15T00:39:42.307 INFO:tasks.workunit.client.0.smithi029.stdout:8/984: chown d8/da/d2f/d66 548687725 1 2024-04-15T00:39:42.406 INFO:tasks.workunit.client.0.smithi029.stdout:4/937: symlink de/df/d1e/d56/dd3/l129 0 2024-04-15T00:39:42.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/953: truncate d1/d1e/d22/ddd/f114 855345 0 2024-04-15T00:39:42.631 INFO:tasks.workunit.client.0.smithi029.stdout:3/949: stat d17/d2f/d76/d7f/dcd/cf0 0 2024-04-15T00:39:42.771 INFO:tasks.workunit.client.0.smithi029.stdout:5/977: dwrite d2/d1a/f3e [4194304,4194304] 0 2024-04-15T00:39:42.832 INFO:tasks.workunit.client.0.smithi029.stdout:4/938: mkdir de/df/d1e/d56/dd3/d12a 0 2024-04-15T00:39:42.846 INFO:tasks.workunit.client.0.smithi029.stdout:3/950: dread - d17/d2a/d4c/fea zero size 2024-04-15T00:39:43.062 INFO:tasks.workunit.client.0.smithi029.stdout:5/978: mkdir d2/de/d13/d22/d26/dfc/d108/d13d 0 2024-04-15T00:39:43.154 INFO:tasks.workunit.client.0.smithi029.stdout:7/946: dwrite d0/d6/d4f/d66/d37/db7/dda/f57 [0,4194304] 0 2024-04-15T00:39:43.227 INFO:tasks.workunit.client.0.smithi029.stdout:2/967: write d3/dd/d2d/d61/dd5/d4a/f9e [2528832,28278] 0 2024-04-15T00:39:43.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/994: truncate d5/d15/d27/d51/d77/f11b 2960929 0 2024-04-15T00:39:43.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/935: write df/d29/d41/d69/d78/f11e [825775,60322] 0 2024-04-15T00:39:43.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/921: write d3/d6/f17 [2427217,43980] 0 2024-04-15T00:39:43.314 INFO:tasks.workunit.client.0.smithi029.stdout:3/951: mkdir d17/d2a/d4c/d13a 0 2024-04-15T00:39:43.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/968: stat d3/dd/d2d/d61/df6/d109/f123 0 2024-04-15T00:39:43.449 INFO:tasks.workunit.client.0.smithi029.stdout:6/954: truncate d1/d8/d72/da3/d102/d108/d58/f84 178467 0 2024-04-15T00:39:43.492 INFO:tasks.workunit.client.0.smithi029.stdout:8/985: dwrite d8/d4a/d78/d23/f4e [0,4194304] 0 2024-04-15T00:39:43.571 INFO:tasks.workunit.client.0.smithi029.stdout:0/995: read - d5/f137 zero size 2024-04-15T00:39:43.624 INFO:tasks.workunit.client.0.smithi029.stdout:3/952: creat d17/d2a/d33/f13b x:0 0 0 2024-04-15T00:39:43.650 INFO:tasks.workunit.client.0.smithi029.stdout:0/996: dread d5/d3e/de3/f49 [4194304,4194304] 0 2024-04-15T00:39:43.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/953: chown d17/f1b 784577 1 2024-04-15T00:39:43.861 INFO:tasks.workunit.client.0.smithi029.stdout:5/979: dwrite d2/de/f10 [0,4194304] 0 2024-04-15T00:39:44.002 INFO:tasks.workunit.client.0.smithi029.stdout:9/922: mkdir d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe/d121 0 2024-04-15T00:39:44.044 INFO:tasks.workunit.client.0.smithi029.stdout:1/936: dwrite df/d29/d41/f47 [4194304,4194304] 0 2024-04-15T00:39:44.140 INFO:tasks.workunit.client.0.smithi029.stdout:4/939: getdents de/d54 0 2024-04-15T00:39:44.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/940: chown f2 0 1 2024-04-15T00:39:44.449 INFO:tasks.workunit.client.0.smithi029.stdout:3/954: mknod d17/d2a/d33/df2/c13c 0 2024-04-15T00:39:44.453 INFO:tasks.workunit.client.0.smithi029.stdout:7/947: rename d0/d6/d4f/dbb/c4b to d0/d6/d39/c135 0 2024-04-15T00:39:44.471 INFO:tasks.workunit.client.0.smithi029.stdout:3/955: dread - d17/d2a/d33/f13b zero size 2024-04-15T00:39:44.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/969: write d3/dd/d2d/d61/df6/ffc [826707,126136] 0 2024-04-15T00:39:44.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/941: truncate de/d2b/f10d 1646632 0 2024-04-15T00:39:44.622 INFO:tasks.workunit.client.0.smithi029.stdout:6/955: write d1/d8/db/d7b/fbe [668199,120196] 0 2024-04-15T00:39:44.622 INFO:tasks.workunit.client.0.smithi029.stdout:8/986: getdents d8/da/d2f/d6e/d92/d10c/d148 0 2024-04-15T00:39:44.641 INFO:tasks.workunit.client.0.smithi029.stdout:0/997: write d5/db/d1a/d65/d76/fe1 [4073974,63069] 0 2024-04-15T00:39:44.753 INFO:tasks.workunit.client.0.smithi029.stdout:2/970: sync 2024-04-15T00:39:44.881 INFO:tasks.workunit.client.0.smithi029.stdout:7/948: stat d0/d6/ff4 0 2024-04-15T00:39:44.942 INFO:tasks.workunit.client.0.smithi029.stdout:1/937: dwrite df/d29/d41/daf/fe7 [0,4194304] 0 2024-04-15T00:39:44.961 INFO:tasks.workunit.client.0.smithi029.stdout:7/949: sync 2024-04-15T00:39:45.022 INFO:tasks.workunit.client.0.smithi029.stdout:1/938: chown df/d29/d41/d69/d4c/d10e 158585789 1 2024-04-15T00:39:45.244 INFO:tasks.workunit.client.0.smithi029.stdout:3/956: dread f15 [0,4194304] 0 2024-04-15T00:39:45.290 INFO:tasks.workunit.client.0.smithi029.stdout:0/998: chown d5/db/c88 10051070 1 2024-04-15T00:39:45.340 INFO:tasks.workunit.client.0.smithi029.stdout:8/987: read d8/da/d2f/d6e/f47 [3688147,82565] 0 2024-04-15T00:39:45.456 INFO:tasks.workunit.client.0.smithi029.stdout:4/942: creat de/d54/d71/d8b/db1/f12b x:0 0 0 2024-04-15T00:39:45.567 INFO:tasks.workunit.client.0.smithi029.stdout:5/980: rename d2/de/d13/d22/d26/d36/l7d to d2/de/d13/d22/d26/dd7/l13e 0 2024-04-15T00:39:45.660 INFO:tasks.workunit.client.0.smithi029.stdout:7/950: symlink d0/d6/d4f/d5d/d65/dbc/dab/l136 0 2024-04-15T00:39:45.763 INFO:tasks.workunit.client.0.smithi029.stdout:3/957: readlink d17/d2a/d4c/da1/l100 0 2024-04-15T00:39:46.282 INFO:tasks.workunit.client.0.smithi029.stdout:6/956: dwrite d1/d8/f9c [0,4194304] 0 2024-04-15T00:39:46.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/999: symlink d5/d15/d27/d51/l148 0 2024-04-15T00:39:46.710 INFO:tasks.workunit.client.0.smithi029.stdout:6/957: chown d1/d1e/d22/ddd/f114 12387 1 2024-04-15T00:39:46.718 INFO:tasks.workunit.client.0.smithi029.stdout:1/939: write df/da4/dfb/f12d [423087,50651] 0 2024-04-15T00:39:46.739 INFO:tasks.workunit.client.0.smithi029.stdout:6/958: stat d1/d8/db/d7b/d85/f8f 0 2024-04-15T00:39:46.778 INFO:tasks.workunit.client.0.smithi029.stdout:6/959: dread d1/d8/db/fd5 [0,4194304] 0 2024-04-15T00:39:47.052 INFO:tasks.workunit.client.0.smithi029.stdout:5/981: rmdir d2/de/d13/d22/d3c/d41/dec/d13c 0 2024-04-15T00:39:47.060 INFO:tasks.workunit.client.0.smithi029.stdout:1/940: mkdir df/d29/d41/d69/d78/dd1/d59/d10a/d140 0 2024-04-15T00:39:47.064 INFO:tasks.workunit.client.0.smithi029.stdout:8/988: write d8/d4a/d78/d23/d28/d30/f69 [1335890,63783] 0 2024-04-15T00:39:47.148 INFO:tasks.workunit.client.0.smithi029.stdout:6/960: readlink d1/d8/db/d98/l124 0 2024-04-15T00:39:47.259 INFO:tasks.workunit.client.0.smithi029.stdout:9/923: rename d3/d6/d9/f22 to d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f122 0 2024-04-15T00:39:47.264 INFO:tasks.workunit.client.0.smithi029.stdout:8/989: mkdir d8/da/d2f/d14a 0 2024-04-15T00:39:47.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/943: write de/df/f12 [999318,116000] 0 2024-04-15T00:39:47.359 INFO:tasks.workunit.client.0.smithi029.stdout:4/944: chown de/d6d/le9 7354 1 2024-04-15T00:39:47.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/924: truncate d3/d6/d9/d29/d60/d64/d6d/f89 660859 0 2024-04-15T00:39:47.500 INFO:tasks.workunit.client.0.smithi029.stdout:5/982: creat d2/de/d13/d22/d26/dfc/d108/d13d/f13f x:0 0 0 2024-04-15T00:39:47.679 INFO:tasks.workunit.client.0.smithi029.stdout:2/971: dwrite d3/dd/d2d/d61/dd5/d4a/f133 [0,4194304] 0 2024-04-15T00:39:47.873 INFO:tasks.workunit.client.0.smithi029.stdout:5/983: creat d2/d1a/f140 x:0 0 0 2024-04-15T00:39:47.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/972: chown d3/dd/d2d/d61/d85/da2/cff 0 1 2024-04-15T00:39:47.942 INFO:tasks.workunit.client.0.smithi029.stdout:7/951: dwrite d0/d6/d4f/d5d/f6d [0,4194304] 0 2024-04-15T00:39:48.030 INFO:tasks.workunit.client.0.smithi029.stdout:3/958: dwrite d17/d83/f9b [0,4194304] 0 2024-04-15T00:39:48.110 INFO:tasks.workunit.client.0.smithi029.stdout:5/984: chown d2/de/d13/d22/d3c/d41/d6d/f81 32856891 1 2024-04-15T00:39:48.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/945: write de/d3a/ff1 [499646,52795] 0 2024-04-15T00:39:48.371 INFO:tasks.workunit.client.0.smithi029.stdout:7/952: truncate d0/d6/d4f/d66/d67/d129/f12c 770074 0 2024-04-15T00:39:48.382 INFO:tasks.workunit.client.0.smithi029.stdout:9/925: write d3/d6/d9/d29/d60/d64/fc4 [2575705,122476] 0 2024-04-15T00:39:48.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/946: fsync de/d3a/ff1 0 2024-04-15T00:39:48.548 INFO:tasks.workunit.client.0.smithi029.stdout:1/941: dwrite df/d29/d41/d4f/fa0 [0,4194304] 0 2024-04-15T00:39:48.574 INFO:tasks.workunit.client.0.smithi029.stdout:6/961: dwrite d1/d8/db/d7b/d85/f96 [0,4194304] 0 2024-04-15T00:39:48.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/973: write d3/dd/da0/fac [493681,21497] 0 2024-04-15T00:39:48.763 INFO:tasks.workunit.client.0.smithi029.stdout:8/990: dwrite d8/da/d2f/d6e/f101 [0,4194304] 0 2024-04-15T00:39:48.879 INFO:tasks.workunit.client.0.smithi029.stdout:7/953: readlink d0/d6/d4f/d5d/d87/da6/lad 0 2024-04-15T00:39:48.945 INFO:tasks.workunit.client.0.smithi029.stdout:3/959: dread d17/d2a/d4c/f8c [4194304,4194304] 0 2024-04-15T00:39:48.947 INFO:tasks.workunit.client.0.smithi029.stdout:9/926: rmdir d3/d6/d9/d15 39 2024-04-15T00:39:48.969 INFO:tasks.workunit.client.0.smithi029.stdout:1/942: creat df/d32/d90/f141 x:0 0 0 2024-04-15T00:39:48.990 INFO:tasks.workunit.client.0.smithi029.stdout:8/991: stat d8/da/d2f/d6e/dc1 0 2024-04-15T00:39:49.008 INFO:tasks.workunit.client.0.smithi029.stdout:2/974: unlink d3/dd/d42/dd1/ce9 0 2024-04-15T00:39:49.094 INFO:tasks.workunit.client.0.smithi029.stdout:5/985: dwrite d2/de/d13/d22/d26/dd7/d118/d9e/fd4 [0,4194304] 0 2024-04-15T00:39:49.221 INFO:tasks.workunit.client.0.smithi029.stdout:1/943: chown df/d29/d41/d4f/f58 116123914 1 2024-04-15T00:39:49.238 INFO:tasks.workunit.client.0.smithi029.stdout:2/975: fsync d3/d2a/d4e/f125 0 2024-04-15T00:39:49.265 INFO:tasks.workunit.client.0.smithi029.stdout:6/962: dwrite d1/d8/db/d7b/d85/f96 [0,4194304] 0 2024-04-15T00:39:49.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/954: dread d0/d6/d4f/d66/d67/d129/f12c [0,4194304] 0 2024-04-15T00:39:49.356 INFO:tasks.workunit.client.0.smithi029.stdout:3/960: write d17/d2f/d76/d7f/feb [569295,86388] 0 2024-04-15T00:39:49.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/947: link de/df/l13 de/df/d1e/d56/dd3/l12c 0 2024-04-15T00:39:49.426 INFO:tasks.workunit.client.0.smithi029.stdout:1/944: chown c7 3461 1 2024-04-15T00:39:49.432 INFO:tasks.workunit.client.0.smithi029.stdout:3/961: chown d17/f29 193122698 1 2024-04-15T00:39:49.600 INFO:tasks.workunit.client.0.smithi029.stdout:2/976: unlink d3/d2a/ff2 0 2024-04-15T00:39:49.734 INFO:tasks.workunit.client.0.smithi029.stdout:9/927: rename d3/d6/d9/d15/d7e/de6/cea to d3/d6/d9/d29/d60/d7f/df1/c123 0 2024-04-15T00:39:49.751 INFO:tasks.workunit.client.0.smithi029.stdout:1/945: dread - df/d29/fd8 zero size 2024-04-15T00:39:49.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/977: sync 2024-04-15T00:39:49.862 INFO:tasks.workunit.client.0.smithi029.stdout:3/962: truncate d17/d83/f6d 1080585 0 2024-04-15T00:39:49.928 INFO:tasks.workunit.client.0.smithi029.stdout:3/963: dread d17/d2a/f34 [0,4194304] 0 2024-04-15T00:39:49.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/964: readlink d17/l2d 0 2024-04-15T00:39:50.139 INFO:tasks.workunit.client.0.smithi029.stdout:8/992: write d8/d4a/d78/d23/d28/d30/d39/d77/fe8 [1726397,111248] 0 2024-04-15T00:39:50.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/963: fdatasync d1/d8/db/db7/fbd 0 2024-04-15T00:39:50.247 INFO:tasks.workunit.client.0.smithi029.stdout:5/986: write d2/de/d13/d22/d3c/d41/d6d/f81 [813037,16447] 0 2024-04-15T00:39:50.341 INFO:tasks.workunit.client.0.smithi029.stdout:1/946: dread - df/d29/d41/d69/f7f zero size 2024-04-15T00:39:50.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/987: sync 2024-04-15T00:39:50.366 INFO:tasks.workunit.client.0.smithi029.stdout:7/955: write d0/d74/ff7 [1623292,93409] 0 2024-04-15T00:39:50.408 INFO:tasks.workunit.client.0.smithi029.stdout:4/948: rename de/d54/d71/l83 to de/d54/d71/l12d 0 2024-04-15T00:39:50.510 INFO:tasks.workunit.client.0.smithi029.stdout:2/978: truncate d3/dd/d2d/d61/dd5/d95/fd8 1473711 0 2024-04-15T00:39:50.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/928: dread d3/d6/d30/fcc [0,4194304] 0 2024-04-15T00:39:50.627 INFO:tasks.workunit.client.0.smithi029.stdout:8/993: creat d8/d4a/d78/d23/d28/d30/d39/d77/dd3/f14b x:0 0 0 2024-04-15T00:39:50.731 INFO:tasks.workunit.client.0.smithi029.stdout:6/964: truncate d1/f18 7466050 0 2024-04-15T00:39:50.758 INFO:tasks.workunit.client.0.smithi029.stdout:8/994: dread d8/d4a/d78/f6b [0,4194304] 0 2024-04-15T00:39:50.784 INFO:tasks.workunit.client.0.smithi029.stdout:8/995: write d8/d4a/d78/d23/d28/d30/d39/d77/fe8 [6391485,87822] 0 2024-04-15T00:39:50.949 INFO:tasks.workunit.client.0.smithi029.stdout:1/947: rename df/da4/dfb to df/d29/d41/d96/d102/d142 0 2024-04-15T00:39:50.970 INFO:tasks.workunit.client.0.smithi029.stdout:7/956: dread d0/d6/d4f/dbb/d49/fd7 [0,4194304] 0 2024-04-15T00:39:51.229 INFO:tasks.workunit.client.0.smithi029.stdout:2/979: mknod d3/dd/d2d/d61/dd5/c13f 0 2024-04-15T00:39:51.238 INFO:tasks.workunit.client.0.smithi029.stdout:2/980: stat d3/dd/d42/f89 0 2024-04-15T00:39:51.245 INFO:tasks.workunit.client.0.smithi029.stdout:2/981: chown d3/d93/c115 28383739 1 2024-04-15T00:39:51.442 INFO:tasks.workunit.client.0.smithi029.stdout:8/996: mknod d8/da7/c14c 0 2024-04-15T00:39:51.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/965: write d17/d2f/d76/d7f/fac [1373865,30137] 0 2024-04-15T00:39:51.692 INFO:tasks.workunit.client.0.smithi029.stdout:4/949: symlink de/d2b/l12e 0 2024-04-15T00:39:51.910 INFO:tasks.workunit.client.0.smithi029.stdout:2/982: mknod d3/d93/dbe/d117/c140 0 2024-04-15T00:39:51.975 INFO:tasks.workunit.client.0.smithi029.stdout:6/965: mkdir d1/d8/d133/d13b 0 2024-04-15T00:39:52.302 INFO:tasks.workunit.client.0.smithi029.stdout:3/966: mkdir d17/d2a/d46/d67/dd6/d102/d109/d13d 0 2024-04-15T00:39:52.310 INFO:tasks.workunit.client.0.smithi029.stdout:3/967: chown d17/d2f/d84/db1 313 1 2024-04-15T00:39:52.396 INFO:tasks.workunit.client.0.smithi029.stdout:9/929: write d3/d6/d9/d29/d60/d7f/f82 [5316695,63748] 0 2024-04-15T00:39:52.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/968: mkdir d17/d2f/d44/d58/d5c/d5f/dfc/d13e 0 2024-04-15T00:39:52.616 INFO:tasks.workunit.client.0.smithi029.stdout:5/988: mkdir d2/de/d141 0 2024-04-15T00:39:52.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/957: write d0/d6/d4f/d66/d37/db7/dda/f57 [2939941,79370] 0 2024-04-15T00:39:52.689 INFO:tasks.workunit.client.0.smithi029.stdout:9/930: dread d3/d6/d9/d15/fb1 [0,4194304] 0 2024-04-15T00:39:52.770 INFO:tasks.workunit.client.0.smithi029.stdout:1/948: dwrite df/fa7 [0,4194304] 0 2024-04-15T00:39:52.840 INFO:tasks.workunit.client.0.smithi029.stdout:8/997: write d8/da/d2f/d6e/d92/d10c/d112/f12d [1009065,130638] 0 2024-04-15T00:39:52.888 INFO:tasks.workunit.client.0.smithi029.stdout:2/983: write d3/dd/f27 [2602531,128107] 0 2024-04-15T00:39:52.920 INFO:tasks.workunit.client.0.smithi029.stdout:6/966: write d1/f8b [3253153,85330] 0 2024-04-15T00:39:53.080 INFO:tasks.workunit.client.0.smithi029.stdout:6/967: sync 2024-04-15T00:39:53.110 INFO:tasks.workunit.client.0.smithi029.stdout:4/950: dwrite de/d6d/d7e/f117 [4194304,4194304] 0 2024-04-15T00:39:53.218 INFO:tasks.workunit.client.0.smithi029.stdout:6/968: dread d1/d8/db/fd5 [0,4194304] 0 2024-04-15T00:39:53.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/989: write d2/f7 [2250406,78966] 0 2024-04-15T00:39:53.650 INFO:tasks.workunit.client.0.smithi029.stdout:4/951: mknod de/d54/d58/d8a/c12f 0 2024-04-15T00:39:53.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/969: link f1 d17/d2a/d46/d67/dd6/d102/d109/d13d/f13f 0 2024-04-15T00:39:53.779 INFO:tasks.workunit.client.0.smithi029.stdout:7/958: write d0/d6/f64 [2443575,102541] 0 2024-04-15T00:39:53.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/931: dwrite d3/d6/d9/d15/d62/d10b/f11f [0,4194304] 0 2024-04-15T00:39:53.957 INFO:tasks.workunit.client.0.smithi029.stdout:8/998: dwrite d8/da/d2f/d66/f84 [0,4194304] 0 2024-04-15T00:39:53.965 INFO:tasks.workunit.client.0.smithi029.stdout:6/969: write d1/d8/d72/da3/d102/d108/fef [558628,123202] 0 2024-04-15T00:39:53.986 INFO:tasks.workunit.client.0.smithi029.stdout:1/949: dwrite fd [0,4194304] 0 2024-04-15T00:39:54.069 INFO:tasks.workunit.client.0.smithi029.stdout:3/970: dread - d17/d2a/d4c/d93/fd9 zero size 2024-04-15T00:39:54.110 INFO:tasks.workunit.client.0.smithi029.stdout:5/990: stat d2/de/d13/d22/d26/dd7/d118/c73 0 2024-04-15T00:39:54.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/950: sync 2024-04-15T00:39:54.124 INFO:tasks.workunit.client.0.smithi029.stdout:6/970: readlink d1/d8/db/d38/d86/led 0 2024-04-15T00:39:54.157 INFO:tasks.workunit.client.0.smithi029.stdout:2/984: rename d3/dd/d2d/d61/f9f to d3/dd/d42/dc6/f141 0 2024-04-15T00:39:54.192 INFO:tasks.workunit.client.0.smithi029.stdout:6/971: chown d1/d8/d72/da3/d102/d108/dd3/de5/df7/cfc 253865860 1 2024-04-15T00:39:54.236 INFO:tasks.workunit.client.0.smithi029.stdout:6/972: dread d1/d8/d72/fb3 [0,4194304] 0 2024-04-15T00:39:54.287 INFO:tasks.workunit.client.0.smithi029.stdout:9/932: fdatasync d3/f4e 0 2024-04-15T00:39:54.430 INFO:tasks.workunit.client.0.smithi029.stdout:4/952: symlink de/d2b/d35/d124/l130 0 2024-04-15T00:39:54.475 INFO:tasks.workunit.client.0.smithi029.stdout:5/991: rename d2/de/d13/d22/d26/dd7/d118/f84 to d2/de/d13/d22/d3c/d41/d113/f142 0 2024-04-15T00:39:54.572 INFO:tasks.workunit.client.0.smithi029.stdout:6/973: mknod d1/d8/d72/da3/d102/d108/dd3/ddf/c13c 0 2024-04-15T00:39:54.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/974: sync 2024-04-15T00:39:54.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/999: write d8/da/d2f/d66/f104 [1088288,5122] 0 2024-04-15T00:39:54.715 INFO:tasks.workunit.client.0.smithi029.stdout:2/985: truncate d3/d13/fd4 526677 0 2024-04-15T00:39:54.733 INFO:tasks.workunit.client.0.smithi029.stdout:7/959: dwrite d0/d6/d4f/d66/d26/d54/ffe [0,4194304] 0 2024-04-15T00:39:54.828 INFO:tasks.workunit.client.0.smithi029.stdout:4/953: write de/df/d1e/d56/fca [8611740,14721] 0 2024-04-15T00:39:54.953 INFO:tasks.workunit.client.0.smithi029.stdout:7/960: dread - d0/d6/d4f/d66/d67/db8/fc8 zero size 2024-04-15T00:39:54.957 INFO:tasks.workunit.client.0.smithi029.stdout:1/951: dwrite df/d29/d41/f4e [0,4194304] 0 2024-04-15T00:39:55.421 INFO:tasks.workunit.client.0.smithi029.stdout:3/971: creat d17/d2a/f140 x:0 0 0 2024-04-15T00:39:55.485 INFO:tasks.workunit.client.0.smithi029.stdout:2/986: dread - d3/dd/da0/faa zero size 2024-04-15T00:39:55.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/952: readlink df/d29/d41/d69/l56 0 2024-04-15T00:39:55.746 INFO:tasks.workunit.client.0.smithi029.stdout:5/992: dread d2/d1a/f59 [0,4194304] 0 2024-04-15T00:39:55.761 INFO:tasks.workunit.client.0.smithi029.stdout:1/953: chown df/d29/d41/d4f/fde 18032 1 2024-04-15T00:39:55.769 INFO:tasks.workunit.client.0.smithi029.stdout:6/975: truncate d1/d8/db/d7b/d85/dd2/dab/f128 3662124 0 2024-04-15T00:39:55.980 INFO:tasks.workunit.client.0.smithi029.stdout:2/987: creat d3/dd/da0/f142 x:0 0 0 2024-04-15T00:39:56.232 INFO:tasks.workunit.client.0.smithi029.stdout:1/954: fdatasync df/f2d 0 2024-04-15T00:39:56.300 INFO:tasks.workunit.client.0.smithi029.stdout:6/976: mkdir d1/d8/d72/da3/d102/d108/dd3/de5/d13d 0 2024-04-15T00:39:56.397 INFO:tasks.workunit.client.0.smithi029.stdout:3/972: truncate d17/d2a/d4c/d93/f131 3281506 0 2024-04-15T00:39:56.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/988: unlink d3/dd/d42/f76 0 2024-04-15T00:39:56.547 INFO:tasks.workunit.client.0.smithi029.stdout:1/955: mkdir df/d29/d41/d69/d78/dd1/d59/dd9/d143 0 2024-04-15T00:39:56.750 INFO:tasks.workunit.client.0.smithi029.stdout:7/961: link d0/d6/d4f/d5d/d65/dbc/dab/l110 d0/d6/d4f/d66/d26/l137 0 2024-04-15T00:39:56.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/993: creat d2/de/d1f/f143 x:0 0 0 2024-04-15T00:39:56.774 INFO:tasks.workunit.client.0.smithi029.stdout:9/933: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f122 [6208374,38694] 0 2024-04-15T00:39:56.819 INFO:tasks.workunit.client.0.smithi029.stdout:7/962: chown d0/d6/d39/d3c/l41 67 1 2024-04-15T00:39:56.941 INFO:tasks.workunit.client.0.smithi029.stdout:6/977: mkdir d1/d1e/d13e 0 2024-04-15T00:39:56.944 INFO:tasks.workunit.client.0.smithi029.stdout:1/956: unlink df/d29/d41/d4f/fde 0 2024-04-15T00:39:57.109 INFO:tasks.workunit.client.0.smithi029.stdout:9/934: creat d3/d6/d9/d29/d60/d64/dfc/f124 x:0 0 0 2024-04-15T00:39:57.121 INFO:tasks.workunit.client.0.smithi029.stdout:9/935: chown d3/d6/d9/d15/fb1 614186275 1 2024-04-15T00:39:57.143 INFO:tasks.workunit.client.0.smithi029.stdout:9/936: fsync d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f122 0 2024-04-15T00:39:57.280 INFO:tasks.workunit.client.0.smithi029.stdout:7/963: dread d0/d6/d4f/d5d/f6d [0,4194304] 0 2024-04-15T00:39:57.285 INFO:tasks.workunit.client.0.smithi029.stdout:1/957: read df/d29/d41/d69/d4c/f75 [2751477,43629] 0 2024-04-15T00:39:57.309 INFO:tasks.workunit.client.0.smithi029.stdout:4/954: dwrite de/d54/d71/d8b/da7/fd0 [0,4194304] 0 2024-04-15T00:39:57.404 INFO:tasks.workunit.client.0.smithi029.stdout:9/937: creat d3/da3/d103/f125 x:0 0 0 2024-04-15T00:39:57.425 INFO:tasks.workunit.client.0.smithi029.stdout:7/964: readlink d0/d6/d39/d3c/d5b/d7e/l11a 0 2024-04-15T00:39:57.553 INFO:tasks.workunit.client.0.smithi029.stdout:5/994: creat d2/de/d13/d22/d26/d36/d4d/d70/d8d/f144 x:0 0 0 2024-04-15T00:39:57.653 INFO:tasks.workunit.client.0.smithi029.stdout:7/965: symlink d0/d6/d4f/d66/l138 0 2024-04-15T00:39:57.815 INFO:tasks.workunit.client.0.smithi029.stdout:1/958: truncate df/d29/d41/d69/d78/fdb 1045292 0 2024-04-15T00:39:57.942 INFO:tasks.workunit.client.0.smithi029.stdout:9/938: dread d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f93 [0,4194304] 0 2024-04-15T00:39:58.218 INFO:tasks.workunit.client.0.smithi029.stdout:4/955: mkdir de/df/d1e/d56/dd3/d12a/d131 0 2024-04-15T00:39:58.286 INFO:tasks.workunit.client.0.smithi029.stdout:3/973: dwrite d17/d2f/d44/d5a/fcb [0,4194304] 0 2024-04-15T00:39:58.293 INFO:tasks.workunit.client.0.smithi029.stdout:2/989: dwrite d3/d93/dbe/d117/fdc [0,4194304] 0 2024-04-15T00:39:58.432 INFO:tasks.workunit.client.0.smithi029.stdout:5/995: symlink d2/de/d13/d22/d26/l145 0 2024-04-15T00:39:58.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/990: sync 2024-04-15T00:39:58.642 INFO:tasks.workunit.client.0.smithi029.stdout:6/978: dwrite d1/d8/d72/da3/fa5 [0,4194304] 0 2024-04-15T00:39:58.758 INFO:tasks.workunit.client.0.smithi029.stdout:9/939: write d3/d6/d9/d29/f4c [3215889,57695] 0 2024-04-15T00:39:58.759 INFO:tasks.workunit.client.0.smithi029.stdout:7/966: dread d0/d6/d4f/d66/d7b/fff [0,4194304] 0 2024-04-15T00:39:58.948 INFO:tasks.workunit.client.0.smithi029.stdout:1/959: mkdir df/d29/d41/d69/d4c/d144 0 2024-04-15T00:39:58.970 INFO:tasks.workunit.client.0.smithi029.stdout:2/991: stat d3/d13/f2f 0 2024-04-15T00:39:59.095 INFO:tasks.workunit.client.0.smithi029.stdout:3/974: write d17/d2a/d33/d37/f99 [1527599,16035] 0 2024-04-15T00:39:59.372 INFO:tasks.workunit.client.0.smithi029.stdout:6/979: rmdir d1/d8/d72/da3/d102/d108/dd3/de5/d104 39 2024-04-15T00:39:59.378 INFO:tasks.workunit.client.0.smithi029.stdout:9/940: fsync d3/d6/d9/d29/d60/d7f/fc2 0 2024-04-15T00:39:59.387 INFO:tasks.workunit.client.0.smithi029.stdout:4/956: symlink de/d54/d71/d8b/da7/d123/l132 0 2024-04-15T00:39:59.431 INFO:tasks.workunit.client.0.smithi029.stdout:1/960: creat df/d32/dbf/f145 x:0 0 0 2024-04-15T00:39:59.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/992: creat d3/d53/f143 x:0 0 0 2024-04-15T00:39:59.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/967: symlink d0/d6/d4f/d66/d26/d77/l139 0 2024-04-15T00:39:59.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/993: sync 2024-04-15T00:39:59.659 INFO:tasks.workunit.client.0.smithi029.stdout:4/957: fsync de/d54/f81 0 2024-04-15T00:39:59.769 INFO:tasks.workunit.client.0.smithi029.stdout:9/941: mknod d3/d6/d9/d15/d4a/d53/c126 0 2024-04-15T00:39:59.856 INFO:tasks.workunit.client.0.smithi029.stdout:9/942: dwrite d3/d6/d9/d29/f4c [0,4194304] 0 2024-04-15T00:39:59.957 INFO:tasks.workunit.client.0.smithi029.stdout:3/975: mknod d17/d2f/d44/d58/d5c/d5f/dfc/d13e/c141 0 2024-04-15T00:40:00.004 INFO:tasks.workunit.client.0.smithi029.stdout:7/968: stat d0/d6/d4f/d66/d26/d77/fc6 0 2024-04-15T00:40:00.412 INFO:tasks.workunit.client.0.smithi029.stdout:4/958: fsync de/d2b/f2a 0 2024-04-15T00:40:00.437 INFO:tasks.workunit.client.0.smithi029.stdout:4/959: write de/d54/d71/d8b/da7/fd0 [4373883,10540] 0 2024-04-15T00:40:00.464 INFO:tasks.workunit.client.0.smithi029.stdout:2/994: rename d3/dd/d2d/d61/dd5/d4a/l54 to d3/dd/d42/dc6/dee/l144 0 2024-04-15T00:40:00.480 INFO:tasks.workunit.client.0.smithi029.stdout:2/995: stat d3/d50/d51/d65 0 2024-04-15T00:40:00.532 INFO:tasks.workunit.client.0.smithi029.stdout:6/980: mknod d1/d8/d72/da3/d102/d108/d58/d59/c13f 0 2024-04-15T00:40:00.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:40:00.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:40:00.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/961: write df/d29/d41/daf/fe7 [4143005,41750] 0 2024-04-15T00:40:01.010 INFO:tasks.workunit.client.0.smithi029.stdout:5/996: link d2/de/d13/d22/d26/d36/c64 d2/de/d13/daa/dc3/c146 0 2024-04-15T00:40:01.188 INFO:tasks.workunit.client.0.smithi029.stdout:3/976: mkdir d17/d2f/d44/d58/d108/d113/d142 0 2024-04-15T00:40:01.350 INFO:tasks.workunit.client.0.smithi029.stdout:9/943: rename d3/d6/d9/d29/lb6 to d3/d6/d9/d29/d60/d7f/df1/l127 0 2024-04-15T00:40:01.436 INFO:tasks.workunit.client.0.smithi029.stdout:1/962: fsync df/d29/d41/d69/d78/dea/f11b 0 2024-04-15T00:40:01.737 INFO:tasks.workunit.client.0.smithi029.stdout:7/969: mkdir d0/d6/d4f/d66/d67/de3/d13a 0 2024-04-15T00:40:02.133 INFO:tasks.workunit.client.0.smithi029.stdout:6/981: creat d1/d1e/f140 x:0 0 0 2024-04-15T00:40:02.228 INFO:tasks.workunit.client.0.smithi029.stdout:9/944: mkdir d3/d6/d9/d29/d60/d128 0 2024-04-15T00:40:02.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/996: rename d3/dd/d2d/d61/d85/da2/cef to d3/d13/c145 0 2024-04-15T00:40:02.455 INFO:tasks.workunit.client.0.smithi029.stdout:9/945: unlink d3/d6/d9/d29/d60/d64/cbc 0 2024-04-15T00:40:02.704 INFO:tasks.workunit.client.0.smithi029.stdout:4/960: dwrite de/fd2 [0,4194304] 0 2024-04-15T00:40:02.800 INFO:tasks.workunit.client.0.smithi029.stdout:5/997: getdents d2/de/d13/d22/d26/dfc/d108 0 2024-04-15T00:40:02.803 INFO:tasks.workunit.client.0.smithi029.stdout:3/977: getdents d17/d2f/d44 0 2024-04-15T00:40:02.914 INFO:tasks.workunit.client.0.smithi029.stdout:3/978: chown d17/d2f/d44/d58/lb0 1 1 2024-04-15T00:40:02.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/997: dread d3/d2a/d4e/f125 [0,4194304] 0 2024-04-15T00:40:02.982 INFO:tasks.workunit.client.0.smithi029.stdout:7/970: write d0/d6/d4f/d66/d37/f7a [417562,61583] 0 2024-04-15T00:40:02.984 INFO:tasks.workunit.client.0.smithi029.stdout:1/963: write df/f2d [3940225,80284] 0 2024-04-15T00:40:03.024 INFO:tasks.workunit.client.0.smithi029.stdout:3/979: read d17/d2a/d4c/d93/fd7 [648574,50268] 0 2024-04-15T00:40:03.043 INFO:tasks.workunit.client.0.smithi029.stdout:1/964: chown df/d29/d41/d69/d4c/df4 6733 1 2024-04-15T00:40:03.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/982: creat d1/d8/d72/da3/d102/d108/d58/f141 x:0 0 0 2024-04-15T00:40:03.342 INFO:tasks.workunit.client.0.smithi029.stdout:9/946: write d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb3 [1231330,6507] 0 2024-04-15T00:40:03.356 INFO:tasks.workunit.client.0.smithi029.stdout:5/998: creat d2/da5/dc8/f147 x:0 0 0 2024-04-15T00:40:03.382 INFO:tasks.workunit.client.0.smithi029.stdout:7/971: dread - d0/d6/d4f/d66/d67/ffc zero size 2024-04-15T00:40:03.383 INFO:tasks.workunit.client.0.smithi029.stdout:3/980: fsync d17/d2a/ff5 0 2024-04-15T00:40:03.387 INFO:tasks.workunit.client.0.smithi029.stdout:1/965: rmdir df/d29/d41 39 2024-04-15T00:40:03.543 INFO:tasks.workunit.client.0.smithi029.stdout:4/961: mknod de/d2b/c133 0 2024-04-15T00:40:03.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/981: dread d17/d2f/d44/f87 [0,4194304] 0 2024-04-15T00:40:03.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/998: dread d3/d13/f97 [0,4194304] 0 2024-04-15T00:40:03.673 INFO:tasks.workunit.client.0.smithi029.stdout:4/962: chown de/d54/d58/f5b 364 1 2024-04-15T00:40:03.752 INFO:tasks.workunit.client.0.smithi029.stdout:9/947: mkdir d3/d6/d9/d29/d60/d64/da8/d129 0 2024-04-15T00:40:03.847 INFO:tasks.workunit.client.0.smithi029.stdout:5/999: mkdir d2/de/d13/d22/de6/d148 0 2024-04-15T00:40:03.909 INFO:tasks.workunit.client.0.smithi029.stdout:4/963: creat de/d54/d71/d8b/da7/d112/f134 x:0 0 0 2024-04-15T00:40:03.962 INFO:tasks.workunit.client.0.smithi029.stdout:6/983: dwrite d1/d1e/f7e [4194304,4194304] 0 2024-04-15T00:40:04.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/999: rename d3/d2a/de4/d12d/c7f to d3/dd/d2d/d61/d85/da2/c146 0 2024-04-15T00:40:04.138 INFO:tasks.workunit.client.0.smithi029.stdout:7/972: dwrite d0/d6/d4f/d5d/f5e [0,4194304] 0 2024-04-15T00:40:04.296 INFO:tasks.workunit.client.0.smithi029.stdout:9/948: mknod d3/d6/d9/d15/c12a 0 2024-04-15T00:40:04.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/984: unlink d1/d8/db/c10a 0 2024-04-15T00:40:04.556 INFO:tasks.workunit.client.0.smithi029.stdout:9/949: sync 2024-04-15T00:40:04.643 INFO:tasks.workunit.client.0.smithi029.stdout:1/966: write df/d29/d41/d69/d78/dd1/d80/fe4 [5679951,18837] 0 2024-04-15T00:40:04.645 INFO:tasks.workunit.client.0.smithi029.stdout:4/964: write de/d54/d71/f11d [341662,24124] 0 2024-04-15T00:40:04.683 INFO:tasks.workunit.client.0.smithi029.stdout:6/985: chown d1/d8/d72/da3/d102/d108/cae 20 1 2024-04-15T00:40:04.789 INFO:tasks.workunit.client.0.smithi029.stdout:4/965: dread - de/df/ffd zero size 2024-04-15T00:40:04.814 INFO:tasks.workunit.client.0.smithi029.stdout:7/973: dread d0/d74/ff7 [0,4194304] 0 2024-04-15T00:40:04.846 INFO:tasks.workunit.client.0.smithi029.stdout:3/982: dwrite d17/d2f/d76/fe8 [0,4194304] 0 2024-04-15T00:40:04.925 INFO:tasks.workunit.client.0.smithi029.stdout:9/950: symlink d3/d6/d9/d29/d60/d64/da8/l12b 0 2024-04-15T00:40:04.934 INFO:tasks.workunit.client.0.smithi029.stdout:4/966: dread - de/df/ffd zero size 2024-04-15T00:40:05.025 INFO:tasks.workunit.client.0.smithi029.stdout:1/967: dread df/d29/f13b [0,4194304] 0 2024-04-15T00:40:05.144 INFO:tasks.workunit.client.0.smithi029.stdout:6/986: fdatasync d1/d8/db/d38/d6f/fa7 0 2024-04-15T00:40:05.437 INFO:tasks.workunit.client.0.smithi029.stdout:3/983: symlink d17/d2f/d76/d7f/dcd/l143 0 2024-04-15T00:40:05.478 INFO:tasks.workunit.client.0.smithi029.stdout:4/967: rmdir de/d54/d71/d8b/da7 39 2024-04-15T00:40:05.828 INFO:tasks.workunit.client.0.smithi029.stdout:3/984: stat d17/d2f/d76/f7a 0 2024-04-15T00:40:05.828 INFO:tasks.workunit.client.0.smithi029.stdout:9/951: creat d3/d6/d9/d15/d4a/d10e/f12c x:0 0 0 2024-04-15T00:40:05.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/987: dread d1/d8/db/d7b/d85/f96 [0,4194304] 0 2024-04-15T00:40:06.050 INFO:tasks.workunit.client.0.smithi029.stdout:3/985: dread d17/f1b [0,4194304] 0 2024-04-15T00:40:06.203 INFO:tasks.workunit.client.0.smithi029.stdout:4/968: rename de/df to de/d54/d71/d8b/d135 0 2024-04-15T00:40:06.208 INFO:tasks.workunit.client.0.smithi029.stdout:7/974: write d0/d6/f123 [425351,43922] 0 2024-04-15T00:40:06.356 INFO:tasks.workunit.client.0.smithi029.stdout:9/952: getdents d3/da3/da7 0 2024-04-15T00:40:06.409 INFO:tasks.workunit.client.0.smithi029.stdout:7/975: stat d0/d6/da2/c121 0 2024-04-15T00:40:06.432 INFO:tasks.workunit.client.0.smithi029.stdout:3/986: dread d17/d2a/d33/d37/f99 [0,4194304] 0 2024-04-15T00:40:06.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/988: symlink d1/d8/d72/da3/d102/d108/dd3/de5/l142 0 2024-04-15T00:40:06.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/989: sync 2024-04-15T00:40:06.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/968: write df/d29/d41/d69/d4c/d7a/fa6 [2819614,19329] 0 2024-04-15T00:40:06.731 INFO:tasks.workunit.client.0.smithi029.stdout:9/953: symlink d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/l12d 0 2024-04-15T00:40:06.818 INFO:tasks.workunit.client.0.smithi029.stdout:6/990: truncate d1/d8/db/d7b/d85/f8f 2554850 0 2024-04-15T00:40:06.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/976: chown d0/d6/d4f/dbb/d49/c72 18 1 2024-04-15T00:40:06.879 INFO:tasks.workunit.client.0.smithi029.stdout:1/969: rmdir df/d32/d90/dc1 39 2024-04-15T00:40:07.066 INFO:tasks.workunit.client.0.smithi029.stdout:6/991: dread d1/d8/db/f15 [0,4194304] 0 2024-04-15T00:40:07.290 INFO:tasks.workunit.client.0.smithi029.stdout:9/954: rmdir d3 39 2024-04-15T00:40:07.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/992: truncate d1/d8/db/f40 9096039 0 2024-04-15T00:40:07.310 INFO:tasks.workunit.client.0.smithi029.stdout:4/969: write f8 [1701277,69851] 0 2024-04-15T00:40:07.396 INFO:tasks.workunit.client.0.smithi029.stdout:1/970: write df/d29/fe5 [4335734,34460] 0 2024-04-15T00:40:07.451 INFO:tasks.workunit.client.0.smithi029.stdout:4/970: stat de/d3a/daa/db6/l126 0 2024-04-15T00:40:07.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/987: dwrite d17/f29 [4194304,4194304] 0 2024-04-15T00:40:07.596 INFO:tasks.workunit.client.0.smithi029.stdout:9/955: read - d3/da3/f119 zero size 2024-04-15T00:40:07.660 INFO:tasks.workunit.client.0.smithi029.stdout:7/977: dwrite d0/d6/d4f/d66/d37/dde/fe6 [0,4194304] 0 2024-04-15T00:40:07.806 INFO:tasks.workunit.client.0.smithi029.stdout:3/988: write d17/d2a/d46/fae [151174,48640] 0 2024-04-15T00:40:07.905 INFO:tasks.workunit.client.0.smithi029.stdout:1/971: dwrite df/f13a [0,4194304] 0 2024-04-15T00:40:07.918 INFO:tasks.workunit.client.0.smithi029.stdout:9/956: dread - d3/d6/d9/d29/d60/d7f/da0/ffb zero size 2024-04-15T00:40:08.008 INFO:tasks.workunit.client.0.smithi029.stdout:6/993: rename d1/d8/d72/da3/d102/d108/d58/d59/f60 to d1/d8/db/d98/dfd/f143 0 2024-04-15T00:40:08.016 INFO:tasks.workunit.client.0.smithi029.stdout:4/971: dread de/d6d/fff [0,4194304] 0 2024-04-15T00:40:08.059 INFO:tasks.workunit.client.0.smithi029.stdout:6/994: chown d1/d8/db/d7b/d85/lac 1071644 1 2024-04-15T00:40:08.251 INFO:tasks.workunit.client.0.smithi029.stdout:3/989: symlink d17/d2f/l144 0 2024-04-15T00:40:08.272 INFO:tasks.workunit.client.0.smithi029.stdout:9/957: mknod d3/d6/d9/d29/d60/d64/d6d/d58/d6a/d97/c12e 0 2024-04-15T00:40:08.307 INFO:tasks.workunit.client.0.smithi029.stdout:1/972: dread df/f3c [0,4194304] 0 2024-04-15T00:40:08.396 INFO:tasks.workunit.client.0.smithi029.stdout:6/995: mkdir d1/db9/d144 0 2024-04-15T00:40:08.503 INFO:tasks.workunit.client.0.smithi029.stdout:9/958: mkdir d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe/d12f 0 2024-04-15T00:40:08.517 INFO:tasks.workunit.client.0.smithi029.stdout:7/978: dwrite d0/d6/d4f/d66/d67/f73 [4194304,4194304] 0 2024-04-15T00:40:08.518 INFO:tasks.workunit.client.0.smithi029.stdout:4/972: dwrite de/d2b/f2a [0,4194304] 0 2024-04-15T00:40:08.650 INFO:tasks.workunit.client.0.smithi029.stdout:6/996: creat d1/d1e/d22/ddd/f145 x:0 0 0 2024-04-15T00:40:08.691 INFO:tasks.workunit.client.0.smithi029.stdout:1/973: unlink df/d32/d90/dc1/fd4 0 2024-04-15T00:40:08.824 INFO:tasks.workunit.client.0.smithi029.stdout:3/990: rename d17/d2f/d44/f66 to d17/d2a/d46/d67/dd6/f145 0 2024-04-15T00:40:08.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/997: dread - d1/d8/d72/fe6 zero size 2024-04-15T00:40:08.951 INFO:tasks.workunit.client.0.smithi029.stdout:6/998: chown d1/d8/db/d7b/d91 602333 1 2024-04-15T00:40:09.124 INFO:tasks.workunit.client.0.smithi029.stdout:7/979: rename d0/d6/d4f/d66 to d0/d6/d4f/dbb/d49/d11c/d13b 0 2024-04-15T00:40:09.615 INFO:tasks.workunit.client.0.smithi029.stdout:6/999: write d1/d8/db/f119 [73581,63836] 0 2024-04-15T00:40:09.724 INFO:tasks.workunit.client.0.smithi029.stdout:7/980: symlink d0/d6/d4f/d5d/l13c 0 2024-04-15T00:40:09.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/974: dwrite df/d29/d41/d69/d78/fb4 [0,4194304] 0 2024-04-15T00:40:09.803 INFO:tasks.workunit.client.0.smithi029.stdout:9/959: dwrite d3/d6/d9/d15/d62/d10b/f11f [0,4194304] 0 2024-04-15T00:40:09.867 INFO:tasks.workunit.client.0.smithi029.stdout:4/973: link de/d3a/daa/db6/f11c de/d54/d71/d8b/da7/f136 0 2024-04-15T00:40:09.961 INFO:tasks.workunit.client.0.smithi029.stdout:9/960: rename d3/d6/d9/d29/d60/d64/d6d/d58 to d3/d6/d9/d29/d60/d64/d6d/d58/d110/d130 22 2024-04-15T00:40:09.979 INFO:tasks.workunit.client.0.smithi029.stdout:9/961: chown d3/d6/d9/d29/d60/d64/d6d/d58/d110/l11e 44460395 1 2024-04-15T00:40:10.320 INFO:tasks.workunit.client.0.smithi029.stdout:7/981: fsync d0/d6/d4f/d5d/d82/f12a 0 2024-04-15T00:40:10.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/991: fdatasync d17/d2f/d44/d58/d5c/d5f/dfc/f10a 0 2024-04-15T00:40:10.662 INFO:tasks.workunit.client.0.smithi029.stdout:7/982: rename d0/d6/d39/f98 to d0/d6/d39/d107/f13d 0 2024-04-15T00:40:10.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/962: mkdir d3/d6/d131 0 2024-04-15T00:40:11.069 INFO:tasks.workunit.client.0.smithi029.stdout:7/983: truncate d0/d6/d4f/d5d/d8d/f117 906792 0 2024-04-15T00:40:11.098 INFO:tasks.workunit.client.0.smithi029.stdout:4/974: write de/d54/d58/d8a/f98 [2228058,16334] 0 2024-04-15T00:40:11.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/975: write df/d29/d41/d96/fd6 [191308,65019] 0 2024-04-15T00:40:11.222 INFO:tasks.workunit.client.0.smithi029.stdout:7/984: dread - d0/d6/d4f/d5d/d65/f131 zero size 2024-04-15T00:40:11.472 INFO:tasks.workunit.client.0.smithi029.stdout:7/985: truncate d0/d6/d39/d3c/d5b/f63 1593433 0 2024-04-15T00:40:11.477 INFO:tasks.workunit.client.0.smithi029.stdout:9/963: write d3/d6/d9/d29/d60/d64/d6d/f91 [732670,34886] 0 2024-04-15T00:40:11.513 INFO:tasks.workunit.client.0.smithi029.stdout:4/975: truncate de/d2b/d59/fd7 961315 0 2024-04-15T00:40:11.522 INFO:tasks.workunit.client.0.smithi029.stdout:7/986: write d0/d6/d4f/dbb/d49/d11c/d13b/d67/f73 [4771398,128550] 0 2024-04-15T00:40:11.550 INFO:tasks.workunit.client.0.smithi029.stdout:3/992: getdents d17/d2f/d76/de1 0 2024-04-15T00:40:11.641 INFO:tasks.workunit.client.0.smithi029.stdout:1/976: dwrite df/d29/d41/d69/d4c/f5c [0,4194304] 0 2024-04-15T00:40:11.777 INFO:tasks.workunit.client.0.smithi029.stdout:7/987: mkdir d0/d6/d4f/d5d/d65/dbc/dab/d13e 0 2024-04-15T00:40:11.787 INFO:tasks.workunit.client.0.smithi029.stdout:3/993: creat d17/d2f/d44/d58/d108/f146 x:0 0 0 2024-04-15T00:40:11.879 INFO:tasks.workunit.client.0.smithi029.stdout:9/964: dwrite d3/f1b [0,4194304] 0 2024-04-15T00:40:11.921 INFO:tasks.workunit.client.0.smithi029.stdout:1/977: sync 2024-04-15T00:40:11.967 INFO:tasks.workunit.client.0.smithi029.stdout:3/994: mkdir d17/d2f/d44/d58/d5c/d5f/dfc/d147 0 2024-04-15T00:40:12.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/976: write de/d54/d71/db5/ff4 [937034,58188] 0 2024-04-15T00:40:12.242 INFO:tasks.workunit.client.0.smithi029.stdout:1/978: rename df/d29/d41/d69/d78/dd1/d80/d94/lad to df/d32/dbf/l146 0 2024-04-15T00:40:12.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/977: chown de/d2b/d35/f69 7 1 2024-04-15T00:40:12.284 INFO:tasks.workunit.client.0.smithi029.stdout:4/978: readlink de/d3a/la8 0 2024-04-15T00:40:12.346 INFO:tasks.workunit.client.0.smithi029.stdout:1/979: sync 2024-04-15T00:40:12.358 INFO:tasks.workunit.client.0.smithi029.stdout:9/965: write d3/da3/f119 [678008,46746] 0 2024-04-15T00:40:12.360 INFO:tasks.workunit.client.0.smithi029.stdout:7/988: write d0/d6/f18 [5178722,115867] 0 2024-04-15T00:40:12.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/995: getdents d17/d2f 0 2024-04-15T00:40:12.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/966: dread d3/f34 [0,4194304] 0 2024-04-15T00:40:12.714 INFO:tasks.workunit.client.0.smithi029.stdout:1/980: truncate df/d29/d41/d69/d4c/f138 849872 0 2024-04-15T00:40:12.727 INFO:tasks.workunit.client.0.smithi029.stdout:4/979: link de/d54/d71/d8b/db1/dd5/cf3 de/d54/d71/d8b/d135/d1e/c137 0 2024-04-15T00:40:12.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/989: dwrite d0/d6/f18 [4194304,4194304] 0 2024-04-15T00:40:12.902 INFO:tasks.workunit.client.0.smithi029.stdout:7/990: readlink d0/d6/l53 0 2024-04-15T00:40:12.941 INFO:tasks.workunit.client.0.smithi029.stdout:3/996: dwrite d17/d2a/d46/f11b [0,4194304] 0 2024-04-15T00:40:13.042 INFO:tasks.workunit.client.0.smithi029.stdout:1/981: creat df/d32/f147 x:0 0 0 2024-04-15T00:40:13.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/997: dread - d17/d2f/d84/f11a zero size 2024-04-15T00:40:13.420 INFO:tasks.workunit.client.0.smithi029.stdout:1/982: read df/f16 [2716330,104074] 0 2024-04-15T00:40:13.432 INFO:tasks.workunit.client.0.smithi029.stdout:9/967: link d3/da3/da7/cd2 d3/d6/d9/d29/d60/d128/c132 0 2024-04-15T00:40:13.457 INFO:tasks.workunit.client.0.smithi029.stdout:4/980: link de/d54/d58/d8a/la2 de/d54/d71/d8b/db1/dd5/l138 0 2024-04-15T00:40:13.639 INFO:tasks.workunit.client.0.smithi029.stdout:9/968: fsync d3/d6/f17 0 2024-04-15T00:40:13.639 INFO:tasks.workunit.client.0.smithi029.stdout:4/981: mknod de/d3a/daa/c139 0 2024-04-15T00:40:13.650 INFO:tasks.workunit.client.0.smithi029.stdout:1/983: rename df/d29/d41/d69/d4c/df4/ffa to df/d29/d41/d69/d78/dd1/d109/f148 0 2024-04-15T00:40:13.650 INFO:tasks.workunit.client.0.smithi029.stdout:3/998: read - d17/d2f/d44/d58/d108/d113/f136 zero size 2024-04-15T00:40:13.755 INFO:tasks.workunit.client.0.smithi029.stdout:4/982: sync 2024-04-15T00:40:13.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/969: read d3/d6/f13 [1968943,52171] 0 2024-04-15T00:40:14.072 INFO:tasks.workunit.client.0.smithi029.stdout:7/991: dwrite d0/d6/d4f/dbb/d49/d11c/d13b/d67/f101 [0,4194304] 0 2024-04-15T00:40:14.148 INFO:tasks.workunit.client.0.smithi029.stdout:3/999: rename d17/d2f/d44/d58/d5c/d5f/fbf to d17/f148 0 2024-04-15T00:40:14.154 INFO:tasks.workunit.client.0.smithi029.stdout:9/970: symlink d3/da3/da7/l133 0 2024-04-15T00:40:14.201 INFO:tasks.workunit.client.0.smithi029.stdout:1/984: dwrite df/d29/fd8 [0,4194304] 0 2024-04-15T00:40:14.287 INFO:tasks.workunit.client.0.smithi029.stdout:4/983: getdents de/d6d 0 2024-04-15T00:40:14.323 INFO:tasks.workunit.client.0.smithi029.stdout:9/971: chown d3/d6/d9/d29/d60/d7f/ld5 486 1 2024-04-15T00:40:14.460 INFO:tasks.workunit.client.0.smithi029.stdout:9/972: symlink d3/d6/d9/d15/d4a/da9/l134 0 2024-04-15T00:40:14.470 INFO:tasks.workunit.client.0.smithi029.stdout:7/992: dread d0/d6/d4f/dbb/d49/d11c/d13b/d26/f51 [0,4194304] 0 2024-04-15T00:40:14.529 INFO:tasks.workunit.client.0.smithi029.stdout:1/985: creat df/d29/d41/d69/d78/dd1/d59/d10a/d140/f149 x:0 0 0 2024-04-15T00:40:14.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/984: mknod de/d3a/c13a 0 2024-04-15T00:40:14.548 INFO:tasks.workunit.client.0.smithi029.stdout:1/986: dread - df/f9e zero size 2024-04-15T00:40:14.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/973: mknod d3/da3/d103/c135 0 2024-04-15T00:40:14.622 INFO:tasks.workunit.client.0.smithi029.stdout:7/993: mkdir d0/d6/d4f/d5d/d82/d13f 0 2024-04-15T00:40:14.633 INFO:tasks.workunit.client.0.smithi029.stdout:9/974: chown d3/da3/d103 16 1 2024-04-15T00:40:14.690 INFO:tasks.workunit.client.0.smithi029.stdout:7/994: chown d0/d6/l45 205 1 2024-04-15T00:40:14.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/995: chown d0/d6/d4f/dbb/d49/d11c/d13b/d67/d129/f130 12625718 1 2024-04-15T00:40:14.782 INFO:tasks.workunit.client.0.smithi029.stdout:1/987: symlink df/d29/d41/d69/d4c/d7a/d12f/l14a 0 2024-04-15T00:40:14.787 INFO:tasks.workunit.client.0.smithi029.stdout:9/975: dread - d3/d6/d9/d15/de8/f118 zero size 2024-04-15T00:40:14.997 INFO:tasks.workunit.client.0.smithi029.stdout:4/985: link de/d54/d58/d8a/c12f de/d54/d71/d8b/d135/d1e/d56/dd3/c13b 0 2024-04-15T00:40:15.021 INFO:tasks.workunit.client.0.smithi029.stdout:7/996: write d0/d6/d4f/d5d/d65/f131 [521538,97583] 0 2024-04-15T00:40:15.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/988: creat df/d29/d41/d69/d78/dd1/d59/d10a/f14b x:0 0 0 2024-04-15T00:40:15.093 INFO:tasks.workunit.client.0.smithi029.stdout:1/989: stat df/d29/d41/d69/d78/dea/f11b 0 2024-04-15T00:40:15.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/986: truncate de/d6d/dde/fe1 317833 0 2024-04-15T00:40:15.514 INFO:tasks.workunit.client.0.smithi029.stdout:1/990: creat df/d29/d41/d69/d4c/df4/f14c x:0 0 0 2024-04-15T00:40:15.587 INFO:tasks.workunit.client.0.smithi029.stdout:9/976: link d3/l8 d3/d6/d131/l136 0 2024-04-15T00:40:15.639 INFO:tasks.workunit.client.0.smithi029.stdout:4/987: readlink de/d54/d71/da3/lec 0 2024-04-15T00:40:15.648 INFO:tasks.workunit.client.0.smithi029.stdout:4/988: chown de/d54/d71/f113 953 1 2024-04-15T00:40:15.843 INFO:tasks.workunit.client.0.smithi029.stdout:1/991: fdatasync df/d32/f39 0 2024-04-15T00:40:15.856 INFO:tasks.workunit.client.0.smithi029.stdout:1/992: readlink df/d32/l3d 0 2024-04-15T00:40:15.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/989: rename de/d54/d58/d8a/f98 to de/d54/d71/da3/f13c 0 2024-04-15T00:40:16.604 INFO:tasks.workunit.client.0.smithi029.stdout:7/997: creat d0/f140 x:0 0 0 2024-04-15T00:40:16.611 INFO:tasks.workunit.client.0.smithi029.stdout:9/977: write d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fb3 [1268621,80799] 0 2024-04-15T00:40:16.639 INFO:tasks.workunit.client.0.smithi029.stdout:7/998: chown d0/d6/d4f/d5d/d87/d103 22107 1 2024-04-15T00:40:16.656 INFO:tasks.workunit.client.0.smithi029.stdout:7/999: rename d0/d69 to d0/d69/ded/d141 22 2024-04-15T00:40:16.804 INFO:tasks.workunit.client.0.smithi029.stdout:1/993: write df/d29/d41/d69/d78/dd1/d59/f129 [787000,9866] 0 2024-04-15T00:40:16.906 INFO:tasks.workunit.client.0.smithi029.stdout:4/990: dwrite de/d6d/d7e/f11a [0,4194304] 0 2024-04-15T00:40:16.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/978: rename d3/d6/d9/d29/d60/d64/dfc/c10f to d3/d6/d9/d15/c137 0 2024-04-15T00:40:17.023 INFO:tasks.workunit.client.0.smithi029.stdout:4/991: chown de/d6d/dde/l10f 1 1 2024-04-15T00:40:17.112 INFO:tasks.workunit.client.0.smithi029.stdout:9/979: chown d3/d6/d9/d15/d62/cbf 618 1 2024-04-15T00:40:17.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/994: dwrite df/f3c [0,4194304] 0 2024-04-15T00:40:17.362 INFO:tasks.workunit.client.0.smithi029.stdout:9/980: fsync d3/d6/d9/d29/d60/d7f/fdf 0 2024-04-15T00:40:17.363 INFO:tasks.workunit.client.0.smithi029.stdout:1/995: readlink df/d29/d41/d96/l130 0 2024-04-15T00:40:17.379 INFO:tasks.workunit.client.0.smithi029.stdout:4/992: symlink de/d54/d58/l13d 0 2024-04-15T00:40:17.398 INFO:tasks.workunit.client.0.smithi029.stdout:1/996: chown df/d29/d41/d96/ff9 8836693 1 2024-04-15T00:40:17.401 INFO:tasks.workunit.client.0.smithi029.stdout:9/981: chown d3/d6/d9/d29/d60/d64/da8 47 1 2024-04-15T00:40:17.432 INFO:tasks.workunit.client.0.smithi029.stdout:1/997: chown df/d29/d41/d69/d78/dd1/d59/d10a/f14b 43 1 2024-04-15T00:40:17.589 INFO:tasks.workunit.client.0.smithi029.stdout:1/998: creat df/d32/dbf/f14d x:0 0 0 2024-04-15T00:40:17.611 INFO:tasks.workunit.client.0.smithi029.stdout:1/999: chown df/d29/d41/d69/d78/dea/f11b 0 1 2024-04-15T00:40:17.623 INFO:tasks.workunit.client.0.smithi029.stdout:4/993: write f2 [2676929,98154] 0 2024-04-15T00:40:17.675 INFO:tasks.workunit.client.0.smithi029.stdout:9/982: symlink d3/d6/d9/d29/d60/l138 0 2024-04-15T00:40:17.729 INFO:tasks.workunit.client.0.smithi029.stdout:4/994: unlink f2 0 2024-04-15T00:40:17.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/983: mkdir d3/d6/d9/d29/d60/d139 0 2024-04-15T00:40:17.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/995: creat de/d3a/f13e x:0 0 0 2024-04-15T00:40:17.945 INFO:tasks.workunit.client.0.smithi029.stdout:9/984: creat d3/d6/d9/d29/f13a x:0 0 0 2024-04-15T00:40:17.947 INFO:tasks.workunit.client.0.smithi029.stdout:4/996: truncate de/d54/d58/fbd 106334 0 2024-04-15T00:40:17.970 INFO:tasks.workunit.client.0.smithi029.stdout:9/985: readlink d3/d6/d9/d29/d60/d7f/ld5 0 2024-04-15T00:40:18.020 INFO:tasks.workunit.client.0.smithi029.stdout:4/997: symlink de/d54/l13f 0 2024-04-15T00:40:18.112 INFO:tasks.workunit.client.0.smithi029.stdout:9/986: creat d3/d6/d9/d29/d60/d7f/da0/d9a/d96/de1/dfe/d121/f13b x:0 0 0 2024-04-15T00:40:18.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/987: symlink d3/d6/d9/d29/d60/d7f/l13c 0 2024-04-15T00:40:18.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/988: chown d3/d6/d9/d29/d60/d7f/da0/c6c 167162069 1 2024-04-15T00:40:18.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/998: getdents de/d54/d71/d8b/d135/d1e/d56/dd3 0 2024-04-15T00:40:18.605 INFO:tasks.workunit.client.0.smithi029.stdout:4/999: readlink de/lfb 0 2024-04-15T00:40:18.621 INFO:tasks.workunit.client.0.smithi029.stdout:9/989: symlink d3/d6/d131/l13d 0 2024-04-15T00:40:18.675 INFO:tasks.workunit.client.0.smithi029.stdout:9/990: mkdir d3/d6/d9/d29/d13e 0 2024-04-15T00:40:18.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/991: write d3/d6/d9/d29/d60/d64/d6d/d58/d6a/f93 [3611121,50197] 0 2024-04-15T00:40:18.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/992: chown c1 2112058 1 2024-04-15T00:40:18.962 INFO:tasks.workunit.client.0.smithi029.stdout:9/993: write d3/d6/d9/d29/d60/d64/d6d/d58/f2a [1311086,115457] 0 2024-04-15T00:40:19.034 INFO:tasks.workunit.client.0.smithi029.stdout:9/994: truncate d3/d6/d9/d29/d60/d7f/da0/d9a/d96/fc7 724448 0 2024-04-15T00:40:19.077 INFO:tasks.workunit.client.0.smithi029.stdout:9/995: readlink d3/d6/d9/d29/d60/d7f/df1/l127 0 2024-04-15T00:40:19.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/996: chown d3/d6/d9/d29/d60/d64/d6d/d58/d6a/fcd 14090 1 2024-04-15T00:40:19.247 INFO:tasks.workunit.client.0.smithi029.stdout:9/997: dwrite d3/d6/d9/d29/d60/d7f/da0/d9a/d96/ff0 [0,4194304] 0 2024-04-15T00:40:19.367 INFO:tasks.workunit.client.0.smithi029.stdout:9/998: creat d3/d6/d9/d29/d60/d64/f13f x:0 0 0 2024-04-15T00:40:19.419 INFO:tasks.workunit.client.0.smithi029.stdout:9/999: dread d3/d6/d9/d29/d60/d64/d6d/d58/f28 [0,4194304] 0 2024-04-15T00:40:19.438 INFO:tasks.workunit.client.0.smithi029.stderr:+ rm -rf -- ./tmp.bxzCiMvu91 2024-04-15T00:40:30.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:40:30.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:40:50.636 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:40:21.149 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.642 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:40:21.154 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.650 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:40:21.143 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.652 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:40:21.145 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.656 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:40:21.150 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.659 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:40:21.152 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.730 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:40:21.242 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.745 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:40:21.238 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:40:50.769 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:40:21.262 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:00.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:41:00.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:41:30.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:41:30.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:41:31.287 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:41:01.800 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.291 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:41:01.804 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.318 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:41:01.831 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.345 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:41:01.839 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.348 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:41:01.842 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.359 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:41:01.853 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.361 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:41:01.854 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.376 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:41:01.870 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:41:31.412 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:41:01.906 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:00.940 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:42:00.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:42:31.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:42:31.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:42:51.554 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:42:22.068 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.556 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:42:22.070 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.587 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:42:22.101 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.612 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:42:22.106 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.612 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:42:22.106 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.614 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:42:22.109 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.614 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:42:22.109 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.646 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:42:22.141 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:42:51.647 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:42:22.141 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:43:01.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:43:01.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:43:31.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:43:31.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:44:01.249 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:44:01.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:44:31.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:44:31.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:44:55.218 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:44:25.732 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.224 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:44:25.739 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.233 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:44:25.728 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.235 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:44:25.731 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.238 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:44:25.733 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.241 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:44:25.736 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.280 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:44:25.795 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.290 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:44:25.786 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:44:55.298 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:44:25.793 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:45:01.517 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:45:01.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:45:31.625 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:45:31.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:46:01.686 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:46:01.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:46:05.420 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-15T00:46:05.420 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-15T00:46:31.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:46:31.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:47:01.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:47:01.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:47:31.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:47:31.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:48:01.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:48:02.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:48:32.056 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:48:32.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:49:02.134 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:49:02.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:49:04.597 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:48:35.113 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.659 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:48:35.108 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.660 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:48:35.120 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.660 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:48:35.109 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.660 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:48:35.110 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.660 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:48:35.111 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.696 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:48:35.213 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.706 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:48:35.203 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:04.707 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:48:35.204 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:49:32.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:49:32.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:50:02.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:50:02.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:50:32.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:50:32.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:51:02.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:51:02.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:51:13.741 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:50:44.258 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.746 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:50:44.264 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.799 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:50:44.316 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.804 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:50:44.301 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.804 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:50:44.301 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.810 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:50:44.307 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.810 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:50:44.308 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.866 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:50:44.362 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:13.866 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:50:44.364 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:51:33.019 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:51:33.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:52:03.091 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:52:03.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:52:33.153 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:52:33.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:53:03.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:53:03.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:53:10.698 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:52:41.216 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.701 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:52:41.219 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.709 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:52:41.207 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.710 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:52:41.208 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.711 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:52:41.210 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.712 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:52:41.211 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.754 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:52:41.272 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.769 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:52:41.267 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:10.787 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:52:41.285 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:53:33.371 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:53:33.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:54:03.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:54:03.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:54:33.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:54:33.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:55:03.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:55:03.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:55:33.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:55:33.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:56:03.895 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:56:03.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:56:34.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:56:34.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:57:04.328 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:57:04.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:57:18.479 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:56:48.997 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.483 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:56:49.002 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.490 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:56:48.989 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.492 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:56:48.991 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.493 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:56:48.992 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.495 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:56:48.994 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.573 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:56:49.091 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.582 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:56:49.081 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:18.595 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:56:49.094 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:57:34.397 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:57:34.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:58:04.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:58:04.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:58:10.517 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:57:41.036 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.525 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:57:41.043 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.553 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:57:41.072 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.576 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:57:41.075 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.577 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:57:41.076 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.579 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:57:41.078 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.579 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:57:41.078 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.626 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:57:41.125 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:10.626 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:57:41.125 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:58:34.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:58:34.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:59:04.608 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:59:04.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:59:34.672 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:59:34.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T00:59:35.951 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:59:06.470 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:35.954 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:59:06.473 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:35.986 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:00:59:06.504 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:36.005 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:59:06.504 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:36.010 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:59:06.510 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:36.012 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:59:06.511 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:36.016 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:59:06.515 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:36.043 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:00:59:06.542 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T00:59:36.049 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:00:59:06.548 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:00:04.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:00:04.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:00:34.809 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:00:34.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:01:04.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:01:04.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:01:24.711 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:00:55.230 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.713 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:00:55.232 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.721 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:00:55.221 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.722 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:00:55.221 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.724 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:00:55.223 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.724 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:00:55.224 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.773 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:00:55.292 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.776 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:00:55.275 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:24.776 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:00:55.275 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:01:34.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:01:34.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:02:05.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:02:05.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:02:35.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:02:35.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:03:05.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:03:05.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:03:35.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:03:35.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:04:05.362 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:04:05.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:04:35.418 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:04:35.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:05:05.476 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:05:05.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:05:33.664 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:05:04.183 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.666 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:05:04.186 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.673 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:05:04.173 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.673 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:05:04.174 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.676 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:05:04.176 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.676 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:05:04.176 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.763 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:05:04.283 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.785 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:05:04.285 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:33.799 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:05:04.299 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:05:35.538 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:05:35.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:06:05.603 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:06:05.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:06:32.421 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:06:02.940 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.426 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:06:02.945 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.459 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:06:02.978 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.481 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:06:02.981 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.482 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:06:02.982 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.483 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:06:02.984 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.484 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:06:02.985 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.516 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:06:03.017 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:32.519 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:06:03.019 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:06:35.666 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:06:35.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:07:05.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:07:05.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:07:35.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:07:35.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:07:57.723 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:07:28.242 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.727 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:07:28.247 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.758 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:07:28.278 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.780 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:07:28.280 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.783 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:07:28.283 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.794 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:07:28.295 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.825 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:07:28.326 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.836 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:07:28.336 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:07:57.870 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:07:28.371 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:08:05.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:08:05.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:08:35.914 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:08:35.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:09:05.997 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:09:06.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:09:36.066 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:09:36.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:09:39.612 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:09:10.132 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.615 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:09:10.135 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.624 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:09:10.124 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.624 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:09:10.124 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.626 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:09:10.127 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.627 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:09:10.128 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.666 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:09:10.186 37242== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.675 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:09:10.175 37015== Warning: unimplemented fcntl command: 1036 2024-04-15T01:09:39.682 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:09:10.183 37014== Warning: unimplemented fcntl command: 1036 2024-04-15T01:10:06.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:10:06.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:10:35.300 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-15T01:10:35.300 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-15T01:10:35.594 DEBUG:teuthology.parallel:result is None 2024-04-15T01:10:35.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T01:10:35.957 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T01:10:35.957 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-15T01:10:35.969 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-15T01:10:35.969 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T01:10:35.969 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T01:10:35.985 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T01:10:35.985 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T01:10:36.041 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T01:10:36.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.188+0000 7faa9b51e640 1 Processor -- start 2024-04-15T01:10:36.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.188+0000 7faa9b51e640 1 -- start start 2024-04-15T01:10:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa9b51e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa940cc530 0x7faa940cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa9b51e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa9415b110 0x7faa9406c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa9b51e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa940ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa9b51e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7faa9406c960 con 0x7faa940cc530 2024-04-15T01:10:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa9b51e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7faa940cf910 con 0x7faa9415b110 2024-04-15T01:10:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa9b51e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7faa940cf350 con 0x7faa940cdff0 2024-04-15T01:10:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa992ba640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faa940cc530 0x7faa940cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.189+0000 7faa98ab9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa9415b110 0x7faa9406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.190+0000 7faa99abb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa940ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.190+0000 7faa98ab9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa9415b110 0x7faa9406c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:35020/0 (socket says 172.21.15.29:35020) 2024-04-15T01:10:36.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.190+0000 7faa98ab9640 1 -- 172.21.15.29:0/1442749102 learned_addr learned my addr 172.21.15.29:0/1442749102 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.193+0000 7faa98ab9640 1 -- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 msgr2=0x7faa940ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.193+0000 7faa98ab9640 1 --2- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa940ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.193+0000 7faa98ab9640 1 -- 172.21.15.29:0/1442749102 >> v2:172.21.15.29:3300/0 conn(0x7faa940cc530 msgr2=0x7faa940cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.193+0000 7faa98ab9640 1 --2- 172.21.15.29:0/1442749102 >> v2:172.21.15.29:3300/0 conn(0x7faa940cc530 0x7faa940cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.193+0000 7faa98ab9640 1 -- 172.21.15.29:0/1442749102 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa940cf630 con 0x7faa9415b110 2024-04-15T01:10:36.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:10:36.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:10:36.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.195+0000 7faa98ab9640 1 --2- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9415b110 0x7faa9406c420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa940c33d0 tx=0x7faa8402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950b1f0cc61d052f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.200+0000 7faa8bfff640 1 -- 172.21.15.29:0/1442749102 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84035020 con 0x7faa9415b110 2024-04-15T01:10:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.200+0000 7faa8bfff640 1 -- 172.21.15.29:0/1442749102 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa84031870 con 0x7faa9415b110 2024-04-15T01:10:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.200+0000 7faa8bfff640 1 -- 172.21.15.29:0/1442749102 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84031c40 con 0x7faa9415b110 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 -- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9415b110 msgr2=0x7faa9406c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9415b110 0x7faa9406c420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa940c33d0 tx=0x7faa8402b910 comp rx=0 tx=0).stop 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 -- 172.21.15.29:0/1442749102 shutdown_connections 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa940ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1442749102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9415b110 0x7faa9406c420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1442749102 >> v2:172.21.15.29:3300/0 conn(0x7faa940cc530 0x7faa940cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 -- 172.21.15.29:0/1442749102 >> 172.21.15.29:0/1442749102 conn(0x7faa940cfb20 msgr2=0x7faa940cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 -- 172.21.15.29:0/1442749102 shutdown_connections 2024-04-15T01:10:36.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.201+0000 7faa9b51e640 1 -- 172.21.15.29:0/1442749102 wait complete. 2024-04-15T01:10:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.202+0000 7faa9b51e640 1 Processor -- start 2024-04-15T01:10:36.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.202+0000 7faa9b51e640 1 -- start start 2024-04-15T01:10:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.203+0000 7faa9b51e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa940cc530 0x7faa941482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.203+0000 7faa9b51e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa94148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.203+0000 7faa9b51e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa9415b110 0x7faa940b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.203+0000 7faa9b51e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faa9415abf0 con 0x7faa9415b110 2024-04-15T01:10:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.203+0000 7faa9b51e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa9415a910 con 0x7faa940cc530 2024-04-15T01:10:36.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.203+0000 7faa9b51e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7faa940cebc0 con 0x7faa940cdff0 2024-04-15T01:10:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.204+0000 7faa98ab9640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa94148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.204+0000 7faa992ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa940cc530 0x7faa941482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.204+0000 7faa99abb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa9415b110 0x7faa940b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.204+0000 7faa992ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa940cc530 0x7faa941482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:35026/0 (socket says 172.21.15.29:35026) 2024-04-15T01:10:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.204+0000 7faa98ab9640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa94148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:36748/0 (socket says 172.21.15.29:36748) 2024-04-15T01:10:36.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.204+0000 7faa992ba640 1 -- 172.21.15.29:0/1137463954 learned_addr learned my addr 172.21.15.29:0/1137463954 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.208+0000 7faa99abb640 1 -- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 msgr2=0x7faa94148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.208+0000 7faa99abb640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa94148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.208+0000 7faa99abb640 1 -- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa940cc530 msgr2=0x7faa941482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.208+0000 7faa99abb640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa940cc530 0x7faa941482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.208+0000 7faa99abb640 1 -- 172.21.15.29:0/1137463954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa94075810 con 0x7faa9415b110 2024-04-15T01:10:36.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.211+0000 7faa99abb640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa9415b110 0x7faa940b00a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00efc0 tx=0x7faa8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:36.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.216+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c018020 con 0x7faa9415b110 2024-04-15T01:10:36.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.216+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c014480 con 0x7faa9415b110 2024-04-15T01:10:36.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.216+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa940b1e30 con 0x7faa9415b110 2024-04-15T01:10:36.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.216+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c014870 con 0x7faa9415b110 2024-04-15T01:10:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.216+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa940af8a0 con 0x7faa9415b110 2024-04-15T01:10:36.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.217+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9404f540 con 0x7faa9415b110 2024-04-15T01:10:36.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.238+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7faa8c005d10 con 0x7faa9415b110 2024-04-15T01:10:36.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.239+0000 7faa89ffb640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faa7806b9e0 0x7faa7806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.239+0000 7faa992ba640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faa7806b9e0 0x7faa7806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.239+0000 7faa992ba640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faa7806b9e0 0x7faa7806dea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faa90009b80 tx=0x7faa90009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:36.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.243+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7faa8c0580d0 con 0x7faa9415b110 2024-04-15T01:10:36.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.511+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faa8c022030 con 0x7faa9415b110 2024-04-15T01:10:36.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.698+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa9406e000 con 0x7faa9415b110 2024-04-15T01:10:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.748+0000 7faa89ffb640 1 -- 172.21.15.29:0/1137463954 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7faa8c010040 con 0x7faa9415b110 2024-04-15T01:10:36.748 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:10:36.748 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T01:10:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faa7806b9e0 msgr2=0x7faa7806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faa7806b9e0 0x7faa7806dea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faa90009b80 tx=0x7faa90009190 comp rx=0 tx=0).stop 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa9415b110 msgr2=0x7faa940b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa9415b110 0x7faa940b00a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00efc0 tx=0x7faa8c00c490 comp rx=0 tx=0).stop 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 shutdown_connections 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7faa7806b9e0 0x7faa7806dea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa9415b110 0x7faa940b00a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7faa940cdff0 0x7faa94148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 --2- 172.21.15.29:0/1137463954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa940cc530 0x7faa941482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 >> 172.21.15.29:0/1137463954 conn(0x7faa940cfb20 msgr2=0x7faa94152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 shutdown_connections 2024-04-15T01:10:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.751+0000 7faa9b51e640 1 -- 172.21.15.29:0/1137463954 wait complete. 2024-04-15T01:10:36.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:01:09.779176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:01:11.503018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:01:16.720777+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T01:10:36.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T01:10:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.868+0000 7f5e069f0640 1 Processor -- start 2024-04-15T01:10:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.869+0000 7f5e069f0640 1 -- start start 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.869+0000 7f5e069f0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e000cb810 0x7f5e000cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.869+0000 7f5e069f0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e000cc1e0 con 0x7f5e000c8bf0 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.869+0000 7f5e069f0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e000c37e0 con 0x7f5e00151440 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.869+0000 7f5e069f0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5e000c4f80 con 0x7f5e000cb810 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.870+0000 7f5dfffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e00151440 0x7f5e000c2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:47976/0 (socket says 172.21.15.29:47976) 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.870+0000 7f5dfffff640 1 -- 172.21.15.29:0/2118941160 learned_addr learned my addr 172.21.15.29:0/2118941160 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.870+0000 7f5e04f8d640 1 --2- 172.21.15.29:0/2118941160 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e000cb810 0x7f5e000cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579302566 0 0) 0x7f5e000cc1e0 con 0x7f5e000c8bf0 2024-04-15T01:10:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dec005730 con 0x7f5e000c8bf0 2024-04-15T01:10:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891689149 0 0) 0x7f5e000c37e0 con 0x7f5e00151440 2024-04-15T01:10:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e000cc1e0 con 0x7f5e00151440 2024-04-15T01:10:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5e04f8d640 1 -- 172.21.15.29:0/2118941160 >> v1:172.21.15.37:6789/0 conn(0x7f5e00151440 legacy=0x7f5e000c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5e04f8d640 1 -- 172.21.15.29:0/2118941160 >> v1:172.21.15.29:6789/0 conn(0x7f5e000c8bf0 legacy=0x7f5e000c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.873+0000 7f5e04f8d640 1 -- 172.21.15.29:0/2118941160 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e000c51d0 con 0x7f5e000cb810 2024-04-15T01:10:36.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.875+0000 7f5e04f8d640 1 --2- 172.21.15.29:0/2118941160 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e000cb810 0x7f5e000cbca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009dc0 tx=0x7f5df802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a76f37254f6098a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8039070 con 0x7f5e000cb810 2024-04-15T01:10:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df802ccd0 con 0x7f5e000cb810 2024-04-15T01:10:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5dfeffd640 1 -- 172.21.15.29:0/2118941160 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8034660 con 0x7f5e000cb810 2024-04-15T01:10:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 -- 172.21.15.29:0/2118941160 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e000cb810 msgr2=0x7f5e000cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 --2- 172.21.15.29:0/2118941160 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e000cb810 0x7f5e000cbca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009dc0 tx=0x7f5df802bf20 comp rx=0 tx=0).stop 2024-04-15T01:10:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 -- 172.21.15.29:0/2118941160 shutdown_connections 2024-04-15T01:10:36.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 --2- 172.21.15.29:0/2118941160 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e000cb810 0x7f5e000cbca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 -- 172.21.15.29:0/2118941160 >> 172.21.15.29:0/2118941160 conn(0x7f5e0006f100 msgr2=0x7f5e0006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:36.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 -- 172.21.15.29:0/2118941160 shutdown_connections 2024-04-15T01:10:36.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.881+0000 7f5e069f0640 1 -- 172.21.15.29:0/2118941160 wait complete. 2024-04-15T01:10:36.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.882+0000 7f5e069f0640 1 Processor -- start 2024-04-15T01:10:36.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.882+0000 7f5e069f0640 1 -- start start 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e069f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e000c8bf0 0x7f5e0014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e069f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 0x7f5e00140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e069f0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e00151440 0x7f5e00140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e069f0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5e000c33d0 con 0x7f5e000c8bf0 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e069f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e000c5790 con 0x7f5e000cb810 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e069f0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5e000c3550 con 0x7f5e00151440 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5dfffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e000c8bf0 0x7f5e0014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 0x7f5e00140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5e04f8d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e00151440 0x7f5e00140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:36.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 0x7f5e00140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:52218/0 (socket says 172.21.15.29:52218) 2024-04-15T01:10:36.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.883+0000 7f5dff7fe640 1 -- 172.21.15.29:0/720787743 learned_addr learned my addr 172.21.15.29:0/720787743 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:36.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.887+0000 7f5dfffff640 1 -- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e00151440 msgr2=0x7f5e00140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.887+0000 7f5dfffff640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e00151440 0x7f5e00140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.887+0000 7f5dfffff640 1 -- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 msgr2=0x7f5e00140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.887+0000 7f5dfffff640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 0x7f5e00140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.887+0000 7f5dfffff640 1 -- 172.21.15.29:0/720787743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e001ecc10 con 0x7f5e000c8bf0 2024-04-15T01:10:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.887+0000 7f5dff7fe640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 0x7f5e00140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T01:10:36.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.890+0000 7f5dfffff640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e000c8bf0 0x7f5e0014ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c3f0 tx=0x7f5df0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.893+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0017070 con 0x7f5e000c8bf0 2024-04-15T01:10:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.893+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df0005ce0 con 0x7f5e000c8bf0 2024-04-15T01:10:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.893+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0007310 con 0x7f5e000c8bf0 2024-04-15T01:10:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.893+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e00144e90 con 0x7f5e000c8bf0 2024-04-15T01:10:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.893+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e001440d0 con 0x7f5e000c8bf0 2024-04-15T01:10:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:36.894+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0004f540 con 0x7f5e000c8bf0 2024-04-15T01:10:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.163+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5df001a070 con 0x7f5e000c8bf0 2024-04-15T01:10:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.164+0000 7f5dfcff9640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5de006b990 0x7f5de006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:37.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.164+0000 7f5dff7fe640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5de006b990 0x7f5de006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:37.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.165+0000 7f5dff7fe640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5de006b990 0x7f5de006de50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e00072120 tx=0x7f5de8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:37.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.181+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5df0056600 con 0x7f5e000c8bf0 2024-04-15T01:10:37.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.181+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5df0021020 con 0x7f5e000c8bf0 2024-04-15T01:10:37.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.365+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5e000ca610 con 0x7f5e000c8bf0 2024-04-15T01:10:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.370+0000 7f5dfcff9640 1 -- 172.21.15.29:0/720787743 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f5df0058560 con 0x7f5e000c8bf0 2024-04-15T01:10:37.369 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T01:10:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5de006b990 msgr2=0x7f5de006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5de006b990 0x7f5de006de50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e00072120 tx=0x7f5de8009040 comp rx=0 tx=0).stop 2024-04-15T01:10:37.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e000c8bf0 msgr2=0x7f5e0014ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e000c8bf0 0x7f5e0014ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c3f0 tx=0x7f5df0001e70 comp rx=0 tx=0).stop 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 shutdown_connections 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5de006b990 0x7f5de006de50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5e00151440 0x7f5e00140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e000cb810 0x7f5e00140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 --2- 172.21.15.29:0/720787743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e000c8bf0 0x7f5e0014ec40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 >> 172.21.15.29:0/720787743 conn(0x7f5e0006f100 msgr2=0x7f5e00071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 shutdown_connections 2024-04-15T01:10:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.373+0000 7f5e069f0640 1 -- 172.21.15.29:0/720787743 wait complete. 2024-04-15T01:10:37.382 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T01:10:37.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.489+0000 7fedddd64640 1 Processor -- start 2024-04-15T01:10:37.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.489+0000 7fedddd64640 1 -- start start 2024-04-15T01:10:37.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.489+0000 7fedddd64640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fedd815b010 0x7fedd80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:37.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.489+0000 7fedddd64640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd815ba10 con 0x7fedd815ac30 2024-04-15T01:10:37.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.489+0000 7fedddd64640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd815b450 con 0x7fedd80cc870 2024-04-15T01:10:37.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.490+0000 7fedddd64640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fedd8154cc0 con 0x7fedd815b010 2024-04-15T01:10:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.490+0000 7fedcffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fedd815b010 0x7fedd80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.490+0000 7fedd7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fedd80cc870 0x7fedd815ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:47980/0 (socket says 172.21.15.29:47980) 2024-04-15T01:10:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.490+0000 7fedd7fff640 1 -- 172.21.15.29:0/1642785879 learned_addr learned my addr 172.21.15.29:0/1642785879 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:37.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.493+0000 7fedd6ffd640 1 -- 172.21.15.29:0/1642785879 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671964170 0 0) 0x7fedd815b450 con 0x7fedd80cc870 2024-04-15T01:10:37.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.493+0000 7fedd6ffd640 1 -- 172.21.15.29:0/1642785879 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc4003520 con 0x7fedd80cc870 2024-04-15T01:10:37.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.493+0000 7fedcffff640 1 -- 172.21.15.29:0/1642785879 >> v1:172.21.15.37:6789/0 conn(0x7fedd80cc870 legacy=0x7fedd815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.493+0000 7fedcffff640 1 -- 172.21.15.29:0/1642785879 >> v1:172.21.15.29:6789/0 conn(0x7fedd815ac30 legacy=0x7fedd80ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.494+0000 7fedcffff640 1 -- 172.21.15.29:0/1642785879 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd815bc80 con 0x7fedd815b010 2024-04-15T01:10:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.498+0000 7fedcffff640 1 --2- 172.21.15.29:0/1642785879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815b010 0x7fedd80cc330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fedc00097a0 tx=0x7fedc002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2eb148c03a04d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:37.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedd6ffd640 1 -- 172.21.15.29:0/1642785879 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc002f810 con 0x7fedd815b010 2024-04-15T01:10:37.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedd6ffd640 1 -- 172.21.15.29:0/1642785879 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc002f9b0 con 0x7fedd815b010 2024-04-15T01:10:37.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedd6ffd640 1 -- 172.21.15.29:0/1642785879 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc002fd80 con 0x7fedd815b010 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 -- 172.21.15.29:0/1642785879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815b010 msgr2=0x7fedd80cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 --2- 172.21.15.29:0/1642785879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815b010 0x7fedd80cc330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fedc00097a0 tx=0x7fedc002b9f0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 -- 172.21.15.29:0/1642785879 shutdown_connections 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 --2- 172.21.15.29:0/1642785879 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815b010 0x7fedd80cc330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 -- 172.21.15.29:0/1642785879 >> 172.21.15.29:0/1642785879 conn(0x7fedd80cfaf0 msgr2=0x7fedd80cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 -- 172.21.15.29:0/1642785879 shutdown_connections 2024-04-15T01:10:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.502+0000 7fedddd64640 1 -- 172.21.15.29:0/1642785879 wait complete. 2024-04-15T01:10:37.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 Processor -- start 2024-04-15T01:10:37.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 -- start start 2024-04-15T01:10:37.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fedd80cc870 0x7fedd81f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:37.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 0x7fedd81f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:37.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd815b010 0x7fedd81f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:37.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fedd815c240 con 0x7fedd815ac30 2024-04-15T01:10:37.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fedd815c5b0 con 0x7fedd815b010 2024-04-15T01:10:37.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.504+0000 7fedddd64640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fedd80ccec0 con 0x7fedd80cc870 2024-04-15T01:10:37.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.505+0000 7fedcffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 0x7fedd81f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:37.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.505+0000 7fedd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd815b010 0x7fedd81f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:37.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.505+0000 7fedcffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 0x7fedd81f4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34646/0 (socket says 172.21.15.29:34646) 2024-04-15T01:10:37.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.505+0000 7fedcffff640 1 -- 172.21.15.29:0/3759633802 learned_addr learned my addr 172.21.15.29:0/3759633802 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:37.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.505+0000 7fedd77fe640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fedd80cc870 0x7fedd81f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.509+0000 7fedcffff640 1 -- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fedd80cc870 msgr2=0x7fedd81f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.509+0000 7fedcffff640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fedd80cc870 0x7fedd81f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.509+0000 7fedcffff640 1 -- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd815b010 msgr2=0x7fedd81f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.509+0000 7fedcffff640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd815b010 0x7fedd81f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.509+0000 7fedcffff640 1 -- 172.21.15.29:0/3759633802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd8159400 con 0x7fedd815ac30 2024-04-15T01:10:37.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.511+0000 7fedcffff640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 0x7fedd81f4460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009890 tx=0x7fedc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.514+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0046070 con 0x7fedd815ac30 2024-04-15T01:10:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.514+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc00378f0 con 0x7fedd815ac30 2024-04-15T01:10:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.514+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0037ce0 con 0x7fedd815ac30 2024-04-15T01:10:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.514+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd81596e0 con 0x7fedd815ac30 2024-04-15T01:10:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.514+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd81f3c60 con 0x7fedd815ac30 2024-04-15T01:10:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.515+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd8074a90 con 0x7fedd815ac30 2024-04-15T01:10:37.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.785+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fedc0049070 con 0x7fedd815ac30 2024-04-15T01:10:37.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.785+0000 7fedd4ff9640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fedb806b9e0 0x7fedb806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.786+0000 7fedd77fe640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fedb806b9e0 0x7fedb806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.786+0000 7fedd77fe640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fedb806b9e0 0x7fedb806dea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fedc8001780 tx=0x7fedc8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.799+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fedc0078ae0 con 0x7fedd815ac30 2024-04-15T01:10:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:37.799+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fedd8074a90 con 0x7fedd815ac30 2024-04-15T01:10:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.001+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fedd804f540 con 0x7fedd815ac30 2024-04-15T01:10:38.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.007+0000 7fedd4ff9640 1 -- 172.21.15.29:0/3759633802 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fedc0050080 con 0x7fedd815ac30 2024-04-15T01:10:38.005 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T01:10:38.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fedb806b9e0 msgr2=0x7fedb806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fedb806b9e0 0x7fedb806dea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fedc8001780 tx=0x7fedc8009040 comp rx=0 tx=0).stop 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 msgr2=0x7fedd81f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 0x7fedd81f4460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009890 tx=0x7fedc0004730 comp rx=0 tx=0).stop 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 shutdown_connections 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fedb806b9e0 0x7fedb806dea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd815b010 0x7fedd81f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815ac30 0x7fedd81f4460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 --2- 172.21.15.29:0/3759633802 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fedd80cc870 0x7fedd81f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 >> 172.21.15.29:0/3759633802 conn(0x7fedd80cfaf0 msgr2=0x7fedd80cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 shutdown_connections 2024-04-15T01:10:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.009+0000 7fedddd64640 1 -- 172.21.15.29:0/3759633802 wait complete. 2024-04-15T01:10:38.018 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T01:10:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.126+0000 7fd1c8876640 1 Processor -- start 2024-04-15T01:10:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.126+0000 7fd1c8876640 1 -- start start 2024-04-15T01:10:38.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.126+0000 7fd1c8876640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1c41523c0 0x7fd1c4158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.126+0000 7fd1c8876640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c415bf90 0x7fd1c40c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.127+0000 7fd1c8876640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c4158fc0 con 0x7fd1c40c9df0 2024-04-15T01:10:38.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.127+0000 7fd1c8876640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c415bb00 con 0x7fd1c41523c0 2024-04-15T01:10:38.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.127+0000 7fd1c8876640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c4158720 con 0x7fd1c415bf90 2024-04-15T01:10:38.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.127+0000 7fd1c1d9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd1c40c9df0 0x7fd1c40c8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35058/0 (socket says 172.21.15.29:35058) 2024-04-15T01:10:38.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.127+0000 7fd1c1d9b640 1 -- 172.21.15.29:0/4237912998 learned_addr learned my addr 172.21.15.29:0/4237912998 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:38.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.127+0000 7fd1c2d9d640 1 --2- 172.21.15.29:0/4237912998 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c415bf90 0x7fd1c40c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.130+0000 7fd1c159a640 1 -- 172.21.15.29:0/4237912998 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602475895 0 0) 0x7fd1c4158fc0 con 0x7fd1c40c9df0 2024-04-15T01:10:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.130+0000 7fd1c159a640 1 -- 172.21.15.29:0/4237912998 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1ac003520 con 0x7fd1c40c9df0 2024-04-15T01:10:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.130+0000 7fd1c2d9d640 1 -- 172.21.15.29:0/4237912998 >> v2:172.21.15.37:3300/0 conn(0x7fd1c41523c0 msgr2=0x7fd1c4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.130+0000 7fd1c2d9d640 1 --2- 172.21.15.29:0/4237912998 >> v2:172.21.15.37:3300/0 conn(0x7fd1c41523c0 0x7fd1c4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.130+0000 7fd1c2d9d640 1 -- 172.21.15.29:0/4237912998 >> v1:172.21.15.29:6789/0 conn(0x7fd1c40c9df0 legacy=0x7fd1c40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.130+0000 7fd1c2d9d640 1 -- 172.21.15.29:0/4237912998 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c4158a00 con 0x7fd1c415bf90 2024-04-15T01:10:38.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.133+0000 7fd1c2d9d640 1 --2- 172.21.15.29:0/4237912998 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c415bf90 0x7fd1c40c9200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009d90 tx=0x7fd1bc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cce1d354c893e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.136+0000 7fd1c159a640 1 -- 172.21.15.29:0/4237912998 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc039070 con 0x7fd1c415bf90 2024-04-15T01:10:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.136+0000 7fd1c159a640 1 -- 172.21.15.29:0/4237912998 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1bc02cce0 con 0x7fd1c415bf90 2024-04-15T01:10:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.136+0000 7fd1c159a640 1 -- 172.21.15.29:0/4237912998 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc034660 con 0x7fd1c415bf90 2024-04-15T01:10:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 -- 172.21.15.29:0/4237912998 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c415bf90 msgr2=0x7fd1c40c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 --2- 172.21.15.29:0/4237912998 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c415bf90 0x7fd1c40c9200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009d90 tx=0x7fd1bc02bf30 comp rx=0 tx=0).stop 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 -- 172.21.15.29:0/4237912998 shutdown_connections 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 --2- 172.21.15.29:0/4237912998 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c415bf90 0x7fd1c40c9200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 --2- 172.21.15.29:0/4237912998 >> v2:172.21.15.37:3300/0 conn(0x7fd1c41523c0 0x7fd1c4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 -- 172.21.15.29:0/4237912998 >> 172.21.15.29:0/4237912998 conn(0x7fd1c4061c20 msgr2=0x7fd1c4062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 -- 172.21.15.29:0/4237912998 shutdown_connections 2024-04-15T01:10:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 -- 172.21.15.29:0/4237912998 wait complete. 2024-04-15T01:10:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.138+0000 7fd1c8876640 1 Processor -- start 2024-04-15T01:10:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 -- start start 2024-04-15T01:10:38.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 0x7fd1c4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1c41523c0 0x7fd1c415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c415bf90 0x7fd1c40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41527a0 con 0x7fd1c41523c0 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c415b790 con 0x7fd1c415bf90 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.139+0000 7fd1c8876640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c415c420 con 0x7fd1c40c9df0 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.140+0000 7fd1c259c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 0x7fd1c4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.140+0000 7fd1c1d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1c41523c0 0x7fd1c415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.140+0000 7fd1c2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c415bf90 0x7fd1c40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.140+0000 7fd1c259c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 0x7fd1c4157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:39440/0 (socket says 172.21.15.29:39440) 2024-04-15T01:10:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.140+0000 7fd1c259c640 1 -- 172.21.15.29:0/426541904 learned_addr learned my addr 172.21.15.29:0/426541904 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.145+0000 7fd1c259c640 1 -- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c415bf90 msgr2=0x7fd1c40b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.145+0000 7fd1c259c640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c415bf90 0x7fd1c40b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.145+0000 7fd1c259c640 1 -- 172.21.15.29:0/426541904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1c41523c0 msgr2=0x7fd1c415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.145+0000 7fd1c259c640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1c41523c0 0x7fd1c415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.145+0000 7fd1c259c640 1 -- 172.21.15.29:0/426541904 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c40c5bc0 con 0x7fd1c40c9df0 2024-04-15T01:10:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.147+0000 7fd1c259c640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 0x7fd1c4157a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400b4a0 tx=0x7fd1b400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:38.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.152+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4014070 con 0x7fd1c40c9df0 2024-04-15T01:10:38.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.152+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b4010610 con 0x7fd1c40c9df0 2024-04-15T01:10:38.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.152+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4010a00 con 0x7fd1c40c9df0 2024-04-15T01:10:38.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.152+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c40c5e80 con 0x7fd1c40c9df0 2024-04-15T01:10:38.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.152+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c4157230 con 0x7fd1c40c9df0 2024-04-15T01:10:38.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.153+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c404f540 con 0x7fd1c40c9df0 2024-04-15T01:10:38.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.434+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd1b4017070 con 0x7fd1c40c9df0 2024-04-15T01:10:38.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.435+0000 7fd1b2ffd640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd1a406b9c0 0x7fd1a406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.435+0000 7fd1c1d9b640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd1a406b9c0 0x7fd1a406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.435+0000 7fd1c1d9b640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd1a406b9c0 0x7fd1a406de80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4075100 tx=0x7fd1b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.438+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd1b4056cf0 con 0x7fd1c40c9df0 2024-04-15T01:10:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.448+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd1b4058c50 con 0x7fd1c40c9df0 2024-04-15T01:10:38.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.629+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd1c40c8fe0 con 0x7fd1c40c9df0 2024-04-15T01:10:38.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.634+0000 7fd1b2ffd640 1 -- 172.21.15.29:0/426541904 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fd1b405ccf0 con 0x7fd1c40c9df0 2024-04-15T01:10:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd1a406b9c0 msgr2=0x7fd1a406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd1a406b9c0 0x7fd1a406de80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4075100 tx=0x7fd1b8009040 comp rx=0 tx=0).stop 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 msgr2=0x7fd1c4157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 0x7fd1c4157a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400b4a0 tx=0x7fd1b400b960 comp rx=0 tx=0).stop 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 shutdown_connections 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd1a406b9c0 0x7fd1a406de80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c415bf90 0x7fd1c40b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1c41523c0 0x7fd1c415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 --2- 172.21.15.29:0/426541904 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd1c40c9df0 0x7fd1c4157a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 >> 172.21.15.29:0/426541904 conn(0x7fd1c4061c20 msgr2=0x7fd1c40cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:38.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 shutdown_connections 2024-04-15T01:10:38.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.636+0000 7fd1c8876640 1 -- 172.21.15.29:0/426541904 wait complete. 2024-04-15T01:10:38.645 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T01:10:38.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 Processor -- start 2024-04-15T01:10:38.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 -- start start 2024-04-15T01:10:38.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb5c4151440 0x7fb5c40c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c40c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c40c37e0 con 0x7fb5c40c72d0 2024-04-15T01:10:38.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c40c4f80 con 0x7fb5c4151440 2024-04-15T01:10:38.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.753+0000 7fb5c991e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c40c51d0 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.754+0000 7fb5c27fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c40c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.754+0000 7fb5c2ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb5c4151440 0x7fb5c40c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.754+0000 7fb5c27fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c40c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:39450/0 (socket says 172.21.15.29:39450) 2024-04-15T01:10:38.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.754+0000 7fb5c27fc640 1 -- 172.21.15.29:0/3735318882 learned_addr learned my addr 172.21.15.29:0/3735318882 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:38.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.757+0000 7fb5c27fc640 1 -- 172.21.15.29:0/3735318882 >> v2:172.21.15.29:3300/0 conn(0x7fb5c4151440 msgr2=0x7fb5c40c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:38.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.757+0000 7fb5c27fc640 1 --2- 172.21.15.29:0/3735318882 >> v2:172.21.15.29:3300/0 conn(0x7fb5c4151440 0x7fb5c40c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.757+0000 7fb5c27fc640 1 -- 172.21.15.29:0/3735318882 >> v1:172.21.15.29:6789/0 conn(0x7fb5c40c72d0 legacy=0x7fb5c40cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.757+0000 7fb5c27fc640 1 -- 172.21.15.29:0/3735318882 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c40c54b0 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.759+0000 7fb5c27fc640 1 --2- 172.21.15.29:0/3735318882 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c40c3200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68924b9596f90d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.761+0000 7fb5c1ffb640 1 -- 172.21.15.29:0/3735318882 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8034070 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c1ffb640 1 -- 172.21.15.29:0/3735318882 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8030840 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c1ffb640 1 -- 172.21.15.29:0/3735318882 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8030c10 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 -- 172.21.15.29:0/3735318882 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 msgr2=0x7fb5c40c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 --2- 172.21.15.29:0/3735318882 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c40c3200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b802b980 comp rx=0 tx=0).stop 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 -- 172.21.15.29:0/3735318882 shutdown_connections 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 --2- 172.21.15.29:0/3735318882 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c40c3200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 --2- 172.21.15.29:0/3735318882 >> v2:172.21.15.29:3300/0 conn(0x7fb5c4151440 0x7fb5c40c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 -- 172.21.15.29:0/3735318882 >> 172.21.15.29:0/3735318882 conn(0x7fb5c406f100 msgr2=0x7fb5c406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 -- 172.21.15.29:0/3735318882 shutdown_connections 2024-04-15T01:10:38.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.763+0000 7fb5c991e640 1 -- 172.21.15.29:0/3735318882 wait complete. 2024-04-15T01:10:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.764+0000 7fb5c991e640 1 Processor -- start 2024-04-15T01:10:38.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 -- start start 2024-04-15T01:10:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c40c72d0 0x7fb5c4156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c41f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c4151440 0x7fb5c413e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40cc0a0 con 0x7fb5c40c72d0 2024-04-15T01:10:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40cbf20 con 0x7fb5c4151440 2024-04-15T01:10:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.765+0000 7fb5c991e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c41f2410 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.766+0000 7fb5c27fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c41f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.766+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c4151440 0x7fb5c413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.766+0000 7fb5c2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c40c72d0 0x7fb5c4156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.766+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c4151440 0x7fb5c413e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:52246/0 (socket says 172.21.15.29:52246) 2024-04-15T01:10:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.766+0000 7fb5c37fe640 1 -- 172.21.15.29:0/145997398 learned_addr learned my addr 172.21.15.29:0/145997398 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.770+0000 7fb5c27fc640 1 -- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c4151440 msgr2=0x7fb5c413e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.770+0000 7fb5c27fc640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c4151440 0x7fb5c413e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.770+0000 7fb5c27fc640 1 -- 172.21.15.29:0/145997398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c40c72d0 msgr2=0x7fb5c4156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.770+0000 7fb5c27fc640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c40c72d0 0x7fb5c4156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.770+0000 7fb5c27fc640 1 -- 172.21.15.29:0/145997398 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c4157a20 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.772+0000 7fb5c27fc640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c41f1ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40c5100 tx=0x7fb5b8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.776+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8048070 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.776+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8030640 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.776+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8034040 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.776+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c40cb400 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.777+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c41f19b0 con 0x7fb5c40c8bf0 2024-04-15T01:10:38.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:38.778+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c406eb60 con 0x7fb5c40c8bf0 2024-04-15T01:10:39.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.057+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb5b804b070 con 0x7fb5c40c8bf0 2024-04-15T01:10:39.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.057+0000 7fb5abfff640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb5b006b9e0 0x7fb5b006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.058+0000 7fb5c2ffd640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb5b006b9e0 0x7fb5b006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.058+0000 7fb5c2ffd640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb5b006b9e0 0x7fb5b006dea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb5c41e4260 tx=0x7fb5b4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:39.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.061+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb5b80307f0 con 0x7fb5c40c8bf0 2024-04-15T01:10:39.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.073+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb5c406eb60 con 0x7fb5c40c8bf0 2024-04-15T01:10:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.264+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb5c40c5eb0 con 0x7fb5c40c8bf0 2024-04-15T01:10:39.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.270+0000 7fb5abfff640 1 -- 172.21.15.29:0/145997398 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fb5c40c5eb0 con 0x7fb5c40c8bf0 2024-04-15T01:10:39.268 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T01:10:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.272+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb5b006b9e0 msgr2=0x7fb5b006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.272+0000 7fb5c991e640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb5b006b9e0 0x7fb5b006dea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb5c41e4260 tx=0x7fb5b4009190 comp rx=0 tx=0).stop 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 msgr2=0x7fb5c41f1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c41f1ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40c5100 tx=0x7fb5b8004730 comp rx=0 tx=0).stop 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 shutdown_connections 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb5b006b9e0 0x7fb5b006dea0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c4151440 0x7fb5c413e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb5c40c8bf0 0x7fb5c41f1ed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 --2- 172.21.15.29:0/145997398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c40c72d0 0x7fb5c4156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 >> 172.21.15.29:0/145997398 conn(0x7fb5c406f100 msgr2=0x7fb5c4072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 shutdown_connections 2024-04-15T01:10:39.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.273+0000 7fb5c991e640 1 -- 172.21.15.29:0/145997398 wait complete. 2024-04-15T01:10:39.282 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T01:10:39.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.387+0000 7f1464695640 1 Processor -- start 2024-04-15T01:10:39.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.387+0000 7f1464695640 1 -- start start 2024-04-15T01:10:39.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.388+0000 7f1464695640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f145c143750 0x7f145c0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.388+0000 7f1464695640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c15dad0 0x7f145c15df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.388+0000 7f1464695640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145c15e4a0 con 0x7f145c0cac00 2024-04-15T01:10:39.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.388+0000 7f1464695640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f145c15a330 con 0x7f145c143750 2024-04-15T01:10:39.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.388+0000 7f1464695640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f145c143b30 con 0x7f145c15dad0 2024-04-15T01:10:39.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.388+0000 7f1462431640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f145c143750 0x7f145c0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.389+0000 7f1462c32640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c15dad0 0x7f145c15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.389+0000 7f1461c30640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f145c0cac00 0x7f145c071180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35070/0 (socket says 172.21.15.29:35070) 2024-04-15T01:10:39.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.389+0000 7f1461c30640 1 -- 172.21.15.29:0/24755575 learned_addr learned my addr 172.21.15.29:0/24755575 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:39.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.391+0000 7f1462c32640 1 -- 172.21.15.29:0/24755575 >> v2:172.21.15.29:3300/0 conn(0x7f145c143750 msgr2=0x7f145c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:39.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.391+0000 7f1462c32640 1 --2- 172.21.15.29:0/24755575 >> v2:172.21.15.29:3300/0 conn(0x7f145c143750 0x7f145c0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.391+0000 7f1462c32640 1 -- 172.21.15.29:0/24755575 >> v1:172.21.15.29:6789/0 conn(0x7f145c0cac00 legacy=0x7f145c071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.391+0000 7f1462c32640 1 -- 172.21.15.29:0/24755575 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c15a5b0 con 0x7f145c15dad0 2024-04-15T01:10:39.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.393+0000 7f1462c32640 1 --2- 172.21.15.29:0/24755575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c15dad0 0x7f145c15df60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1458009d90 tx=0x7f145802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af2846063d802b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:39.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.397+0000 7f146142f640 1 -- 172.21.15.29:0/24755575 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458039070 con 0x7f145c15dad0 2024-04-15T01:10:39.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.397+0000 7f146142f640 1 -- 172.21.15.29:0/24755575 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145802cce0 con 0x7f145c15dad0 2024-04-15T01:10:39.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.397+0000 7f146142f640 1 -- 172.21.15.29:0/24755575 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458034660 con 0x7f145c15dad0 2024-04-15T01:10:39.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 -- 172.21.15.29:0/24755575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c15dad0 msgr2=0x7f145c15df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 --2- 172.21.15.29:0/24755575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c15dad0 0x7f145c15df60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1458009d90 tx=0x7f145802bf30 comp rx=0 tx=0).stop 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 -- 172.21.15.29:0/24755575 shutdown_connections 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 --2- 172.21.15.29:0/24755575 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c15dad0 0x7f145c15df60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 --2- 172.21.15.29:0/24755575 >> v2:172.21.15.29:3300/0 conn(0x7f145c143750 0x7f145c0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 -- 172.21.15.29:0/24755575 >> 172.21.15.29:0/24755575 conn(0x7f145c070810 msgr2=0x7f145c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 -- 172.21.15.29:0/24755575 shutdown_connections 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.398+0000 7f1464695640 1 -- 172.21.15.29:0/24755575 wait complete. 2024-04-15T01:10:39.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.399+0000 7f1464695640 1 Processor -- start 2024-04-15T01:10:39.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.399+0000 7f1464695640 1 -- start start 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1464695640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f145c0cac00 0x7f145c0c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1464695640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c143750 0x7f145c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1464695640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 0x7f145c0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1464695640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f145c15ae50 con 0x7f145c15dad0 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1464695640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f145c15ab70 con 0x7f145c0cac00 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1464695640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f145c15b130 con 0x7f145c143750 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.400+0000 7f1462c32640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 0x7f145c0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.401+0000 7f1461c30640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c143750 0x7f145c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.401+0000 7f1462c32640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 0x7f145c0cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34678/0 (socket says 172.21.15.29:34678) 2024-04-15T01:10:39.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.401+0000 7f1462431640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f145c0cac00 0x7f145c0c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.401+0000 7f1462c32640 1 -- 172.21.15.29:0/3581884816 learned_addr learned my addr 172.21.15.29:0/3581884816 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:39.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.404+0000 7f1462c32640 1 -- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c143750 msgr2=0x7f145c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.404+0000 7f1462c32640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c143750 0x7f145c0cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.404+0000 7f1462c32640 1 -- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f145c0cac00 msgr2=0x7f145c0c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.404+0000 7f1462c32640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f145c0cac00 0x7f145c0c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.404+0000 7f1462c32640 1 -- 172.21.15.29:0/3581884816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c1f03f0 con 0x7f145c15dad0 2024-04-15T01:10:39.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.406+0000 7f1462c32640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 0x7f145c0cbed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1458009d90 tx=0x7f1458004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.410+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458039050 con 0x7f145c15dad0 2024-04-15T01:10:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.410+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1458045070 con 0x7f145c15dad0 2024-04-15T01:10:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.410+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458009450 con 0x7f145c15dad0 2024-04-15T01:10:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.410+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c1f06d0 con 0x7f145c15dad0 2024-04-15T01:10:39.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.411+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c1f0c90 con 0x7f145c15dad0 2024-04-15T01:10:39.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.411+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145c075840 con 0x7f145c15dad0 2024-04-15T01:10:39.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.678+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f145803e850 con 0x7f145c15dad0 2024-04-15T01:10:39.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.678+0000 7f1452ffd640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f144006b9e0 0x7f144006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:39.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.679+0000 7f1462431640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f144006b9e0 0x7f144006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:39.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.679+0000 7f1462431640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f144006b9e0 0x7f144006dea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1454009b40 tx=0x7f1454009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:39.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.692+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f145807a5a0 con 0x7f145c15dad0 2024-04-15T01:10:39.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.692+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f145c075840 con 0x7f145c15dad0 2024-04-15T01:10:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.886+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f145c075000 con 0x7f145c15dad0 2024-04-15T01:10:39.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.890+0000 7f1452ffd640 1 -- 172.21.15.29:0/3581884816 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f145c075000 con 0x7f145c15dad0 2024-04-15T01:10:39.887 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-15T01:10:39.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f144006b9e0 msgr2=0x7f144006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f144006b9e0 0x7f144006dea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1454009b40 tx=0x7f1454009190 comp rx=0 tx=0).stop 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 msgr2=0x7f145c0cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 0x7f145c0cbed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1458009d90 tx=0x7f1458004a40 comp rx=0 tx=0).stop 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 shutdown_connections 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f144006b9e0 0x7f144006dea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c15dad0 0x7f145c0cbed0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f145c143750 0x7f145c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 --2- 172.21.15.29:0/3581884816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f145c0cac00 0x7f145c0c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 >> 172.21.15.29:0/3581884816 conn(0x7f145c070810 msgr2=0x7f145c158180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 shutdown_connections 2024-04-15T01:10:39.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:39.892+0000 7f1464695640 1 -- 172.21.15.29:0/3581884816 wait complete. 2024-04-15T01:10:39.901 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-15T01:10:39.901 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T01:10:39.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T01:10:40.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 Processor -- start 2024-04-15T01:10:40.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 -- start start 2024-04-15T01:10:40.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0caad0 0x7f9d7c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9d7c0cdd40 0x7f9d7c0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7c15abe0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7c154cf0 con 0x7f9d7c0cdd40 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.061+0000 7f9d8278c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c15b480 con 0x7f9d7c0caad0 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.062+0000 7f9d80d29640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9d7c0cdd40 0x7f9d7c0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.062+0000 7f9d7b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d7c0cd920 0x7f9d7c0cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:47990/0 (socket says 172.21.15.29:47990) 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.062+0000 7f9d7b7fe640 1 -- 172.21.15.29:0/2643242894 learned_addr learned my addr 172.21.15.29:0/2643242894 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:40.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.062+0000 7f9d7bfff640 1 --2- 172.21.15.29:0/2643242894 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0caad0 0x7f9d7c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.064+0000 7f9d7affd640 1 -- 172.21.15.29:0/2643242894 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190547488 0 0) 0x7f9d7c15abe0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.064+0000 7f9d7affd640 1 -- 172.21.15.29:0/2643242894 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d64003520 con 0x7f9d7c0cd920 2024-04-15T01:10:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.065+0000 7f9d80d29640 1 -- 172.21.15.29:0/2643242894 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0caad0 msgr2=0x7f9d7c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.065+0000 7f9d80d29640 1 --2- 172.21.15.29:0/2643242894 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0caad0 0x7f9d7c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.065+0000 7f9d80d29640 1 -- 172.21.15.29:0/2643242894 >> v1:172.21.15.37:6789/0 conn(0x7f9d7c0cd920 legacy=0x7f9d7c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.065+0000 7f9d80d29640 1 -- 172.21.15.29:0/2643242894 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c15aec0 con 0x7f9d7c0cdd40 2024-04-15T01:10:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.066+0000 7f9d80d29640 1 --2- 172.21.15.29:0/2643242894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cdd40 0x7f9d7c0cebd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009d90 tx=0x7f9d7402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c389cdb80ba14 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.070+0000 7f9d7affd640 1 -- 172.21.15.29:0/2643242894 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74039070 con 0x7f9d7c0cdd40 2024-04-15T01:10:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.070+0000 7f9d7affd640 1 -- 172.21.15.29:0/2643242894 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7402cc50 con 0x7f9d7c0cdd40 2024-04-15T01:10:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.070+0000 7f9d7affd640 1 -- 172.21.15.29:0/2643242894 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74034440 con 0x7f9d7c0cdd40 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 -- 172.21.15.29:0/2643242894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cdd40 msgr2=0x7f9d7c0cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2643242894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cdd40 0x7f9d7c0cebd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009d90 tx=0x7f9d7402bea0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 -- 172.21.15.29:0/2643242894 shutdown_connections 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2643242894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cdd40 0x7f9d7c0cebd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2643242894 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0caad0 0x7f9d7c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 -- 172.21.15.29:0/2643242894 >> 172.21.15.29:0/2643242894 conn(0x7f9d7c0cfb20 msgr2=0x7f9d7c0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 -- 172.21.15.29:0/2643242894 shutdown_connections 2024-04-15T01:10:40.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.071+0000 7f9d8278c640 1 -- 172.21.15.29:0/2643242894 wait complete. 2024-04-15T01:10:40.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.072+0000 7f9d8278c640 1 Processor -- start 2024-04-15T01:10:40.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.072+0000 7f9d8278c640 1 -- start start 2024-04-15T01:10:40.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d8278c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d7c0caad0 0x7f9d7c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d8278c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 0x7f9d7c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d8278c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0cdd40 0x7f9d7c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d8278c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0ce6b0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d8278c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0ce3d0 con 0x7f9d7c0caad0 2024-04-15T01:10:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d8278c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0ccc10 con 0x7f9d7c0cdd40 2024-04-15T01:10:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.073+0000 7f9d7b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 0x7f9d7c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.074+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d7c0caad0 0x7f9d7c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.074+0000 7f9d80d29640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0cdd40 0x7f9d7c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.074+0000 7f9d7b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 0x7f9d7c14f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34710/0 (socket says 172.21.15.29:34710) 2024-04-15T01:10:40.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.074+0000 7f9d7b7fe640 1 -- 172.21.15.29:0/2157252213 learned_addr learned my addr 172.21.15.29:0/2157252213 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.077+0000 7f9d7b7fe640 1 -- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0cdd40 msgr2=0x7f9d7c14f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.077+0000 7f9d7b7fe640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0cdd40 0x7f9d7c14f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.077+0000 7f9d7b7fe640 1 -- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d7c0caad0 msgr2=0x7f9d7c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.077+0000 7f9d7b7fe640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d7c0caad0 0x7f9d7c15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.077+0000 7f9d7b7fe640 1 -- 172.21.15.29:0/2157252213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c157ae0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.079+0000 7f9d7b7fe640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 0x7f9d7c14f090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c430 tx=0x7f9d6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:40.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.083+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c017070 con 0x7f9d7c0cd920 2024-04-15T01:10:40.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.083+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6c005ce0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.083+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0072f0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.083+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c1f03b0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.083+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c1f0970 con 0x7f9d7c0cd920 2024-04-15T01:10:40.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.084+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c04f540 con 0x7f9d7c0cd920 2024-04-15T01:10:40.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.103+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9d6c01a070 con 0x7f9d7c0cd920 2024-04-15T01:10:40.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.103+0000 7f9d78ff9640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9d6806b9e0 0x7f9d6806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.104+0000 7f9d7bfff640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9d6806b9e0 0x7f9d6806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.104+0000 7f9d7bfff640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9d6806b9e0 0x7f9d6806dea0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009aa0 tx=0x7f9d70009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:40.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.363+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9d6c056720 con 0x7f9d7c0cd920 2024-04-15T01:10:40.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.364+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9d6c021020 con 0x7f9d7c0cd920 2024-04-15T01:10:40.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.548+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d7c1578c0 con 0x7f9d7c0cd920 2024-04-15T01:10:40.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.589+0000 7f9d78ff9640 1 -- 172.21.15.29:0/2157252213 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7f9d6c058680 con 0x7f9d7c0cd920 2024-04-15T01:10:40.588 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:10:40.588 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T01:10:40.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9d6806b9e0 msgr2=0x7f9d6806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9d6806b9e0 0x7f9d6806dea0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009aa0 tx=0x7f9d70009190 comp rx=0 tx=0).stop 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 msgr2=0x7f9d7c14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 0x7f9d7c14f090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c430 tx=0x7f9d6c00c8f0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 shutdown_connections 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9d6806b9e0 0x7f9d6806dea0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9d7c0cdd40 0x7f9d7c14f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c0cd920 0x7f9d7c14f090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 --2- 172.21.15.29:0/2157252213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d7c0caad0 0x7f9d7c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 >> 172.21.15.29:0/2157252213 conn(0x7f9d7c0cfb20 msgr2=0x7f9d7c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 shutdown_connections 2024-04-15T01:10:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.592+0000 7f9d8278c640 1 -- 172.21.15.29:0/2157252213 wait complete. 2024-04-15T01:10:40.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T00:00:55.371624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T00:01:09.779176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T00:01:11.503018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-15T00:01:16.720777+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-15T01:10:40.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T01:10:40.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.708+0000 7f64afa9d640 1 Processor -- start 2024-04-15T01:10:40.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.709+0000 7f64afa9d640 1 -- start start 2024-04-15T01:10:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.709+0000 7f64afa9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a815ac30 0x7f64a815b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.709+0000 7f64afa9d640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a815ba10 con 0x7f64a80ca470 2024-04-15T01:10:40.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.709+0000 7f64afa9d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a815bc80 con 0x7f64a80cca40 2024-04-15T01:10:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.709+0000 7f64afa9d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f64a8154cc0 con 0x7f64a815ac30 2024-04-15T01:10:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.710+0000 7f64ad038640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f64a80ca470 0x7f64a80cc330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35080/0 (socket says 172.21.15.29:35080) 2024-04-15T01:10:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.710+0000 7f64ad038640 1 -- 172.21.15.29:0/223380479 learned_addr learned my addr 172.21.15.29:0/223380479 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:40.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.710+0000 7f64ad839640 1 --2- 172.21.15.29:0/223380479 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a815ac30 0x7f64a815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237314143 0 0) 0x7f64a815ba10 con 0x7f64a80ca470 2024-04-15T01:10:40.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6494003520 con 0x7f64a80ca470 2024-04-15T01:10:40.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240138267 0 0) 0x7f64a815bc80 con 0x7f64a80cca40 2024-04-15T01:10:40.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64a815ba10 con 0x7f64a80cca40 2024-04-15T01:10:40.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ad839640 1 -- 172.21.15.29:0/223380479 >> v1:172.21.15.37:6789/0 conn(0x7f64a80cca40 legacy=0x7f64a815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ad839640 1 -- 172.21.15.29:0/223380479 >> v1:172.21.15.29:6789/0 conn(0x7f64a80ca470 legacy=0x7f64a80cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.713+0000 7f64ad839640 1 -- 172.21.15.29:0/223380479 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a815bf60 con 0x7f64a815ac30 2024-04-15T01:10:40.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.715+0000 7f64ad839640 1 --2- 172.21.15.29:0/223380479 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a815ac30 0x7f64a815b010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64a40097d0 tx=0x7f64a402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d59a3d07abdbd96 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:40.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.717+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4034070 con 0x7f64a815ac30 2024-04-15T01:10:40.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.719+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a4030880 con 0x7f64a815ac30 2024-04-15T01:10:40.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.719+0000 7f64ac837640 1 -- 172.21.15.29:0/223380479 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4030c30 con 0x7f64a815ac30 2024-04-15T01:10:40.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 -- 172.21.15.29:0/223380479 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a815ac30 msgr2=0x7f64a815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 --2- 172.21.15.29:0/223380479 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a815ac30 0x7f64a815b010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64a40097d0 tx=0x7f64a402b9c0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 -- 172.21.15.29:0/223380479 shutdown_connections 2024-04-15T01:10:40.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 --2- 172.21.15.29:0/223380479 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a815ac30 0x7f64a815b010 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 -- 172.21.15.29:0/223380479 >> 172.21.15.29:0/223380479 conn(0x7f64a80cfaf0 msgr2=0x7f64a80cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:40.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 -- 172.21.15.29:0/223380479 shutdown_connections 2024-04-15T01:10:40.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.720+0000 7f64afa9d640 1 -- 172.21.15.29:0/223380479 wait complete. 2024-04-15T01:10:40.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.721+0000 7f64afa9d640 1 Processor -- start 2024-04-15T01:10:40.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.721+0000 7f64afa9d640 1 -- start start 2024-04-15T01:10:40.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64afa9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a80ca470 0x7f64a81ede30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64afa9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a80cca40 0x7f64a8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64afa9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 0x7f64a8153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64afa9d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80ccec0 con 0x7f64a815ac30 2024-04-15T01:10:40.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64afa9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64a815c5b0 con 0x7f64a80ca470 2024-04-15T01:10:40.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64afa9d640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f64a815d150 con 0x7f64a80cca40 2024-04-15T01:10:40.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.722+0000 7f64ae03a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 0x7f64a8153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.723+0000 7f64ad839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a80ca470 0x7f64a81ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.723+0000 7f64ad038640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a80cca40 0x7f64a8153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.723+0000 7f64ae03a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 0x7f64a8153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34720/0 (socket says 172.21.15.29:34720) 2024-04-15T01:10:40.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.723+0000 7f64ae03a640 1 -- 172.21.15.29:0/2637971799 learned_addr learned my addr 172.21.15.29:0/2637971799 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.726+0000 7f64ae03a640 1 -- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a80cca40 msgr2=0x7f64a8153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.726+0000 7f64ae03a640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a80cca40 0x7f64a8153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.726+0000 7f64ae03a640 1 -- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a80ca470 msgr2=0x7f64a81ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:40.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.726+0000 7f64ae03a640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a80ca470 0x7f64a81ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:40.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.726+0000 7f64ae03a640 1 -- 172.21.15.29:0/2637971799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80b26e0 con 0x7f64a815ac30 2024-04-15T01:10:40.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.729+0000 7f64ae03a640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 0x7f64a8153f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c7c0 tx=0x7f64a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.732+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0003b70 con 0x7f64a815ac30 2024-04-15T01:10:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.732+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a0003d10 con 0x7f64a815ac30 2024-04-15T01:10:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.732+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000aa50 con 0x7f64a815ac30 2024-04-15T01:10:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.732+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a80b2c80 con 0x7f64a815ac30 2024-04-15T01:10:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.732+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a8155920 con 0x7f64a815ac30 2024-04-15T01:10:40.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.733+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a804f540 con 0x7f64a815ac30 2024-04-15T01:10:40.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.752+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f64a000abf0 con 0x7f64a815ac30 2024-04-15T01:10:40.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.752+0000 7f649e7fc640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f648c06b9e0 0x7f648c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:40.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.752+0000 7f64ad839640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f648c06b9e0 0x7f648c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:40.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.753+0000 7f64ad839640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f648c06b9e0 0x7f648c06dea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f64a4036000 tx=0x7f64a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:40.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:40.756+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f64a00577b0 con 0x7f64a815ac30 2024-04-15T01:10:41.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.015+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f64a0059710 con 0x7f64a815ac30 2024-04-15T01:10:41.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.203+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f64a80b10a0 con 0x7f64a815ac30 2024-04-15T01:10:41.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.208+0000 7f649e7fc640 1 -- 172.21.15.29:0/2637971799 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f64a005d7b0 con 0x7f64a815ac30 2024-04-15T01:10:41.205 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-15T01:10:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.209+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f648c06b9e0 msgr2=0x7f648c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.209+0000 7f64afa9d640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f648c06b9e0 0x7f648c06dea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f64a4036000 tx=0x7f64a4008030 comp rx=0 tx=0).stop 2024-04-15T01:10:41.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.209+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 msgr2=0x7f64a8153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.209+0000 7f64afa9d640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 0x7f64a8153f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c7c0 tx=0x7f64a000cc80 comp rx=0 tx=0).stop 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 shutdown_connections 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f648c06b9e0 0x7f648c06dea0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64a815ac30 0x7f64a8153f40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f64a80cca40 0x7f64a8153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 --2- 172.21.15.29:0/2637971799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a80ca470 0x7f64a81ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 >> 172.21.15.29:0/2637971799 conn(0x7f64a80cfaf0 msgr2=0x7f64a80ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 shutdown_connections 2024-04-15T01:10:41.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.210+0000 7f64afa9d640 1 -- 172.21.15.29:0/2637971799 wait complete. 2024-04-15T01:10:41.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T01:10:41.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.326+0000 7fe1c4ec8640 1 Processor -- start 2024-04-15T01:10:41.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.326+0000 7fe1c4ec8640 1 -- start start 2024-04-15T01:10:41.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.327+0000 7fe1c4ec8640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c00cf1a0 0x7fe1c006c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.327+0000 7fe1c4ec8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c00cd980 con 0x7fe1c00d0800 2024-04-15T01:10:41.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.327+0000 7fe1c4ec8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c006c8c0 con 0x7fe1c015a200 2024-04-15T01:10:41.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.327+0000 7fe1c4ec8640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c00cf580 con 0x7fe1c00cf1a0 2024-04-15T01:10:41.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.328+0000 7fe1bdd9b640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe1c00d0800 0x7fe1c00cbc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35090/0 (socket says 172.21.15.29:35090) 2024-04-15T01:10:41.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.328+0000 7fe1bdd9b640 1 -- 172.21.15.29:0/2025097996 learned_addr learned my addr 172.21.15.29:0/2025097996 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:41.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.328+0000 7fe1be59c640 1 --2- 172.21.15.29:0/2025097996 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c00cf1a0 0x7fe1c006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.330+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529003495 0 0) 0x7fe1c006c8c0 con 0x7fe1c015a200 2024-04-15T01:10:41.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.330+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a8003520 con 0x7fe1c015a200 2024-04-15T01:10:41.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.330+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422361738 0 0) 0x7fe1b4001110 con 0x7fe1c00d0800 2024-04-15T01:10:41.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.330+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1c006c8c0 con 0x7fe1c00d0800 2024-04-15T01:10:41.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.331+0000 7fe1be59c640 1 -- 172.21.15.29:0/2025097996 >> v1:172.21.15.37:6789/0 conn(0x7fe1c015a200 legacy=0x7fe1c015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.331+0000 7fe1be59c640 1 -- 172.21.15.29:0/2025097996 >> v1:172.21.15.29:6789/0 conn(0x7fe1c00d0800 legacy=0x7fe1c00cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.331+0000 7fe1be59c640 1 -- 172.21.15.29:0/2025097996 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c006cb50 con 0x7fe1c00cf1a0 2024-04-15T01:10:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.333+0000 7fe1be59c640 1 --2- 172.21.15.29:0/2025097996 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c00cf1a0 0x7fe1c006c380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80097d0 tx=0x7fe1b802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faf4d9e7d64c889e server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.337+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8034070 con 0x7fe1c00cf1a0 2024-04-15T01:10:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.337+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b8030880 con 0x7fe1c00cf1a0 2024-04-15T01:10:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.337+0000 7fe1bd59a640 1 -- 172.21.15.29:0/2025097996 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8030c50 con 0x7fe1c00cf1a0 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/2025097996 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c00cf1a0 msgr2=0x7fe1c006c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/2025097996 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c00cf1a0 0x7fe1c006c380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80097d0 tx=0x7fe1b802b9c0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/2025097996 shutdown_connections 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/2025097996 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c00cf1a0 0x7fe1c006c380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/2025097996 >> 172.21.15.29:0/2025097996 conn(0x7fe1c00cfba0 msgr2=0x7fe1c00cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/2025097996 shutdown_connections 2024-04-15T01:10:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.338+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/2025097996 wait complete. 2024-04-15T01:10:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 Processor -- start 2024-04-15T01:10:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 -- start start 2024-04-15T01:10:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c00cf1a0 0x7fe1c01f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 0x7fe1c00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c015a200 0x7fe1c00cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00cb180 con 0x7fe1c00d0800 2024-04-15T01:10:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00caea0 con 0x7fe1c00cf1a0 2024-04-15T01:10:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.340+0000 7fe1c4ec8640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c00cb460 con 0x7fe1c015a200 2024-04-15T01:10:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.341+0000 7fe1bdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 0x7fe1c00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.341+0000 7fe1be59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c00cf1a0 0x7fe1c01f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.341+0000 7fe1bed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c015a200 0x7fe1c00cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.341+0000 7fe1bdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 0x7fe1c00b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34730/0 (socket says 172.21.15.29:34730) 2024-04-15T01:10:41.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.341+0000 7fe1bdd9b640 1 -- 172.21.15.29:0/976801965 learned_addr learned my addr 172.21.15.29:0/976801965 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.345+0000 7fe1bdd9b640 1 -- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c015a200 msgr2=0x7fe1c00cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.345+0000 7fe1bdd9b640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c015a200 0x7fe1c00cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.345+0000 7fe1bdd9b640 1 -- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c00cf1a0 msgr2=0x7fe1c01f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.345+0000 7fe1bdd9b640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c00cf1a0 0x7fe1c01f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.345+0000 7fe1bdd9b640 1 -- 172.21.15.29:0/976801965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c01f45f0 con 0x7fe1c00d0800 2024-04-15T01:10:41.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.347+0000 7fe1bdd9b640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 0x7fe1c00b3cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c760 tx=0x7fe1b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.351+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4017070 con 0x7fe1c00d0800 2024-04-15T01:10:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.351+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b4005ad0 con 0x7fe1c00d0800 2024-04-15T01:10:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.351+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4007e20 con 0x7fe1c00d0800 2024-04-15T01:10:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.351+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c015af30 con 0x7fe1c00d0800 2024-04-15T01:10:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.351+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c00b1320 con 0x7fe1c00d0800 2024-04-15T01:10:41.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.352+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c00c7690 con 0x7fe1c00d0800 2024-04-15T01:10:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.372+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe1b401a070 con 0x7fe1c00d0800 2024-04-15T01:10:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.373+0000 7fe1aeffd640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1a006b9e0 0x7fe1a006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.373+0000 7fe1be59c640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1a006b9e0 0x7fe1a006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.374+0000 7fe1be59c640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1a006b9e0 0x7fe1a006dea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8036000 tx=0x7fe1b803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:41.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.633+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe1b4056630 con 0x7fe1c00d0800 2024-04-15T01:10:41.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.633+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1c00c7690 con 0x7fe1c00d0800 2024-04-15T01:10:41.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.816+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe1c004f540 con 0x7fe1c00d0800 2024-04-15T01:10:41.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.822+0000 7fe1aeffd640 1 -- 172.21.15.29:0/976801965 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fe1b4021020 con 0x7fe1c00d0800 2024-04-15T01:10:41.819 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1a006b9e0 msgr2=0x7fe1a006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1a006b9e0 0x7fe1a006dea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8036000 tx=0x7fe1b803b040 comp rx=0 tx=0).stop 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 msgr2=0x7fe1c00b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 0x7fe1c00b3cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c760 tx=0x7fe1b400cc20 comp rx=0 tx=0).stop 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 shutdown_connections 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe1a006b9e0 0x7fe1a006dea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe1c015a200 0x7fe1c00cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1c00d0800 0x7fe1c00b3cc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 --2- 172.21.15.29:0/976801965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c00cf1a0 0x7fe1c01f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 >> 172.21.15.29:0/976801965 conn(0x7fe1c00cfba0 msgr2=0x7fe1c0154080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 shutdown_connections 2024-04-15T01:10:41.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.824+0000 7fe1c4ec8640 1 -- 172.21.15.29:0/976801965 wait complete. 2024-04-15T01:10:41.833 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T01:10:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.943+0000 7f23c17bb640 1 Processor -- start 2024-04-15T01:10:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.943+0000 7f23c17bb640 1 -- start start 2024-04-15T01:10:41.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.944+0000 7f23c17bb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc157670 0x7f23bc157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.944+0000 7f23c17bb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc0c4010 con 0x7f23bc14dbb0 2024-04-15T01:10:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.944+0000 7f23c17bb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc0c42f0 con 0x7f23bc0c6c60 2024-04-15T01:10:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.944+0000 7f23c17bb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc1571e0 con 0x7f23bc157670 2024-04-15T01:10:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.945+0000 7f23baffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f23bc14dbb0 0x7f23bc072f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:35106/0 (socket says 172.21.15.29:35106) 2024-04-15T01:10:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.945+0000 7f23baffd640 1 -- 172.21.15.29:0/2834552544 learned_addr learned my addr 172.21.15.29:0/2834552544 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:41.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.945+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/2834552544 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc157670 0x7f23bc157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696372287 0 0) 0x7f23bc0c4010 con 0x7f23bc14dbb0 2024-04-15T01:10:41.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23a8003520 con 0x7f23bc14dbb0 2024-04-15T01:10:41.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779213818 0 0) 0x7f23bc0c42f0 con 0x7f23bc0c6c60 2024-04-15T01:10:41.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23bc0c4010 con 0x7f23bc0c6c60 2024-04-15T01:10:41.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23bb7fe640 1 -- 172.21.15.29:0/2834552544 >> v1:172.21.15.37:6789/0 conn(0x7f23bc0c6c60 legacy=0x7f23bc0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23bb7fe640 1 -- 172.21.15.29:0/2834552544 >> v1:172.21.15.29:6789/0 conn(0x7f23bc14dbb0 legacy=0x7f23bc072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.948+0000 7f23bb7fe640 1 -- 172.21.15.29:0/2834552544 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc0c45d0 con 0x7f23bc157670 2024-04-15T01:10:41.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.950+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/2834552544 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc157670 0x7f23bc157b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097d0 tx=0x7f23b402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9470ea28b0790ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:41.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.954+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4035020 con 0x7f23bc157670 2024-04-15T01:10:41.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.954+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b4031890 con 0x7f23bc157670 2024-04-15T01:10:41.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.954+0000 7f23b9ffb640 1 -- 172.21.15.29:0/2834552544 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4031c60 con 0x7f23bc157670 2024-04-15T01:10:41.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 -- 172.21.15.29:0/2834552544 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc157670 msgr2=0x7f23bc157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 --2- 172.21.15.29:0/2834552544 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc157670 0x7f23bc157b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097d0 tx=0x7f23b402b930 comp rx=0 tx=0).stop 2024-04-15T01:10:41.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 -- 172.21.15.29:0/2834552544 shutdown_connections 2024-04-15T01:10:41.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 --2- 172.21.15.29:0/2834552544 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc157670 0x7f23bc157b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 -- 172.21.15.29:0/2834552544 >> 172.21.15.29:0/2834552544 conn(0x7f23bc06c310 msgr2=0x7f23bc06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:41.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 -- 172.21.15.29:0/2834552544 shutdown_connections 2024-04-15T01:10:41.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.955+0000 7f23c17bb640 1 -- 172.21.15.29:0/2834552544 wait complete. 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.956+0000 7f23c17bb640 1 Processor -- start 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.956+0000 7f23c17bb640 1 -- start start 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23c17bb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc0c6c60 0x7f23bc144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23c17bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23bc14dbb0 0x7f23bc149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23c17bb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 0x7f23bc146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23c17bb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0c4d10 con 0x7f23bc157670 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23c17bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0c4b90 con 0x7f23bc14dbb0 2024-04-15T01:10:41.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23c17bb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc073630 con 0x7f23bc0c6c60 2024-04-15T01:10:41.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.957+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 0x7f23bc146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.958+0000 7f23baffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc0c6c60 0x7f23bc144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.958+0000 7f23ba7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23bc14dbb0 0x7f23bc149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:41.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.958+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 0x7f23bc146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34738/0 (socket says 172.21.15.29:34738) 2024-04-15T01:10:41.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.958+0000 7f23bb7fe640 1 -- 172.21.15.29:0/375826144 learned_addr learned my addr 172.21.15.29:0/375826144 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.961+0000 7f23bb7fe640 1 -- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc0c6c60 msgr2=0x7f23bc144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.961+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc0c6c60 0x7f23bc144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.961+0000 7f23bb7fe640 1 -- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23bc14dbb0 msgr2=0x7f23bc149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.961+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23bc14dbb0 0x7f23bc149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:41.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.962+0000 7f23bb7fe640 1 -- 172.21.15.29:0/375826144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc145720 con 0x7f23bc157670 2024-04-15T01:10:41.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.964+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 0x7f23bc146c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23b402b970 tx=0x7f23b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.967+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4035040 con 0x7f23bc157670 2024-04-15T01:10:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.968+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b40305f0 con 0x7f23bc157670 2024-04-15T01:10:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.968+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc0c78b0 con 0x7f23bc157670 2024-04-15T01:10:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.968+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40309c0 con 0x7f23bc157670 2024-04-15T01:10:41.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.968+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc146700 con 0x7f23bc157670 2024-04-15T01:10:41.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:41.969+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc0c7dd0 con 0x7f23bc157670 2024-04-15T01:10:42.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.241+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f23b404d060 con 0x7f23bc157670 2024-04-15T01:10:42.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.241+0000 7f23b37fe640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f239c06ba10 0x7f239c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.241+0000 7f23baffd640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f239c06ba10 0x7f239c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.242+0000 7f23baffd640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f239c06ba10 0x7f239c06ded0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0012e0 tx=0x7f23ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.255+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f23b407b430 con 0x7f23bc157670 2024-04-15T01:10:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.255+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f23b4041070 con 0x7f23bc157670 2024-04-15T01:10:42.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.438+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23bc1464f0 con 0x7f23bc157670 2024-04-15T01:10:42.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.444+0000 7f23b37fe640 1 -- 172.21.15.29:0/375826144 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f23b402d040 con 0x7f23bc157670 2024-04-15T01:10:42.441 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-15T01:10:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f239c06ba10 msgr2=0x7f239c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f239c06ba10 0x7f239c06ded0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0012e0 tx=0x7f23ac009040 comp rx=0 tx=0).stop 2024-04-15T01:10:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 msgr2=0x7f23bc146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 0x7f23bc146c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23b402b970 tx=0x7f23b40046c0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 shutdown_connections 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f239c06ba10 0x7f239c06ded0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc157670 0x7f23bc146c20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23bc14dbb0 0x7f23bc149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 --2- 172.21.15.29:0/375826144 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f23bc0c6c60 0x7f23bc144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.446+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 >> 172.21.15.29:0/375826144 conn(0x7f23bc06c310 msgr2=0x7f23bc155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.447+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 shutdown_connections 2024-04-15T01:10:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.447+0000 7f23c17bb640 1 -- 172.21.15.29:0/375826144 wait complete. 2024-04-15T01:10:42.455 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-15T01:10:42.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.563+0000 7fd0af37b640 1 Processor -- start 2024-04-15T01:10:42.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.563+0000 7fd0af37b640 1 -- start start 2024-04-15T01:10:42.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.564+0000 7fd0af37b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80c3020 0x7fd0a806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.564+0000 7fd0af37b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a80b1260 0x7fd0a80c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.564+0000 7fd0af37b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a815b250 con 0x7fd0a80c2c40 2024-04-15T01:10:42.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.564+0000 7fd0af37b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a815adc0 con 0x7fd0a80b1260 2024-04-15T01:10:42.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.564+0000 7fd0af37b640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a806b7d0 con 0x7fd0a80c3020 2024-04-15T01:10:42.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.565+0000 7fd0ac916640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80c3020 0x7fd0a806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.565+0000 7fd0ad918640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a80b1260 0x7fd0a80c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.565+0000 7fd0ad117640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0a80c2c40 0x7fd0a815e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:48022/0 (socket says 172.21.15.29:48022) 2024-04-15T01:10:42.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.565+0000 7fd0ad117640 1 -- 172.21.15.29:0/1505391981 learned_addr learned my addr 172.21.15.29:0/1505391981 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:42.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.568+0000 7fd0ac916640 1 -- 172.21.15.29:0/1505391981 >> v2:172.21.15.37:3300/0 conn(0x7fd0a80b1260 msgr2=0x7fd0a80c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:42.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.568+0000 7fd0ac916640 1 --2- 172.21.15.29:0/1505391981 >> v2:172.21.15.37:3300/0 conn(0x7fd0a80b1260 0x7fd0a80c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.568+0000 7fd0ac916640 1 -- 172.21.15.29:0/1505391981 >> v1:172.21.15.37:6789/0 conn(0x7fd0a80c2c40 legacy=0x7fd0a815e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:42.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.568+0000 7fd0ac916640 1 -- 172.21.15.29:0/1505391981 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a815a490 con 0x7fd0a80c3020 2024-04-15T01:10:42.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.571+0000 7fd0ac916640 1 --2- 172.21.15.29:0/1505391981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80c3020 0x7fd0a806bce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0097a0 tx=0x7fd09c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c02494a8443efd server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.575+0000 7fd0a7fff640 1 -- 172.21.15.29:0/1505391981 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c034070 con 0x7fd0a80c3020 2024-04-15T01:10:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.575+0000 7fd0a7fff640 1 -- 172.21.15.29:0/1505391981 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c030610 con 0x7fd0a80c3020 2024-04-15T01:10:42.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.575+0000 7fd0a7fff640 1 -- 172.21.15.29:0/1505391981 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0309e0 con 0x7fd0a80c3020 2024-04-15T01:10:42.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 -- 172.21.15.29:0/1505391981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80c3020 msgr2=0x7fd0a806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:42.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 --2- 172.21.15.29:0/1505391981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80c3020 0x7fd0a806bce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0097a0 tx=0x7fd09c02b960 comp rx=0 tx=0).stop 2024-04-15T01:10:42.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 -- 172.21.15.29:0/1505391981 shutdown_connections 2024-04-15T01:10:42.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 --2- 172.21.15.29:0/1505391981 >> v2:172.21.15.37:3300/0 conn(0x7fd0a80b1260 0x7fd0a80c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 --2- 172.21.15.29:0/1505391981 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80c3020 0x7fd0a806bce0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 -- 172.21.15.29:0/1505391981 >> 172.21.15.29:0/1505391981 conn(0x7fd0a806f920 msgr2=0x7fd0a806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:42.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 -- 172.21.15.29:0/1505391981 shutdown_connections 2024-04-15T01:10:42.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.576+0000 7fd0af37b640 1 -- 172.21.15.29:0/1505391981 wait complete. 2024-04-15T01:10:42.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.577+0000 7fd0af37b640 1 Processor -- start 2024-04-15T01:10:42.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.577+0000 7fd0af37b640 1 -- start start 2024-04-15T01:10:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0af37b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80b1260 0x7fd0a8155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0af37b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a80c2c40 0x7fd0a8155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0af37b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 0x7fd0a81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0af37b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a806c220 con 0x7fd0a80c3020 2024-04-15T01:10:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0af37b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a815aa50 con 0x7fd0a80c2c40 2024-04-15T01:10:42.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0af37b640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a806c3a0 con 0x7fd0a80b1260 2024-04-15T01:10:42.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0ad918640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 0x7fd0a81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0ac916640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a80c2c40 0x7fd0a8155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.578+0000 7fd0ad117640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80b1260 0x7fd0a8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.579+0000 7fd0ad918640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 0x7fd0a81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34744/0 (socket says 172.21.15.29:34744) 2024-04-15T01:10:42.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.579+0000 7fd0ad918640 1 -- 172.21.15.29:0/691733899 learned_addr learned my addr 172.21.15.29:0/691733899 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:42.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.582+0000 7fd0ad918640 1 -- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80b1260 msgr2=0x7fd0a8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:42.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.582+0000 7fd0ad918640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80b1260 0x7fd0a8155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.582+0000 7fd0ad918640 1 -- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a80c2c40 msgr2=0x7fd0a8155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:42.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.582+0000 7fd0ad918640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a80c2c40 0x7fd0a8155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:42.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.582+0000 7fd0ad918640 1 -- 172.21.15.29:0/691733899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a80cc630 con 0x7fd0a80c3020 2024-04-15T01:10:42.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.585+0000 7fd0ad918640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 0x7fd0a81525f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd09800efc0 tx=0x7fd09800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:42.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.588+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098018020 con 0x7fd0a80c3020 2024-04-15T01:10:42.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.588+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd098014480 con 0x7fd0a80c3020 2024-04-15T01:10:42.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.588+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098014870 con 0x7fd0a80c3020 2024-04-15T01:10:42.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.588+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a80cbd90 con 0x7fd0a80c3020 2024-04-15T01:10:42.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.589+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a80cc350 con 0x7fd0a80c3020 2024-04-15T01:10:42.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.590+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a804f540 con 0x7fd0a80c3020 2024-04-15T01:10:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.608+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd098005d10 con 0x7fd0a80c3020 2024-04-15T01:10:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.608+0000 7fd0a5ffb640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd09406b9e0 0x7fd09406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.609+0000 7fd0ad117640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd09406b9e0 0x7fd09406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.609+0000 7fd0ad117640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd09406b9e0 0x7fd09406dea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a0007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:42.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.612+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd098058190 con 0x7fd0a80c3020 2024-04-15T01:10:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:42.872+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd098022030 con 0x7fd0a80c3020 2024-04-15T01:10:43.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.099+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd0a8072c10 con 0x7fd0a80c3020 2024-04-15T01:10:43.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.106+0000 7fd0a5ffb640 1 -- 172.21.15.29:0/691733899 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fd098010040 con 0x7fd0a80c3020 2024-04-15T01:10:43.104 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-15T01:10:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd09406b9e0 msgr2=0x7fd09406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd09406b9e0 0x7fd09406dea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a0007e80 comp rx=0 tx=0).stop 2024-04-15T01:10:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 msgr2=0x7fd0a81525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 0x7fd0a81525f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd09800efc0 tx=0x7fd09800c490 comp rx=0 tx=0).stop 2024-04-15T01:10:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 shutdown_connections 2024-04-15T01:10:43.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd09406b9e0 0x7fd09406dea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0a80c3020 0x7fd0a81525f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a80c2c40 0x7fd0a8155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 --2- 172.21.15.29:0/691733899 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd0a80b1260 0x7fd0a8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 >> 172.21.15.29:0/691733899 conn(0x7fd0a806f920 msgr2=0x7fd0a806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 shutdown_connections 2024-04-15T01:10:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.109+0000 7fd0af37b640 1 -- 172.21.15.29:0/691733899 wait complete. 2024-04-15T01:10:43.118 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T01:10:43.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.223+0000 7f1dc80de640 1 Processor -- start 2024-04-15T01:10:43.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.224+0000 7f1dc80de640 1 -- start start 2024-04-15T01:10:43.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.224+0000 7f1dc80de640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1dc0154760 0x7f1dc00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:43.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.224+0000 7f1dc80de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015e470 0x7f1dc015d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:43.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.224+0000 7f1dc80de640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc00cc370 con 0x7f1dc015deb0 2024-04-15T01:10:43.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.224+0000 7f1dc80de640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc0154b40 con 0x7f1dc0154760 2024-04-15T01:10:43.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.224+0000 7f1dc80de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc00ce630 con 0x7f1dc015e470 2024-04-15T01:10:43.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.225+0000 7f1dc5e7a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1dc0154760 0x7f1dc00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:43.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.225+0000 7f1dc667b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1dc015deb0 0x7f1dc00ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:48034/0 (socket says 172.21.15.29:48034) 2024-04-15T01:10:43.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.225+0000 7f1dc667b640 1 -- 172.21.15.29:0/2452690898 learned_addr learned my addr 172.21.15.29:0/2452690898 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:43.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.225+0000 7f1dc5679640 1 --2- 172.21.15.29:0/2452690898 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015e470 0x7f1dc015d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:43.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.228+0000 7f1dc4e78640 1 -- 172.21.15.29:0/2452690898 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890827898 0 0) 0x7f1dc00cc370 con 0x7f1dc015deb0 2024-04-15T01:10:43.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.228+0000 7f1dc4e78640 1 -- 172.21.15.29:0/2452690898 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dac003520 con 0x7f1dc015deb0 2024-04-15T01:10:43.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.228+0000 7f1dc5e7a640 1 -- 172.21.15.29:0/2452690898 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015e470 msgr2=0x7f1dc015d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:43.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.228+0000 7f1dc5e7a640 1 --2- 172.21.15.29:0/2452690898 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015e470 0x7f1dc015d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.228+0000 7f1dc5e7a640 1 -- 172.21.15.29:0/2452690898 >> v1:172.21.15.37:6789/0 conn(0x7f1dc015deb0 legacy=0x7f1dc00ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.228+0000 7f1dc5e7a640 1 -- 172.21.15.29:0/2452690898 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc00ce910 con 0x7f1dc0154760 2024-04-15T01:10:43.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.230+0000 7f1dc5e7a640 1 --2- 172.21.15.29:0/2452690898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc0154760 0x7f1dc00ca6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0097a0 tx=0x7f1dbc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d4209493feb28c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:43.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc4e78640 1 -- 172.21.15.29:0/2452690898 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc035020 con 0x7f1dc0154760 2024-04-15T01:10:43.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc4e78640 1 -- 172.21.15.29:0/2452690898 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dbc031810 con 0x7f1dc0154760 2024-04-15T01:10:43.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc4e78640 1 -- 172.21.15.29:0/2452690898 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc031be0 con 0x7f1dc0154760 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 -- 172.21.15.29:0/2452690898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc0154760 msgr2=0x7f1dc00ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 --2- 172.21.15.29:0/2452690898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc0154760 0x7f1dc00ca6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0097a0 tx=0x7f1dbc02b8b0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 -- 172.21.15.29:0/2452690898 shutdown_connections 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 --2- 172.21.15.29:0/2452690898 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015e470 0x7f1dc015d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 --2- 172.21.15.29:0/2452690898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc0154760 0x7f1dc00ca6d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 -- 172.21.15.29:0/2452690898 >> 172.21.15.29:0/2452690898 conn(0x7f1dc0061c20 msgr2=0x7f1dc0062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 -- 172.21.15.29:0/2452690898 shutdown_connections 2024-04-15T01:10:43.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.234+0000 7f1dc80de640 1 -- 172.21.15.29:0/2452690898 wait complete. 2024-04-15T01:10:43.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.236+0000 7f1dc80de640 1 Processor -- start 2024-04-15T01:10:43.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.236+0000 7f1dc80de640 1 -- start start 2024-04-15T01:10:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc80de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc0154760 0x7f1dc014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc80de640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015deb0 0x7f1dc015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc80de640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 0x7f1dc015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc80de640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc00ceed0 con 0x7f1dc015e470 2024-04-15T01:10:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc80de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc00cc5e0 con 0x7f1dc0154760 2024-04-15T01:10:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc80de640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc00cac10 con 0x7f1dc015deb0 2024-04-15T01:10:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc667b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 0x7f1dc015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc5e7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc0154760 0x7f1dc014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc5679640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015deb0 0x7f1dc015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc667b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 0x7f1dc015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34770/0 (socket says 172.21.15.29:34770) 2024-04-15T01:10:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.237+0000 7f1dc667b640 1 -- 172.21.15.29:0/4067410365 learned_addr learned my addr 172.21.15.29:0/4067410365 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.241+0000 7f1dc667b640 1 -- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015deb0 msgr2=0x7f1dc015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.241+0000 7f1dc667b640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015deb0 0x7f1dc015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.241+0000 7f1dc667b640 1 -- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc0154760 msgr2=0x7f1dc014a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.241+0000 7f1dc667b640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc0154760 0x7f1dc014a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.241+0000 7f1dc667b640 1 -- 172.21.15.29:0/4067410365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc01503e0 con 0x7f1dc015e470 2024-04-15T01:10:43.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.243+0000 7f1dc667b640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 0x7f1dc015ad20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1db800cb40 tx=0x7f1db800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.247+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8017070 con 0x7f1dc015e470 2024-04-15T01:10:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.247+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db800abe0 con 0x7f1dc015e470 2024-04-15T01:10:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.247+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8012400 con 0x7f1dc015e470 2024-04-15T01:10:43.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.247+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc0158690 con 0x7f1dc015e470 2024-04-15T01:10:43.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.247+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc0158c50 con 0x7f1dc015e470 2024-04-15T01:10:43.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.248+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc00d0b50 con 0x7f1dc015e470 2024-04-15T01:10:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.268+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1db801a070 con 0x7f1dc015e470 2024-04-15T01:10:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.268+0000 7f1db67fc640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1da406b9e0 0x7f1da406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:43.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.268+0000 7f1dc5e7a640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1da406b9e0 0x7f1da406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:43.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.269+0000 7f1dc5e7a640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1da406b9e0 0x7f1da406dea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc036000 tx=0x7f1dbc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:43.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.525+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1db80570b0 con 0x7f1dc015e470 2024-04-15T01:10:43.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.526+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1dc00d0b50 con 0x7f1dc015e470 2024-04-15T01:10:43.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.719+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1dc00733c0 con 0x7f1dc015e470 2024-04-15T01:10:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.723+0000 7f1db67fc640 1 -- 172.21.15.29:0/4067410365 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f1dc00733c0 con 0x7f1dc015e470 2024-04-15T01:10:43.721 INFO:teuthology.orchestra.run.smithi029.stderr:listed 0 entries 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1da406b9e0 msgr2=0x7f1da406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1da406b9e0 0x7f1da406dea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc036000 tx=0x7f1dbc008030 comp rx=0 tx=0).stop 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 msgr2=0x7f1dc015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 0x7f1dc015ad20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1db800cb40 tx=0x7f1db800a060 comp rx=0 tx=0).stop 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 shutdown_connections 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f1da406b9e0 0x7f1da406dea0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dc015e470 0x7f1dc015ad20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f1dc015deb0 0x7f1dc015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 --2- 172.21.15.29:0/4067410365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc0154760 0x7f1dc014a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 >> 172.21.15.29:0/4067410365 conn(0x7f1dc0061c20 msgr2=0x7f1dc015c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 shutdown_connections 2024-04-15T01:10:43.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:43.725+0000 7f1dc80de640 1 -- 172.21.15.29:0/4067410365 wait complete. 2024-04-15T01:10:43.734 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-04-15T01:10:43.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T01:10:43.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-15T01:10:43.761 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:10:43.799 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[46478]: fuse finished with error 0 and tester_r 0 2024-04-15T01:10:44.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:==00:01:08:11.000 46478== 2024-04-15T01:10:44.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:==00:01:08:11.000 46478== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:10:44.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:10:49.863 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:10:49.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T01:10:49.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T01:10:49.864 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-15T01:10:49.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T01:10:49.882 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-04-15T01:10:49.939 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T01:10:49.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T01:10:49.940 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T01:10:50.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T01:10:50.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-04-15T01:10:50.121 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-15T01:10:50.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T01:10:50.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.239+0000 7fe5d15bb640 1 Processor -- start 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.239+0000 7fe5d15bb640 1 -- start start 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.240+0000 7fe5d15bb640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5cc0cc530 0x7fe5cc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.240+0000 7fe5d15bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5cc0cdff0 0x7fe5cc0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.240+0000 7fe5d15bb640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5cc0cf910 con 0x7fe5cc15b110 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.240+0000 7fe5d15bb640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe5cc0cf350 con 0x7fe5cc0cc530 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.240+0000 7fe5d15bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe5cc0cf630 con 0x7fe5cc0cdff0 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.241+0000 7fe5cb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5cc0cdff0 0x7fe5cc0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.241+0000 7fe5cb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5cc0cdff0 0x7fe5cc0ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:33216/0 (socket says 172.21.15.29:33216) 2024-04-15T01:10:50.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.241+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/1078438865 learned_addr learned my addr 172.21.15.29:0/1078438865 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:50.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.245+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/1078438865 >> v2:172.21.15.29:3300/0 conn(0x7fe5cc0cc530 msgr2=0x7fe5cc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:50.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.245+0000 7fe5cb7fe640 1 --2- 172.21.15.29:0/1078438865 >> v2:172.21.15.29:3300/0 conn(0x7fe5cc0cc530 0x7fe5cc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.245+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/1078438865 >> v1:172.21.15.29:6789/0 conn(0x7fe5cc15b110 legacy=0x7fe5cc06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:50.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.245+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/1078438865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5cc15a630 con 0x7fe5cc0cdff0 2024-04-15T01:10:50.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.248+0000 7fe5cb7fe640 1 --2- 172.21.15.29:0/1078438865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc0cdff0 0x7fe5cc0ce400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0c6b80 tx=0x7fe5c402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a7235ca76a316b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:50.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.252+0000 7fe5c9ffb640 1 -- 172.21.15.29:0/1078438865 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c402ca80 con 0x7fe5cc0cdff0 2024-04-15T01:10:50.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.252+0000 7fe5c9ffb640 1 -- 172.21.15.29:0/1078438865 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c402cc20 con 0x7fe5cc0cdff0 2024-04-15T01:10:50.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.252+0000 7fe5c9ffb640 1 -- 172.21.15.29:0/1078438865 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40343f0 con 0x7fe5cc0cdff0 2024-04-15T01:10:50.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 -- 172.21.15.29:0/1078438865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc0cdff0 msgr2=0x7fe5cc0ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/1078438865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc0cdff0 0x7fe5cc0ce400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0c6b80 tx=0x7fe5c402bee0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 -- 172.21.15.29:0/1078438865 shutdown_connections 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/1078438865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc0cdff0 0x7fe5cc0ce400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/1078438865 >> v2:172.21.15.29:3300/0 conn(0x7fe5cc0cc530 0x7fe5cc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 -- 172.21.15.29:0/1078438865 >> 172.21.15.29:0/1078438865 conn(0x7fe5cc0cfb20 msgr2=0x7fe5cc0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 -- 172.21.15.29:0/1078438865 shutdown_connections 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.253+0000 7fe5d15bb640 1 -- 172.21.15.29:0/1078438865 wait complete. 2024-04-15T01:10:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.254+0000 7fe5d15bb640 1 Processor -- start 2024-04-15T01:10:50.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.254+0000 7fe5d15bb640 1 -- start start 2024-04-15T01:10:50.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5d15bb640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe5cc0cc530 0x7fe5cc0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5d15bb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5cc0cdff0 0x7fe5cc0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5d15bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 0x7fe5cc0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5d15bb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc0cebc0 con 0x7fe5cc0cdff0 2024-04-15T01:10:50.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5d15bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc15abf0 con 0x7fe5cc15b110 2024-04-15T01:10:50.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5d15bb640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe5cc154b10 con 0x7fe5cc0cc530 2024-04-15T01:10:50.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.255+0000 7fe5cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 0x7fe5cc0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.256+0000 7fe5caffd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe5cc0cc530 0x7fe5cc0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.256+0000 7fe5cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 0x7fe5cc0b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:33220/0 (socket says 172.21.15.29:33220) 2024-04-15T01:10:50.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.256+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/196085592 learned_addr learned my addr 172.21.15.29:0/196085592 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:50.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.260+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe5cc0cc530 msgr2=0x7fe5cc0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.260+0000 7fe5cb7fe640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe5cc0cc530 0x7fe5cc0b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.260+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/196085592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5cc0cdff0 msgr2=0x7fe5cc0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.260+0000 7fe5cb7fe640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5cc0cdff0 0x7fe5cc0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.260+0000 7fe5cb7fe640 1 -- 172.21.15.29:0/196085592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5cc15a2b0 con 0x7fe5cc15b110 2024-04-15T01:10:50.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.262+0000 7fe5cb7fe640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 0x7fe5cc0b0b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4036040 tx=0x7fe5c4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:50.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.266+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4043020 con 0x7fe5cc15b110 2024-04-15T01:10:50.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.266+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c403e450 con 0x7fe5cc15b110 2024-04-15T01:10:50.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.266+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c403e840 con 0x7fe5cc15b110 2024-04-15T01:10:50.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.266+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5cc0cb550 con 0x7fe5cc15b110 2024-04-15T01:10:50.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.267+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5cc0c95f0 con 0x7fe5cc15b110 2024-04-15T01:10:50.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.268+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5cc04f540 con 0x7fe5cc15b110 2024-04-15T01:10:50.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.552+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe5c4046020 con 0x7fe5cc15b110 2024-04-15T01:10:50.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.552+0000 7fe5b37fe640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe5b806b9e0 0x7fe5b806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.552+0000 7fe5caffd640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe5b806b9e0 0x7fe5b806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.553+0000 7fe5caffd640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe5b806b9e0 0x7fe5b806dea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009990 tx=0x7fe5c0009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:50.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.556+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe5c4079cd0 con 0x7fe5cc15b110 2024-04-15T01:10:50.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.567+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe5c404d030 con 0x7fe5cc15b110 2024-04-15T01:10:50.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.743+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5cc06e000 con 0x7fe5b806b9e0 2024-04-15T01:10:50.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.753+0000 7fe5b37fe640 1 -- 172.21.15.29:0/196085592 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335006 (secure 0 0 0) 0x7fe5cc06e000 con 0x7fe5b806b9e0 2024-04-15T01:10:50.756 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:10:50.758 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe5b806b9e0 msgr2=0x7fe5b806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe5b806b9e0 0x7fe5b806dea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009990 tx=0x7fe5c0009110 comp rx=0 tx=0).stop 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 msgr2=0x7fe5cc0b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 0x7fe5cc0b0b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4036040 tx=0x7fe5c4004a40 comp rx=0 tx=0).stop 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 shutdown_connections 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe5b806b9e0 0x7fe5b806dea0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5cc15b110 0x7fe5cc0b0b00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5cc0cdff0 0x7fe5cc0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 --2- 172.21.15.29:0/196085592 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe5cc0cc530 0x7fe5cc0b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 >> 172.21.15.29:0/196085592 conn(0x7fe5cc0cfb20 msgr2=0x7fe5cc14f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 shutdown_connections 2024-04-15T01:10:50.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.756+0000 7fe5d15bb640 1 -- 172.21.15.29:0/196085592 wait complete. 2024-04-15T01:10:50.766 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2120,"stamp":"2024-04-15T01:10:50.023739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182212376,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":6016,"num_read_kb":1595737,"num_write":54695,"num_write_kb":4529750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63524,"ondisk_log_size":63524,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1089112,"kb_used_data":171032,"kb_used_omap":12,"kb_used_meta":918003,"kb_avail":753885608,"statfs":{"total":773094113280,"available":771978862592,"internally_reserved":0,"allocated":175136768,"data_stored":365444512,"data_compressed":48398084,"data_compressed_allocated":63004672,"data_compressed_original":255000576,"omap_allocated":12751,"internal_metadata":940035633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14025,"num_objects":-12,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":46,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003662"},"pg_stats":[{"pgid":"2.1f","version":"29'501","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:03.426864+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T01:10:03.426864+0000","last_peered":"2024-04-15T01:10:03.426864+0000","last_clean":"2024-04-15T01:10:03.426864+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T01:10:03.426864+0000","last_undegraded":"2024-04-15T01:10:03.426864+0000","last_fullsized":"2024-04-15T01:10:03.426864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'200","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024578+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T01:10:44.024578+0000","last_peered":"2024-04-15T01:10:44.024578+0000","last_clean":"2024-04-15T01:10:44.024578+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T01:10:44.024578+0000","last_undegraded":"2024-04-15T01:10:44.024578+0000","last_fullsized":"2024-04-15T01:10:44.024578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'821","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.274399+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T01:10:33.274399+0000","last_peered":"2024-04-15T01:10:33.274399+0000","last_clean":"2024-04-15T01:10:33.274399+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T01:10:33.274399+0000","last_undegraded":"2024-04-15T01:10:33.274399+0000","last_fullsized":"2024-04-15T01:10:33.274399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":55758,"num_write":811,"num_write_kb":161190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'216","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:21.424765+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T01:09:21.424765+0000","last_peered":"2024-04-15T01:09:21.424765+0000","last_clean":"2024-04-15T01:09:21.424765+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T01:09:21.424765+0000","last_undegraded":"2024-04-15T01:09:21.424765+0000","last_fullsized":"2024-04-15T01:09:21.424765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'182","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100863+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T01:10:44.100863+0000","last_peered":"2024-04-15T01:10:44.100863+0000","last_clean":"2024-04-15T01:10:44.100863+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T01:10:44.100863+0000","last_undegraded":"2024-04-15T01:10:44.100863+0000","last_fullsized":"2024-04-15T01:10:44.100863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'760","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326809+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T01:10:31.326809+0000","last_peered":"2024-04-15T01:10:31.326809+0000","last_clean":"2024-04-15T01:10:31.326809+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:31.326809+0000","last_undegraded":"2024-04-15T01:10:31.326809+0000","last_fullsized":"2024-04-15T01:10:31.326809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42531,"num_write":744,"num_write_kb":122981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1119","reported_seq":1174,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.796641+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T01:10:23.796641+0000","last_peered":"2024-04-15T01:10:23.796641+0000","last_clean":"2024-04-15T01:10:23.796641+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T01:10:23.796641+0000","last_undegraded":"2024-04-15T01:10:23.796641+0000","last_fullsized":"2024-04-15T01:10:23.796641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":12823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.096991+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T01:10:44.096991+0000","last_peered":"2024-04-15T01:10:44.096991+0000","last_clean":"2024-04-15T01:10:44.096991+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T01:10:44.096991+0000","last_undegraded":"2024-04-15T01:10:44.096991+0000","last_fullsized":"2024-04-15T01:10:44.096991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'741","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.169772+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T01:10:30.169772+0000","last_peered":"2024-04-15T01:10:30.169772+0000","last_clean":"2024-04-15T01:10:30.169772+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T01:10:30.169772+0000","last_undegraded":"2024-04-15T01:10:30.169772+0000","last_fullsized":"2024-04-15T01:10:30.169772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8438,"num_write":729,"num_write_kb":110173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'784","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:06.691411+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T01:10:06.691411+0000","last_peered":"2024-04-15T01:10:06.691411+0000","last_clean":"2024-04-15T01:10:06.691411+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T01:10:06.691411+0000","last_undegraded":"2024-04-15T01:10:06.691411+0000","last_fullsized":"2024-04-15T01:10:06.691411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.101557+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T01:10:44.101557+0000","last_peered":"2024-04-15T01:10:44.101557+0000","last_clean":"2024-04-15T01:10:44.101557+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T01:10:44.101557+0000","last_undegraded":"2024-04-15T01:10:44.101557+0000","last_fullsized":"2024-04-15T01:10:44.101557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'759","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.552677+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T01:10:30.552677+0000","last_peered":"2024-04-15T01:10:30.552677+0000","last_clean":"2024-04-15T01:10:30.552677+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T01:10:30.552677+0000","last_undegraded":"2024-04-15T01:10:30.552677+0000","last_fullsized":"2024-04-15T01:10:30.552677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":36806,"num_write":750,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'207","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119353+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T01:10:44.119353+0000","last_peered":"2024-04-15T01:10:44.119353+0000","last_clean":"2024-04-15T01:10:44.119353+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T01:10:44.119353+0000","last_undegraded":"2024-04-15T01:10:44.119353+0000","last_fullsized":"2024-04-15T01:10:44.119353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'916","reported_seq":974,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:47.677285+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T01:09:47.677285+0000","last_peered":"2024-04-15T01:09:47.677285+0000","last_clean":"2024-04-15T01:09:47.677285+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T01:09:47.677285+0000","last_undegraded":"2024-04-15T01:09:47.677285+0000","last_fullsized":"2024-04-15T01:09:47.677285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":8649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'809","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.791696+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T01:10:23.791696+0000","last_peered":"2024-04-15T01:10:23.791696+0000","last_clean":"2024-04-15T01:10:23.791696+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T01:10:23.791696+0000","last_undegraded":"2024-04-15T01:10:23.791696+0000","last_fullsized":"2024-04-15T01:10:23.791696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":99885,"num_write":793,"num_write_kb":204639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'209","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.027855+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T01:10:44.027855+0000","last_peered":"2024-04-15T01:10:44.027855+0000","last_clean":"2024-04-15T01:10:44.027855+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T01:10:44.027855+0000","last_undegraded":"2024-04-15T01:10:44.027855+0000","last_fullsized":"2024-04-15T01:10:44.027855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'780","reported_seq":840,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.336327+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T01:10:37.336327+0000","last_peered":"2024-04-15T01:10:37.336327+0000","last_clean":"2024-04-15T01:10:37.336327+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T01:10:37.336327+0000","last_undegraded":"2024-04-15T01:10:37.336327+0000","last_fullsized":"2024-04-15T01:10:37.336327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'885","reported_seq":1047,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.324900+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T01:10:33.324900+0000","last_peered":"2024-04-15T01:10:33.324900+0000","last_clean":"2024-04-15T01:10:33.324900+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T01:10:33.324900+0000","last_undegraded":"2024-04-15T01:10:33.324900+0000","last_fullsized":"2024-04-15T01:10:33.324900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52186,"num_write":871,"num_write_kb":181200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'202","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.028940+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T01:10:44.028940+0000","last_peered":"2024-04-15T01:10:44.028940+0000","last_clean":"2024-04-15T01:10:44.028940+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T01:10:44.028940+0000","last_undegraded":"2024-04-15T01:10:44.028940+0000","last_fullsized":"2024-04-15T01:10:44.028940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'195","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:37.074931+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T01:09:37.074931+0000","last_peered":"2024-04-15T01:09:37.074931+0000","last_clean":"2024-04-15T01:09:37.074931+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T01:09:37.074931+0000","last_undegraded":"2024-04-15T01:09:37.074931+0000","last_fullsized":"2024-04-15T01:09:37.074931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'743","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.048951+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T01:10:31.048951+0000","last_peered":"2024-04-15T01:10:31.048951+0000","last_clean":"2024-04-15T01:10:31.048951+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T01:10:31.048951+0000","last_undegraded":"2024-04-15T01:10:31.048951+0000","last_fullsized":"2024-04-15T01:10:31.048951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58288,"num_write":731,"num_write_kb":102006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'221","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.113964+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T01:10:44.113964+0000","last_peered":"2024-04-15T01:10:44.113964+0000","last_clean":"2024-04-15T01:10:44.113964+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T01:10:44.113964+0000","last_undegraded":"2024-04-15T01:10:44.113964+0000","last_fullsized":"2024-04-15T01:10:44.113964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'783","reported_seq":843,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:07.669537+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T01:10:07.669537+0000","last_peered":"2024-04-15T01:10:07.669537+0000","last_clean":"2024-04-15T01:10:07.669537+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T01:10:07.669537+0000","last_undegraded":"2024-04-15T01:10:07.669537+0000","last_fullsized":"2024-04-15T01:10:07.669537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'723","reported_seq":860,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.247777+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T01:10:35.247777+0000","last_peered":"2024-04-15T01:10:35.247777+0000","last_clean":"2024-04-15T01:10:35.247777+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T01:10:35.247777+0000","last_undegraded":"2024-04-15T01:10:35.247777+0000","last_fullsized":"2024-04-15T01:10:35.247777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":38800,"num_write":705,"num_write_kb":106309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'224","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.083669+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T01:10:44.083669+0000","last_peered":"2024-04-15T01:10:44.083669+0000","last_clean":"2024-04-15T01:10:44.083669+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T01:10:44.083669+0000","last_undegraded":"2024-04-15T01:10:44.083669+0000","last_fullsized":"2024-04-15T01:10:44.083669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'194","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.402360+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T01:10:35.402360+0000","last_peered":"2024-04-15T01:10:35.402360+0000","last_clean":"2024-04-15T01:10:35.402360+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T01:10:35.402360+0000","last_undegraded":"2024-04-15T01:10:35.402360+0000","last_fullsized":"2024-04-15T01:10:35.402360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'797","reported_seq":968,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326928+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T01:10:31.326928+0000","last_peered":"2024-04-15T01:10:31.326928+0000","last_clean":"2024-04-15T01:10:31.326928+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T01:10:31.326928+0000","last_undegraded":"2024-04-15T01:10:31.326928+0000","last_fullsized":"2024-04-15T01:10:31.326928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60896,"num_write":782,"num_write_kb":175614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'173","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.037149+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T01:10:44.037149+0000","last_peered":"2024-04-15T01:10:44.037149+0000","last_clean":"2024-04-15T01:10:44.037149+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T01:10:44.037149+0000","last_undegraded":"2024-04-15T01:10:44.037149+0000","last_fullsized":"2024-04-15T01:10:44.037149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3598","reported_seq":3658,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.735333+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T01:10:36.735333+0000","last_peered":"2024-04-15T01:10:36.735333+0000","last_clean":"2024-04-15T01:10:36.735333+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T01:10:36.735333+0000","last_undegraded":"2024-04-15T01:10:36.735333+0000","last_fullsized":"2024-04-15T01:10:36.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10014,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'787","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.786208+0000","last_change":"2024-04-15T00:01:50.325887+0000","last_active":"2024-04-15T01:10:23.786208+0000","last_peered":"2024-04-15T01:10:23.786208+0000","last_clean":"2024-04-15T01:10:23.786208+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T01:10:23.786208+0000","last_undegraded":"2024-04-15T01:10:23.786208+0000","last_fullsized":"2024-04-15T01:10:23.786208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:56:24.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27446,"num_write":780,"num_write_kb":102026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'200","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120138+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T01:10:44.120138+0000","last_peered":"2024-04-15T01:10:44.120138+0000","last_clean":"2024-04-15T01:10:44.120138+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T01:10:44.120138+0000","last_undegraded":"2024-04-15T01:10:44.120138+0000","last_fullsized":"2024-04-15T01:10:44.120138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'592","reported_seq":653,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:20.369577+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T01:10:20.369577+0000","last_peered":"2024-04-15T01:10:20.369577+0000","last_clean":"2024-04-15T01:10:20.369577+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T01:10:20.369577+0000","last_undegraded":"2024-04-15T01:10:20.369577+0000","last_fullsized":"2024-04-15T01:10:20.369577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'736","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.100676+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T01:10:29.100676+0000","last_peered":"2024-04-15T01:10:29.100676+0000","last_clean":"2024-04-15T01:10:29.100676+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T01:10:29.100676+0000","last_undegraded":"2024-04-15T01:10:29.100676+0000","last_fullsized":"2024-04-15T01:10:29.100676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":59617,"num_write":721,"num_write_kb":101495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088748+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T01:10:44.088748+0000","last_peered":"2024-04-15T01:10:44.088748+0000","last_clean":"2024-04-15T01:10:44.088748+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T01:10:44.088748+0000","last_undegraded":"2024-04-15T01:10:44.088748+0000","last_fullsized":"2024-04-15T01:10:44.088748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'304","reported_seq":365,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:48.534460+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T01:09:48.534460+0000","last_peered":"2024-04-15T01:09:48.534460+0000","last_clean":"2024-04-15T01:09:48.534460+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T01:09:48.534460+0000","last_undegraded":"2024-04-15T01:09:48.534460+0000","last_fullsized":"2024-04-15T01:09:48.534460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'778","reported_seq":912,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.107257+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T01:10:29.107257+0000","last_peered":"2024-04-15T01:10:29.107257+0000","last_clean":"2024-04-15T01:10:29.107257+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T01:10:29.107257+0000","last_undegraded":"2024-04-15T01:10:29.107257+0000","last_fullsized":"2024-04-15T01:10:29.107257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":54040,"num_write":767,"num_write_kb":142606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'203","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.117642+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T01:10:44.117642+0000","last_peered":"2024-04-15T01:10:44.117642+0000","last_clean":"2024-04-15T01:10:44.117642+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T01:10:44.117642+0000","last_undegraded":"2024-04-15T01:10:44.117642+0000","last_fullsized":"2024-04-15T01:10:44.117642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'988","reported_seq":1049,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:34.095462+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T01:08:34.095462+0000","last_peered":"2024-04-15T01:08:34.095462+0000","last_clean":"2024-04-15T01:08:34.095462+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T01:08:34.095462+0000","last_undegraded":"2024-04-15T01:08:34.095462+0000","last_fullsized":"2024-04-15T01:08:34.095462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":8655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'695","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324605+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T01:10:36.324605+0000","last_peered":"2024-04-15T01:10:36.324605+0000","last_clean":"2024-04-15T01:10:36.324605+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T01:10:36.324605+0000","last_undegraded":"2024-04-15T01:10:36.324605+0000","last_fullsized":"2024-04-15T01:10:36.324605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:49.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22523,"num_write":688,"num_write_kb":89336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"29'209","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.118138+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T01:10:44.118138+0000","last_peered":"2024-04-15T01:10:44.118138+0000","last_clean":"2024-04-15T01:10:44.118138+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T01:10:44.118138+0000","last_undegraded":"2024-04-15T01:10:44.118138+0000","last_fullsized":"2024-04-15T01:10:44.118138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3013","reported_seq":6022,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:38.153294+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T01:10:38.153294+0000","last_peered":"2024-04-15T01:10:38.153294+0000","last_clean":"2024-04-15T01:10:38.153294+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T01:10:38.153294+0000","last_undegraded":"2024-04-15T01:10:38.153294+0000","last_fullsized":"2024-04-15T01:10:38.153294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3013,"log_dups_size":0,"ondisk_log_size":3013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":2955,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'697","reported_seq":789,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.712983+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T01:10:30.712983+0000","last_peered":"2024-04-15T01:10:30.712983+0000","last_clean":"2024-04-15T01:10:30.712983+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T01:10:30.712983+0000","last_undegraded":"2024-04-15T01:10:30.712983+0000","last_fullsized":"2024-04-15T01:10:30.712983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19611,"num_write":689,"num_write_kb":76681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094106+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T01:10:44.094106+0000","last_peered":"2024-04-15T01:10:44.094106+0000","last_clean":"2024-04-15T01:10:44.094106+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T01:10:44.094106+0000","last_undegraded":"2024-04-15T01:10:44.094106+0000","last_fullsized":"2024-04-15T01:10:44.094106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'490","reported_seq":552,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.155539+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T01:09:40.155539+0000","last_peered":"2024-04-15T01:09:40.155539+0000","last_clean":"2024-04-15T01:09:40.155539+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T01:09:40.155539+0000","last_undegraded":"2024-04-15T01:09:40.155539+0000","last_fullsized":"2024-04-15T01:09:40.155539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'862","reported_seq":1064,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.221729+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T01:10:35.221729+0000","last_peered":"2024-04-15T01:10:35.221729+0000","last_clean":"2024-04-15T01:10:35.221729+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T01:10:35.221729+0000","last_undegraded":"2024-04-15T01:10:35.221729+0000","last_fullsized":"2024-04-15T01:10:35.221729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":84642,"num_write":849,"num_write_kb":128022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'185","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122812+0000","last_change":"2024-04-15T00:01:49.998011+0000","last_active":"2024-04-15T01:10:44.122812+0000","last_peered":"2024-04-15T01:10:44.122812+0000","last_clean":"2024-04-15T01:10:44.122812+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T01:10:44.122812+0000","last_undegraded":"2024-04-15T01:10:44.122812+0000","last_fullsized":"2024-04-15T01:10:44.122812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:09:28.962143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"29'299","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.787521+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T01:10:23.787521+0000","last_peered":"2024-04-15T01:10:23.787521+0000","last_clean":"2024-04-15T01:10:23.787521+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T01:10:23.787521+0000","last_undegraded":"2024-04-15T01:10:23.787521+0000","last_fullsized":"2024-04-15T01:10:23.787521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:07:20.354724+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T01:07:20.354724+0000","last_peered":"2024-04-15T01:07:20.354724+0000","last_clean":"2024-04-15T01:07:20.354724+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T01:07:20.354724+0000","last_undegraded":"2024-04-15T01:07:20.354724+0000","last_fullsized":"2024-04-15T01:07:20.354724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'808","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.400673+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T01:10:33.400673+0000","last_peered":"2024-04-15T01:10:33.400673+0000","last_clean":"2024-04-15T01:10:33.400673+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T01:10:33.400673+0000","last_undegraded":"2024-04-15T01:10:33.400673+0000","last_fullsized":"2024-04-15T01:10:33.400673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":51109,"num_write":790,"num_write_kb":155353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103744+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T01:10:44.103744+0000","last_peered":"2024-04-15T01:10:44.103744+0000","last_clean":"2024-04-15T01:10:44.103744+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T01:10:44.103744+0000","last_undegraded":"2024-04-15T01:10:44.103744+0000","last_fullsized":"2024-04-15T01:10:44.103744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'252","reported_seq":310,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.841722+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T01:10:43.841722+0000","last_peered":"2024-04-15T01:10:43.841722+0000","last_clean":"2024-04-15T01:10:43.841722+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T01:10:43.841722+0000","last_undegraded":"2024-04-15T01:10:43.841722+0000","last_fullsized":"2024-04-15T01:10:43.841722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3902566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'818","reported_seq":999,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.401547+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T01:10:33.401547+0000","last_peered":"2024-04-15T01:10:33.401547+0000","last_clean":"2024-04-15T01:10:33.401547+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T01:10:33.401547+0000","last_undegraded":"2024-04-15T01:10:33.401547+0000","last_fullsized":"2024-04-15T01:10:33.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":80804,"num_write":805,"num_write_kb":188613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081875+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T01:10:44.081875+0000","last_peered":"2024-04-15T01:10:44.081875+0000","last_clean":"2024-04-15T01:10:44.081875+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T01:10:44.081875+0000","last_undegraded":"2024-04-15T01:10:44.081875+0000","last_fullsized":"2024-04-15T01:10:44.081875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'781","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:35.006699+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T01:09:35.006699+0000","last_peered":"2024-04-15T01:09:35.006699+0000","last_clean":"2024-04-15T01:09:35.006699+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T01:09:35.006699+0000","last_undegraded":"2024-04-15T01:09:35.006699+0000","last_fullsized":"2024-04-15T01:09:35.006699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'763","reported_seq":910,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:22.751023+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T01:10:22.751023+0000","last_peered":"2024-04-15T01:10:22.751023+0000","last_clean":"2024-04-15T01:10:22.751023+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T01:10:22.751023+0000","last_undegraded":"2024-04-15T01:10:22.751023+0000","last_fullsized":"2024-04-15T01:10:22.751023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":61965,"num_write":764,"num_write_kb":101545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095025+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T01:10:44.095025+0000","last_peered":"2024-04-15T01:10:44.095025+0000","last_clean":"2024-04-15T01:10:44.095025+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T01:10:44.095025+0000","last_undegraded":"2024-04-15T01:10:44.095025+0000","last_fullsized":"2024-04-15T01:10:44.095025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'783","reported_seq":841,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:55.148414+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T01:08:55.148414+0000","last_peered":"2024-04-15T01:08:55.148414+0000","last_clean":"2024-04-15T01:08:55.148414+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T01:08:55.148414+0000","last_undegraded":"2024-04-15T01:08:55.148414+0000","last_fullsized":"2024-04-15T01:08:55.148414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'786","reported_seq":924,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.389363+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T01:10:36.389363+0000","last_peered":"2024-04-15T01:10:36.389363+0000","last_clean":"2024-04-15T01:10:36.389363+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T01:10:36.389363+0000","last_undegraded":"2024-04-15T01:10:36.389363+0000","last_fullsized":"2024-04-15T01:10:36.389363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":35671,"num_write":777,"num_write_kb":118402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.092714+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T01:10:44.092714+0000","last_peered":"2024-04-15T01:10:44.092714+0000","last_clean":"2024-04-15T01:10:44.092714+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T01:10:44.092714+0000","last_undegraded":"2024-04-15T01:10:44.092714+0000","last_fullsized":"2024-04-15T01:10:44.092714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'765","reported_seq":823,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.767966+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T01:10:17.767966+0000","last_peered":"2024-04-15T01:10:17.767966+0000","last_clean":"2024-04-15T01:10:17.767966+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T01:10:17.767966+0000","last_undegraded":"2024-04-15T01:10:17.767966+0000","last_fullsized":"2024-04-15T01:10:17.767966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'816","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.220146+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T01:10:33.220146+0000","last_peered":"2024-04-15T01:10:33.220146+0000","last_clean":"2024-04-15T01:10:33.220146+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T01:10:33.220146+0000","last_undegraded":"2024-04-15T01:10:33.220146+0000","last_fullsized":"2024-04-15T01:10:33.220146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39992,"num_write":799,"num_write_kb":139135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'231","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093976+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T01:10:44.093976+0000","last_peered":"2024-04-15T01:10:44.093976+0000","last_clean":"2024-04-15T01:10:44.093976+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T01:10:44.093976+0000","last_undegraded":"2024-04-15T01:10:44.093976+0000","last_fullsized":"2024-04-15T01:10:44.093976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'473","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.338706+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T01:10:36.338706+0000","last_peered":"2024-04-15T01:10:36.338706+0000","last_clean":"2024-04-15T01:10:36.338706+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T01:10:36.338706+0000","last_undegraded":"2024-04-15T01:10:36.338706+0000","last_fullsized":"2024-04-15T01:10:36.338706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":8414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'762","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.055277+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T01:10:29.055277+0000","last_peered":"2024-04-15T01:10:29.055277+0000","last_clean":"2024-04-15T01:10:29.055277+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T01:10:29.055277+0000","last_undegraded":"2024-04-15T01:10:29.055277+0000","last_fullsized":"2024-04-15T01:10:29.055277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":53894,"num_write":751,"num_write_kb":106228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.109035+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T01:10:44.109035+0000","last_peered":"2024-04-15T01:10:44.109035+0000","last_clean":"2024-04-15T01:10:44.109035+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T01:10:44.109035+0000","last_undegraded":"2024-04-15T01:10:44.109035+0000","last_fullsized":"2024-04-15T01:10:44.109035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'63","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:08.497363+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T01:09:08.497363+0000","last_peered":"2024-04-15T01:09:08.497363+0000","last_clean":"2024-04-15T01:09:08.497363+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T01:09:08.497363+0000","last_undegraded":"2024-04-15T01:09:08.497363+0000","last_fullsized":"2024-04-15T01:09:08.497363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'778","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.966740+0000","last_change":"2024-04-15T00:01:50.326200+0000","last_active":"2024-04-15T01:10:21.966740+0000","last_peered":"2024-04-15T01:10:21.966740+0000","last_clean":"2024-04-15T01:10:21.966740+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T01:10:21.966740+0000","last_undegraded":"2024-04-15T01:10:21.966740+0000","last_fullsized":"2024-04-15T01:10:21.966740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:32:27.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":41754,"num_write":768,"num_write_kb":168968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'200","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094807+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T01:10:44.094807+0000","last_peered":"2024-04-15T01:10:44.094807+0000","last_clean":"2024-04-15T01:10:44.094807+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T01:10:44.094807+0000","last_undegraded":"2024-04-15T01:10:44.094807+0000","last_fullsized":"2024-04-15T01:10:44.094807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'60","reported_seq":117,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324199+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T01:10:36.324199+0000","last_peered":"2024-04-15T01:10:36.324199+0000","last_clean":"2024-04-15T01:10:36.324199+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T01:10:36.324199+0000","last_undegraded":"2024-04-15T01:10:36.324199+0000","last_fullsized":"2024-04-15T01:10:36.324199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'697","reported_seq":801,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.054816+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T01:10:29.054816+0000","last_peered":"2024-04-15T01:10:29.054816+0000","last_clean":"2024-04-15T01:10:29.054816+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T01:10:29.054816+0000","last_undegraded":"2024-04-15T01:10:29.054816+0000","last_fullsized":"2024-04-15T01:10:29.054816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":31143,"num_write":687,"num_write_kb":101153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'209","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104276+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T01:10:44.104276+0000","last_peered":"2024-04-15T01:10:44.104276+0000","last_clean":"2024-04-15T01:10:44.104276+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T01:10:44.104276+0000","last_undegraded":"2024-04-15T01:10:44.104276+0000","last_fullsized":"2024-04-15T01:10:44.104276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'390","reported_seq":447,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:54.194363+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T01:08:54.194363+0000","last_peered":"2024-04-15T01:08:54.194363+0000","last_clean":"2024-04-15T01:08:54.194363+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T01:08:54.194363+0000","last_undegraded":"2024-04-15T01:08:54.194363+0000","last_fullsized":"2024-04-15T01:08:54.194363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'747","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.144852+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T01:10:33.144852+0000","last_peered":"2024-04-15T01:10:33.144852+0000","last_clean":"2024-04-15T01:10:33.144852+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T01:10:33.144852+0000","last_undegraded":"2024-04-15T01:10:33.144852+0000","last_fullsized":"2024-04-15T01:10:33.144852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":56791,"num_write":733,"num_write_kb":134490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100391+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T01:10:44.100391+0000","last_peered":"2024-04-15T01:10:44.100391+0000","last_clean":"2024-04-15T01:10:44.100391+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T01:10:44.100391+0000","last_undegraded":"2024-04-15T01:10:44.100391+0000","last_fullsized":"2024-04-15T01:10:44.100391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1423","reported_seq":1480,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.623835+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T01:10:21.623835+0000","last_peered":"2024-04-15T01:10:21.623835+0000","last_clean":"2024-04-15T01:10:21.623835+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T01:10:21.623835+0000","last_undegraded":"2024-04-15T01:10:21.623835+0000","last_fullsized":"2024-04-15T01:10:21.623835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":13127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'798","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.406562+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T01:10:33.406562+0000","last_peered":"2024-04-15T01:10:33.406562+0000","last_clean":"2024-04-15T01:10:33.406562+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T01:10:33.406562+0000","last_undegraded":"2024-04-15T01:10:33.406562+0000","last_fullsized":"2024-04-15T01:10:33.406562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":58877,"num_write":785,"num_write_kb":152322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'203","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124028+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T01:10:44.124028+0000","last_peered":"2024-04-15T01:10:44.124028+0000","last_clean":"2024-04-15T01:10:44.124028+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T01:10:44.124028+0000","last_undegraded":"2024-04-15T01:10:44.124028+0000","last_fullsized":"2024-04-15T01:10:44.124028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1844","reported_seq":1900,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.151340+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T01:10:37.151340+0000","last_peered":"2024-04-15T01:10:37.151340+0000","last_clean":"2024-04-15T01:10:37.151340+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T01:10:37.151340+0000","last_undegraded":"2024-04-15T01:10:37.151340+0000","last_fullsized":"2024-04-15T01:10:37.151340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":5818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'701","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.553388+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T01:10:30.553388+0000","last_peered":"2024-04-15T01:10:30.553388+0000","last_clean":"2024-04-15T01:10:30.553388+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T01:10:30.553388+0000","last_undegraded":"2024-04-15T01:10:30.553388+0000","last_fullsized":"2024-04-15T01:10:30.553388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35520,"num_write":691,"num_write_kb":85742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.098091+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T01:10:44.098091+0000","last_peered":"2024-04-15T01:10:44.098091+0000","last_clean":"2024-04-15T01:10:44.098091+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T01:10:44.098091+0000","last_undegraded":"2024-04-15T01:10:44.098091+0000","last_fullsized":"2024-04-15T01:10:44.098091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'396","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:13.065031+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T01:10:13.065031+0000","last_peered":"2024-04-15T01:10:13.065031+0000","last_clean":"2024-04-15T01:10:13.065031+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T01:10:13.065031+0000","last_undegraded":"2024-04-15T01:10:13.065031+0000","last_fullsized":"2024-04-15T01:10:13.065031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'858","reported_seq":983,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.214354+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T01:10:33.214354+0000","last_peered":"2024-04-15T01:10:33.214354+0000","last_clean":"2024-04-15T01:10:33.214354+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T01:10:33.214354+0000","last_undegraded":"2024-04-15T01:10:33.214354+0000","last_fullsized":"2024-04-15T01:10:33.214354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":40736,"num_write":845,"num_write_kb":155666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'215","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112020+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T01:10:44.112020+0000","last_peered":"2024-04-15T01:10:44.112020+0000","last_clean":"2024-04-15T01:10:44.112020+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T01:10:44.112020+0000","last_undegraded":"2024-04-15T01:10:44.112020+0000","last_fullsized":"2024-04-15T01:10:44.112020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'69","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.837447+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T01:10:43.837447+0000","last_peered":"2024-04-15T01:10:43.837447+0000","last_clean":"2024-04-15T01:10:43.837447+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T01:10:43.837447+0000","last_undegraded":"2024-04-15T01:10:43.837447+0000","last_fullsized":"2024-04-15T01:10:43.837447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'833","reported_seq":967,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.445684+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T01:10:33.445684+0000","last_peered":"2024-04-15T01:10:33.445684+0000","last_clean":"2024-04-15T01:10:33.445684+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T01:10:33.445684+0000","last_undegraded":"2024-04-15T01:10:33.445684+0000","last_fullsized":"2024-04-15T01:10:33.445684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":38336,"num_write":816,"num_write_kb":147104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'791","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.170941+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T01:10:30.170941+0000","last_peered":"2024-04-15T01:10:30.170941+0000","last_clean":"2024-04-15T01:10:30.170941+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T01:10:30.170941+0000","last_undegraded":"2024-04-15T01:10:30.170941+0000","last_fullsized":"2024-04-15T01:10:30.170941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":55193,"num_write":783,"num_write_kb":131702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'213","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.254659+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T01:10:44.254659+0000","last_peered":"2024-04-15T01:10:44.254659+0000","last_clean":"2024-04-15T01:10:44.254659+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T01:10:44.254659+0000","last_undegraded":"2024-04-15T01:10:44.254659+0000","last_fullsized":"2024-04-15T01:10:44.254659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1370","reported_seq":1426,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:26.576298+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T01:09:26.576298+0000","last_peered":"2024-04-15T01:09:26.576298+0000","last_clean":"2024-04-15T01:09:26.576298+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T01:09:26.576298+0000","last_undegraded":"2024-04-15T01:09:26.576298+0000","last_fullsized":"2024-04-15T01:09:26.576298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'758","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.626649+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T01:10:17.626649+0000","last_peered":"2024-04-15T01:10:17.626649+0000","last_clean":"2024-04-15T01:10:17.626649+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:17.626649+0000","last_undegraded":"2024-04-15T01:10:17.626649+0000","last_fullsized":"2024-04-15T01:10:17.626649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":41433,"num_write":747,"num_write_kb":139089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'219","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032800+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T01:10:44.032800+0000","last_peered":"2024-04-15T01:10:44.032800+0000","last_clean":"2024-04-15T01:10:44.032800+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T01:10:44.032800+0000","last_undegraded":"2024-04-15T01:10:44.032800+0000","last_fullsized":"2024-04-15T01:10:44.032800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'580","reported_seq":636,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:32.070004+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T01:09:32.070004+0000","last_peered":"2024-04-15T01:09:32.070004+0000","last_clean":"2024-04-15T01:09:32.070004+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T01:09:32.070004+0000","last_undegraded":"2024-04-15T01:09:32.070004+0000","last_fullsized":"2024-04-15T01:09:32.070004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1197","reported_seq":1252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:17.007966+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T01:09:17.007966+0000","last_peered":"2024-04-15T01:09:17.007966+0000","last_clean":"2024-04-15T01:09:17.007966+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T01:09:17.007966+0000","last_undegraded":"2024-04-15T01:09:17.007966+0000","last_fullsized":"2024-04-15T01:09:17.007966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'187","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.087512+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T01:10:44.087512+0000","last_peered":"2024-04-15T01:10:44.087512+0000","last_clean":"2024-04-15T01:10:44.087512+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T01:10:44.087512+0000","last_undegraded":"2024-04-15T01:10:44.087512+0000","last_fullsized":"2024-04-15T01:10:44.087512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'744","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.393810+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T01:10:30.393810+0000","last_peered":"2024-04-15T01:10:30.393810+0000","last_clean":"2024-04-15T01:10:30.393810+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T01:10:30.393810+0000","last_undegraded":"2024-04-15T01:10:30.393810+0000","last_fullsized":"2024-04-15T01:10:30.393810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":84659,"num_write":735,"num_write_kb":176000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'220","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.168273+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T01:09:40.168273+0000","last_peered":"2024-04-15T01:09:40.168273+0000","last_clean":"2024-04-15T01:09:40.168273+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T01:09:40.168273+0000","last_undegraded":"2024-04-15T01:09:40.168273+0000","last_fullsized":"2024-04-15T01:09:40.168273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'202","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122471+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T01:10:44.122471+0000","last_peered":"2024-04-15T01:10:44.122471+0000","last_clean":"2024-04-15T01:10:44.122471+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T01:10:44.122471+0000","last_undegraded":"2024-04-15T01:10:44.122471+0000","last_fullsized":"2024-04-15T01:10:44.122471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'759","reported_seq":920,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:25.904298+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T01:10:25.904298+0000","last_peered":"2024-04-15T01:10:25.904298+0000","last_clean":"2024-04-15T01:10:25.904298+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T01:10:25.904298+0000","last_undegraded":"2024-04-15T01:10:25.904298+0000","last_fullsized":"2024-04-15T01:10:25.904298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62677,"num_write":745,"num_write_kb":206027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'216","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.115518+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T01:10:44.115518+0000","last_peered":"2024-04-15T01:10:44.115518+0000","last_clean":"2024-04-15T01:10:44.115518+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T01:10:44.115518+0000","last_undegraded":"2024-04-15T01:10:44.115518+0000","last_fullsized":"2024-04-15T01:10:44.115518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103511+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T01:10:44.103511+0000","last_peered":"2024-04-15T01:10:44.103511+0000","last_clean":"2024-04-15T01:10:44.103511+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T01:10:44.103511+0000","last_undegraded":"2024-04-15T01:10:44.103511+0000","last_fullsized":"2024-04-15T01:10:44.103511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'232","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.080669+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T01:10:44.080669+0000","last_peered":"2024-04-15T01:10:44.080669+0000","last_clean":"2024-04-15T01:10:44.080669+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T01:10:44.080669+0000","last_undegraded":"2024-04-15T01:10:44.080669+0000","last_fullsized":"2024-04-15T01:10:44.080669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'207","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.083665+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T01:10:44.083665+0000","last_peered":"2024-04-15T01:10:44.083665+0000","last_clean":"2024-04-15T01:10:44.083665+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T01:10:44.083665+0000","last_undegraded":"2024-04-15T01:10:44.083665+0000","last_fullsized":"2024-04-15T01:10:44.083665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.040848+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T01:10:44.040848+0000","last_peered":"2024-04-15T01:10:44.040848+0000","last_clean":"2024-04-15T01:10:44.040848+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T01:10:44.040848+0000","last_undegraded":"2024-04-15T01:10:44.040848+0000","last_fullsized":"2024-04-15T01:10:44.040848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'207","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120698+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T01:10:44.120698+0000","last_peered":"2024-04-15T01:10:44.120698+0000","last_clean":"2024-04-15T01:10:44.120698+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T01:10:44.120698+0000","last_undegraded":"2024-04-15T01:10:44.120698+0000","last_fullsized":"2024-04-15T01:10:44.120698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'241","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.123430+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T01:10:44.123430+0000","last_peered":"2024-04-15T01:10:44.123430+0000","last_clean":"2024-04-15T01:10:44.123430+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T01:10:44.123430+0000","last_undegraded":"2024-04-15T01:10:44.123430+0000","last_fullsized":"2024-04-15T01:10:44.123430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'192","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024735+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T01:10:44.024735+0000","last_peered":"2024-04-15T01:10:44.024735+0000","last_clean":"2024-04-15T01:10:44.024735+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T01:10:44.024735+0000","last_undegraded":"2024-04-15T01:10:44.024735+0000","last_fullsized":"2024-04-15T01:10:44.024735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.084292+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T01:10:44.084292+0000","last_peered":"2024-04-15T01:10:44.084292+0000","last_clean":"2024-04-15T01:10:44.084292+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T01:10:44.084292+0000","last_undegraded":"2024-04-15T01:10:44.084292+0000","last_fullsized":"2024-04-15T01:10:44.084292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032553+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T01:10:44.032553+0000","last_peered":"2024-04-15T01:10:44.032553+0000","last_clean":"2024-04-15T01:10:44.032553+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T01:10:44.032553+0000","last_undegraded":"2024-04-15T01:10:44.032553+0000","last_fullsized":"2024-04-15T01:10:44.032553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'215","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095159+0000","last_change":"2024-04-15T00:01:50.325599+0000","last_active":"2024-04-15T01:10:44.095159+0000","last_peered":"2024-04-15T01:10:44.095159+0000","last_clean":"2024-04-15T01:10:44.095159+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T01:10:44.095159+0000","last_undegraded":"2024-04-15T01:10:44.095159+0000","last_fullsized":"2024-04-15T01:10:44.095159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'212","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104229+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T01:10:44.104229+0000","last_peered":"2024-04-15T01:10:44.104229+0000","last_clean":"2024-04-15T01:10:44.104229+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T01:10:44.104229+0000","last_undegraded":"2024-04-15T01:10:44.104229+0000","last_fullsized":"2024-04-15T01:10:44.104229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'223","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119670+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T01:10:44.119670+0000","last_peered":"2024-04-15T01:10:44.119670+0000","last_clean":"2024-04-15T01:10:44.119670+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T01:10:44.119670+0000","last_undegraded":"2024-04-15T01:10:44.119670+0000","last_fullsized":"2024-04-15T01:10:44.119670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081817+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T01:10:44.081817+0000","last_peered":"2024-04-15T01:10:44.081817+0000","last_clean":"2024-04-15T01:10:44.081817+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T01:10:44.081817+0000","last_undegraded":"2024-04-15T01:10:44.081817+0000","last_fullsized":"2024-04-15T01:10:44.081817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.114261+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T01:10:44.114261+0000","last_peered":"2024-04-15T01:10:44.114261+0000","last_clean":"2024-04-15T01:10:44.114261+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T01:10:44.114261+0000","last_undegraded":"2024-04-15T01:10:44.114261+0000","last_fullsized":"2024-04-15T01:10:44.114261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'199","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.111859+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T01:10:44.111859+0000","last_peered":"2024-04-15T01:10:44.111859+0000","last_clean":"2024-04-15T01:10:44.111859+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T01:10:44.111859+0000","last_undegraded":"2024-04-15T01:10:44.111859+0000","last_fullsized":"2024-04-15T01:10:44.111859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'222","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097146+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T01:10:44.097146+0000","last_peered":"2024-04-15T01:10:44.097146+0000","last_clean":"2024-04-15T01:10:44.097146+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T01:10:44.097146+0000","last_undegraded":"2024-04-15T01:10:44.097146+0000","last_fullsized":"2024-04-15T01:10:44.097146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'215","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124019+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T01:10:44.124019+0000","last_peered":"2024-04-15T01:10:44.124019+0000","last_clean":"2024-04-15T01:10:44.124019+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T01:10:44.124019+0000","last_undegraded":"2024-04-15T01:10:44.124019+0000","last_fullsized":"2024-04-15T01:10:44.124019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088632+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T01:10:44.088632+0000","last_peered":"2024-04-15T01:10:44.088632+0000","last_clean":"2024-04-15T01:10:44.088632+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T01:10:44.088632+0000","last_undegraded":"2024-04-15T01:10:44.088632+0000","last_fullsized":"2024-04-15T01:10:44.088632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.039555+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T01:10:44.039555+0000","last_peered":"2024-04-15T01:10:44.039555+0000","last_clean":"2024-04-15T01:10:44.039555+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T01:10:44.039555+0000","last_undegraded":"2024-04-15T01:10:44.039555+0000","last_fullsized":"2024-04-15T01:10:44.039555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'185","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122630+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T01:10:44.122630+0000","last_peered":"2024-04-15T01:10:44.122630+0000","last_clean":"2024-04-15T01:10:44.122630+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T01:10:44.122630+0000","last_undegraded":"2024-04-15T01:10:44.122630+0000","last_fullsized":"2024-04-15T01:10:44.122630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'188","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112221+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T01:10:44.112221+0000","last_peered":"2024-04-15T01:10:44.112221+0000","last_clean":"2024-04-15T01:10:44.112221+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T01:10:44.112221+0000","last_undegraded":"2024-04-15T01:10:44.112221+0000","last_fullsized":"2024-04-15T01:10:44.112221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122116+0000","last_change":"2024-04-15T00:01:49.997896+0000","last_active":"2024-04-15T01:10:44.122116+0000","last_peered":"2024-04-15T01:10:44.122116+0000","last_clean":"2024-04-15T01:10:44.122116+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T01:10:44.122116+0000","last_undegraded":"2024-04-15T01:10:44.122116+0000","last_fullsized":"2024-04-15T01:10:44.122116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:52:44.356891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'211","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103209+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T01:10:44.103209+0000","last_peered":"2024-04-15T01:10:44.103209+0000","last_clean":"2024-04-15T01:10:44.103209+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T01:10:44.103209+0000","last_undegraded":"2024-04-15T01:10:44.103209+0000","last_fullsized":"2024-04-15T01:10:44.103209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.038221+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T01:10:44.038221+0000","last_peered":"2024-04-15T01:10:44.038221+0000","last_clean":"2024-04-15T01:10:44.038221+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T01:10:44.038221+0000","last_undegraded":"2024-04-15T01:10:44.038221+0000","last_fullsized":"2024-04-15T01:10:44.038221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.060783+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T01:10:44.060783+0000","last_peered":"2024-04-15T01:10:44.060783+0000","last_clean":"2024-04-15T01:10:44.060783+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T01:10:44.060783+0000","last_undegraded":"2024-04-15T01:10:44.060783+0000","last_fullsized":"2024-04-15T01:10:44.060783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'197","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097300+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T01:10:44.097300+0000","last_peered":"2024-04-15T01:10:44.097300+0000","last_clean":"2024-04-15T01:10:44.097300+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T01:10:44.097300+0000","last_undegraded":"2024-04-15T01:10:44.097300+0000","last_fullsized":"2024-04-15T01:10:44.097300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.085102+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T01:10:44.085102+0000","last_peered":"2024-04-15T01:10:44.085102+0000","last_clean":"2024-04-15T01:10:44.085102+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T01:10:44.085102+0000","last_undegraded":"2024-04-15T01:10:44.085102+0000","last_fullsized":"2024-04-15T01:10:44.085102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'195","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093604+0000","last_change":"2024-04-15T00:01:50.003849+0000","last_active":"2024-04-15T01:10:44.093604+0000","last_peered":"2024-04-15T01:10:44.093604+0000","last_clean":"2024-04-15T01:10:44.093604+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T01:10:44.093604+0000","last_undegraded":"2024-04-15T01:10:44.093604+0000","last_fullsized":"2024-04-15T01:10:44.093604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'194","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.090714+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T01:10:44.090714+0000","last_peered":"2024-04-15T01:10:44.090714+0000","last_clean":"2024-04-15T01:10:44.090714+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T01:10:44.090714+0000","last_undegraded":"2024-04-15T01:10:44.090714+0000","last_fullsized":"2024-04-15T01:10:44.090714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'214","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.116609+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T01:10:44.116609+0000","last_peered":"2024-04-15T01:10:44.116609+0000","last_clean":"2024-04-15T01:10:44.116609+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T01:10:44.116609+0000","last_undegraded":"2024-04-15T01:10:44.116609+0000","last_fullsized":"2024-04-15T01:10:44.116609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'211","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.091482+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T01:10:44.091482+0000","last_peered":"2024-04-15T01:10:44.091482+0000","last_clean":"2024-04-15T01:10:44.091482+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T01:10:44.091482+0000","last_undegraded":"2024-04-15T01:10:44.091482+0000","last_fullsized":"2024-04-15T01:10:44.091482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2952,"num_read_kb":1592021,"num_write":24431,"num_write_kb":4334185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24810,"ondisk_log_size":24810,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13159,"ondisk_log_size":13159,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":181622008,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":30105,"num_write_kb":193149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172548096,"data_stored":363244016,"data_compressed":48333034,"data_compressed_allocated":62914560,"data_compressed_original":253853696,"omap_allocated":0,"internal_metadata":0},"log_size":25438,"ondisk_log_size":25438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542986,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137664,"kb_used_data":30200,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94234176,"statfs":{"total":96636764160,"available":96495796224,"internally_reserved":0,"allocated":30924800,"data_stored":72023688,"data_compressed":9942585,"data_compressed_allocated":12574720,"data_compressed_original":53891072,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542986,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157088,"kb_used_data":23256,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94214752,"statfs":{"total":96636764160,"available":96475906048,"internally_reserved":0,"allocated":23814144,"data_stored":50461162,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542986,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136936,"kb_used_data":21152,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94234904,"statfs":{"total":96636764160,"available":96496541696,"internally_reserved":0,"allocated":21659648,"data_stored":41781534,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542987,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125000,"kb_used_data":25856,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94246840,"statfs":{"total":96636764160,"available":96508764160,"internally_reserved":0,"allocated":26476544,"data_stored":50461030,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510283,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144168,"kb_used_data":18592,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94227672,"statfs":{"total":96636764160,"available":96489136128,"internally_reserved":0,"allocated":19038208,"data_stored":35235566,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510281,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":11480,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":11755520,"data_stored":22359130,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510283,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169692,"kb_used_data":21972,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94202148,"statfs":{"total":96636764160,"available":96462999552,"internally_reserved":0,"allocated":22499328,"data_stored":50460650,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575691,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103780,"kb_used_data":18524,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94268060,"statfs":{"total":96636764160,"available":96530493440,"internally_reserved":0,"allocated":18968576,"data_stored":42661752,"data_compressed":5896627,"data_compressed_allocated":7761920,"data_compressed_original":31666176,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18595840,"data_stored":41943914,"data_compressed":5864102,"data_compressed_allocated":7716864,"data_compressed_original":31092736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":50333180,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11448320,"data_stored":22231660,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18731008,"data_stored":35108096,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":50333560,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21352448,"data_stored":41654064,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":50333692,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30552064,"data_stored":71305850,"data_compressed":9910060,"data_compressed_allocated":12529664,"data_compressed_original":53317632,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T01:10:50.772 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T01:10:50.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.911+0000 7fbbf0d8c640 1 Processor -- start 2024-04-15T01:10:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.911+0000 7fbbf0d8c640 1 -- start start 2024-04-15T01:10:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbf0d8c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbbec0c54b0 0x7fbbec158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbf0d8c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c6150 0x7fbbec15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbf0d8c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbec158120 con 0x7fbbec0c50d0 2024-04-15T01:10:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbf0d8c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fbbec0c67e0 con 0x7fbbec0c54b0 2024-04-15T01:10:50.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbf0d8c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbbec0c6aa0 con 0x7fbbec0c6150 2024-04-15T01:10:50.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbe3fff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbbec0c54b0 0x7fbbec158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbea59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbbec0c50d0 0x7fbbec140fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:39038/0 (socket says 172.21.15.29:39038) 2024-04-15T01:10:50.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.912+0000 7fbbea59c640 1 -- 172.21.15.29:0/3662074404 learned_addr learned my addr 172.21.15.29:0/3662074404 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:50.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.913+0000 7fbbead9d640 1 --2- 172.21.15.29:0/3662074404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c6150 0x7fbbec15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.915+0000 7fbbe3fff640 1 -- 172.21.15.29:0/3662074404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c6150 msgr2=0x7fbbec15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:50.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.915+0000 7fbbe3fff640 1 --2- 172.21.15.29:0/3662074404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c6150 0x7fbbec15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.915+0000 7fbbe3fff640 1 -- 172.21.15.29:0/3662074404 >> v1:172.21.15.37:6789/0 conn(0x7fbbec0c50d0 legacy=0x7fbbec140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.915+0000 7fbbe3fff640 1 -- 172.21.15.29:0/3662074404 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec1583c0 con 0x7fbbec0c54b0 2024-04-15T01:10:50.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.917+0000 7fbbe3fff640 1 --2- 172.21.15.29:0/3662074404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c54b0 0x7fbbec158bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009790 tx=0x7fbbd402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0bda50a0297c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:50.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.920+0000 7fbbe9d9b640 1 -- 172.21.15.29:0/3662074404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4035020 con 0x7fbbec0c54b0 2024-04-15T01:10:50.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.920+0000 7fbbe9d9b640 1 -- 172.21.15.29:0/3662074404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd4031890 con 0x7fbbec0c54b0 2024-04-15T01:10:50.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.920+0000 7fbbe9d9b640 1 -- 172.21.15.29:0/3662074404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4031c60 con 0x7fbbec0c54b0 2024-04-15T01:10:50.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/3662074404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c54b0 msgr2=0x7fbbec158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/3662074404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c54b0 0x7fbbec158bc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009790 tx=0x7fbbd402b930 comp rx=0 tx=0).stop 2024-04-15T01:10:50.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/3662074404 shutdown_connections 2024-04-15T01:10:50.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/3662074404 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c6150 0x7fbbec15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/3662074404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c54b0 0x7fbbec158bc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/3662074404 >> 172.21.15.29:0/3662074404 conn(0x7fbbec06fca0 msgr2=0x7fbbec06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:50.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/3662074404 shutdown_connections 2024-04-15T01:10:50.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.921+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/3662074404 wait complete. 2024-04-15T01:10:50.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.922+0000 7fbbf0d8c640 1 Processor -- start 2024-04-15T01:10:50.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.922+0000 7fbbf0d8c640 1 -- start start 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbf0d8c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 0x7fbbec1ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbf0d8c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c54b0 0x7fbbec13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbf0d8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbec0c6150 0x7fbbec0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbf0d8c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1416c0 con 0x7fbbec0c50d0 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbf0d8c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec0c6d80 con 0x7fbbec0c6150 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbf0d8c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fbbec141840 con 0x7fbbec0c54b0 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.923+0000 7fbbea59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 0x7fbbec1ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.924+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c54b0 0x7fbbec13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.924+0000 7fbbead9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbec0c6150 0x7fbbec0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:50.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.924+0000 7fbbea59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 0x7fbbec1ee6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36368/0 (socket says 172.21.15.29:36368) 2024-04-15T01:10:50.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.924+0000 7fbbea59c640 1 -- 172.21.15.29:0/1194981221 learned_addr learned my addr 172.21.15.29:0/1194981221 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:50.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.927+0000 7fbbea59c640 1 -- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c54b0 msgr2=0x7fbbec13e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.927+0000 7fbbea59c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c54b0 0x7fbbec13e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.927+0000 7fbbea59c640 1 -- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbec0c6150 msgr2=0x7fbbec0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:50.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.927+0000 7fbbea59c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbec0c6150 0x7fbbec0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:50.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.927+0000 7fbbea59c640 1 -- 172.21.15.29:0/1194981221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec13f0c0 con 0x7fbbec0c50d0 2024-04-15T01:10:50.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.930+0000 7fbbea59c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 0x7fbbec1ee6e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c430 tx=0x7fbbdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:50.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.933+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc017070 con 0x7fbbec0c50d0 2024-04-15T01:10:50.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.933+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc005ce0 con 0x7fbbec0c50d0 2024-04-15T01:10:50.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.933+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0072f0 con 0x7fbbec0c50d0 2024-04-15T01:10:50.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.933+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec154940 con 0x7fbbec0c50d0 2024-04-15T01:10:50.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.933+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec154ee0 con 0x7fbbec0c50d0 2024-04-15T01:10:50.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:50.934+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec04f540 con 0x7fbbec0c50d0 2024-04-15T01:10:51.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.201+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbbdc01a070 con 0x7fbbec0c50d0 2024-04-15T01:10:51.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.201+0000 7fbbe2ffd640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbbcc06ba10 0x7fbbcc06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:51.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.201+0000 7fbbe3fff640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbbcc06ba10 0x7fbbcc06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:51.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.202+0000 7fbbe3fff640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbbcc06ba10 0x7fbbcc06ded0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4036000 tx=0x7fbbd4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:51.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.215+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbbdc056680 con 0x7fbbec0c50d0 2024-04-15T01:10:51.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.215+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbbdc021020 con 0x7fbbec0c50d0 2024-04-15T01:10:51.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.401+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbbec1e1e80 con 0x7fbbcc06ba10 2024-04-15T01:10:51.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.410+0000 7fbbe2ffd640 1 -- 172.21.15.29:0/1194981221 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335006 (secure 0 0 0) 0x7fbbec1e1e80 con 0x7fbbcc06ba10 2024-04-15T01:10:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:10:51.418 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T01:10:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbbcc06ba10 msgr2=0x7fbbcc06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbbcc06ba10 0x7fbbcc06ded0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4036000 tx=0x7fbbd4008030 comp rx=0 tx=0).stop 2024-04-15T01:10:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 msgr2=0x7fbbec1ee6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 0x7fbbec1ee6e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c430 tx=0x7fbbdc00c8f0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 shutdown_connections 2024-04-15T01:10:51.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fbbcc06ba10 0x7fbbcc06ded0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbec0c6150 0x7fbbec0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fbbec0c54b0 0x7fbbec13e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 --2- 172.21.15.29:0/1194981221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbec0c50d0 0x7fbbec1ee6e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 >> 172.21.15.29:0/1194981221 conn(0x7fbbec06fca0 msgr2=0x7fbbec06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 shutdown_connections 2024-04-15T01:10:51.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.413+0000 7fbbf0d8c640 1 -- 172.21.15.29:0/1194981221 wait complete. 2024-04-15T01:10:51.425 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2120,"stamp":"2024-04-15T01:10:50.023739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182212376,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":6016,"num_read_kb":1595737,"num_write":54695,"num_write_kb":4529750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63524,"ondisk_log_size":63524,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1089112,"kb_used_data":171032,"kb_used_omap":12,"kb_used_meta":918003,"kb_avail":753885608,"statfs":{"total":773094113280,"available":771978862592,"internally_reserved":0,"allocated":175136768,"data_stored":365444512,"data_compressed":48398084,"data_compressed_allocated":63004672,"data_compressed_original":255000576,"omap_allocated":12751,"internal_metadata":940035633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14025,"num_objects":-12,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":46,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003662"},"pg_stats":[{"pgid":"2.1f","version":"29'501","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:03.426864+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T01:10:03.426864+0000","last_peered":"2024-04-15T01:10:03.426864+0000","last_clean":"2024-04-15T01:10:03.426864+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T01:10:03.426864+0000","last_undegraded":"2024-04-15T01:10:03.426864+0000","last_fullsized":"2024-04-15T01:10:03.426864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'200","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024578+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T01:10:44.024578+0000","last_peered":"2024-04-15T01:10:44.024578+0000","last_clean":"2024-04-15T01:10:44.024578+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T01:10:44.024578+0000","last_undegraded":"2024-04-15T01:10:44.024578+0000","last_fullsized":"2024-04-15T01:10:44.024578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'821","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.274399+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T01:10:33.274399+0000","last_peered":"2024-04-15T01:10:33.274399+0000","last_clean":"2024-04-15T01:10:33.274399+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T01:10:33.274399+0000","last_undegraded":"2024-04-15T01:10:33.274399+0000","last_fullsized":"2024-04-15T01:10:33.274399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":55758,"num_write":811,"num_write_kb":161190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'216","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:21.424765+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T01:09:21.424765+0000","last_peered":"2024-04-15T01:09:21.424765+0000","last_clean":"2024-04-15T01:09:21.424765+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T01:09:21.424765+0000","last_undegraded":"2024-04-15T01:09:21.424765+0000","last_fullsized":"2024-04-15T01:09:21.424765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'182","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100863+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T01:10:44.100863+0000","last_peered":"2024-04-15T01:10:44.100863+0000","last_clean":"2024-04-15T01:10:44.100863+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T01:10:44.100863+0000","last_undegraded":"2024-04-15T01:10:44.100863+0000","last_fullsized":"2024-04-15T01:10:44.100863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'760","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326809+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T01:10:31.326809+0000","last_peered":"2024-04-15T01:10:31.326809+0000","last_clean":"2024-04-15T01:10:31.326809+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:31.326809+0000","last_undegraded":"2024-04-15T01:10:31.326809+0000","last_fullsized":"2024-04-15T01:10:31.326809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42531,"num_write":744,"num_write_kb":122981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1119","reported_seq":1174,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.796641+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T01:10:23.796641+0000","last_peered":"2024-04-15T01:10:23.796641+0000","last_clean":"2024-04-15T01:10:23.796641+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T01:10:23.796641+0000","last_undegraded":"2024-04-15T01:10:23.796641+0000","last_fullsized":"2024-04-15T01:10:23.796641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":12823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.096991+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T01:10:44.096991+0000","last_peered":"2024-04-15T01:10:44.096991+0000","last_clean":"2024-04-15T01:10:44.096991+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T01:10:44.096991+0000","last_undegraded":"2024-04-15T01:10:44.096991+0000","last_fullsized":"2024-04-15T01:10:44.096991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'741","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.169772+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T01:10:30.169772+0000","last_peered":"2024-04-15T01:10:30.169772+0000","last_clean":"2024-04-15T01:10:30.169772+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T01:10:30.169772+0000","last_undegraded":"2024-04-15T01:10:30.169772+0000","last_fullsized":"2024-04-15T01:10:30.169772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8438,"num_write":729,"num_write_kb":110173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'784","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:06.691411+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T01:10:06.691411+0000","last_peered":"2024-04-15T01:10:06.691411+0000","last_clean":"2024-04-15T01:10:06.691411+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T01:10:06.691411+0000","last_undegraded":"2024-04-15T01:10:06.691411+0000","last_fullsized":"2024-04-15T01:10:06.691411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.101557+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T01:10:44.101557+0000","last_peered":"2024-04-15T01:10:44.101557+0000","last_clean":"2024-04-15T01:10:44.101557+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T01:10:44.101557+0000","last_undegraded":"2024-04-15T01:10:44.101557+0000","last_fullsized":"2024-04-15T01:10:44.101557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'759","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.552677+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T01:10:30.552677+0000","last_peered":"2024-04-15T01:10:30.552677+0000","last_clean":"2024-04-15T01:10:30.552677+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T01:10:30.552677+0000","last_undegraded":"2024-04-15T01:10:30.552677+0000","last_fullsized":"2024-04-15T01:10:30.552677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":36806,"num_write":750,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'207","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119353+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T01:10:44.119353+0000","last_peered":"2024-04-15T01:10:44.119353+0000","last_clean":"2024-04-15T01:10:44.119353+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T01:10:44.119353+0000","last_undegraded":"2024-04-15T01:10:44.119353+0000","last_fullsized":"2024-04-15T01:10:44.119353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'916","reported_seq":974,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:47.677285+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T01:09:47.677285+0000","last_peered":"2024-04-15T01:09:47.677285+0000","last_clean":"2024-04-15T01:09:47.677285+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T01:09:47.677285+0000","last_undegraded":"2024-04-15T01:09:47.677285+0000","last_fullsized":"2024-04-15T01:09:47.677285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":8649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'809","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.791696+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T01:10:23.791696+0000","last_peered":"2024-04-15T01:10:23.791696+0000","last_clean":"2024-04-15T01:10:23.791696+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T01:10:23.791696+0000","last_undegraded":"2024-04-15T01:10:23.791696+0000","last_fullsized":"2024-04-15T01:10:23.791696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":99885,"num_write":793,"num_write_kb":204639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'209","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.027855+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T01:10:44.027855+0000","last_peered":"2024-04-15T01:10:44.027855+0000","last_clean":"2024-04-15T01:10:44.027855+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T01:10:44.027855+0000","last_undegraded":"2024-04-15T01:10:44.027855+0000","last_fullsized":"2024-04-15T01:10:44.027855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'780","reported_seq":840,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.336327+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T01:10:37.336327+0000","last_peered":"2024-04-15T01:10:37.336327+0000","last_clean":"2024-04-15T01:10:37.336327+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T01:10:37.336327+0000","last_undegraded":"2024-04-15T01:10:37.336327+0000","last_fullsized":"2024-04-15T01:10:37.336327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'885","reported_seq":1047,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.324900+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T01:10:33.324900+0000","last_peered":"2024-04-15T01:10:33.324900+0000","last_clean":"2024-04-15T01:10:33.324900+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T01:10:33.324900+0000","last_undegraded":"2024-04-15T01:10:33.324900+0000","last_fullsized":"2024-04-15T01:10:33.324900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52186,"num_write":871,"num_write_kb":181200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'202","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.028940+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T01:10:44.028940+0000","last_peered":"2024-04-15T01:10:44.028940+0000","last_clean":"2024-04-15T01:10:44.028940+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T01:10:44.028940+0000","last_undegraded":"2024-04-15T01:10:44.028940+0000","last_fullsized":"2024-04-15T01:10:44.028940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'195","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:37.074931+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T01:09:37.074931+0000","last_peered":"2024-04-15T01:09:37.074931+0000","last_clean":"2024-04-15T01:09:37.074931+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T01:09:37.074931+0000","last_undegraded":"2024-04-15T01:09:37.074931+0000","last_fullsized":"2024-04-15T01:09:37.074931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'743","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.048951+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T01:10:31.048951+0000","last_peered":"2024-04-15T01:10:31.048951+0000","last_clean":"2024-04-15T01:10:31.048951+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T01:10:31.048951+0000","last_undegraded":"2024-04-15T01:10:31.048951+0000","last_fullsized":"2024-04-15T01:10:31.048951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58288,"num_write":731,"num_write_kb":102006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'221","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.113964+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T01:10:44.113964+0000","last_peered":"2024-04-15T01:10:44.113964+0000","last_clean":"2024-04-15T01:10:44.113964+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T01:10:44.113964+0000","last_undegraded":"2024-04-15T01:10:44.113964+0000","last_fullsized":"2024-04-15T01:10:44.113964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'783","reported_seq":843,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:07.669537+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T01:10:07.669537+0000","last_peered":"2024-04-15T01:10:07.669537+0000","last_clean":"2024-04-15T01:10:07.669537+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T01:10:07.669537+0000","last_undegraded":"2024-04-15T01:10:07.669537+0000","last_fullsized":"2024-04-15T01:10:07.669537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'723","reported_seq":860,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.247777+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T01:10:35.247777+0000","last_peered":"2024-04-15T01:10:35.247777+0000","last_clean":"2024-04-15T01:10:35.247777+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T01:10:35.247777+0000","last_undegraded":"2024-04-15T01:10:35.247777+0000","last_fullsized":"2024-04-15T01:10:35.247777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":38800,"num_write":705,"num_write_kb":106309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'224","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.083669+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T01:10:44.083669+0000","last_peered":"2024-04-15T01:10:44.083669+0000","last_clean":"2024-04-15T01:10:44.083669+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T01:10:44.083669+0000","last_undegraded":"2024-04-15T01:10:44.083669+0000","last_fullsized":"2024-04-15T01:10:44.083669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'194","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.402360+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T01:10:35.402360+0000","last_peered":"2024-04-15T01:10:35.402360+0000","last_clean":"2024-04-15T01:10:35.402360+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T01:10:35.402360+0000","last_undegraded":"2024-04-15T01:10:35.402360+0000","last_fullsized":"2024-04-15T01:10:35.402360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'797","reported_seq":968,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326928+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T01:10:31.326928+0000","last_peered":"2024-04-15T01:10:31.326928+0000","last_clean":"2024-04-15T01:10:31.326928+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T01:10:31.326928+0000","last_undegraded":"2024-04-15T01:10:31.326928+0000","last_fullsized":"2024-04-15T01:10:31.326928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60896,"num_write":782,"num_write_kb":175614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'173","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.037149+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T01:10:44.037149+0000","last_peered":"2024-04-15T01:10:44.037149+0000","last_clean":"2024-04-15T01:10:44.037149+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T01:10:44.037149+0000","last_undegraded":"2024-04-15T01:10:44.037149+0000","last_fullsized":"2024-04-15T01:10:44.037149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3598","reported_seq":3658,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.735333+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T01:10:36.735333+0000","last_peered":"2024-04-15T01:10:36.735333+0000","last_clean":"2024-04-15T01:10:36.735333+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T01:10:36.735333+0000","last_undegraded":"2024-04-15T01:10:36.735333+0000","last_fullsized":"2024-04-15T01:10:36.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10014,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'787","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.786208+0000","last_change":"2024-04-15T00:01:50.325887+0000","last_active":"2024-04-15T01:10:23.786208+0000","last_peered":"2024-04-15T01:10:23.786208+0000","last_clean":"2024-04-15T01:10:23.786208+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T01:10:23.786208+0000","last_undegraded":"2024-04-15T01:10:23.786208+0000","last_fullsized":"2024-04-15T01:10:23.786208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:56:24.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27446,"num_write":780,"num_write_kb":102026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'200","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120138+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T01:10:44.120138+0000","last_peered":"2024-04-15T01:10:44.120138+0000","last_clean":"2024-04-15T01:10:44.120138+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T01:10:44.120138+0000","last_undegraded":"2024-04-15T01:10:44.120138+0000","last_fullsized":"2024-04-15T01:10:44.120138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'592","reported_seq":653,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:20.369577+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T01:10:20.369577+0000","last_peered":"2024-04-15T01:10:20.369577+0000","last_clean":"2024-04-15T01:10:20.369577+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T01:10:20.369577+0000","last_undegraded":"2024-04-15T01:10:20.369577+0000","last_fullsized":"2024-04-15T01:10:20.369577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'736","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.100676+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T01:10:29.100676+0000","last_peered":"2024-04-15T01:10:29.100676+0000","last_clean":"2024-04-15T01:10:29.100676+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T01:10:29.100676+0000","last_undegraded":"2024-04-15T01:10:29.100676+0000","last_fullsized":"2024-04-15T01:10:29.100676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":59617,"num_write":721,"num_write_kb":101495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088748+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T01:10:44.088748+0000","last_peered":"2024-04-15T01:10:44.088748+0000","last_clean":"2024-04-15T01:10:44.088748+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T01:10:44.088748+0000","last_undegraded":"2024-04-15T01:10:44.088748+0000","last_fullsized":"2024-04-15T01:10:44.088748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'304","reported_seq":365,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:48.534460+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T01:09:48.534460+0000","last_peered":"2024-04-15T01:09:48.534460+0000","last_clean":"2024-04-15T01:09:48.534460+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T01:09:48.534460+0000","last_undegraded":"2024-04-15T01:09:48.534460+0000","last_fullsized":"2024-04-15T01:09:48.534460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'778","reported_seq":912,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.107257+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T01:10:29.107257+0000","last_peered":"2024-04-15T01:10:29.107257+0000","last_clean":"2024-04-15T01:10:29.107257+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T01:10:29.107257+0000","last_undegraded":"2024-04-15T01:10:29.107257+0000","last_fullsized":"2024-04-15T01:10:29.107257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":54040,"num_write":767,"num_write_kb":142606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'203","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.117642+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T01:10:44.117642+0000","last_peered":"2024-04-15T01:10:44.117642+0000","last_clean":"2024-04-15T01:10:44.117642+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T01:10:44.117642+0000","last_undegraded":"2024-04-15T01:10:44.117642+0000","last_fullsized":"2024-04-15T01:10:44.117642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'988","reported_seq":1049,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:34.095462+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T01:08:34.095462+0000","last_peered":"2024-04-15T01:08:34.095462+0000","last_clean":"2024-04-15T01:08:34.095462+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T01:08:34.095462+0000","last_undegraded":"2024-04-15T01:08:34.095462+0000","last_fullsized":"2024-04-15T01:08:34.095462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":8655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'695","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324605+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T01:10:36.324605+0000","last_peered":"2024-04-15T01:10:36.324605+0000","last_clean":"2024-04-15T01:10:36.324605+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T01:10:36.324605+0000","last_undegraded":"2024-04-15T01:10:36.324605+0000","last_fullsized":"2024-04-15T01:10:36.324605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:49.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22523,"num_write":688,"num_write_kb":89336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"29'209","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.118138+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T01:10:44.118138+0000","last_peered":"2024-04-15T01:10:44.118138+0000","last_clean":"2024-04-15T01:10:44.118138+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T01:10:44.118138+0000","last_undegraded":"2024-04-15T01:10:44.118138+0000","last_fullsized":"2024-04-15T01:10:44.118138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3013","reported_seq":6022,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:38.153294+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T01:10:38.153294+0000","last_peered":"2024-04-15T01:10:38.153294+0000","last_clean":"2024-04-15T01:10:38.153294+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T01:10:38.153294+0000","last_undegraded":"2024-04-15T01:10:38.153294+0000","last_fullsized":"2024-04-15T01:10:38.153294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3013,"log_dups_size":0,"ondisk_log_size":3013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":2955,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'697","reported_seq":789,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.712983+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T01:10:30.712983+0000","last_peered":"2024-04-15T01:10:30.712983+0000","last_clean":"2024-04-15T01:10:30.712983+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T01:10:30.712983+0000","last_undegraded":"2024-04-15T01:10:30.712983+0000","last_fullsized":"2024-04-15T01:10:30.712983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19611,"num_write":689,"num_write_kb":76681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094106+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T01:10:44.094106+0000","last_peered":"2024-04-15T01:10:44.094106+0000","last_clean":"2024-04-15T01:10:44.094106+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T01:10:44.094106+0000","last_undegraded":"2024-04-15T01:10:44.094106+0000","last_fullsized":"2024-04-15T01:10:44.094106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'490","reported_seq":552,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.155539+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T01:09:40.155539+0000","last_peered":"2024-04-15T01:09:40.155539+0000","last_clean":"2024-04-15T01:09:40.155539+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T01:09:40.155539+0000","last_undegraded":"2024-04-15T01:09:40.155539+0000","last_fullsized":"2024-04-15T01:09:40.155539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'862","reported_seq":1064,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.221729+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T01:10:35.221729+0000","last_peered":"2024-04-15T01:10:35.221729+0000","last_clean":"2024-04-15T01:10:35.221729+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T01:10:35.221729+0000","last_undegraded":"2024-04-15T01:10:35.221729+0000","last_fullsized":"2024-04-15T01:10:35.221729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":84642,"num_write":849,"num_write_kb":128022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'185","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122812+0000","last_change":"2024-04-15T00:01:49.998011+0000","last_active":"2024-04-15T01:10:44.122812+0000","last_peered":"2024-04-15T01:10:44.122812+0000","last_clean":"2024-04-15T01:10:44.122812+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T01:10:44.122812+0000","last_undegraded":"2024-04-15T01:10:44.122812+0000","last_fullsized":"2024-04-15T01:10:44.122812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:09:28.962143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"29'299","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.787521+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T01:10:23.787521+0000","last_peered":"2024-04-15T01:10:23.787521+0000","last_clean":"2024-04-15T01:10:23.787521+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T01:10:23.787521+0000","last_undegraded":"2024-04-15T01:10:23.787521+0000","last_fullsized":"2024-04-15T01:10:23.787521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:07:20.354724+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T01:07:20.354724+0000","last_peered":"2024-04-15T01:07:20.354724+0000","last_clean":"2024-04-15T01:07:20.354724+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T01:07:20.354724+0000","last_undegraded":"2024-04-15T01:07:20.354724+0000","last_fullsized":"2024-04-15T01:07:20.354724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'808","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.400673+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T01:10:33.400673+0000","last_peered":"2024-04-15T01:10:33.400673+0000","last_clean":"2024-04-15T01:10:33.400673+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T01:10:33.400673+0000","last_undegraded":"2024-04-15T01:10:33.400673+0000","last_fullsized":"2024-04-15T01:10:33.400673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":51109,"num_write":790,"num_write_kb":155353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103744+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T01:10:44.103744+0000","last_peered":"2024-04-15T01:10:44.103744+0000","last_clean":"2024-04-15T01:10:44.103744+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T01:10:44.103744+0000","last_undegraded":"2024-04-15T01:10:44.103744+0000","last_fullsized":"2024-04-15T01:10:44.103744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'252","reported_seq":310,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.841722+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T01:10:43.841722+0000","last_peered":"2024-04-15T01:10:43.841722+0000","last_clean":"2024-04-15T01:10:43.841722+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T01:10:43.841722+0000","last_undegraded":"2024-04-15T01:10:43.841722+0000","last_fullsized":"2024-04-15T01:10:43.841722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3902566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'818","reported_seq":999,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.401547+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T01:10:33.401547+0000","last_peered":"2024-04-15T01:10:33.401547+0000","last_clean":"2024-04-15T01:10:33.401547+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T01:10:33.401547+0000","last_undegraded":"2024-04-15T01:10:33.401547+0000","last_fullsized":"2024-04-15T01:10:33.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":80804,"num_write":805,"num_write_kb":188613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081875+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T01:10:44.081875+0000","last_peered":"2024-04-15T01:10:44.081875+0000","last_clean":"2024-04-15T01:10:44.081875+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T01:10:44.081875+0000","last_undegraded":"2024-04-15T01:10:44.081875+0000","last_fullsized":"2024-04-15T01:10:44.081875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'781","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:35.006699+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T01:09:35.006699+0000","last_peered":"2024-04-15T01:09:35.006699+0000","last_clean":"2024-04-15T01:09:35.006699+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T01:09:35.006699+0000","last_undegraded":"2024-04-15T01:09:35.006699+0000","last_fullsized":"2024-04-15T01:09:35.006699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'763","reported_seq":910,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:22.751023+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T01:10:22.751023+0000","last_peered":"2024-04-15T01:10:22.751023+0000","last_clean":"2024-04-15T01:10:22.751023+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T01:10:22.751023+0000","last_undegraded":"2024-04-15T01:10:22.751023+0000","last_fullsized":"2024-04-15T01:10:22.751023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":61965,"num_write":764,"num_write_kb":101545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095025+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T01:10:44.095025+0000","last_peered":"2024-04-15T01:10:44.095025+0000","last_clean":"2024-04-15T01:10:44.095025+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T01:10:44.095025+0000","last_undegraded":"2024-04-15T01:10:44.095025+0000","last_fullsized":"2024-04-15T01:10:44.095025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'783","reported_seq":841,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:55.148414+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T01:08:55.148414+0000","last_peered":"2024-04-15T01:08:55.148414+0000","last_clean":"2024-04-15T01:08:55.148414+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T01:08:55.148414+0000","last_undegraded":"2024-04-15T01:08:55.148414+0000","last_fullsized":"2024-04-15T01:08:55.148414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'786","reported_seq":924,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.389363+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T01:10:36.389363+0000","last_peered":"2024-04-15T01:10:36.389363+0000","last_clean":"2024-04-15T01:10:36.389363+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T01:10:36.389363+0000","last_undegraded":"2024-04-15T01:10:36.389363+0000","last_fullsized":"2024-04-15T01:10:36.389363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":35671,"num_write":777,"num_write_kb":118402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.092714+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T01:10:44.092714+0000","last_peered":"2024-04-15T01:10:44.092714+0000","last_clean":"2024-04-15T01:10:44.092714+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T01:10:44.092714+0000","last_undegraded":"2024-04-15T01:10:44.092714+0000","last_fullsized":"2024-04-15T01:10:44.092714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'765","reported_seq":823,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.767966+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T01:10:17.767966+0000","last_peered":"2024-04-15T01:10:17.767966+0000","last_clean":"2024-04-15T01:10:17.767966+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T01:10:17.767966+0000","last_undegraded":"2024-04-15T01:10:17.767966+0000","last_fullsized":"2024-04-15T01:10:17.767966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'816","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.220146+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T01:10:33.220146+0000","last_peered":"2024-04-15T01:10:33.220146+0000","last_clean":"2024-04-15T01:10:33.220146+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T01:10:33.220146+0000","last_undegraded":"2024-04-15T01:10:33.220146+0000","last_fullsized":"2024-04-15T01:10:33.220146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39992,"num_write":799,"num_write_kb":139135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'231","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093976+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T01:10:44.093976+0000","last_peered":"2024-04-15T01:10:44.093976+0000","last_clean":"2024-04-15T01:10:44.093976+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T01:10:44.093976+0000","last_undegraded":"2024-04-15T01:10:44.093976+0000","last_fullsized":"2024-04-15T01:10:44.093976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'473","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.338706+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T01:10:36.338706+0000","last_peered":"2024-04-15T01:10:36.338706+0000","last_clean":"2024-04-15T01:10:36.338706+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T01:10:36.338706+0000","last_undegraded":"2024-04-15T01:10:36.338706+0000","last_fullsized":"2024-04-15T01:10:36.338706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":8414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'762","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.055277+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T01:10:29.055277+0000","last_peered":"2024-04-15T01:10:29.055277+0000","last_clean":"2024-04-15T01:10:29.055277+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T01:10:29.055277+0000","last_undegraded":"2024-04-15T01:10:29.055277+0000","last_fullsized":"2024-04-15T01:10:29.055277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":53894,"num_write":751,"num_write_kb":106228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.109035+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T01:10:44.109035+0000","last_peered":"2024-04-15T01:10:44.109035+0000","last_clean":"2024-04-15T01:10:44.109035+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T01:10:44.109035+0000","last_undegraded":"2024-04-15T01:10:44.109035+0000","last_fullsized":"2024-04-15T01:10:44.109035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'63","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:08.497363+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T01:09:08.497363+0000","last_peered":"2024-04-15T01:09:08.497363+0000","last_clean":"2024-04-15T01:09:08.497363+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T01:09:08.497363+0000","last_undegraded":"2024-04-15T01:09:08.497363+0000","last_fullsized":"2024-04-15T01:09:08.497363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'778","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.966740+0000","last_change":"2024-04-15T00:01:50.326200+0000","last_active":"2024-04-15T01:10:21.966740+0000","last_peered":"2024-04-15T01:10:21.966740+0000","last_clean":"2024-04-15T01:10:21.966740+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T01:10:21.966740+0000","last_undegraded":"2024-04-15T01:10:21.966740+0000","last_fullsized":"2024-04-15T01:10:21.966740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:32:27.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":41754,"num_write":768,"num_write_kb":168968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'200","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094807+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T01:10:44.094807+0000","last_peered":"2024-04-15T01:10:44.094807+0000","last_clean":"2024-04-15T01:10:44.094807+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T01:10:44.094807+0000","last_undegraded":"2024-04-15T01:10:44.094807+0000","last_fullsized":"2024-04-15T01:10:44.094807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'60","reported_seq":117,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324199+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T01:10:36.324199+0000","last_peered":"2024-04-15T01:10:36.324199+0000","last_clean":"2024-04-15T01:10:36.324199+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T01:10:36.324199+0000","last_undegraded":"2024-04-15T01:10:36.324199+0000","last_fullsized":"2024-04-15T01:10:36.324199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'697","reported_seq":801,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.054816+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T01:10:29.054816+0000","last_peered":"2024-04-15T01:10:29.054816+0000","last_clean":"2024-04-15T01:10:29.054816+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T01:10:29.054816+0000","last_undegraded":"2024-04-15T01:10:29.054816+0000","last_fullsized":"2024-04-15T01:10:29.054816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":31143,"num_write":687,"num_write_kb":101153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'209","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104276+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T01:10:44.104276+0000","last_peered":"2024-04-15T01:10:44.104276+0000","last_clean":"2024-04-15T01:10:44.104276+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T01:10:44.104276+0000","last_undegraded":"2024-04-15T01:10:44.104276+0000","last_fullsized":"2024-04-15T01:10:44.104276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'390","reported_seq":447,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:54.194363+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T01:08:54.194363+0000","last_peered":"2024-04-15T01:08:54.194363+0000","last_clean":"2024-04-15T01:08:54.194363+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T01:08:54.194363+0000","last_undegraded":"2024-04-15T01:08:54.194363+0000","last_fullsized":"2024-04-15T01:08:54.194363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'747","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.144852+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T01:10:33.144852+0000","last_peered":"2024-04-15T01:10:33.144852+0000","last_clean":"2024-04-15T01:10:33.144852+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T01:10:33.144852+0000","last_undegraded":"2024-04-15T01:10:33.144852+0000","last_fullsized":"2024-04-15T01:10:33.144852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":56791,"num_write":733,"num_write_kb":134490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100391+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T01:10:44.100391+0000","last_peered":"2024-04-15T01:10:44.100391+0000","last_clean":"2024-04-15T01:10:44.100391+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T01:10:44.100391+0000","last_undegraded":"2024-04-15T01:10:44.100391+0000","last_fullsized":"2024-04-15T01:10:44.100391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1423","reported_seq":1480,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.623835+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T01:10:21.623835+0000","last_peered":"2024-04-15T01:10:21.623835+0000","last_clean":"2024-04-15T01:10:21.623835+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T01:10:21.623835+0000","last_undegraded":"2024-04-15T01:10:21.623835+0000","last_fullsized":"2024-04-15T01:10:21.623835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":13127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'798","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.406562+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T01:10:33.406562+0000","last_peered":"2024-04-15T01:10:33.406562+0000","last_clean":"2024-04-15T01:10:33.406562+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T01:10:33.406562+0000","last_undegraded":"2024-04-15T01:10:33.406562+0000","last_fullsized":"2024-04-15T01:10:33.406562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":58877,"num_write":785,"num_write_kb":152322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'203","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124028+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T01:10:44.124028+0000","last_peered":"2024-04-15T01:10:44.124028+0000","last_clean":"2024-04-15T01:10:44.124028+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T01:10:44.124028+0000","last_undegraded":"2024-04-15T01:10:44.124028+0000","last_fullsized":"2024-04-15T01:10:44.124028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1844","reported_seq":1900,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.151340+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T01:10:37.151340+0000","last_peered":"2024-04-15T01:10:37.151340+0000","last_clean":"2024-04-15T01:10:37.151340+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T01:10:37.151340+0000","last_undegraded":"2024-04-15T01:10:37.151340+0000","last_fullsized":"2024-04-15T01:10:37.151340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":5818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'701","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.553388+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T01:10:30.553388+0000","last_peered":"2024-04-15T01:10:30.553388+0000","last_clean":"2024-04-15T01:10:30.553388+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T01:10:30.553388+0000","last_undegraded":"2024-04-15T01:10:30.553388+0000","last_fullsized":"2024-04-15T01:10:30.553388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35520,"num_write":691,"num_write_kb":85742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.098091+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T01:10:44.098091+0000","last_peered":"2024-04-15T01:10:44.098091+0000","last_clean":"2024-04-15T01:10:44.098091+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T01:10:44.098091+0000","last_undegraded":"2024-04-15T01:10:44.098091+0000","last_fullsized":"2024-04-15T01:10:44.098091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'396","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:13.065031+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T01:10:13.065031+0000","last_peered":"2024-04-15T01:10:13.065031+0000","last_clean":"2024-04-15T01:10:13.065031+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T01:10:13.065031+0000","last_undegraded":"2024-04-15T01:10:13.065031+0000","last_fullsized":"2024-04-15T01:10:13.065031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'858","reported_seq":983,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.214354+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T01:10:33.214354+0000","last_peered":"2024-04-15T01:10:33.214354+0000","last_clean":"2024-04-15T01:10:33.214354+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T01:10:33.214354+0000","last_undegraded":"2024-04-15T01:10:33.214354+0000","last_fullsized":"2024-04-15T01:10:33.214354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":40736,"num_write":845,"num_write_kb":155666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'215","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112020+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T01:10:44.112020+0000","last_peered":"2024-04-15T01:10:44.112020+0000","last_clean":"2024-04-15T01:10:44.112020+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T01:10:44.112020+0000","last_undegraded":"2024-04-15T01:10:44.112020+0000","last_fullsized":"2024-04-15T01:10:44.112020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'69","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.837447+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T01:10:43.837447+0000","last_peered":"2024-04-15T01:10:43.837447+0000","last_clean":"2024-04-15T01:10:43.837447+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T01:10:43.837447+0000","last_undegraded":"2024-04-15T01:10:43.837447+0000","last_fullsized":"2024-04-15T01:10:43.837447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'833","reported_seq":967,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.445684+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T01:10:33.445684+0000","last_peered":"2024-04-15T01:10:33.445684+0000","last_clean":"2024-04-15T01:10:33.445684+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T01:10:33.445684+0000","last_undegraded":"2024-04-15T01:10:33.445684+0000","last_fullsized":"2024-04-15T01:10:33.445684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":38336,"num_write":816,"num_write_kb":147104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'791","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.170941+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T01:10:30.170941+0000","last_peered":"2024-04-15T01:10:30.170941+0000","last_clean":"2024-04-15T01:10:30.170941+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T01:10:30.170941+0000","last_undegraded":"2024-04-15T01:10:30.170941+0000","last_fullsized":"2024-04-15T01:10:30.170941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":55193,"num_write":783,"num_write_kb":131702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'213","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.254659+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T01:10:44.254659+0000","last_peered":"2024-04-15T01:10:44.254659+0000","last_clean":"2024-04-15T01:10:44.254659+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T01:10:44.254659+0000","last_undegraded":"2024-04-15T01:10:44.254659+0000","last_fullsized":"2024-04-15T01:10:44.254659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1370","reported_seq":1426,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:26.576298+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T01:09:26.576298+0000","last_peered":"2024-04-15T01:09:26.576298+0000","last_clean":"2024-04-15T01:09:26.576298+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T01:09:26.576298+0000","last_undegraded":"2024-04-15T01:09:26.576298+0000","last_fullsized":"2024-04-15T01:09:26.576298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'758","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.626649+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T01:10:17.626649+0000","last_peered":"2024-04-15T01:10:17.626649+0000","last_clean":"2024-04-15T01:10:17.626649+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:17.626649+0000","last_undegraded":"2024-04-15T01:10:17.626649+0000","last_fullsized":"2024-04-15T01:10:17.626649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":41433,"num_write":747,"num_write_kb":139089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'219","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032800+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T01:10:44.032800+0000","last_peered":"2024-04-15T01:10:44.032800+0000","last_clean":"2024-04-15T01:10:44.032800+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T01:10:44.032800+0000","last_undegraded":"2024-04-15T01:10:44.032800+0000","last_fullsized":"2024-04-15T01:10:44.032800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'580","reported_seq":636,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:32.070004+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T01:09:32.070004+0000","last_peered":"2024-04-15T01:09:32.070004+0000","last_clean":"2024-04-15T01:09:32.070004+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T01:09:32.070004+0000","last_undegraded":"2024-04-15T01:09:32.070004+0000","last_fullsized":"2024-04-15T01:09:32.070004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1197","reported_seq":1252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:17.007966+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T01:09:17.007966+0000","last_peered":"2024-04-15T01:09:17.007966+0000","last_clean":"2024-04-15T01:09:17.007966+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T01:09:17.007966+0000","last_undegraded":"2024-04-15T01:09:17.007966+0000","last_fullsized":"2024-04-15T01:09:17.007966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'187","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.087512+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T01:10:44.087512+0000","last_peered":"2024-04-15T01:10:44.087512+0000","last_clean":"2024-04-15T01:10:44.087512+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T01:10:44.087512+0000","last_undegraded":"2024-04-15T01:10:44.087512+0000","last_fullsized":"2024-04-15T01:10:44.087512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'744","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.393810+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T01:10:30.393810+0000","last_peered":"2024-04-15T01:10:30.393810+0000","last_clean":"2024-04-15T01:10:30.393810+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T01:10:30.393810+0000","last_undegraded":"2024-04-15T01:10:30.393810+0000","last_fullsized":"2024-04-15T01:10:30.393810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":84659,"num_write":735,"num_write_kb":176000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'220","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.168273+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T01:09:40.168273+0000","last_peered":"2024-04-15T01:09:40.168273+0000","last_clean":"2024-04-15T01:09:40.168273+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T01:09:40.168273+0000","last_undegraded":"2024-04-15T01:09:40.168273+0000","last_fullsized":"2024-04-15T01:09:40.168273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'202","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122471+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T01:10:44.122471+0000","last_peered":"2024-04-15T01:10:44.122471+0000","last_clean":"2024-04-15T01:10:44.122471+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T01:10:44.122471+0000","last_undegraded":"2024-04-15T01:10:44.122471+0000","last_fullsized":"2024-04-15T01:10:44.122471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'759","reported_seq":920,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:25.904298+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T01:10:25.904298+0000","last_peered":"2024-04-15T01:10:25.904298+0000","last_clean":"2024-04-15T01:10:25.904298+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T01:10:25.904298+0000","last_undegraded":"2024-04-15T01:10:25.904298+0000","last_fullsized":"2024-04-15T01:10:25.904298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62677,"num_write":745,"num_write_kb":206027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'216","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.115518+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T01:10:44.115518+0000","last_peered":"2024-04-15T01:10:44.115518+0000","last_clean":"2024-04-15T01:10:44.115518+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T01:10:44.115518+0000","last_undegraded":"2024-04-15T01:10:44.115518+0000","last_fullsized":"2024-04-15T01:10:44.115518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103511+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T01:10:44.103511+0000","last_peered":"2024-04-15T01:10:44.103511+0000","last_clean":"2024-04-15T01:10:44.103511+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T01:10:44.103511+0000","last_undegraded":"2024-04-15T01:10:44.103511+0000","last_fullsized":"2024-04-15T01:10:44.103511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'232","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.080669+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T01:10:44.080669+0000","last_peered":"2024-04-15T01:10:44.080669+0000","last_clean":"2024-04-15T01:10:44.080669+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T01:10:44.080669+0000","last_undegraded":"2024-04-15T01:10:44.080669+0000","last_fullsized":"2024-04-15T01:10:44.080669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'207","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.083665+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T01:10:44.083665+0000","last_peered":"2024-04-15T01:10:44.083665+0000","last_clean":"2024-04-15T01:10:44.083665+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T01:10:44.083665+0000","last_undegraded":"2024-04-15T01:10:44.083665+0000","last_fullsized":"2024-04-15T01:10:44.083665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.040848+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T01:10:44.040848+0000","last_peered":"2024-04-15T01:10:44.040848+0000","last_clean":"2024-04-15T01:10:44.040848+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T01:10:44.040848+0000","last_undegraded":"2024-04-15T01:10:44.040848+0000","last_fullsized":"2024-04-15T01:10:44.040848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'207","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120698+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T01:10:44.120698+0000","last_peered":"2024-04-15T01:10:44.120698+0000","last_clean":"2024-04-15T01:10:44.120698+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T01:10:44.120698+0000","last_undegraded":"2024-04-15T01:10:44.120698+0000","last_fullsized":"2024-04-15T01:10:44.120698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'241","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.123430+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T01:10:44.123430+0000","last_peered":"2024-04-15T01:10:44.123430+0000","last_clean":"2024-04-15T01:10:44.123430+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T01:10:44.123430+0000","last_undegraded":"2024-04-15T01:10:44.123430+0000","last_fullsized":"2024-04-15T01:10:44.123430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'192","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024735+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T01:10:44.024735+0000","last_peered":"2024-04-15T01:10:44.024735+0000","last_clean":"2024-04-15T01:10:44.024735+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T01:10:44.024735+0000","last_undegraded":"2024-04-15T01:10:44.024735+0000","last_fullsized":"2024-04-15T01:10:44.024735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.084292+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T01:10:44.084292+0000","last_peered":"2024-04-15T01:10:44.084292+0000","last_clean":"2024-04-15T01:10:44.084292+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T01:10:44.084292+0000","last_undegraded":"2024-04-15T01:10:44.084292+0000","last_fullsized":"2024-04-15T01:10:44.084292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032553+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T01:10:44.032553+0000","last_peered":"2024-04-15T01:10:44.032553+0000","last_clean":"2024-04-15T01:10:44.032553+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T01:10:44.032553+0000","last_undegraded":"2024-04-15T01:10:44.032553+0000","last_fullsized":"2024-04-15T01:10:44.032553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'215","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095159+0000","last_change":"2024-04-15T00:01:50.325599+0000","last_active":"2024-04-15T01:10:44.095159+0000","last_peered":"2024-04-15T01:10:44.095159+0000","last_clean":"2024-04-15T01:10:44.095159+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T01:10:44.095159+0000","last_undegraded":"2024-04-15T01:10:44.095159+0000","last_fullsized":"2024-04-15T01:10:44.095159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'212","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104229+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T01:10:44.104229+0000","last_peered":"2024-04-15T01:10:44.104229+0000","last_clean":"2024-04-15T01:10:44.104229+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T01:10:44.104229+0000","last_undegraded":"2024-04-15T01:10:44.104229+0000","last_fullsized":"2024-04-15T01:10:44.104229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'223","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119670+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T01:10:44.119670+0000","last_peered":"2024-04-15T01:10:44.119670+0000","last_clean":"2024-04-15T01:10:44.119670+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T01:10:44.119670+0000","last_undegraded":"2024-04-15T01:10:44.119670+0000","last_fullsized":"2024-04-15T01:10:44.119670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081817+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T01:10:44.081817+0000","last_peered":"2024-04-15T01:10:44.081817+0000","last_clean":"2024-04-15T01:10:44.081817+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T01:10:44.081817+0000","last_undegraded":"2024-04-15T01:10:44.081817+0000","last_fullsized":"2024-04-15T01:10:44.081817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.114261+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T01:10:44.114261+0000","last_peered":"2024-04-15T01:10:44.114261+0000","last_clean":"2024-04-15T01:10:44.114261+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T01:10:44.114261+0000","last_undegraded":"2024-04-15T01:10:44.114261+0000","last_fullsized":"2024-04-15T01:10:44.114261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'199","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.111859+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T01:10:44.111859+0000","last_peered":"2024-04-15T01:10:44.111859+0000","last_clean":"2024-04-15T01:10:44.111859+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T01:10:44.111859+0000","last_undegraded":"2024-04-15T01:10:44.111859+0000","last_fullsized":"2024-04-15T01:10:44.111859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'222","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097146+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T01:10:44.097146+0000","last_peered":"2024-04-15T01:10:44.097146+0000","last_clean":"2024-04-15T01:10:44.097146+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T01:10:44.097146+0000","last_undegraded":"2024-04-15T01:10:44.097146+0000","last_fullsized":"2024-04-15T01:10:44.097146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'215","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124019+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T01:10:44.124019+0000","last_peered":"2024-04-15T01:10:44.124019+0000","last_clean":"2024-04-15T01:10:44.124019+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T01:10:44.124019+0000","last_undegraded":"2024-04-15T01:10:44.124019+0000","last_fullsized":"2024-04-15T01:10:44.124019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088632+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T01:10:44.088632+0000","last_peered":"2024-04-15T01:10:44.088632+0000","last_clean":"2024-04-15T01:10:44.088632+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T01:10:44.088632+0000","last_undegraded":"2024-04-15T01:10:44.088632+0000","last_fullsized":"2024-04-15T01:10:44.088632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.039555+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T01:10:44.039555+0000","last_peered":"2024-04-15T01:10:44.039555+0000","last_clean":"2024-04-15T01:10:44.039555+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T01:10:44.039555+0000","last_undegraded":"2024-04-15T01:10:44.039555+0000","last_fullsized":"2024-04-15T01:10:44.039555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'185","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122630+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T01:10:44.122630+0000","last_peered":"2024-04-15T01:10:44.122630+0000","last_clean":"2024-04-15T01:10:44.122630+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T01:10:44.122630+0000","last_undegraded":"2024-04-15T01:10:44.122630+0000","last_fullsized":"2024-04-15T01:10:44.122630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'188","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112221+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T01:10:44.112221+0000","last_peered":"2024-04-15T01:10:44.112221+0000","last_clean":"2024-04-15T01:10:44.112221+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T01:10:44.112221+0000","last_undegraded":"2024-04-15T01:10:44.112221+0000","last_fullsized":"2024-04-15T01:10:44.112221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122116+0000","last_change":"2024-04-15T00:01:49.997896+0000","last_active":"2024-04-15T01:10:44.122116+0000","last_peered":"2024-04-15T01:10:44.122116+0000","last_clean":"2024-04-15T01:10:44.122116+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T01:10:44.122116+0000","last_undegraded":"2024-04-15T01:10:44.122116+0000","last_fullsized":"2024-04-15T01:10:44.122116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:52:44.356891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'211","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103209+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T01:10:44.103209+0000","last_peered":"2024-04-15T01:10:44.103209+0000","last_clean":"2024-04-15T01:10:44.103209+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T01:10:44.103209+0000","last_undegraded":"2024-04-15T01:10:44.103209+0000","last_fullsized":"2024-04-15T01:10:44.103209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.038221+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T01:10:44.038221+0000","last_peered":"2024-04-15T01:10:44.038221+0000","last_clean":"2024-04-15T01:10:44.038221+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T01:10:44.038221+0000","last_undegraded":"2024-04-15T01:10:44.038221+0000","last_fullsized":"2024-04-15T01:10:44.038221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.060783+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T01:10:44.060783+0000","last_peered":"2024-04-15T01:10:44.060783+0000","last_clean":"2024-04-15T01:10:44.060783+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T01:10:44.060783+0000","last_undegraded":"2024-04-15T01:10:44.060783+0000","last_fullsized":"2024-04-15T01:10:44.060783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'197","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097300+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T01:10:44.097300+0000","last_peered":"2024-04-15T01:10:44.097300+0000","last_clean":"2024-04-15T01:10:44.097300+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T01:10:44.097300+0000","last_undegraded":"2024-04-15T01:10:44.097300+0000","last_fullsized":"2024-04-15T01:10:44.097300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.085102+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T01:10:44.085102+0000","last_peered":"2024-04-15T01:10:44.085102+0000","last_clean":"2024-04-15T01:10:44.085102+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T01:10:44.085102+0000","last_undegraded":"2024-04-15T01:10:44.085102+0000","last_fullsized":"2024-04-15T01:10:44.085102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'195","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093604+0000","last_change":"2024-04-15T00:01:50.003849+0000","last_active":"2024-04-15T01:10:44.093604+0000","last_peered":"2024-04-15T01:10:44.093604+0000","last_clean":"2024-04-15T01:10:44.093604+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T01:10:44.093604+0000","last_undegraded":"2024-04-15T01:10:44.093604+0000","last_fullsized":"2024-04-15T01:10:44.093604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'194","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.090714+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T01:10:44.090714+0000","last_peered":"2024-04-15T01:10:44.090714+0000","last_clean":"2024-04-15T01:10:44.090714+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T01:10:44.090714+0000","last_undegraded":"2024-04-15T01:10:44.090714+0000","last_fullsized":"2024-04-15T01:10:44.090714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'214","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.116609+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T01:10:44.116609+0000","last_peered":"2024-04-15T01:10:44.116609+0000","last_clean":"2024-04-15T01:10:44.116609+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T01:10:44.116609+0000","last_undegraded":"2024-04-15T01:10:44.116609+0000","last_fullsized":"2024-04-15T01:10:44.116609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'211","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.091482+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T01:10:44.091482+0000","last_peered":"2024-04-15T01:10:44.091482+0000","last_clean":"2024-04-15T01:10:44.091482+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T01:10:44.091482+0000","last_undegraded":"2024-04-15T01:10:44.091482+0000","last_fullsized":"2024-04-15T01:10:44.091482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2952,"num_read_kb":1592021,"num_write":24431,"num_write_kb":4334185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24810,"ondisk_log_size":24810,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13159,"ondisk_log_size":13159,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":181622008,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":30105,"num_write_kb":193149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172548096,"data_stored":363244016,"data_compressed":48333034,"data_compressed_allocated":62914560,"data_compressed_original":253853696,"omap_allocated":0,"internal_metadata":0},"log_size":25438,"ondisk_log_size":25438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542986,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137664,"kb_used_data":30200,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94234176,"statfs":{"total":96636764160,"available":96495796224,"internally_reserved":0,"allocated":30924800,"data_stored":72023688,"data_compressed":9942585,"data_compressed_allocated":12574720,"data_compressed_original":53891072,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542986,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157088,"kb_used_data":23256,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94214752,"statfs":{"total":96636764160,"available":96475906048,"internally_reserved":0,"allocated":23814144,"data_stored":50461162,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542986,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136936,"kb_used_data":21152,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94234904,"statfs":{"total":96636764160,"available":96496541696,"internally_reserved":0,"allocated":21659648,"data_stored":41781534,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542987,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125000,"kb_used_data":25856,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94246840,"statfs":{"total":96636764160,"available":96508764160,"internally_reserved":0,"allocated":26476544,"data_stored":50461030,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510283,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144168,"kb_used_data":18592,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94227672,"statfs":{"total":96636764160,"available":96489136128,"internally_reserved":0,"allocated":19038208,"data_stored":35235566,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510281,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":11480,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":11755520,"data_stored":22359130,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510283,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169692,"kb_used_data":21972,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94202148,"statfs":{"total":96636764160,"available":96462999552,"internally_reserved":0,"allocated":22499328,"data_stored":50460650,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575691,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103780,"kb_used_data":18524,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94268060,"statfs":{"total":96636764160,"available":96530493440,"internally_reserved":0,"allocated":18968576,"data_stored":42661752,"data_compressed":5896627,"data_compressed_allocated":7761920,"data_compressed_original":31666176,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18595840,"data_stored":41943914,"data_compressed":5864102,"data_compressed_allocated":7716864,"data_compressed_original":31092736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":50333180,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11448320,"data_stored":22231660,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18731008,"data_stored":35108096,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":50333560,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21352448,"data_stored":41654064,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":50333692,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30552064,"data_stored":71305850,"data_compressed":9910060,"data_compressed_allocated":12529664,"data_compressed_original":53317632,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T01:10:51.434 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T01:10:51.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T01:10:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.569+0000 7f7dbbb7b640 1 Processor -- start 2024-04-15T01:10:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.570+0000 7f7dbbb7b640 1 -- start start 2024-04-15T01:10:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.570+0000 7f7dbbb7b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db40c2c50 0x7f7db4072f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.570+0000 7f7dbbb7b640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db40c5780 con 0x7f7db41568e0 2024-04-15T01:10:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.570+0000 7f7dbbb7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db40c5a60 con 0x7f7db4150a30 2024-04-15T01:10:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.570+0000 7f7dbbb7b640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f7db40734b0 con 0x7f7db40c2c50 2024-04-15T01:10:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.571+0000 7f7dba118640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7db41568e0 0x7f7db4156d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55998/0 (socket says 172.21.15.29:55998) 2024-04-15T01:10:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.571+0000 7f7dba118640 1 -- 172.21.15.29:0/4073718581 learned_addr learned my addr 172.21.15.29:0/4073718581 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.571+0000 7f7db9116640 1 --2- 172.21.15.29:0/4073718581 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db40c2c50 0x7f7db4072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:51.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.574+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677891860 0 0) 0x7f7db40c5780 con 0x7f7db41568e0 2024-04-15T01:10:51.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.574+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d9c003520 con 0x7f7db41568e0 2024-04-15T01:10:51.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.574+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 875938532 0 0) 0x7f7db40c5a60 con 0x7f7db4150a30 2024-04-15T01:10:51.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.574+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db40c5780 con 0x7f7db4150a30 2024-04-15T01:10:51.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.575+0000 7f7db9116640 1 -- 172.21.15.29:0/4073718581 >> v1:172.21.15.37:6789/0 conn(0x7f7db4150a30 legacy=0x7f7db40c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.575+0000 7f7db9116640 1 -- 172.21.15.29:0/4073718581 >> v1:172.21.15.29:6789/0 conn(0x7f7db41568e0 legacy=0x7f7db4156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.575+0000 7f7db9116640 1 -- 172.21.15.29:0/4073718581 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db406cd10 con 0x7f7db40c2c50 2024-04-15T01:10:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.577+0000 7f7db9116640 1 --2- 172.21.15.29:0/4073718581 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db40c2c50 0x7f7db4072f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a960 tx=0x7f7da802ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b46ffacd75c1eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:51.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.581+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da803a070 con 0x7f7db40c2c50 2024-04-15T01:10:51.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.581+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da802dc30 con 0x7f7db40c2c50 2024-04-15T01:10:51.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.581+0000 7f7db8915640 1 -- 172.21.15.29:0/4073718581 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da800b040 con 0x7f7db40c2c50 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/4073718581 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db40c2c50 msgr2=0x7f7db4072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/4073718581 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db40c2c50 0x7f7db4072f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a960 tx=0x7f7da802ce80 comp rx=0 tx=0).stop 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/4073718581 shutdown_connections 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/4073718581 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db40c2c50 0x7f7db4072f70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/4073718581 >> 172.21.15.29:0/4073718581 conn(0x7f7db406fca0 msgr2=0x7f7db406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/4073718581 shutdown_connections 2024-04-15T01:10:51.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.582+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/4073718581 wait complete. 2024-04-15T01:10:51.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.583+0000 7f7dbbb7b640 1 Processor -- start 2024-04-15T01:10:51.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.583+0000 7f7dbbb7b640 1 -- start start 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.584+0000 7f7dbbb7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40c2c50 0x7f7db40caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.584+0000 7f7dbbb7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 0x7f7db414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.584+0000 7f7dbbb7b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db41568e0 0x7f7db4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.584+0000 7f7dbbb7b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7db406d5b0 con 0x7f7db4150a30 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.584+0000 7f7dbbb7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7db406d2d0 con 0x7f7db40c2c50 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.584+0000 7f7dbbb7b640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f7db40c5420 con 0x7f7db41568e0 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.585+0000 7f7db9116640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 0x7f7db414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.585+0000 7f7db9917640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40c2c50 0x7f7db40caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:51.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.585+0000 7f7dba118640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db41568e0 0x7f7db4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:51.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.585+0000 7f7db9116640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 0x7f7db414f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36376/0 (socket says 172.21.15.29:36376) 2024-04-15T01:10:51.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.585+0000 7f7db9116640 1 -- 172.21.15.29:0/1945571384 learned_addr learned my addr 172.21.15.29:0/1945571384 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:51.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.588+0000 7f7db9116640 1 -- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db41568e0 msgr2=0x7f7db4154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.588+0000 7f7db9116640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db41568e0 0x7f7db4154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.588+0000 7f7db9116640 1 -- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40c2c50 msgr2=0x7f7db40caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:51.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.588+0000 7f7db9116640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40c2c50 0x7f7db40caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:51.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.588+0000 7f7db9116640 1 -- 172.21.15.29:0/1945571384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db41f4010 con 0x7f7db4150a30 2024-04-15T01:10:51.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.591+0000 7f7db9116640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 0x7f7db414f670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7da802d490 tx=0x7f7da80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:51.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.594+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8043070 con 0x7f7db4150a30 2024-04-15T01:10:51.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.594+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da803e3f0 con 0x7f7db4150a30 2024-04-15T01:10:51.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.594+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da803a040 con 0x7f7db4150a30 2024-04-15T01:10:51.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.594+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db41f42d0 con 0x7f7db4150a30 2024-04-15T01:10:51.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.594+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db41f0580 con 0x7f7db4150a30 2024-04-15T01:10:51.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.595+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db40726b0 con 0x7f7db4150a30 2024-04-15T01:10:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.615+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7da8046070 con 0x7f7db4150a30 2024-04-15T01:10:51.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.615+0000 7f7db27fc640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7da006b9e0 0x7f7da006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:51.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.615+0000 7f7db9917640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7da006b9e0 0x7f7da006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:51.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.616+0000 7f7db9917640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7da006b9e0 0x7f7da006dea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7dac007fd0 tx=0x7f7dac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:51.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.874+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f7da8078570 con 0x7f7db4150a30 2024-04-15T01:10:51.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:51.874+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7db40726b0 con 0x7f7db4150a30 2024-04-15T01:10:52.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.073+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7db404f540 con 0x7f7da006b9e0 2024-04-15T01:10:52.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.081+0000 7f7db27fc640 1 -- 172.21.15.29:0/1945571384 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334939 (secure 0 0 0) 0x7f7db404f540 con 0x7f7da006b9e0 2024-04-15T01:10:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:10:52.089 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T01:10:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7da006b9e0 msgr2=0x7f7da006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7da006b9e0 0x7f7da006dea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7dac007fd0 tx=0x7f7dac009040 comp rx=0 tx=0).stop 2024-04-15T01:10:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 msgr2=0x7f7db414f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 0x7f7db414f670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7da802d490 tx=0x7f7da80046c0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 shutdown_connections 2024-04-15T01:10:52.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f7da006b9e0 0x7f7da006dea0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f7db41568e0 0x7f7db4154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4150a30 0x7f7db414f670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 --2- 172.21.15.29:0/1945571384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40c2c50 0x7f7db40caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 >> 172.21.15.29:0/1945571384 conn(0x7f7db406fca0 msgr2=0x7f7db41456f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:52.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 shutdown_connections 2024-04-15T01:10:52.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.085+0000 7f7dbbb7b640 1 -- 172.21.15.29:0/1945571384 wait complete. 2024-04-15T01:10:52.095 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2121,"stamp":"2024-04-15T01:10:52.024404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182212376,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":6016,"num_read_kb":1595737,"num_write":54695,"num_write_kb":4529750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63524,"ondisk_log_size":63524,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1089112,"kb_used_data":171032,"kb_used_omap":12,"kb_used_meta":918003,"kb_avail":753885608,"statfs":{"total":773094113280,"available":771978862592,"internally_reserved":0,"allocated":175136768,"data_stored":365444512,"data_compressed":48398084,"data_compressed_allocated":63004672,"data_compressed_original":255000576,"omap_allocated":12751,"internal_metadata":940035633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19541,"num_objects":-7,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":41,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003862"},"pg_stats":[{"pgid":"2.1f","version":"29'501","reported_seq":562,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:03.426864+0000","last_change":"2024-04-15T00:01:11.987130+0000","last_active":"2024-04-15T01:10:03.426864+0000","last_peered":"2024-04-15T01:10:03.426864+0000","last_clean":"2024-04-15T01:10:03.426864+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T01:10:03.426864+0000","last_undegraded":"2024-04-15T01:10:03.426864+0000","last_fullsized":"2024-04-15T01:10:03.426864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:45:45.602247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'200","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024578+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T01:10:44.024578+0000","last_peered":"2024-04-15T01:10:44.024578+0000","last_clean":"2024-04-15T01:10:44.024578+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T01:10:44.024578+0000","last_undegraded":"2024-04-15T01:10:44.024578+0000","last_fullsized":"2024-04-15T01:10:44.024578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'821","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.274399+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T01:10:33.274399+0000","last_peered":"2024-04-15T01:10:33.274399+0000","last_clean":"2024-04-15T01:10:33.274399+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T01:10:33.274399+0000","last_undegraded":"2024-04-15T01:10:33.274399+0000","last_fullsized":"2024-04-15T01:10:33.274399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":55758,"num_write":811,"num_write_kb":161190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'216","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:21.424765+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T01:09:21.424765+0000","last_peered":"2024-04-15T01:09:21.424765+0000","last_clean":"2024-04-15T01:09:21.424765+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T01:09:21.424765+0000","last_undegraded":"2024-04-15T01:09:21.424765+0000","last_fullsized":"2024-04-15T01:09:21.424765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'182","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100863+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T01:10:44.100863+0000","last_peered":"2024-04-15T01:10:44.100863+0000","last_clean":"2024-04-15T01:10:44.100863+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T01:10:44.100863+0000","last_undegraded":"2024-04-15T01:10:44.100863+0000","last_fullsized":"2024-04-15T01:10:44.100863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'760","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326809+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T01:10:31.326809+0000","last_peered":"2024-04-15T01:10:31.326809+0000","last_clean":"2024-04-15T01:10:31.326809+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:31.326809+0000","last_undegraded":"2024-04-15T01:10:31.326809+0000","last_fullsized":"2024-04-15T01:10:31.326809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42531,"num_write":744,"num_write_kb":122981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1119","reported_seq":1174,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.796641+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T01:10:23.796641+0000","last_peered":"2024-04-15T01:10:23.796641+0000","last_clean":"2024-04-15T01:10:23.796641+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T01:10:23.796641+0000","last_undegraded":"2024-04-15T01:10:23.796641+0000","last_fullsized":"2024-04-15T01:10:23.796641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":12823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.096991+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T01:10:44.096991+0000","last_peered":"2024-04-15T01:10:44.096991+0000","last_clean":"2024-04-15T01:10:44.096991+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T01:10:44.096991+0000","last_undegraded":"2024-04-15T01:10:44.096991+0000","last_fullsized":"2024-04-15T01:10:44.096991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'741","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.169772+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T01:10:30.169772+0000","last_peered":"2024-04-15T01:10:30.169772+0000","last_clean":"2024-04-15T01:10:30.169772+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T01:10:30.169772+0000","last_undegraded":"2024-04-15T01:10:30.169772+0000","last_fullsized":"2024-04-15T01:10:30.169772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8438,"num_write":729,"num_write_kb":110173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'784","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:06.691411+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T01:10:06.691411+0000","last_peered":"2024-04-15T01:10:06.691411+0000","last_clean":"2024-04-15T01:10:06.691411+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T01:10:06.691411+0000","last_undegraded":"2024-04-15T01:10:06.691411+0000","last_fullsized":"2024-04-15T01:10:06.691411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.101557+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T01:10:44.101557+0000","last_peered":"2024-04-15T01:10:44.101557+0000","last_clean":"2024-04-15T01:10:44.101557+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T01:10:44.101557+0000","last_undegraded":"2024-04-15T01:10:44.101557+0000","last_fullsized":"2024-04-15T01:10:44.101557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'759","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.552677+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T01:10:30.552677+0000","last_peered":"2024-04-15T01:10:30.552677+0000","last_clean":"2024-04-15T01:10:30.552677+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T01:10:30.552677+0000","last_undegraded":"2024-04-15T01:10:30.552677+0000","last_fullsized":"2024-04-15T01:10:30.552677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":36806,"num_write":750,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'207","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119353+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T01:10:44.119353+0000","last_peered":"2024-04-15T01:10:44.119353+0000","last_clean":"2024-04-15T01:10:44.119353+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T01:10:44.119353+0000","last_undegraded":"2024-04-15T01:10:44.119353+0000","last_fullsized":"2024-04-15T01:10:44.119353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'916","reported_seq":974,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:47.677285+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T01:09:47.677285+0000","last_peered":"2024-04-15T01:09:47.677285+0000","last_clean":"2024-04-15T01:09:47.677285+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T01:09:47.677285+0000","last_undegraded":"2024-04-15T01:09:47.677285+0000","last_fullsized":"2024-04-15T01:09:47.677285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":8649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'809","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.791696+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T01:10:23.791696+0000","last_peered":"2024-04-15T01:10:23.791696+0000","last_clean":"2024-04-15T01:10:23.791696+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T01:10:23.791696+0000","last_undegraded":"2024-04-15T01:10:23.791696+0000","last_fullsized":"2024-04-15T01:10:23.791696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":99885,"num_write":793,"num_write_kb":204639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'209","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.027855+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T01:10:44.027855+0000","last_peered":"2024-04-15T01:10:44.027855+0000","last_clean":"2024-04-15T01:10:44.027855+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T01:10:44.027855+0000","last_undegraded":"2024-04-15T01:10:44.027855+0000","last_fullsized":"2024-04-15T01:10:44.027855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'780","reported_seq":840,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.336327+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T01:10:37.336327+0000","last_peered":"2024-04-15T01:10:37.336327+0000","last_clean":"2024-04-15T01:10:37.336327+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T01:10:37.336327+0000","last_undegraded":"2024-04-15T01:10:37.336327+0000","last_fullsized":"2024-04-15T01:10:37.336327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'885","reported_seq":1047,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.324900+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T01:10:33.324900+0000","last_peered":"2024-04-15T01:10:33.324900+0000","last_clean":"2024-04-15T01:10:33.324900+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T01:10:33.324900+0000","last_undegraded":"2024-04-15T01:10:33.324900+0000","last_fullsized":"2024-04-15T01:10:33.324900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52186,"num_write":871,"num_write_kb":181200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'202","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.028940+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T01:10:44.028940+0000","last_peered":"2024-04-15T01:10:44.028940+0000","last_clean":"2024-04-15T01:10:44.028940+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T01:10:44.028940+0000","last_undegraded":"2024-04-15T01:10:44.028940+0000","last_fullsized":"2024-04-15T01:10:44.028940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'195","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:37.074931+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T01:09:37.074931+0000","last_peered":"2024-04-15T01:09:37.074931+0000","last_clean":"2024-04-15T01:09:37.074931+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T01:09:37.074931+0000","last_undegraded":"2024-04-15T01:09:37.074931+0000","last_fullsized":"2024-04-15T01:09:37.074931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'743","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.048951+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T01:10:31.048951+0000","last_peered":"2024-04-15T01:10:31.048951+0000","last_clean":"2024-04-15T01:10:31.048951+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T01:10:31.048951+0000","last_undegraded":"2024-04-15T01:10:31.048951+0000","last_fullsized":"2024-04-15T01:10:31.048951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:23.755107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58288,"num_write":731,"num_write_kb":102006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'221","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.113964+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T01:10:44.113964+0000","last_peered":"2024-04-15T01:10:44.113964+0000","last_clean":"2024-04-15T01:10:44.113964+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T01:10:44.113964+0000","last_undegraded":"2024-04-15T01:10:44.113964+0000","last_fullsized":"2024-04-15T01:10:44.113964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'783","reported_seq":843,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:07.669537+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T01:10:07.669537+0000","last_peered":"2024-04-15T01:10:07.669537+0000","last_clean":"2024-04-15T01:10:07.669537+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T01:10:07.669537+0000","last_undegraded":"2024-04-15T01:10:07.669537+0000","last_fullsized":"2024-04-15T01:10:07.669537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'723","reported_seq":860,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.247777+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T01:10:35.247777+0000","last_peered":"2024-04-15T01:10:35.247777+0000","last_clean":"2024-04-15T01:10:35.247777+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T01:10:35.247777+0000","last_undegraded":"2024-04-15T01:10:35.247777+0000","last_fullsized":"2024-04-15T01:10:35.247777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":38800,"num_write":705,"num_write_kb":106309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'224","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.083669+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T01:10:44.083669+0000","last_peered":"2024-04-15T01:10:44.083669+0000","last_clean":"2024-04-15T01:10:44.083669+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T01:10:44.083669+0000","last_undegraded":"2024-04-15T01:10:44.083669+0000","last_fullsized":"2024-04-15T01:10:44.083669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'194","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.402360+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T01:10:35.402360+0000","last_peered":"2024-04-15T01:10:35.402360+0000","last_clean":"2024-04-15T01:10:35.402360+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T01:10:35.402360+0000","last_undegraded":"2024-04-15T01:10:35.402360+0000","last_fullsized":"2024-04-15T01:10:35.402360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'797","reported_seq":968,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326928+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T01:10:31.326928+0000","last_peered":"2024-04-15T01:10:31.326928+0000","last_clean":"2024-04-15T01:10:31.326928+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T01:10:31.326928+0000","last_undegraded":"2024-04-15T01:10:31.326928+0000","last_fullsized":"2024-04-15T01:10:31.326928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60896,"num_write":782,"num_write_kb":175614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'173","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.037149+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T01:10:44.037149+0000","last_peered":"2024-04-15T01:10:44.037149+0000","last_clean":"2024-04-15T01:10:44.037149+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T01:10:44.037149+0000","last_undegraded":"2024-04-15T01:10:44.037149+0000","last_fullsized":"2024-04-15T01:10:44.037149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3598","reported_seq":3658,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.735333+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T01:10:36.735333+0000","last_peered":"2024-04-15T01:10:36.735333+0000","last_clean":"2024-04-15T01:10:36.735333+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T01:10:36.735333+0000","last_undegraded":"2024-04-15T01:10:36.735333+0000","last_fullsized":"2024-04-15T01:10:36.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10014,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'787","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.786208+0000","last_change":"2024-04-15T00:01:50.325887+0000","last_active":"2024-04-15T01:10:23.786208+0000","last_peered":"2024-04-15T01:10:23.786208+0000","last_clean":"2024-04-15T01:10:23.786208+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T01:10:23.786208+0000","last_undegraded":"2024-04-15T01:10:23.786208+0000","last_fullsized":"2024-04-15T01:10:23.786208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:56:24.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27446,"num_write":780,"num_write_kb":102026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'200","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120138+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T01:10:44.120138+0000","last_peered":"2024-04-15T01:10:44.120138+0000","last_clean":"2024-04-15T01:10:44.120138+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T01:10:44.120138+0000","last_undegraded":"2024-04-15T01:10:44.120138+0000","last_fullsized":"2024-04-15T01:10:44.120138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'592","reported_seq":653,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:20.369577+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T01:10:20.369577+0000","last_peered":"2024-04-15T01:10:20.369577+0000","last_clean":"2024-04-15T01:10:20.369577+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T01:10:20.369577+0000","last_undegraded":"2024-04-15T01:10:20.369577+0000","last_fullsized":"2024-04-15T01:10:20.369577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'736","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.100676+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T01:10:29.100676+0000","last_peered":"2024-04-15T01:10:29.100676+0000","last_clean":"2024-04-15T01:10:29.100676+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T01:10:29.100676+0000","last_undegraded":"2024-04-15T01:10:29.100676+0000","last_fullsized":"2024-04-15T01:10:29.100676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":59617,"num_write":721,"num_write_kb":101495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088748+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T01:10:44.088748+0000","last_peered":"2024-04-15T01:10:44.088748+0000","last_clean":"2024-04-15T01:10:44.088748+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T01:10:44.088748+0000","last_undegraded":"2024-04-15T01:10:44.088748+0000","last_fullsized":"2024-04-15T01:10:44.088748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'304","reported_seq":365,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:48.534460+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T01:09:48.534460+0000","last_peered":"2024-04-15T01:09:48.534460+0000","last_clean":"2024-04-15T01:09:48.534460+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T01:09:48.534460+0000","last_undegraded":"2024-04-15T01:09:48.534460+0000","last_fullsized":"2024-04-15T01:09:48.534460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'778","reported_seq":912,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.107257+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T01:10:29.107257+0000","last_peered":"2024-04-15T01:10:29.107257+0000","last_clean":"2024-04-15T01:10:29.107257+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T01:10:29.107257+0000","last_undegraded":"2024-04-15T01:10:29.107257+0000","last_fullsized":"2024-04-15T01:10:29.107257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:29.352914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":54040,"num_write":767,"num_write_kb":142606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'203","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.117642+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T01:10:44.117642+0000","last_peered":"2024-04-15T01:10:44.117642+0000","last_clean":"2024-04-15T01:10:44.117642+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T01:10:44.117642+0000","last_undegraded":"2024-04-15T01:10:44.117642+0000","last_fullsized":"2024-04-15T01:10:44.117642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'988","reported_seq":1049,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:34.095462+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T01:08:34.095462+0000","last_peered":"2024-04-15T01:08:34.095462+0000","last_clean":"2024-04-15T01:08:34.095462+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T01:08:34.095462+0000","last_undegraded":"2024-04-15T01:08:34.095462+0000","last_fullsized":"2024-04-15T01:08:34.095462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":8655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'695","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324605+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T01:10:36.324605+0000","last_peered":"2024-04-15T01:10:36.324605+0000","last_clean":"2024-04-15T01:10:36.324605+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T01:10:36.324605+0000","last_undegraded":"2024-04-15T01:10:36.324605+0000","last_fullsized":"2024-04-15T01:10:36.324605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:49.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22523,"num_write":688,"num_write_kb":89336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"29'209","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.118138+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T01:10:44.118138+0000","last_peered":"2024-04-15T01:10:44.118138+0000","last_clean":"2024-04-15T01:10:44.118138+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T01:10:44.118138+0000","last_undegraded":"2024-04-15T01:10:44.118138+0000","last_fullsized":"2024-04-15T01:10:44.118138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3013","reported_seq":6022,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:38.153294+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T01:10:38.153294+0000","last_peered":"2024-04-15T01:10:38.153294+0000","last_clean":"2024-04-15T01:10:38.153294+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T01:10:38.153294+0000","last_undegraded":"2024-04-15T01:10:38.153294+0000","last_fullsized":"2024-04-15T01:10:38.153294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3013,"log_dups_size":0,"ondisk_log_size":3013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":2955,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'697","reported_seq":789,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.712983+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T01:10:30.712983+0000","last_peered":"2024-04-15T01:10:30.712983+0000","last_clean":"2024-04-15T01:10:30.712983+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T01:10:30.712983+0000","last_undegraded":"2024-04-15T01:10:30.712983+0000","last_fullsized":"2024-04-15T01:10:30.712983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:11:10.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19611,"num_write":689,"num_write_kb":76681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094106+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T01:10:44.094106+0000","last_peered":"2024-04-15T01:10:44.094106+0000","last_clean":"2024-04-15T01:10:44.094106+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T01:10:44.094106+0000","last_undegraded":"2024-04-15T01:10:44.094106+0000","last_fullsized":"2024-04-15T01:10:44.094106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:51:16.173399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'490","reported_seq":552,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.155539+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T01:09:40.155539+0000","last_peered":"2024-04-15T01:09:40.155539+0000","last_clean":"2024-04-15T01:09:40.155539+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T01:09:40.155539+0000","last_undegraded":"2024-04-15T01:09:40.155539+0000","last_fullsized":"2024-04-15T01:09:40.155539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'862","reported_seq":1064,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.221729+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T01:10:35.221729+0000","last_peered":"2024-04-15T01:10:35.221729+0000","last_clean":"2024-04-15T01:10:35.221729+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T01:10:35.221729+0000","last_undegraded":"2024-04-15T01:10:35.221729+0000","last_fullsized":"2024-04-15T01:10:35.221729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:47.871434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":84642,"num_write":849,"num_write_kb":128022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'185","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122812+0000","last_change":"2024-04-15T00:01:49.998011+0000","last_active":"2024-04-15T01:10:44.122812+0000","last_peered":"2024-04-15T01:10:44.122812+0000","last_clean":"2024-04-15T01:10:44.122812+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T01:10:44.122812+0000","last_undegraded":"2024-04-15T01:10:44.122812+0000","last_fullsized":"2024-04-15T01:10:44.122812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:09:28.962143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"29'299","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.787521+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T01:10:23.787521+0000","last_peered":"2024-04-15T01:10:23.787521+0000","last_clean":"2024-04-15T01:10:23.787521+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T01:10:23.787521+0000","last_undegraded":"2024-04-15T01:10:23.787521+0000","last_fullsized":"2024-04-15T01:10:23.787521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:07:20.354724+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T01:07:20.354724+0000","last_peered":"2024-04-15T01:07:20.354724+0000","last_clean":"2024-04-15T01:07:20.354724+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T01:07:20.354724+0000","last_undegraded":"2024-04-15T01:07:20.354724+0000","last_fullsized":"2024-04-15T01:07:20.354724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'808","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.400673+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T01:10:33.400673+0000","last_peered":"2024-04-15T01:10:33.400673+0000","last_clean":"2024-04-15T01:10:33.400673+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T01:10:33.400673+0000","last_undegraded":"2024-04-15T01:10:33.400673+0000","last_fullsized":"2024-04-15T01:10:33.400673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":51109,"num_write":790,"num_write_kb":155353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103744+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T01:10:44.103744+0000","last_peered":"2024-04-15T01:10:44.103744+0000","last_clean":"2024-04-15T01:10:44.103744+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T01:10:44.103744+0000","last_undegraded":"2024-04-15T01:10:44.103744+0000","last_fullsized":"2024-04-15T01:10:44.103744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'252","reported_seq":310,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.841722+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T01:10:43.841722+0000","last_peered":"2024-04-15T01:10:43.841722+0000","last_clean":"2024-04-15T01:10:43.841722+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T01:10:43.841722+0000","last_undegraded":"2024-04-15T01:10:43.841722+0000","last_fullsized":"2024-04-15T01:10:43.841722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3902566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'818","reported_seq":999,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.401547+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T01:10:33.401547+0000","last_peered":"2024-04-15T01:10:33.401547+0000","last_clean":"2024-04-15T01:10:33.401547+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T01:10:33.401547+0000","last_undegraded":"2024-04-15T01:10:33.401547+0000","last_fullsized":"2024-04-15T01:10:33.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":80804,"num_write":805,"num_write_kb":188613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081875+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T01:10:44.081875+0000","last_peered":"2024-04-15T01:10:44.081875+0000","last_clean":"2024-04-15T01:10:44.081875+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T01:10:44.081875+0000","last_undegraded":"2024-04-15T01:10:44.081875+0000","last_fullsized":"2024-04-15T01:10:44.081875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'781","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:35.006699+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T01:09:35.006699+0000","last_peered":"2024-04-15T01:09:35.006699+0000","last_clean":"2024-04-15T01:09:35.006699+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T01:09:35.006699+0000","last_undegraded":"2024-04-15T01:09:35.006699+0000","last_fullsized":"2024-04-15T01:09:35.006699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:19.272648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'763","reported_seq":910,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:22.751023+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T01:10:22.751023+0000","last_peered":"2024-04-15T01:10:22.751023+0000","last_clean":"2024-04-15T01:10:22.751023+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T01:10:22.751023+0000","last_undegraded":"2024-04-15T01:10:22.751023+0000","last_fullsized":"2024-04-15T01:10:22.751023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:52:04.107438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":61965,"num_write":764,"num_write_kb":101545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095025+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T01:10:44.095025+0000","last_peered":"2024-04-15T01:10:44.095025+0000","last_clean":"2024-04-15T01:10:44.095025+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T01:10:44.095025+0000","last_undegraded":"2024-04-15T01:10:44.095025+0000","last_fullsized":"2024-04-15T01:10:44.095025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'783","reported_seq":841,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:55.148414+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T01:08:55.148414+0000","last_peered":"2024-04-15T01:08:55.148414+0000","last_clean":"2024-04-15T01:08:55.148414+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T01:08:55.148414+0000","last_undegraded":"2024-04-15T01:08:55.148414+0000","last_fullsized":"2024-04-15T01:08:55.148414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'786","reported_seq":924,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.389363+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T01:10:36.389363+0000","last_peered":"2024-04-15T01:10:36.389363+0000","last_clean":"2024-04-15T01:10:36.389363+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T01:10:36.389363+0000","last_undegraded":"2024-04-15T01:10:36.389363+0000","last_fullsized":"2024-04-15T01:10:36.389363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":35671,"num_write":777,"num_write_kb":118402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.092714+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T01:10:44.092714+0000","last_peered":"2024-04-15T01:10:44.092714+0000","last_clean":"2024-04-15T01:10:44.092714+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T01:10:44.092714+0000","last_undegraded":"2024-04-15T01:10:44.092714+0000","last_fullsized":"2024-04-15T01:10:44.092714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'765","reported_seq":823,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.767966+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T01:10:17.767966+0000","last_peered":"2024-04-15T01:10:17.767966+0000","last_clean":"2024-04-15T01:10:17.767966+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T01:10:17.767966+0000","last_undegraded":"2024-04-15T01:10:17.767966+0000","last_fullsized":"2024-04-15T01:10:17.767966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'816","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.220146+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T01:10:33.220146+0000","last_peered":"2024-04-15T01:10:33.220146+0000","last_clean":"2024-04-15T01:10:33.220146+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T01:10:33.220146+0000","last_undegraded":"2024-04-15T01:10:33.220146+0000","last_fullsized":"2024-04-15T01:10:33.220146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39992,"num_write":799,"num_write_kb":139135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'231","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093976+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T01:10:44.093976+0000","last_peered":"2024-04-15T01:10:44.093976+0000","last_clean":"2024-04-15T01:10:44.093976+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T01:10:44.093976+0000","last_undegraded":"2024-04-15T01:10:44.093976+0000","last_fullsized":"2024-04-15T01:10:44.093976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'473","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.338706+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T01:10:36.338706+0000","last_peered":"2024-04-15T01:10:36.338706+0000","last_clean":"2024-04-15T01:10:36.338706+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T01:10:36.338706+0000","last_undegraded":"2024-04-15T01:10:36.338706+0000","last_fullsized":"2024-04-15T01:10:36.338706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":8414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'762","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.055277+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T01:10:29.055277+0000","last_peered":"2024-04-15T01:10:29.055277+0000","last_clean":"2024-04-15T01:10:29.055277+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T01:10:29.055277+0000","last_undegraded":"2024-04-15T01:10:29.055277+0000","last_fullsized":"2024-04-15T01:10:29.055277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:59:01.337443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":53894,"num_write":751,"num_write_kb":106228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.109035+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T01:10:44.109035+0000","last_peered":"2024-04-15T01:10:44.109035+0000","last_clean":"2024-04-15T01:10:44.109035+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T01:10:44.109035+0000","last_undegraded":"2024-04-15T01:10:44.109035+0000","last_fullsized":"2024-04-15T01:10:44.109035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'63","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:08.497363+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T01:09:08.497363+0000","last_peered":"2024-04-15T01:09:08.497363+0000","last_clean":"2024-04-15T01:09:08.497363+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T01:09:08.497363+0000","last_undegraded":"2024-04-15T01:09:08.497363+0000","last_fullsized":"2024-04-15T01:09:08.497363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'778","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.966740+0000","last_change":"2024-04-15T00:01:50.326200+0000","last_active":"2024-04-15T01:10:21.966740+0000","last_peered":"2024-04-15T01:10:21.966740+0000","last_clean":"2024-04-15T01:10:21.966740+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T01:10:21.966740+0000","last_undegraded":"2024-04-15T01:10:21.966740+0000","last_fullsized":"2024-04-15T01:10:21.966740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:32:27.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":41754,"num_write":768,"num_write_kb":168968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'200","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094807+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T01:10:44.094807+0000","last_peered":"2024-04-15T01:10:44.094807+0000","last_clean":"2024-04-15T01:10:44.094807+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T01:10:44.094807+0000","last_undegraded":"2024-04-15T01:10:44.094807+0000","last_fullsized":"2024-04-15T01:10:44.094807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'60","reported_seq":117,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324199+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T01:10:36.324199+0000","last_peered":"2024-04-15T01:10:36.324199+0000","last_clean":"2024-04-15T01:10:36.324199+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T01:10:36.324199+0000","last_undegraded":"2024-04-15T01:10:36.324199+0000","last_fullsized":"2024-04-15T01:10:36.324199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'697","reported_seq":801,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.054816+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T01:10:29.054816+0000","last_peered":"2024-04-15T01:10:29.054816+0000","last_clean":"2024-04-15T01:10:29.054816+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T01:10:29.054816+0000","last_undegraded":"2024-04-15T01:10:29.054816+0000","last_fullsized":"2024-04-15T01:10:29.054816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":31143,"num_write":687,"num_write_kb":101153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'209","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104276+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T01:10:44.104276+0000","last_peered":"2024-04-15T01:10:44.104276+0000","last_clean":"2024-04-15T01:10:44.104276+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T01:10:44.104276+0000","last_undegraded":"2024-04-15T01:10:44.104276+0000","last_fullsized":"2024-04-15T01:10:44.104276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'390","reported_seq":447,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:54.194363+0000","last_change":"2024-04-15T00:01:11.988585+0000","last_active":"2024-04-15T01:08:54.194363+0000","last_peered":"2024-04-15T01:08:54.194363+0000","last_clean":"2024-04-15T01:08:54.194363+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T01:08:54.194363+0000","last_undegraded":"2024-04-15T01:08:54.194363+0000","last_fullsized":"2024-04-15T01:08:54.194363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:48:25.428804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'747","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.144852+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T01:10:33.144852+0000","last_peered":"2024-04-15T01:10:33.144852+0000","last_clean":"2024-04-15T01:10:33.144852+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T01:10:33.144852+0000","last_undegraded":"2024-04-15T01:10:33.144852+0000","last_fullsized":"2024-04-15T01:10:33.144852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":56791,"num_write":733,"num_write_kb":134490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100391+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T01:10:44.100391+0000","last_peered":"2024-04-15T01:10:44.100391+0000","last_clean":"2024-04-15T01:10:44.100391+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T01:10:44.100391+0000","last_undegraded":"2024-04-15T01:10:44.100391+0000","last_fullsized":"2024-04-15T01:10:44.100391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1423","reported_seq":1480,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.623835+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T01:10:21.623835+0000","last_peered":"2024-04-15T01:10:21.623835+0000","last_clean":"2024-04-15T01:10:21.623835+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T01:10:21.623835+0000","last_undegraded":"2024-04-15T01:10:21.623835+0000","last_fullsized":"2024-04-15T01:10:21.623835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":13127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'798","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.406562+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T01:10:33.406562+0000","last_peered":"2024-04-15T01:10:33.406562+0000","last_clean":"2024-04-15T01:10:33.406562+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T01:10:33.406562+0000","last_undegraded":"2024-04-15T01:10:33.406562+0000","last_fullsized":"2024-04-15T01:10:33.406562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:16.374836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":58877,"num_write":785,"num_write_kb":152322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'203","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124028+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T01:10:44.124028+0000","last_peered":"2024-04-15T01:10:44.124028+0000","last_clean":"2024-04-15T01:10:44.124028+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T01:10:44.124028+0000","last_undegraded":"2024-04-15T01:10:44.124028+0000","last_fullsized":"2024-04-15T01:10:44.124028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1844","reported_seq":1900,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.151340+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T01:10:37.151340+0000","last_peered":"2024-04-15T01:10:37.151340+0000","last_clean":"2024-04-15T01:10:37.151340+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T01:10:37.151340+0000","last_undegraded":"2024-04-15T01:10:37.151340+0000","last_fullsized":"2024-04-15T01:10:37.151340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":5818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'701","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.553388+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T01:10:30.553388+0000","last_peered":"2024-04-15T01:10:30.553388+0000","last_clean":"2024-04-15T01:10:30.553388+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T01:10:30.553388+0000","last_undegraded":"2024-04-15T01:10:30.553388+0000","last_fullsized":"2024-04-15T01:10:30.553388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35520,"num_write":691,"num_write_kb":85742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.098091+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T01:10:44.098091+0000","last_peered":"2024-04-15T01:10:44.098091+0000","last_clean":"2024-04-15T01:10:44.098091+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T01:10:44.098091+0000","last_undegraded":"2024-04-15T01:10:44.098091+0000","last_fullsized":"2024-04-15T01:10:44.098091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'396","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:13.065031+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T01:10:13.065031+0000","last_peered":"2024-04-15T01:10:13.065031+0000","last_clean":"2024-04-15T01:10:13.065031+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T01:10:13.065031+0000","last_undegraded":"2024-04-15T01:10:13.065031+0000","last_fullsized":"2024-04-15T01:10:13.065031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'858","reported_seq":983,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.214354+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T01:10:33.214354+0000","last_peered":"2024-04-15T01:10:33.214354+0000","last_clean":"2024-04-15T01:10:33.214354+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T01:10:33.214354+0000","last_undegraded":"2024-04-15T01:10:33.214354+0000","last_fullsized":"2024-04-15T01:10:33.214354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":40736,"num_write":845,"num_write_kb":155666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'215","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112020+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T01:10:44.112020+0000","last_peered":"2024-04-15T01:10:44.112020+0000","last_clean":"2024-04-15T01:10:44.112020+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T01:10:44.112020+0000","last_undegraded":"2024-04-15T01:10:44.112020+0000","last_fullsized":"2024-04-15T01:10:44.112020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'69","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.837447+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T01:10:43.837447+0000","last_peered":"2024-04-15T01:10:43.837447+0000","last_clean":"2024-04-15T01:10:43.837447+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T01:10:43.837447+0000","last_undegraded":"2024-04-15T01:10:43.837447+0000","last_fullsized":"2024-04-15T01:10:43.837447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'833","reported_seq":967,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.445684+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T01:10:33.445684+0000","last_peered":"2024-04-15T01:10:33.445684+0000","last_clean":"2024-04-15T01:10:33.445684+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T01:10:33.445684+0000","last_undegraded":"2024-04-15T01:10:33.445684+0000","last_fullsized":"2024-04-15T01:10:33.445684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":38336,"num_write":816,"num_write_kb":147104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'791","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.170941+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T01:10:30.170941+0000","last_peered":"2024-04-15T01:10:30.170941+0000","last_clean":"2024-04-15T01:10:30.170941+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T01:10:30.170941+0000","last_undegraded":"2024-04-15T01:10:30.170941+0000","last_fullsized":"2024-04-15T01:10:30.170941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:09:05.379992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":55193,"num_write":783,"num_write_kb":131702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'213","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.254659+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T01:10:44.254659+0000","last_peered":"2024-04-15T01:10:44.254659+0000","last_clean":"2024-04-15T01:10:44.254659+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T01:10:44.254659+0000","last_undegraded":"2024-04-15T01:10:44.254659+0000","last_fullsized":"2024-04-15T01:10:44.254659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1370","reported_seq":1426,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:26.576298+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T01:09:26.576298+0000","last_peered":"2024-04-15T01:09:26.576298+0000","last_clean":"2024-04-15T01:09:26.576298+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T01:09:26.576298+0000","last_undegraded":"2024-04-15T01:09:26.576298+0000","last_fullsized":"2024-04-15T01:09:26.576298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'758","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.626649+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T01:10:17.626649+0000","last_peered":"2024-04-15T01:10:17.626649+0000","last_clean":"2024-04-15T01:10:17.626649+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:17.626649+0000","last_undegraded":"2024-04-15T01:10:17.626649+0000","last_fullsized":"2024-04-15T01:10:17.626649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":41433,"num_write":747,"num_write_kb":139089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'219","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032800+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T01:10:44.032800+0000","last_peered":"2024-04-15T01:10:44.032800+0000","last_clean":"2024-04-15T01:10:44.032800+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T01:10:44.032800+0000","last_undegraded":"2024-04-15T01:10:44.032800+0000","last_fullsized":"2024-04-15T01:10:44.032800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'580","reported_seq":636,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:32.070004+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T01:09:32.070004+0000","last_peered":"2024-04-15T01:09:32.070004+0000","last_clean":"2024-04-15T01:09:32.070004+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T01:09:32.070004+0000","last_undegraded":"2024-04-15T01:09:32.070004+0000","last_fullsized":"2024-04-15T01:09:32.070004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1197","reported_seq":1252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:17.007966+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T01:09:17.007966+0000","last_peered":"2024-04-15T01:09:17.007966+0000","last_clean":"2024-04-15T01:09:17.007966+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T01:09:17.007966+0000","last_undegraded":"2024-04-15T01:09:17.007966+0000","last_fullsized":"2024-04-15T01:09:17.007966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'187","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.087512+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T01:10:44.087512+0000","last_peered":"2024-04-15T01:10:44.087512+0000","last_clean":"2024-04-15T01:10:44.087512+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T01:10:44.087512+0000","last_undegraded":"2024-04-15T01:10:44.087512+0000","last_fullsized":"2024-04-15T01:10:44.087512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'744","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.393810+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T01:10:30.393810+0000","last_peered":"2024-04-15T01:10:30.393810+0000","last_clean":"2024-04-15T01:10:30.393810+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T01:10:30.393810+0000","last_undegraded":"2024-04-15T01:10:30.393810+0000","last_fullsized":"2024-04-15T01:10:30.393810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":84659,"num_write":735,"num_write_kb":176000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'220","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.168273+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T01:09:40.168273+0000","last_peered":"2024-04-15T01:09:40.168273+0000","last_clean":"2024-04-15T01:09:40.168273+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T01:09:40.168273+0000","last_undegraded":"2024-04-15T01:09:40.168273+0000","last_fullsized":"2024-04-15T01:09:40.168273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'202","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122471+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T01:10:44.122471+0000","last_peered":"2024-04-15T01:10:44.122471+0000","last_clean":"2024-04-15T01:10:44.122471+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T01:10:44.122471+0000","last_undegraded":"2024-04-15T01:10:44.122471+0000","last_fullsized":"2024-04-15T01:10:44.122471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'759","reported_seq":920,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:25.904298+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T01:10:25.904298+0000","last_peered":"2024-04-15T01:10:25.904298+0000","last_clean":"2024-04-15T01:10:25.904298+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T01:10:25.904298+0000","last_undegraded":"2024-04-15T01:10:25.904298+0000","last_fullsized":"2024-04-15T01:10:25.904298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62677,"num_write":745,"num_write_kb":206027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'216","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.115518+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T01:10:44.115518+0000","last_peered":"2024-04-15T01:10:44.115518+0000","last_clean":"2024-04-15T01:10:44.115518+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T01:10:44.115518+0000","last_undegraded":"2024-04-15T01:10:44.115518+0000","last_fullsized":"2024-04-15T01:10:44.115518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103511+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T01:10:44.103511+0000","last_peered":"2024-04-15T01:10:44.103511+0000","last_clean":"2024-04-15T01:10:44.103511+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T01:10:44.103511+0000","last_undegraded":"2024-04-15T01:10:44.103511+0000","last_fullsized":"2024-04-15T01:10:44.103511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'232","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.080669+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T01:10:44.080669+0000","last_peered":"2024-04-15T01:10:44.080669+0000","last_clean":"2024-04-15T01:10:44.080669+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T01:10:44.080669+0000","last_undegraded":"2024-04-15T01:10:44.080669+0000","last_fullsized":"2024-04-15T01:10:44.080669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'207","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.083665+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T01:10:44.083665+0000","last_peered":"2024-04-15T01:10:44.083665+0000","last_clean":"2024-04-15T01:10:44.083665+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T01:10:44.083665+0000","last_undegraded":"2024-04-15T01:10:44.083665+0000","last_fullsized":"2024-04-15T01:10:44.083665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:00:02.354448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.040848+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T01:10:44.040848+0000","last_peered":"2024-04-15T01:10:44.040848+0000","last_clean":"2024-04-15T01:10:44.040848+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T01:10:44.040848+0000","last_undegraded":"2024-04-15T01:10:44.040848+0000","last_fullsized":"2024-04-15T01:10:44.040848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'207","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120698+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T01:10:44.120698+0000","last_peered":"2024-04-15T01:10:44.120698+0000","last_clean":"2024-04-15T01:10:44.120698+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T01:10:44.120698+0000","last_undegraded":"2024-04-15T01:10:44.120698+0000","last_fullsized":"2024-04-15T01:10:44.120698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'241","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.123430+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T01:10:44.123430+0000","last_peered":"2024-04-15T01:10:44.123430+0000","last_clean":"2024-04-15T01:10:44.123430+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T01:10:44.123430+0000","last_undegraded":"2024-04-15T01:10:44.123430+0000","last_fullsized":"2024-04-15T01:10:44.123430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'192","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024735+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T01:10:44.024735+0000","last_peered":"2024-04-15T01:10:44.024735+0000","last_clean":"2024-04-15T01:10:44.024735+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T01:10:44.024735+0000","last_undegraded":"2024-04-15T01:10:44.024735+0000","last_fullsized":"2024-04-15T01:10:44.024735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.084292+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T01:10:44.084292+0000","last_peered":"2024-04-15T01:10:44.084292+0000","last_clean":"2024-04-15T01:10:44.084292+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T01:10:44.084292+0000","last_undegraded":"2024-04-15T01:10:44.084292+0000","last_fullsized":"2024-04-15T01:10:44.084292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032553+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T01:10:44.032553+0000","last_peered":"2024-04-15T01:10:44.032553+0000","last_clean":"2024-04-15T01:10:44.032553+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T01:10:44.032553+0000","last_undegraded":"2024-04-15T01:10:44.032553+0000","last_fullsized":"2024-04-15T01:10:44.032553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'215","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095159+0000","last_change":"2024-04-15T00:01:50.325599+0000","last_active":"2024-04-15T01:10:44.095159+0000","last_peered":"2024-04-15T01:10:44.095159+0000","last_clean":"2024-04-15T01:10:44.095159+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T01:10:44.095159+0000","last_undegraded":"2024-04-15T01:10:44.095159+0000","last_fullsized":"2024-04-15T01:10:44.095159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'212","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104229+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T01:10:44.104229+0000","last_peered":"2024-04-15T01:10:44.104229+0000","last_clean":"2024-04-15T01:10:44.104229+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T01:10:44.104229+0000","last_undegraded":"2024-04-15T01:10:44.104229+0000","last_fullsized":"2024-04-15T01:10:44.104229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'223","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119670+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T01:10:44.119670+0000","last_peered":"2024-04-15T01:10:44.119670+0000","last_clean":"2024-04-15T01:10:44.119670+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T01:10:44.119670+0000","last_undegraded":"2024-04-15T01:10:44.119670+0000","last_fullsized":"2024-04-15T01:10:44.119670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081817+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T01:10:44.081817+0000","last_peered":"2024-04-15T01:10:44.081817+0000","last_clean":"2024-04-15T01:10:44.081817+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T01:10:44.081817+0000","last_undegraded":"2024-04-15T01:10:44.081817+0000","last_fullsized":"2024-04-15T01:10:44.081817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.114261+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T01:10:44.114261+0000","last_peered":"2024-04-15T01:10:44.114261+0000","last_clean":"2024-04-15T01:10:44.114261+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T01:10:44.114261+0000","last_undegraded":"2024-04-15T01:10:44.114261+0000","last_fullsized":"2024-04-15T01:10:44.114261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'199","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.111859+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T01:10:44.111859+0000","last_peered":"2024-04-15T01:10:44.111859+0000","last_clean":"2024-04-15T01:10:44.111859+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T01:10:44.111859+0000","last_undegraded":"2024-04-15T01:10:44.111859+0000","last_fullsized":"2024-04-15T01:10:44.111859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'222","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097146+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T01:10:44.097146+0000","last_peered":"2024-04-15T01:10:44.097146+0000","last_clean":"2024-04-15T01:10:44.097146+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T01:10:44.097146+0000","last_undegraded":"2024-04-15T01:10:44.097146+0000","last_fullsized":"2024-04-15T01:10:44.097146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'215","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124019+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T01:10:44.124019+0000","last_peered":"2024-04-15T01:10:44.124019+0000","last_clean":"2024-04-15T01:10:44.124019+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T01:10:44.124019+0000","last_undegraded":"2024-04-15T01:10:44.124019+0000","last_fullsized":"2024-04-15T01:10:44.124019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088632+0000","last_change":"2024-04-15T00:01:12.886321+0000","last_active":"2024-04-15T01:10:44.088632+0000","last_peered":"2024-04-15T01:10:44.088632+0000","last_clean":"2024-04-15T01:10:44.088632+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T01:10:44.088632+0000","last_undegraded":"2024-04-15T01:10:44.088632+0000","last_fullsized":"2024-04-15T01:10:44.088632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:30.322735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.039555+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T01:10:44.039555+0000","last_peered":"2024-04-15T01:10:44.039555+0000","last_clean":"2024-04-15T01:10:44.039555+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T01:10:44.039555+0000","last_undegraded":"2024-04-15T01:10:44.039555+0000","last_fullsized":"2024-04-15T01:10:44.039555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'185","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122630+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T01:10:44.122630+0000","last_peered":"2024-04-15T01:10:44.122630+0000","last_clean":"2024-04-15T01:10:44.122630+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T01:10:44.122630+0000","last_undegraded":"2024-04-15T01:10:44.122630+0000","last_fullsized":"2024-04-15T01:10:44.122630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'188","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112221+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T01:10:44.112221+0000","last_peered":"2024-04-15T01:10:44.112221+0000","last_clean":"2024-04-15T01:10:44.112221+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T01:10:44.112221+0000","last_undegraded":"2024-04-15T01:10:44.112221+0000","last_fullsized":"2024-04-15T01:10:44.112221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122116+0000","last_change":"2024-04-15T00:01:49.997896+0000","last_active":"2024-04-15T01:10:44.122116+0000","last_peered":"2024-04-15T01:10:44.122116+0000","last_clean":"2024-04-15T01:10:44.122116+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T01:10:44.122116+0000","last_undegraded":"2024-04-15T01:10:44.122116+0000","last_fullsized":"2024-04-15T01:10:44.122116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:52:44.356891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'211","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103209+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T01:10:44.103209+0000","last_peered":"2024-04-15T01:10:44.103209+0000","last_clean":"2024-04-15T01:10:44.103209+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T01:10:44.103209+0000","last_undegraded":"2024-04-15T01:10:44.103209+0000","last_fullsized":"2024-04-15T01:10:44.103209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.038221+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T01:10:44.038221+0000","last_peered":"2024-04-15T01:10:44.038221+0000","last_clean":"2024-04-15T01:10:44.038221+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T01:10:44.038221+0000","last_undegraded":"2024-04-15T01:10:44.038221+0000","last_fullsized":"2024-04-15T01:10:44.038221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.060783+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T01:10:44.060783+0000","last_peered":"2024-04-15T01:10:44.060783+0000","last_clean":"2024-04-15T01:10:44.060783+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T01:10:44.060783+0000","last_undegraded":"2024-04-15T01:10:44.060783+0000","last_fullsized":"2024-04-15T01:10:44.060783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'197","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097300+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T01:10:44.097300+0000","last_peered":"2024-04-15T01:10:44.097300+0000","last_clean":"2024-04-15T01:10:44.097300+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T01:10:44.097300+0000","last_undegraded":"2024-04-15T01:10:44.097300+0000","last_fullsized":"2024-04-15T01:10:44.097300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.085102+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T01:10:44.085102+0000","last_peered":"2024-04-15T01:10:44.085102+0000","last_clean":"2024-04-15T01:10:44.085102+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T01:10:44.085102+0000","last_undegraded":"2024-04-15T01:10:44.085102+0000","last_fullsized":"2024-04-15T01:10:44.085102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'195","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093604+0000","last_change":"2024-04-15T00:01:50.003849+0000","last_active":"2024-04-15T01:10:44.093604+0000","last_peered":"2024-04-15T01:10:44.093604+0000","last_clean":"2024-04-15T01:10:44.093604+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T01:10:44.093604+0000","last_undegraded":"2024-04-15T01:10:44.093604+0000","last_fullsized":"2024-04-15T01:10:44.093604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'194","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.090714+0000","last_change":"2024-04-15T00:01:12.981255+0000","last_active":"2024-04-15T01:10:44.090714+0000","last_peered":"2024-04-15T01:10:44.090714+0000","last_clean":"2024-04-15T01:10:44.090714+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T01:10:44.090714+0000","last_undegraded":"2024-04-15T01:10:44.090714+0000","last_fullsized":"2024-04-15T01:10:44.090714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:19:19.559758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'214","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.116609+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T01:10:44.116609+0000","last_peered":"2024-04-15T01:10:44.116609+0000","last_clean":"2024-04-15T01:10:44.116609+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T01:10:44.116609+0000","last_undegraded":"2024-04-15T01:10:44.116609+0000","last_fullsized":"2024-04-15T01:10:44.116609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'211","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.091482+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T01:10:44.091482+0000","last_peered":"2024-04-15T01:10:44.091482+0000","last_clean":"2024-04-15T01:10:44.091482+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T01:10:44.091482+0000","last_undegraded":"2024-04-15T01:10:44.091482+0000","last_fullsized":"2024-04-15T01:10:44.091482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2952,"num_read_kb":1592021,"num_write":24431,"num_write_kb":4334185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24810,"ondisk_log_size":24810,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13159,"ondisk_log_size":13159,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":181622008,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":30105,"num_write_kb":193149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172548096,"data_stored":363244016,"data_compressed":48333034,"data_compressed_allocated":62914560,"data_compressed_original":253853696,"omap_allocated":0,"internal_metadata":0},"log_size":25438,"ondisk_log_size":25438,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542987,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137664,"kb_used_data":30200,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94234176,"statfs":{"total":96636764160,"available":96495796224,"internally_reserved":0,"allocated":30924800,"data_stored":72023688,"data_compressed":9942585,"data_compressed_allocated":12574720,"data_compressed_original":53891072,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542987,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157088,"kb_used_data":23256,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94214752,"statfs":{"total":96636764160,"available":96475906048,"internally_reserved":0,"allocated":23814144,"data_stored":50461162,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542987,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136936,"kb_used_data":21152,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94234904,"statfs":{"total":96636764160,"available":96496541696,"internally_reserved":0,"allocated":21659648,"data_stored":41781534,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542988,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125000,"kb_used_data":25856,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94246840,"statfs":{"total":96636764160,"available":96508764160,"internally_reserved":0,"allocated":26476544,"data_stored":50461030,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510284,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144168,"kb_used_data":18592,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94227672,"statfs":{"total":96636764160,"available":96489136128,"internally_reserved":0,"allocated":19038208,"data_stored":35235566,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510282,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":11480,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":11755520,"data_stored":22359130,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510284,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169692,"kb_used_data":21972,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94202148,"statfs":{"total":96636764160,"available":96462999552,"internally_reserved":0,"allocated":22499328,"data_stored":50460650,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575691,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103780,"kb_used_data":18524,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94268060,"statfs":{"total":96636764160,"available":96530493440,"internally_reserved":0,"allocated":18968576,"data_stored":42661752,"data_compressed":5896627,"data_compressed_allocated":7761920,"data_compressed_original":31666176,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18595840,"data_stored":41943914,"data_compressed":5864102,"data_compressed_allocated":7716864,"data_compressed_original":31092736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":50333180,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11448320,"data_stored":22231660,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18731008,"data_stored":35108096,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":50333560,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21352448,"data_stored":41654064,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":50333692,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30552064,"data_stored":71305850,"data_compressed":9910060,"data_compressed_allocated":12529664,"data_compressed_original":53317632,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T01:10:52.103 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T01:10:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.240+0000 7fcb287c8640 1 Processor -- start 2024-04-15T01:10:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.240+0000 7fcb287c8640 1 -- start start 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.241+0000 7fcb287c8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb2015b110 0x7fcb200cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.241+0000 7fcb287c8640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb200cdff0 0x7fcb200ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.241+0000 7fcb287c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb200cf910 con 0x7fcb200cc530 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.241+0000 7fcb287c8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fcb200cf350 con 0x7fcb2015b110 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.241+0000 7fcb287c8640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fcb200cf630 con 0x7fcb200cdff0 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.242+0000 7fcb26d65640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb200cdff0 0x7fcb200ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.242+0000 7fcb26564640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb200cc530 0x7fcb2006c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:39056/0 (socket says 172.21.15.29:39056) 2024-04-15T01:10:52.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.242+0000 7fcb26564640 1 -- 172.21.15.29:0/2386601359 learned_addr learned my addr 172.21.15.29:0/2386601359 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:52.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.244+0000 7fcb25d63640 1 --2- 172.21.15.29:0/2386601359 >> v2:172.21.15.29:3300/0 conn(0x7fcb2015b110 0x7fcb200cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:52.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.245+0000 7fcb26d65640 1 -- 172.21.15.29:0/2386601359 >> v2:172.21.15.29:3300/0 conn(0x7fcb2015b110 msgr2=0x7fcb200cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:52.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.245+0000 7fcb26d65640 1 --2- 172.21.15.29:0/2386601359 >> v2:172.21.15.29:3300/0 conn(0x7fcb2015b110 0x7fcb200cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.245+0000 7fcb26d65640 1 -- 172.21.15.29:0/2386601359 >> v1:172.21.15.37:6789/0 conn(0x7fcb200cc530 legacy=0x7fcb2006c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.245+0000 7fcb26d65640 1 -- 172.21.15.29:0/2386601359 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2015a630 con 0x7fcb200cdff0 2024-04-15T01:10:52.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.250+0000 7fcb26d65640 1 --2- 172.21.15.29:0/2386601359 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb200cdff0 0x7fcb200ce400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009d90 tx=0x7fcb1802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f939dcdd26c3024f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:52.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.256+0000 7fcb25562640 1 -- 172.21.15.29:0/2386601359 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18039070 con 0x7fcb200cdff0 2024-04-15T01:10:52.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.256+0000 7fcb25562640 1 -- 172.21.15.29:0/2386601359 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1802cc50 con 0x7fcb200cdff0 2024-04-15T01:10:52.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.256+0000 7fcb25562640 1 -- 172.21.15.29:0/2386601359 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18034440 con 0x7fcb200cdff0 2024-04-15T01:10:52.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 -- 172.21.15.29:0/2386601359 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb200cdff0 msgr2=0x7fcb200ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2386601359 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb200cdff0 0x7fcb200ce400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009d90 tx=0x7fcb1802bea0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 -- 172.21.15.29:0/2386601359 shutdown_connections 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2386601359 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb200cdff0 0x7fcb200ce400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2386601359 >> v2:172.21.15.29:3300/0 conn(0x7fcb2015b110 0x7fcb200cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 -- 172.21.15.29:0/2386601359 >> 172.21.15.29:0/2386601359 conn(0x7fcb200cfb20 msgr2=0x7fcb200cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 -- 172.21.15.29:0/2386601359 shutdown_connections 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.257+0000 7fcb287c8640 1 -- 172.21.15.29:0/2386601359 wait complete. 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.258+0000 7fcb287c8640 1 Processor -- start 2024-04-15T01:10:52.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.258+0000 7fcb287c8640 1 -- start start 2024-04-15T01:10:52.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb287c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb200cc530 0x7fcb201557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:52.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb287c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200cdff0 0x7fcb20155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:52.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb287c8640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 0x7fcb200b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:52.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb287c8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb200cebc0 con 0x7fcb200cc530 2024-04-15T01:10:52.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb287c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2015abf0 con 0x7fcb200cdff0 2024-04-15T01:10:52.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb287c8640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fcb20154b10 con 0x7fcb2015b110 2024-04-15T01:10:52.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb26d65640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 0x7fcb200b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:52.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.259+0000 7fcb25d63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200cdff0 0x7fcb20155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:52.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.260+0000 7fcb25d63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200cdff0 0x7fcb20155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:33260/0 (socket says 172.21.15.29:33260) 2024-04-15T01:10:52.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.260+0000 7fcb26d65640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 0x7fcb200b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:41674/0 (socket says 172.21.15.29:41674) 2024-04-15T01:10:52.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.260+0000 7fcb25d63640 1 -- 172.21.15.29:0/2861524970 learned_addr learned my addr 172.21.15.29:0/2861524970 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:52.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.264+0000 7fcb26d65640 1 -- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200cdff0 msgr2=0x7fcb20155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.264+0000 7fcb26d65640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200cdff0 0x7fcb20155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.264+0000 7fcb26d65640 1 -- 172.21.15.29:0/2861524970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb200cc530 msgr2=0x7fcb201557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.264+0000 7fcb26d65640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb200cc530 0x7fcb201557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.264+0000 7fcb26d65640 1 -- 172.21.15.29:0/2861524970 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb20155380 con 0x7fcb2015b110 2024-04-15T01:10:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.267+0000 7fcb26d65640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 0x7fcb200b19f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb200cf7b0 tx=0x7fcb18004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.271+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18039050 con 0x7fcb2015b110 2024-04-15T01:10:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.271+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb18045070 con 0x7fcb2015b110 2024-04-15T01:10:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.271+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1803e610 con 0x7fcb2015b110 2024-04-15T01:10:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.271+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb200af600 con 0x7fcb2015b110 2024-04-15T01:10:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.271+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb200b0890 con 0x7fcb2015b110 2024-04-15T01:10:52.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.272+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb200b03a0 con 0x7fcb2015b110 2024-04-15T01:10:52.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.552+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fcb1803e7b0 con 0x7fcb2015b110 2024-04-15T01:10:52.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.552+0000 7fcb16ffd640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fcb0406b9e0 0x7fcb0406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:52.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.552+0000 7fcb26564640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fcb0406b9e0 0x7fcb0406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:52.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.553+0000 7fcb26564640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fcb0406b9e0 0x7fcb0406dea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0015f0 tx=0x7fcb1c007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:52.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.555+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fcb1807a2a0 con 0x7fcb2015b110 2024-04-15T01:10:52.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.566+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcb20155380 con 0x7fcb2015b110 2024-04-15T01:10:52.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.752+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb2004f540 con 0x7fcb2015b110 2024-04-15T01:10:52.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.801+0000 7fcb16ffd640 1 -- 172.21.15.29:0/2861524970 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7fcb1807c900 con 0x7fcb2015b110 2024-04-15T01:10:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:10:52.800 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fcb0406b9e0 msgr2=0x7fcb0406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fcb0406b9e0 0x7fcb0406dea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0015f0 tx=0x7fcb1c007a40 comp rx=0 tx=0).stop 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 msgr2=0x7fcb200b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 0x7fcb200b19f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb200cf7b0 tx=0x7fcb18004a40 comp rx=0 tx=0).stop 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 shutdown_connections 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fcb0406b9e0 0x7fcb0406dea0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fcb2015b110 0x7fcb200b19f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200cdff0 0x7fcb20155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 --2- 172.21.15.29:0/2861524970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb200cc530 0x7fcb201557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:52.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 >> 172.21.15.29:0/2861524970 conn(0x7fcb200cfb20 msgr2=0x7fcb2014f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:52.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 shutdown_connections 2024-04-15T01:10:52.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:52.803+0000 7fcb287c8640 1 -- 172.21.15.29:0/2861524970 wait complete. 2024-04-15T01:10:53.815 INFO:tasks.ceph:Scrubbing osd.0 2024-04-15T01:10:53.815 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:53.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.937+0000 7ff8ff3fe640 1 Processor -- start 2024-04-15T01:10:53.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.937+0000 7ff8ff3fe640 1 -- start start 2024-04-15T01:10:53.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.938+0000 7ff8ff3fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f80715c0 0x7ff8f815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:53.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.938+0000 7ff8ff3fe640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f80c3810 con 0x7ff8f81402c0 2024-04-15T01:10:53.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.938+0000 7ff8ff3fe640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f80c50a0 con 0x7ff8f815b1d0 2024-04-15T01:10:53.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.938+0000 7ff8ff3fe640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f815a800 con 0x7ff8f80715c0 2024-04-15T01:10:53.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.939+0000 7ff8fd19a640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff8f81402c0 0x7ff8f80c7860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56006/0 (socket says 172.21.15.29:56006) 2024-04-15T01:10:53.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.939+0000 7ff8fd19a640 1 -- 172.21.15.29:0/3124313155 learned_addr learned my addr 172.21.15.29:0/3124313155 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:53.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.939+0000 7ff8fc999640 1 --2- 172.21.15.29:0/3124313155 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f80715c0 0x7ff8f815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:53.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.941+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475602821 0 0) 0x7ff8f80c3810 con 0x7ff8f81402c0 2024-04-15T01:10:53.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.941+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e4003520 con 0x7ff8f81402c0 2024-04-15T01:10:53.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.941+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286137865 0 0) 0x7ff8f80c50a0 con 0x7ff8f815b1d0 2024-04-15T01:10:53.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.941+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f80c3810 con 0x7ff8f815b1d0 2024-04-15T01:10:53.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.942+0000 7ff8fc999640 1 -- 172.21.15.29:0/3124313155 >> v1:172.21.15.37:6789/0 conn(0x7ff8f815b1d0 legacy=0x7ff8f80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:53.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.942+0000 7ff8fc999640 1 -- 172.21.15.29:0/3124313155 >> v1:172.21.15.29:6789/0 conn(0x7ff8f81402c0 legacy=0x7ff8f80c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:53.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.942+0000 7ff8fc999640 1 -- 172.21.15.29:0/3124313155 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f80c5380 con 0x7ff8f80715c0 2024-04-15T01:10:53.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.944+0000 7ff8fc999640 1 --2- 172.21.15.29:0/3124313155 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f80715c0 0x7ff8f815ac90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40097d0 tx=0x7ff8f402db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb7b1402acfad85 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:53.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.948+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f402f900 con 0x7ff8f80715c0 2024-04-15T01:10:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.948+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f402faa0 con 0x7ff8f80715c0 2024-04-15T01:10:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.948+0000 7ff8effff640 1 -- 172.21.15.29:0/3124313155 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4037420 con 0x7ff8f80715c0 2024-04-15T01:10:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/3124313155 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f80715c0 msgr2=0x7ff8f815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 --2- 172.21.15.29:0/3124313155 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f80715c0 0x7ff8f815ac90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40097d0 tx=0x7ff8f402db40 comp rx=0 tx=0).stop 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/3124313155 shutdown_connections 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 --2- 172.21.15.29:0/3124313155 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f80715c0 0x7ff8f815ac90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/3124313155 >> 172.21.15.29:0/3124313155 conn(0x7ff8f806b3e0 msgr2=0x7ff8f806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/3124313155 shutdown_connections 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.949+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/3124313155 wait complete. 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.950+0000 7ff8ff3fe640 1 Processor -- start 2024-04-15T01:10:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.950+0000 7ff8ff3fe640 1 -- start start 2024-04-15T01:10:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8ff3fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8f80715c0 0x7ff8f81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8ff3fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f81402c0 0x7ff8f80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8ff3fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8f815b1d0 0x7ff8f8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8ff3fe640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f80c4d40 con 0x7ff8f80715c0 2024-04-15T01:10:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8ff3fe640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f80c5940 con 0x7ff8f815b1d0 2024-04-15T01:10:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8ff3fe640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f80c8aa0 con 0x7ff8f81402c0 2024-04-15T01:10:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.951+0000 7ff8fd19a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8f80715c0 0x7ff8f81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.952+0000 7ff8fc999640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f81402c0 0x7ff8f80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.952+0000 7ff8fd99b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8f815b1d0 0x7ff8f8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.952+0000 7ff8fd19a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8f80715c0 0x7ff8f81379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36410/0 (socket says 172.21.15.29:36410) 2024-04-15T01:10:53.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.952+0000 7ff8fd19a640 1 -- 172.21.15.29:0/1836398784 learned_addr learned my addr 172.21.15.29:0/1836398784 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:53.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.955+0000 7ff8fd19a640 1 -- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f81402c0 msgr2=0x7ff8f80c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.955+0000 7ff8fd19a640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff8f81402c0 0x7ff8f80c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.955+0000 7ff8fd19a640 1 -- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8f815b1d0 msgr2=0x7ff8f8156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.955+0000 7ff8fd19a640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8f815b1d0 0x7ff8f8156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.955+0000 7ff8fd19a640 1 -- 172.21.15.29:0/1836398784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f81ef7e0 con 0x7ff8f80715c0 2024-04-15T01:10:53.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.957+0000 7ff8fd19a640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8f80715c0 0x7ff8f81379e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c450 tx=0x7ff8e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:53.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.961+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8017070 con 0x7ff8f80715c0 2024-04-15T01:10:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.961+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e8005ce0 con 0x7ff8f80715c0 2024-04-15T01:10:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.961+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80072b0 con 0x7ff8f80715c0 2024-04-15T01:10:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.961+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f81ec5b0 con 0x7ff8f80715c0 2024-04-15T01:10:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.961+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f81eb7f0 con 0x7ff8f80715c0 2024-04-15T01:10:53.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.962+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8f804f540 con 0x7ff8f80715c0 2024-04-15T01:10:53.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.982+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff8e801a070 con 0x7ff8f80715c0 2024-04-15T01:10:53.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.982+0000 7ff8edffb640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff8dc06b9e0 0x7ff8dc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:53.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.983+0000 7ff8fc999640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff8dc06b9e0 0x7ff8dc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:53.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.983+0000 7ff8fc999640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff8dc06b9e0 0x7ff8dc06dea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4038000 tx=0x7ff8f4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:53.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.985+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff8e8056970 con 0x7ff8f80715c0 2024-04-15T01:10:53.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.985+0000 7ff8edffb640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7ff8dc075370 0x7ff8dc077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:53.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.985+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 --> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8e801ae50 con 0x7ff8dc075370 2024-04-15T01:10:53.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.986+0000 7ff8fd99b640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7ff8dc075370 0x7ff8dc077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:53.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.986+0000 7ff8fd99b640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7ff8dc075370 0x7ff8dc077810 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:53.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.987+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff8e8054b70 con 0x7ff8f80715c0 2024-04-15T01:10:53.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:53.987+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== osd.0 v2:172.21.15.29:6800/1292838260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8e801ae50 con 0x7ff8dc075370 2024-04-15T01:10:53.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.000+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 --> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff8f815ac90 con 0x7ff8dc075370 2024-04-15T01:10:53.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.000+0000 7ff8edffb640 1 -- 172.21.15.29:0/1836398784 <== osd.0 v2:172.21.15.29:6800/1292838260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff8f815ac90 con 0x7ff8dc075370 2024-04-15T01:10:53.999 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:53.999 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:53.999 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.000+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7ff8dc075370 msgr2=0x7ff8dc077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.000+0000 7ff8ff3fe640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:6800/1292838260,v1:172.21.15.29:6801/1292838260] conn(0x7ff8dc075370 0x7ff8dc077810 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff8dc06b9e0 msgr2=0x7ff8dc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff8dc06b9e0 0x7ff8dc06dea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4038000 tx=0x7ff8f4008030 comp rx=0 tx=0).stop 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8f80715c0 msgr2=0x7ff8f81379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 --2- 172.21.15.29:0/1836398784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8f80715c0 0x7ff8f81379e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c450 tx=0x7ff8e800c910 comp rx=0 tx=0).stop 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8fd99b640 1 -- 172.21.15.29:0/1836398784 reap_dead start 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 shutdown_connections 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 >> 172.21.15.29:0/1836398784 conn(0x7ff8f806b3e0 msgr2=0x7ff8f806f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 shutdown_connections 2024-04-15T01:10:54.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.001+0000 7ff8ff3fe640 1 -- 172.21.15.29:0/1836398784 wait complete. 2024-04-15T01:10:54.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-15T01:10:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.115+0000 7f289e511640 1 Processor -- start 2024-04-15T01:10:54.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.115+0000 7f289e511640 1 -- start start 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.116+0000 7f289e511640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28980c9d30 0x7f2898141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.116+0000 7f289e511640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2898158870 con 0x7f28980c6260 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.116+0000 7f289e511640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2898158b50 con 0x7f28980c6640 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.116+0000 7f289e511640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2898158e30 con 0x7f28980c9d30 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.116+0000 7f289caae640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28980c9d30 0x7f2898141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.117+0000 7f28977fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28980c6640 0x7f2898140f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:39070/0 (socket says 172.21.15.29:39070) 2024-04-15T01:10:54.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.117+0000 7f28977fe640 1 -- 172.21.15.29:0/3569866793 learned_addr learned my addr 172.21.15.29:0/3569866793 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.119+0000 7f2896ffd640 1 -- 172.21.15.29:0/3569866793 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526341225 0 0) 0x7f2898158b50 con 0x7f28980c6640 2024-04-15T01:10:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.119+0000 7f2896ffd640 1 -- 172.21.15.29:0/3569866793 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2884003520 con 0x7f28980c6640 2024-04-15T01:10:54.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.120+0000 7f289caae640 1 -- 172.21.15.29:0/3569866793 >> v1:172.21.15.37:6789/0 conn(0x7f28980c6640 legacy=0x7f2898140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.120+0000 7f289caae640 1 -- 172.21.15.29:0/3569866793 >> v1:172.21.15.29:6789/0 conn(0x7f28980c6260 legacy=0x7f289815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.120+0000 7f289caae640 1 -- 172.21.15.29:0/3569866793 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289815b850 con 0x7f28980c9d30 2024-04-15T01:10:54.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.124+0000 7f289caae640 1 --2- 172.21.15.29:0/3569866793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c9d30 0x7f2898141630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2890009d90 tx=0x7f289002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf769423064a54 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.129+0000 7f2896ffd640 1 -- 172.21.15.29:0/3569866793 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890039070 con 0x7f28980c9d30 2024-04-15T01:10:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.129+0000 7f2896ffd640 1 -- 172.21.15.29:0/3569866793 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289002cd00 con 0x7f28980c9d30 2024-04-15T01:10:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.129+0000 7f2896ffd640 1 -- 172.21.15.29:0/3569866793 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890034660 con 0x7f28980c9d30 2024-04-15T01:10:54.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.129+0000 7f289e511640 1 -- 172.21.15.29:0/3569866793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c9d30 msgr2=0x7f2898141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.129+0000 7f289e511640 1 --2- 172.21.15.29:0/3569866793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c9d30 0x7f2898141630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2890009d90 tx=0x7f289002bf50 comp rx=0 tx=0).stop 2024-04-15T01:10:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.130+0000 7f289e511640 1 -- 172.21.15.29:0/3569866793 shutdown_connections 2024-04-15T01:10:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.130+0000 7f289e511640 1 --2- 172.21.15.29:0/3569866793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c9d30 0x7f2898141630 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.130+0000 7f289e511640 1 -- 172.21.15.29:0/3569866793 >> 172.21.15.29:0/3569866793 conn(0x7f289806c310 msgr2=0x7f289806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.130+0000 7f289e511640 1 -- 172.21.15.29:0/3569866793 shutdown_connections 2024-04-15T01:10:54.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.130+0000 7f289e511640 1 -- 172.21.15.29:0/3569866793 wait complete. 2024-04-15T01:10:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.131+0000 7f289e511640 1 Processor -- start 2024-04-15T01:10:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.131+0000 7f289e511640 1 -- start start 2024-04-15T01:10:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f289e511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28980c6260 0x7f28981ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f289e511640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 0x7f28981f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f289e511640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f28980c9d30 0x7f28981579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f289e511640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f28980701f0 con 0x7f28980c6640 2024-04-15T01:10:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f289e511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2898070070 con 0x7f28980c6260 2024-04-15T01:10:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f289e511640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f28980c7cf0 con 0x7f28980c9d30 2024-04-15T01:10:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.132+0000 7f28977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 0x7f28981f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.133+0000 7f2897fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28980c6260 0x7f28981ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.133+0000 7f289caae640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f28980c9d30 0x7f28981579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.133+0000 7f28977fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 0x7f28981f0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36428/0 (socket says 172.21.15.29:36428) 2024-04-15T01:10:54.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.133+0000 7f28977fe640 1 -- 172.21.15.29:0/3832148192 learned_addr learned my addr 172.21.15.29:0/3832148192 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.136+0000 7f28977fe640 1 -- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f28980c9d30 msgr2=0x7f28981579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.136+0000 7f28977fe640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f28980c9d30 0x7f28981579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.136+0000 7f28977fe640 1 -- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28980c6260 msgr2=0x7f28981ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.136+0000 7f28977fe640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28980c6260 0x7f28981ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.136+0000 7f28977fe640 1 -- 172.21.15.29:0/3832148192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289813af50 con 0x7f28980c6640 2024-04-15T01:10:54.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.139+0000 7f28977fe640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 0x7f28981f0f60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f288000c500 tx=0x7f288000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.143+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880017070 con 0x7f28980c6640 2024-04-15T01:10:54.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.143+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880005ce0 con 0x7f28980c6640 2024-04-15T01:10:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.143+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28981f16a0 con 0x7f28980c6640 2024-04-15T01:10:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.143+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800072f0 con 0x7f28980c6640 2024-04-15T01:10:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.143+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28981f1c40 con 0x7f28980c6640 2024-04-15T01:10:54.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.144+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289804f540 con 0x7f28980c6640 2024-04-15T01:10:54.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.164+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f288001a070 con 0x7f28980c6640 2024-04-15T01:10:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.164+0000 7f2894ff9640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f287806b990 0x7f287806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.165+0000 7f2897fff640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f287806b990 0x7f287806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.165+0000 7f2897fff640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f287806b990 0x7f287806de50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2888001780 tx=0x7f2888009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.426+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f28800569e0 con 0x7f28980c6640 2024-04-15T01:10:54.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.426+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2880058940 con 0x7f28980c6640 2024-04-15T01:10:54.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.610+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f289813dff0 con 0x7f287806b990 2024-04-15T01:10:54.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.611+0000 7f2894ff9640 1 -- 172.21.15.29:0/3832148192 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f289813dff0 con 0x7f287806b990 2024-04-15T01:10:54.609 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-04-15T01:10:54.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f287806b990 msgr2=0x7f287806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f287806b990 0x7f287806de50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2888001780 tx=0x7f2888009040 comp rx=0 tx=0).stop 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 msgr2=0x7f28981f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 0x7f28981f0f60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f288000c500 tx=0x7f288000c9c0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 shutdown_connections 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f287806b990 0x7f287806de50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f28980c9d30 0x7f28981579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28980c6640 0x7f28981f0f60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 --2- 172.21.15.29:0/3832148192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28980c6260 0x7f28981ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 >> 172.21.15.29:0/3832148192 conn(0x7f289806c310 msgr2=0x7f289806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 shutdown_connections 2024-04-15T01:10:54.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.613+0000 7f289e511640 1 -- 172.21.15.29:0/3832148192 wait complete. 2024-04-15T01:10:54.623 INFO:tasks.ceph:Scrubbing osd.1 2024-04-15T01:10:54.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:54.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.731+0000 7f5f47a0f640 1 Processor -- start 2024-04-15T01:10:54.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 -- start start 2024-04-15T01:10:54.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f401547f0 0x7f5f400ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f4006d760 0x7f5f4015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f400cdfe0 0x7f5f400ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4015b370 con 0x7f5f400cdfe0 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5f400ccb20 con 0x7f5f401547f0 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.732+0000 7f5f47a0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5f40154bd0 con 0x7f5f4006d760 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.733+0000 7f5f45fac640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f400cdfe0 0x7f5f400ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.733+0000 7f5f45fac640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f400cdfe0 0x7f5f400ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36436/0 (socket says 172.21.15.29:36436) 2024-04-15T01:10:54.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.733+0000 7f5f45fac640 1 -- 172.21.15.29:0/723590866 learned_addr learned my addr 172.21.15.29:0/723590866 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:54.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.735+0000 7f5f45fac640 1 -- 172.21.15.29:0/723590866 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f4006d760 msgr2=0x7f5f4015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:54.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.735+0000 7f5f45fac640 1 --2- 172.21.15.29:0/723590866 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f4006d760 0x7f5f4015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.736+0000 7f5f45fac640 1 -- 172.21.15.29:0/723590866 >> v2:172.21.15.37:3300/0 conn(0x7f5f401547f0 msgr2=0x7f5f400ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:54.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.736+0000 7f5f45fac640 1 --2- 172.21.15.29:0/723590866 >> v2:172.21.15.37:3300/0 conn(0x7f5f401547f0 0x7f5f400ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.736+0000 7f5f45fac640 1 -- 172.21.15.29:0/723590866 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4015adb0 con 0x7f5f400cdfe0 2024-04-15T01:10:54.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.738+0000 7f5f45fac640 1 --2- 172.21.15.29:0/723590866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f400ce430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f4006b500 tx=0x7f5f3802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d838ef772302cd53 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.741+0000 7f5f37fff640 1 -- 172.21.15.29:0/723590866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3802cb00 con 0x7f5f400cdfe0 2024-04-15T01:10:54.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.741+0000 7f5f37fff640 1 -- 172.21.15.29:0/723590866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3802cca0 con 0x7f5f400cdfe0 2024-04-15T01:10:54.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.741+0000 7f5f37fff640 1 -- 172.21.15.29:0/723590866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38034610 con 0x7f5f400cdfe0 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 -- 172.21.15.29:0/723590866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 msgr2=0x7f5f400ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/723590866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f400ce430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5f4006b500 tx=0x7f5f3802bf60 comp rx=0 tx=0).stop 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 -- 172.21.15.29:0/723590866 shutdown_connections 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/723590866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f400ce430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/723590866 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f4006d760 0x7f5f4015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/723590866 >> v2:172.21.15.37:3300/0 conn(0x7f5f401547f0 0x7f5f400ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 -- 172.21.15.29:0/723590866 >> 172.21.15.29:0/723590866 conn(0x7f5f40061c20 msgr2=0x7f5f40062030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 -- 172.21.15.29:0/723590866 shutdown_connections 2024-04-15T01:10:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.742+0000 7f5f47a0f640 1 -- 172.21.15.29:0/723590866 wait complete. 2024-04-15T01:10:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 Processor -- start 2024-04-15T01:10:54.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 -- start start 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f4006d760 0x7f5f40149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f401f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f401547f0 0x7f5f401483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5f400cc7b0 con 0x7f5f400cdfe0 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f400cc4d0 con 0x7f5f4006d760 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.744+0000 7f5f47a0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4006dbf0 con 0x7f5f401547f0 2024-04-15T01:10:54.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.745+0000 7f5f44faa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f401f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.745+0000 7f5f44faa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f401f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36438/0 (socket says 172.21.15.29:36438) 2024-04-15T01:10:54.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.745+0000 7f5f44faa640 1 -- 172.21.15.29:0/3620029923 learned_addr learned my addr 172.21.15.29:0/3620029923 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.748+0000 7f5f44faa640 1 -- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f401547f0 msgr2=0x7f5f401483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.748+0000 7f5f44faa640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5f401547f0 0x7f5f401483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.748+0000 7f5f44faa640 1 -- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f4006d760 msgr2=0x7f5f40149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.748+0000 7f5f44faa640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f4006d760 0x7f5f40149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.748+0000 7f5f44faa640 1 -- 172.21.15.29:0/3620029923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4014e3a0 con 0x7f5f400cdfe0 2024-04-15T01:10:54.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.751+0000 7f5f44faa640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f401f0a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b4d0 tx=0x7f5f3000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.754+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30014070 con 0x7f5f400cdfe0 2024-04-15T01:10:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.754+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30010870 con 0x7f5f400cdfe0 2024-04-15T01:10:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.754+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30010c60 con 0x7f5f400cdfe0 2024-04-15T01:10:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.754+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f40148ca0 con 0x7f5f400cdfe0 2024-04-15T01:10:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.755+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f40149260 con 0x7f5f400cdfe0 2024-04-15T01:10:54.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.755+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f4004f540 con 0x7f5f400cdfe0 2024-04-15T01:10:54.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.774+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5f30017070 con 0x7f5f400cdfe0 2024-04-15T01:10:54.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.775+0000 7f5f35ffb640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5f2406b9e0 0x7f5f2406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.775+0000 7f5f457ab640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5f2406b9e0 0x7f5f2406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.776+0000 7f5f457ab640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5f2406b9e0 0x7f5f2406dea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009670 tx=0x7f5f3c006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.780+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5f30057160 con 0x7f5f400cdfe0 2024-04-15T01:10:54.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.780+0000 7f5f35ffb640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f5f24075370 0x7f5f24077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.780+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 --> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f30017e50 con 0x7f5f24075370 2024-04-15T01:10:54.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.780+0000 7f5f45fac640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f5f24075370 0x7f5f24077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.780+0000 7f5f45fac640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f5f24075370 0x7f5f24077810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.781+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== osd.1 v2:172.21.15.29:6808/367785710 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f30017e50 con 0x7f5f24075370 2024-04-15T01:10:54.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.787+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5f30055360 con 0x7f5f400cdfe0 2024-04-15T01:10:54.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.795+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 --> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5f4006dee0 con 0x7f5f24075370 2024-04-15T01:10:54.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.795+0000 7f5f35ffb640 1 -- 172.21.15.29:0/3620029923 <== osd.1 v2:172.21.15.29:6808/367785710 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5f4006dee0 con 0x7f5f24075370 2024-04-15T01:10:54.794 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:54.794 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:54.794 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f5f24075370 msgr2=0x7f5f24077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:6808/367785710,v1:172.21.15.29:6809/367785710] conn(0x7f5f24075370 0x7f5f24077810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5f2406b9e0 msgr2=0x7f5f2406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f5f2406b9e0 0x7f5f2406dea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009670 tx=0x7f5f3c006bf0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 msgr2=0x7f5f401f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 --2- 172.21.15.29:0/3620029923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f400cdfe0 0x7f5f401f0a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b4d0 tx=0x7f5f3000b990 comp rx=0 tx=0).stop 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f45fac640 1 -- 172.21.15.29:0/3620029923 reap_dead start 2024-04-15T01:10:54.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 shutdown_connections 2024-04-15T01:10:54.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 >> 172.21.15.29:0/3620029923 conn(0x7f5f40061c20 msgr2=0x7f5f401500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:54.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 shutdown_connections 2024-04-15T01:10:54.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.796+0000 7f5f47a0f640 1 -- 172.21.15.29:0/3620029923 wait complete. 2024-04-15T01:10:54.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-15T01:10:54.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.909+0000 7f2aed9d8640 1 Processor -- start 2024-04-15T01:10:54.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.909+0000 7f2aed9d8640 1 -- start start 2024-04-15T01:10:54.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.910+0000 7f2aed9d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ae815b110 0x7f2ae80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.910+0000 7f2aed9d8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ae80cdff0 0x7f2ae80ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.910+0000 7f2aed9d8640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ae80cf910 con 0x7f2ae80cc530 2024-04-15T01:10:54.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.910+0000 7f2aed9d8640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae80cf350 con 0x7f2ae80cdff0 2024-04-15T01:10:54.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.910+0000 7f2aed9d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae80cf630 con 0x7f2ae815b110 2024-04-15T01:10:54.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.911+0000 7f2ae77fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ae80cdff0 0x7f2ae80ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.911+0000 7f2ae6ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2ae80cc530 0x7f2ae806c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56022/0 (socket says 172.21.15.29:56022) 2024-04-15T01:10:54.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.911+0000 7f2ae6ffd640 1 -- 172.21.15.29:0/1341981131 learned_addr learned my addr 172.21.15.29:0/1341981131 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:54.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.911+0000 7f2ae67fc640 1 --2- 172.21.15.29:0/1341981131 >> v2:172.21.15.37:3300/0 conn(0x7f2ae815b110 0x7f2ae80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.914+0000 7f2ae77fe640 1 -- 172.21.15.29:0/1341981131 >> v2:172.21.15.37:3300/0 conn(0x7f2ae815b110 msgr2=0x7f2ae80cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:54.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.914+0000 7f2ae77fe640 1 --2- 172.21.15.29:0/1341981131 >> v2:172.21.15.37:3300/0 conn(0x7f2ae815b110 0x7f2ae80cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.914+0000 7f2ae77fe640 1 -- 172.21.15.29:0/1341981131 >> v1:172.21.15.29:6789/0 conn(0x7f2ae80cc530 legacy=0x7f2ae806c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.914+0000 7f2ae77fe640 1 -- 172.21.15.29:0/1341981131 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae815a630 con 0x7f2ae80cdff0 2024-04-15T01:10:54.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.917+0000 7f2ae77fe640 1 --2- 172.21.15.29:0/1341981131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cdff0 0x7f2ae80ce400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80c33d0 tx=0x7f2ad802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338c4911aff1cbbb server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.923+0000 7f2ae5ffb640 1 -- 172.21.15.29:0/1341981131 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8039070 con 0x7f2ae80cdff0 2024-04-15T01:10:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.923+0000 7f2ae5ffb640 1 -- 172.21.15.29:0/1341981131 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad802cc80 con 0x7f2ae80cdff0 2024-04-15T01:10:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.923+0000 7f2ae5ffb640 1 -- 172.21.15.29:0/1341981131 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8034660 con 0x7f2ae80cdff0 2024-04-15T01:10:54.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 -- 172.21.15.29:0/1341981131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cdff0 msgr2=0x7f2ae80ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/1341981131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cdff0 0x7f2ae80ce400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80c33d0 tx=0x7f2ad802bed0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 -- 172.21.15.29:0/1341981131 shutdown_connections 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/1341981131 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cdff0 0x7f2ae80ce400 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/1341981131 >> v2:172.21.15.37:3300/0 conn(0x7f2ae815b110 0x7f2ae80cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 -- 172.21.15.29:0/1341981131 >> 172.21.15.29:0/1341981131 conn(0x7f2ae80cfb20 msgr2=0x7f2ae80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 -- 172.21.15.29:0/1341981131 shutdown_connections 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.924+0000 7f2aed9d8640 1 -- 172.21.15.29:0/1341981131 wait complete. 2024-04-15T01:10:54.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.925+0000 7f2aed9d8640 1 Processor -- start 2024-04-15T01:10:54.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 -- start start 2024-04-15T01:10:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cc530 0x7f2ae80c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 0x7f2ae8156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2ae815b110 0x7f2ae81f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae80cebc0 con 0x7f2ae80cc530 2024-04-15T01:10:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae815abf0 con 0x7f2ae80cdff0 2024-04-15T01:10:54.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.926+0000 7f2aed9d8640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae8154b10 con 0x7f2ae815b110 2024-04-15T01:10:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.927+0000 7f2ae77fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2ae815b110 0x7f2ae81f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.928+0000 7f2ae67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 0x7f2ae8156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.928+0000 7f2ae77fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2ae815b110 0x7f2ae81f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:41712/0 (socket says 172.21.15.29:41712) 2024-04-15T01:10:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.928+0000 7f2ae67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 0x7f2ae8156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:33312/0 (socket says 172.21.15.29:33312) 2024-04-15T01:10:54.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.928+0000 7f2ae77fe640 1 -- 172.21.15.29:0/2535937249 learned_addr learned my addr 172.21.15.29:0/2535937249 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:54.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.930+0000 7f2ae6ffd640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cc530 0x7f2ae80c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.932+0000 7f2ae67fc640 1 -- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2ae815b110 msgr2=0x7f2ae81f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.932+0000 7f2ae67fc640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2ae815b110 0x7f2ae81f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.932+0000 7f2ae67fc640 1 -- 172.21.15.29:0/2535937249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cc530 msgr2=0x7f2ae80c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.932+0000 7f2ae67fc640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cc530 0x7f2ae80c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:54.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.932+0000 7f2ae67fc640 1 -- 172.21.15.29:0/2535937249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae8152760 con 0x7f2ae80cdff0 2024-04-15T01:10:54.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.935+0000 7f2ae67fc640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 0x7f2ae8156060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e870 tx=0x7f2adc00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.939+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc017070 con 0x7f2ae80cdff0 2024-04-15T01:10:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.939+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc00ee60 con 0x7f2ae80cdff0 2024-04-15T01:10:54.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.939+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae80cb550 con 0x7f2ae80cdff0 2024-04-15T01:10:54.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.939+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00cb60 con 0x7f2ae80cdff0 2024-04-15T01:10:54.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.939+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae81e41d0 con 0x7f2ae80cdff0 2024-04-15T01:10:54.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.940+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae8156d60 con 0x7f2ae80cdff0 2024-04-15T01:10:54.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.961+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2adc01a070 con 0x7f2ae80cdff0 2024-04-15T01:10:54.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.962+0000 7f2acffff640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2ad406b9e0 0x7f2ad406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:54.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.962+0000 7f2ae6ffd640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2ad406b9e0 0x7f2ad406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:54.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:54.962+0000 7f2ae6ffd640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2ad406b9e0 0x7f2ad406dea0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0007fd0 tx=0x7f2ae0007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.227+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f2adc057470 con 0x7f2ae80cdff0 2024-04-15T01:10:55.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.238+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2adc0593d0 con 0x7f2ae80cdff0 2024-04-15T01:10:55.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.419+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2ae80c8580 con 0x7f2ad406b9e0 2024-04-15T01:10:55.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.420+0000 7f2acffff640 1 -- 172.21.15.29:0/2535937249 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2ae0001460 con 0x7f2ad406b9e0 2024-04-15T01:10:55.419 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2ad406b9e0 msgr2=0x7f2ad406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2ad406b9e0 0x7f2ad406dea0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0007fd0 tx=0x7f2ae0007e80 comp rx=0 tx=0).stop 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 msgr2=0x7f2ae8156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 0x7f2ae8156060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e870 tx=0x7f2adc00ed30 comp rx=0 tx=0).stop 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 shutdown_connections 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f2ad406b9e0 0x7f2ad406dea0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f2ae815b110 0x7f2ae81f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae80cdff0 0x7f2ae8156060 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 --2- 172.21.15.29:0/2535937249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae80cc530 0x7f2ae80c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 >> 172.21.15.29:0/2535937249 conn(0x7f2ae80cfb20 msgr2=0x7f2ae8153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 shutdown_connections 2024-04-15T01:10:55.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.422+0000 7f2aed9d8640 1 -- 172.21.15.29:0/2535937249 wait complete. 2024-04-15T01:10:55.432 INFO:tasks.ceph:Scrubbing osd.2 2024-04-15T01:10:55.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.540+0000 7f9849b1e640 1 Processor -- start 2024-04-15T01:10:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.540+0000 7f9849b1e640 1 -- start start 2024-04-15T01:10:55.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.541+0000 7f9849b1e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98441523d0 0x7f98441580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.541+0000 7f9849b1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440cda00 0x7f98440cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.541+0000 7f9849b1e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98440c8900 con 0x7f98440c8b10 2024-04-15T01:10:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.541+0000 7f9849b1e640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f98440b2060 con 0x7f98441523d0 2024-04-15T01:10:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.541+0000 7f9849b1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f98440c2e50 con 0x7f98440cda00 2024-04-15T01:10:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.542+0000 7f98437fe640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98441523d0 0x7f98441580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.542+0000 7f9843fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440cda00 0x7f98440cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.542+0000 7f9842ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98440c8b10 0x7f98440b1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:39084/0 (socket says 172.21.15.29:39084) 2024-04-15T01:10:55.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.542+0000 7f9842ffd640 1 -- 172.21.15.29:0/2742406495 learned_addr learned my addr 172.21.15.29:0/2742406495 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.544+0000 7f98437fe640 1 -- 172.21.15.29:0/2742406495 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440cda00 msgr2=0x7f98440cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.544+0000 7f98437fe640 1 --2- 172.21.15.29:0/2742406495 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440cda00 0x7f98440cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.544+0000 7f98437fe640 1 -- 172.21.15.29:0/2742406495 >> v1:172.21.15.37:6789/0 conn(0x7f98440c8b10 legacy=0x7f98440b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.544+0000 7f98437fe640 1 -- 172.21.15.29:0/2742406495 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440c30f0 con 0x7f98441523d0 2024-04-15T01:10:55.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.546+0000 7f98437fe640 1 --2- 172.21.15.29:0/2742406495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98441523d0 0x7f98441580f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98340097a0 tx=0x7f983402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c0cb2159b0ae81 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f98427fc640 1 -- 172.21.15.29:0/2742406495 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834035020 con 0x7f98441523d0 2024-04-15T01:10:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f98427fc640 1 -- 172.21.15.29:0/2742406495 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9834031830 con 0x7f98441523d0 2024-04-15T01:10:55.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f98427fc640 1 -- 172.21.15.29:0/2742406495 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834031c00 con 0x7f98441523d0 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 -- 172.21.15.29:0/2742406495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98441523d0 msgr2=0x7f98441580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 --2- 172.21.15.29:0/2742406495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98441523d0 0x7f98441580f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98340097a0 tx=0x7f983402b8d0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 -- 172.21.15.29:0/2742406495 shutdown_connections 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 --2- 172.21.15.29:0/2742406495 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440cda00 0x7f98440cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 --2- 172.21.15.29:0/2742406495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98441523d0 0x7f98441580f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 -- 172.21.15.29:0/2742406495 >> 172.21.15.29:0/2742406495 conn(0x7f9844071330 msgr2=0x7f9844071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 -- 172.21.15.29:0/2742406495 shutdown_connections 2024-04-15T01:10:55.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.550+0000 7f9849b1e640 1 -- 172.21.15.29:0/2742406495 wait complete. 2024-04-15T01:10:55.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.552+0000 7f9849b1e640 1 Processor -- start 2024-04-15T01:10:55.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.552+0000 7f9849b1e640 1 -- start start 2024-04-15T01:10:55.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9849b1e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440c8b10 0x7f98441f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9849b1e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98440cda00 0x7f98440c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9849b1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98441523d0 0x7f98440c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9849b1e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f98440c3910 con 0x7f98440cda00 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9849b1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98440c3390 con 0x7f98441523d0 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9849b1e640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f98440c3bf0 con 0x7f98440c8b10 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9842ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98440cda00 0x7f98440c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9843fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98441523d0 0x7f98440c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f98437fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440c8b10 0x7f98441f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9842ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98440cda00 0x7f98440c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36474/0 (socket says 172.21.15.29:36474) 2024-04-15T01:10:55.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.553+0000 7f9842ffd640 1 -- 172.21.15.29:0/4102009334 learned_addr learned my addr 172.21.15.29:0/4102009334 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.557+0000 7f9842ffd640 1 -- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440c8b10 msgr2=0x7f98441f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.557+0000 7f9842ffd640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f98440c8b10 0x7f98441f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.557+0000 7f9842ffd640 1 -- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98441523d0 msgr2=0x7f98440c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.557+0000 7f9842ffd640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98441523d0 0x7f98440c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.557+0000 7f9842ffd640 1 -- 172.21.15.29:0/4102009334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440c4f30 con 0x7f98440cda00 2024-04-15T01:10:55.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.559+0000 7f9842ffd640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98440cda00 0x7f98440c53e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f983800c3f0 tx=0x7f983800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.563+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838017070 con 0x7f98440cda00 2024-04-15T01:10:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.563+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9838005ce0 con 0x7f98440cda00 2024-04-15T01:10:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.563+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380072f0 con 0x7f98440cda00 2024-04-15T01:10:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.563+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98441f1e00 con 0x7f98440cda00 2024-04-15T01:10:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.563+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98440c76a0 con 0x7f98440cda00 2024-04-15T01:10:55.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.564+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f984404f540 con 0x7f98440cda00 2024-04-15T01:10:55.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.584+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f983801a070 con 0x7f98440cda00 2024-04-15T01:10:55.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.584+0000 7f982bfff640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f983006b990 0x7f983006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.584+0000 7f98437fe640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f983006b990 0x7f983006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.585+0000 7f98437fe640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f983006b990 0x7f983006de50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9834036000 tx=0x7f9834008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.587+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9838056830 con 0x7f98440cda00 2024-04-15T01:10:55.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.588+0000 7f982bfff640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7f9830075330 0x7f98300777d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.588+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 --> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9838006e50 con 0x7f9830075330 2024-04-15T01:10:55.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.588+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9838054a30 con 0x7f98440cda00 2024-04-15T01:10:55.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.588+0000 7f9843fff640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7f9830075330 0x7f98300777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.588+0000 7f9843fff640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7f9830075330 0x7f98300777d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.589+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== osd.2 v2:172.21.15.29:6824/2157921057 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9838006e50 con 0x7f9830075330 2024-04-15T01:10:55.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.602+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 --> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9844143d90 con 0x7f9830075330 2024-04-15T01:10:55.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.602+0000 7f982bfff640 1 -- 172.21.15.29:0/4102009334 <== osd.2 v2:172.21.15.29:6824/2157921057 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f983c011520 con 0x7f9830075330 2024-04-15T01:10:55.602 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:55.602 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:55.602 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7f9830075330 msgr2=0x7f98300777d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:6824/2157921057,v1:172.21.15.29:6825/2157921057] conn(0x7f9830075330 0x7f98300777d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f983006b990 msgr2=0x7f983006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f983006b990 0x7f983006de50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9834036000 tx=0x7f9834008030 comp rx=0 tx=0).stop 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98440cda00 msgr2=0x7f98440c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 --2- 172.21.15.29:0/4102009334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98440cda00 0x7f98440c53e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f983800c3f0 tx=0x7f983800c8b0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9843fff640 1 -- 172.21.15.29:0/4102009334 reap_dead start 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 shutdown_connections 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 >> 172.21.15.29:0/4102009334 conn(0x7f9844071330 msgr2=0x7f9844150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:55.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 shutdown_connections 2024-04-15T01:10:55.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.603+0000 7f9849b1e640 1 -- 172.21.15.29:0/4102009334 wait complete. 2024-04-15T01:10:55.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-15T01:10:55.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.718+0000 7fd6b83fa640 1 Processor -- start 2024-04-15T01:10:55.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.718+0000 7fd6b83fa640 1 -- start start 2024-04-15T01:10:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.719+0000 7fd6b83fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6b00c3550 0x7fd6b0070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.719+0000 7fd6b83fa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6b00709d0 0x7fd6b01596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.719+0000 7fd6b83fa640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b0157fb0 con 0x7fd6b014ea00 2024-04-15T01:10:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.719+0000 7fd6b83fa640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b00c3970 con 0x7fd6b00709d0 2024-04-15T01:10:55.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.719+0000 7fd6b83fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b0158230 con 0x7fd6b00c3550 2024-04-15T01:10:55.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.720+0000 7fd6b6997640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd6b00709d0 0x7fd6b01596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.720+0000 7fd6b5995640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6b00c3550 0x7fd6b0070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.720+0000 7fd6b5995640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6b00c3550 0x7fd6b0070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:33336/0 (socket says 172.21.15.29:33336) 2024-04-15T01:10:55.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.720+0000 7fd6b5995640 1 -- 172.21.15.29:0/1676020301 learned_addr learned my addr 172.21.15.29:0/1676020301 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:55.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.722+0000 7fd6b5995640 1 -- 172.21.15.29:0/1676020301 >> v2:172.21.15.29:3300/0 conn(0x7fd6b00709d0 msgr2=0x7fd6b01596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:55.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.722+0000 7fd6b5995640 1 --2- 172.21.15.29:0/1676020301 >> v2:172.21.15.29:3300/0 conn(0x7fd6b00709d0 0x7fd6b01596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.722+0000 7fd6b5995640 1 -- 172.21.15.29:0/1676020301 >> v1:172.21.15.29:6789/0 conn(0x7fd6b014ea00 legacy=0x7fd6b00cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.722+0000 7fd6b5995640 1 -- 172.21.15.29:0/1676020301 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b0158510 con 0x7fd6b00c3550 2024-04-15T01:10:55.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.724+0000 7fd6b5995640 1 --2- 172.21.15.29:0/1676020301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b0070490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0070420 tx=0x7fd6a002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42078dfdf3d90e1a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.728+0000 7fd6b5194640 1 -- 172.21.15.29:0/1676020301 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a002f850 con 0x7fd6b00c3550 2024-04-15T01:10:55.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.728+0000 7fd6b5194640 1 -- 172.21.15.29:0/1676020301 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a002f9f0 con 0x7fd6b00c3550 2024-04-15T01:10:55.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.728+0000 7fd6b5194640 1 -- 172.21.15.29:0/1676020301 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a002fdc0 con 0x7fd6b00c3550 2024-04-15T01:10:55.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 -- 172.21.15.29:0/1676020301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 msgr2=0x7fd6b0070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/1676020301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b0070490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0070420 tx=0x7fd6a002ba30 comp rx=0 tx=0).stop 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 -- 172.21.15.29:0/1676020301 shutdown_connections 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/1676020301 >> v2:172.21.15.29:3300/0 conn(0x7fd6b00709d0 0x7fd6b01596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/1676020301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b0070490 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 -- 172.21.15.29:0/1676020301 >> 172.21.15.29:0/1676020301 conn(0x7fd6b0061e00 msgr2=0x7fd6b0062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 -- 172.21.15.29:0/1676020301 shutdown_connections 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.729+0000 7fd6b83fa640 1 -- 172.21.15.29:0/1676020301 wait complete. 2024-04-15T01:10:55.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.730+0000 7fd6b83fa640 1 Processor -- start 2024-04-15T01:10:55.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.730+0000 7fd6b83fa640 1 -- start start 2024-04-15T01:10:55.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b83fa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 0x7fd6b01e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b83fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b01e2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b83fa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd6b014ea00 0x7fd6b01edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b83fa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b0158db0 con 0x7fd6b00709d0 2024-04-15T01:10:55.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b83fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b0158ad0 con 0x7fd6b00c3550 2024-04-15T01:10:55.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b83fa640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b014ede0 con 0x7fd6b014ea00 2024-04-15T01:10:55.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.731+0000 7fd6b6196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 0x7fd6b01e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.732+0000 7fd6b6997640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd6b014ea00 0x7fd6b01edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.732+0000 7fd6b5995640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b01e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.732+0000 7fd6b6196640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 0x7fd6b01e35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36494/0 (socket says 172.21.15.29:36494) 2024-04-15T01:10:55.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.732+0000 7fd6b6196640 1 -- 172.21.15.29:0/2473344957 learned_addr learned my addr 172.21.15.29:0/2473344957 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:55.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.735+0000 7fd6b5995640 1 -- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd6b014ea00 msgr2=0x7fd6b01edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.735+0000 7fd6b5995640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd6b014ea00 0x7fd6b01edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.735+0000 7fd6b5995640 1 -- 172.21.15.29:0/2473344957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 msgr2=0x7fd6b01e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:55.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.735+0000 7fd6b5995640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 0x7fd6b01e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:55.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.735+0000 7fd6b5995640 1 -- 172.21.15.29:0/2473344957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b01f1af0 con 0x7fd6b00c3550 2024-04-15T01:10:55.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.735+0000 7fd6b6196640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 0x7fd6b01e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T01:10:55.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.738+0000 7fd6b5995640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b01e2040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0033000 tx=0x7fd6a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.741+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0037c80 con 0x7fd6b00c3550 2024-04-15T01:10:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.741+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a0047070 con 0x7fd6b00c3550 2024-04-15T01:10:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.741+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0037e60 con 0x7fd6b00c3550 2024-04-15T01:10:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.741+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b01f1dd0 con 0x7fd6b00c3550 2024-04-15T01:10:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.741+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b00c8910 con 0x7fd6b00c3550 2024-04-15T01:10:55.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.742+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b0070610 con 0x7fd6b00c3550 2024-04-15T01:10:55.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.762+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd6a0040050 con 0x7fd6b00c3550 2024-04-15T01:10:55.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.762+0000 7fd6a6ffd640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd69406b9e0 0x7fd69406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:55.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.762+0000 7fd6b6196640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd69406b9e0 0x7fd69406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:55.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.763+0000 7fd6b6196640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd69406b9e0 0x7fd69406dea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac001b90 tx=0x7fd6ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:55.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:55.766+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd6a007a3e0 con 0x7fd6b00c3550 2024-04-15T01:10:56.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.051+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd6b0070610 con 0x7fd6b00c3550 2024-04-15T01:10:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.235+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd6b01e3ec0 con 0x7fd69406b9e0 2024-04-15T01:10:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.236+0000 7fd6a6ffd640 1 -- 172.21.15.29:0/2473344957 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd6b01e3ec0 con 0x7fd69406b9e0 2024-04-15T01:10:56.235 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd69406b9e0 msgr2=0x7fd69406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd69406b9e0 0x7fd69406dea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac001b90 tx=0x7fd6ac009040 comp rx=0 tx=0).stop 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 msgr2=0x7fd6b01e2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b01e2040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0033000 tx=0x7fd6a00046c0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 shutdown_connections 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fd69406b9e0 0x7fd69406dea0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fd6b014ea00 0x7fd6b01edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b00c3550 0x7fd6b01e2040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 --2- 172.21.15.29:0/2473344957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6b00709d0 0x7fd6b01e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 >> 172.21.15.29:0/2473344957 conn(0x7fd6b0061e00 msgr2=0x7fd6b0157340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 shutdown_connections 2024-04-15T01:10:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.238+0000 7fd6b83fa640 1 -- 172.21.15.29:0/2473344957 wait complete. 2024-04-15T01:10:56.248 INFO:tasks.ceph:Scrubbing osd.3 2024-04-15T01:10:56.249 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:56.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.356+0000 7f231aff0640 1 Processor -- start 2024-04-15T01:10:56.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.356+0000 7f231aff0640 1 -- start start 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.357+0000 7f231aff0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23141547f0 0x7f23140ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.357+0000 7f231aff0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f231415ab30 con 0x7f23140cdfe0 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.357+0000 7f231aff0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f231415adb0 con 0x7f231406d760 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.357+0000 7f231aff0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f231415b370 con 0x7f23141547f0 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.358+0000 7f2318d8c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f23141547f0 0x7f23140ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.358+0000 7f2313fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f231406d760 0x7f231415a420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:39096/0 (socket says 172.21.15.29:39096) 2024-04-15T01:10:56.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.358+0000 7f2313fff640 1 -- 172.21.15.29:0/4016114001 learned_addr learned my addr 172.21.15.29:0/4016114001 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:56.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.361+0000 7f23137fe640 1 -- 172.21.15.29:0/4016114001 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905927834 0 0) 0x7f231415adb0 con 0x7f231406d760 2024-04-15T01:10:56.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.361+0000 7f23137fe640 1 -- 172.21.15.29:0/4016114001 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22fc003520 con 0x7f231406d760 2024-04-15T01:10:56.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.361+0000 7f2318d8c640 1 -- 172.21.15.29:0/4016114001 >> v1:172.21.15.37:6789/0 conn(0x7f231406d760 legacy=0x7f231415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.361+0000 7f2318d8c640 1 -- 172.21.15.29:0/4016114001 >> v1:172.21.15.29:6789/0 conn(0x7f23140cdfe0 legacy=0x7f23140ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.361+0000 7f2318d8c640 1 -- 172.21.15.29:0/4016114001 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231415b090 con 0x7f23141547f0 2024-04-15T01:10:56.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.365+0000 7f2318d8c640 1 --2- 172.21.15.29:0/4016114001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23141547f0 0x7f23140ccfb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f23040097a0 tx=0x7f230402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab61aeb486a59aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.370+0000 7f23137fe640 1 -- 172.21.15.29:0/4016114001 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230402f810 con 0x7f23141547f0 2024-04-15T01:10:56.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.370+0000 7f23137fe640 1 -- 172.21.15.29:0/4016114001 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230402f9b0 con 0x7f23141547f0 2024-04-15T01:10:56.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.370+0000 7f23137fe640 1 -- 172.21.15.29:0/4016114001 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230402fd80 con 0x7f23141547f0 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.370+0000 7f231aff0640 1 -- 172.21.15.29:0/4016114001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23141547f0 msgr2=0x7f23140ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.370+0000 7f231aff0640 1 --2- 172.21.15.29:0/4016114001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23141547f0 0x7f23140ccfb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f23040097a0 tx=0x7f230402b9f0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.371+0000 7f231aff0640 1 -- 172.21.15.29:0/4016114001 shutdown_connections 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.371+0000 7f231aff0640 1 --2- 172.21.15.29:0/4016114001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23141547f0 0x7f23140ccfb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.371+0000 7f231aff0640 1 -- 172.21.15.29:0/4016114001 >> 172.21.15.29:0/4016114001 conn(0x7f2314061c20 msgr2=0x7f2314062030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.371+0000 7f231aff0640 1 -- 172.21.15.29:0/4016114001 shutdown_connections 2024-04-15T01:10:56.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.371+0000 7f231aff0640 1 -- 172.21.15.29:0/4016114001 wait complete. 2024-04-15T01:10:56.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.372+0000 7f231aff0640 1 Processor -- start 2024-04-15T01:10:56.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.372+0000 7f231aff0640 1 -- start start 2024-04-15T01:10:56.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.372+0000 7f231aff0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f231406d760 0x7f23140c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f231aff0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23140cdfe0 0x7f23140c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f231aff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23141547f0 0x7f2314157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f231aff0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2314154bd0 con 0x7f23140cdfe0 2024-04-15T01:10:56.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f231aff0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23140ccb20 con 0x7f23141547f0 2024-04-15T01:10:56.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f231aff0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f23140cc7b0 con 0x7f231406d760 2024-04-15T01:10:56.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f2313fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23140cdfe0 0x7f23140c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f2318d8c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f231406d760 0x7f23140c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f231958d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23141547f0 0x7f2314157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f2313fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23140cdfe0 0x7f23140c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36506/0 (socket says 172.21.15.29:36506) 2024-04-15T01:10:56.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.373+0000 7f2313fff640 1 -- 172.21.15.29:0/1305463561 learned_addr learned my addr 172.21.15.29:0/1305463561 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:56.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.377+0000 7f2313fff640 1 -- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f231406d760 msgr2=0x7f23140c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.377+0000 7f2313fff640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f231406d760 0x7f23140c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.377+0000 7f2313fff640 1 -- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23141547f0 msgr2=0x7f2314157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.377+0000 7f2313fff640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23141547f0 0x7f2314157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.377+0000 7f2313fff640 1 -- 172.21.15.29:0/1305463561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23141f0570 con 0x7f23140cdfe0 2024-04-15T01:10:56.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.379+0000 7f2313fff640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23140cdfe0 0x7f23140c8530 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f230800c530 tx=0x7f230800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.383+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308017070 con 0x7f23140cdfe0 2024-04-15T01:10:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.383+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2308005ce0 con 0x7f23140cdfe0 2024-04-15T01:10:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.383+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23140cd290 con 0x7f23140cdfe0 2024-04-15T01:10:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.383+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080072b0 con 0x7f23140cdfe0 2024-04-15T01:10:56.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.383+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23140c7230 con 0x7f23140cdfe0 2024-04-15T01:10:56.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.384+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f231404f540 con 0x7f23140cdfe0 2024-04-15T01:10:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.403+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f230801a070 con 0x7f23140cdfe0 2024-04-15T01:10:56.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.403+0000 7f23117fa640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f230006b9e0 0x7f230006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.404+0000 7f2318d8c640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f230006b9e0 0x7f230006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.404+0000 7f2318d8c640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f230006b9e0 0x7f230006dea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2304036000 tx=0x7f2304008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.407+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f2308056990 con 0x7f23140cdfe0 2024-04-15T01:10:56.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.407+0000 7f23117fa640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f2300075370 0x7f2300077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.407+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 --> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f230801ae50 con 0x7f2300075370 2024-04-15T01:10:56.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.407+0000 7f231958d640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f2300075370 0x7f2300077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.408+0000 7f231958d640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f2300075370 0x7f2300077810 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.408+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== osd.3 v2:172.21.15.29:6816/3034992974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f230801ae50 con 0x7f2300075370 2024-04-15T01:10:56.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.409+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2308054b90 con 0x7f23140cdfe0 2024-04-15T01:10:56.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 --> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23140cdab0 con 0x7f2300075370 2024-04-15T01:10:56.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f23117fa640 1 -- 172.21.15.29:0/1305463561 <== osd.3 v2:172.21.15.29:6816/3034992974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23140cdab0 con 0x7f2300075370 2024-04-15T01:10:56.420 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:56.421 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:56.421 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:56.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f2300075370 msgr2=0x7f2300077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:6816/3034992974,v1:172.21.15.29:6817/3034992974] conn(0x7f2300075370 0x7f2300077810 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f230006b9e0 msgr2=0x7f230006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f230006b9e0 0x7f230006dea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2304036000 tx=0x7f2304008030 comp rx=0 tx=0).stop 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23140cdfe0 msgr2=0x7f23140c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 --2- 172.21.15.29:0/1305463561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23140cdfe0 0x7f23140c8530 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f230800c530 tx=0x7f230800c9f0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231958d640 1 -- 172.21.15.29:0/1305463561 reap_dead start 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 shutdown_connections 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 >> 172.21.15.29:0/1305463561 conn(0x7f2314061c20 msgr2=0x7f231414fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 shutdown_connections 2024-04-15T01:10:56.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.422+0000 7f231aff0640 1 -- 172.21.15.29:0/1305463561 wait complete. 2024-04-15T01:10:56.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-15T01:10:56.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.543+0000 7f81edcde640 1 Processor -- start 2024-04-15T01:10:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.543+0000 7f81edcde640 1 -- start start 2024-04-15T01:10:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.544+0000 7f81edcde640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81e8070530 0x7f81e80cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.544+0000 7f81edcde640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e8143a90 con 0x7f81e81436b0 2024-04-15T01:10:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.544+0000 7f81edcde640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e815a5a0 con 0x7f81e8070980 2024-04-15T01:10:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.544+0000 7f81edcde640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f81e815a880 con 0x7f81e8070530 2024-04-15T01:10:56.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.544+0000 7f81e6ffd640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f81e8070530 0x7f81e80cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.545+0000 7f81e7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f81e8070980 0x7f81e815b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:38990/0 (socket says 172.21.15.29:38990) 2024-04-15T01:10:56.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.545+0000 7f81e7fff640 1 -- 172.21.15.29:0/483298306 learned_addr learned my addr 172.21.15.29:0/483298306 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:56.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.547+0000 7f81e67fc640 1 -- 172.21.15.29:0/483298306 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890471742 0 0) 0x7f81e815a5a0 con 0x7f81e8070980 2024-04-15T01:10:56.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.547+0000 7f81e67fc640 1 -- 172.21.15.29:0/483298306 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81d0003520 con 0x7f81e8070980 2024-04-15T01:10:56.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.548+0000 7f81e6ffd640 1 -- 172.21.15.29:0/483298306 >> v1:172.21.15.37:6789/0 conn(0x7f81e8070980 legacy=0x7f81e815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.548+0000 7f81e6ffd640 1 -- 172.21.15.29:0/483298306 >> v1:172.21.15.29:6789/0 conn(0x7f81e81436b0 legacy=0x7f81e815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.548+0000 7f81e6ffd640 1 -- 172.21.15.29:0/483298306 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e815ab60 con 0x7f81e8070530 2024-04-15T01:10:56.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.550+0000 7f81e6ffd640 1 --2- 172.21.15.29:0/483298306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cdbc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097a0 tx=0x7f81dc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a67a134898b1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.555+0000 7f81e67fc640 1 -- 172.21.15.29:0/483298306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc02f810 con 0x7f81e8070530 2024-04-15T01:10:56.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.555+0000 7f81e67fc640 1 -- 172.21.15.29:0/483298306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc02f9b0 con 0x7f81e8070530 2024-04-15T01:10:56.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.555+0000 7f81e67fc640 1 -- 172.21.15.29:0/483298306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc02fd80 con 0x7f81e8070530 2024-04-15T01:10:56.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.555+0000 7f81edcde640 1 -- 172.21.15.29:0/483298306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 msgr2=0x7f81e80cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.556+0000 7f81edcde640 1 --2- 172.21.15.29:0/483298306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cdbc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097a0 tx=0x7f81dc02b9f0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.556+0000 7f81edcde640 1 -- 172.21.15.29:0/483298306 shutdown_connections 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.556+0000 7f81edcde640 1 --2- 172.21.15.29:0/483298306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cdbc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.556+0000 7f81edcde640 1 -- 172.21.15.29:0/483298306 >> 172.21.15.29:0/483298306 conn(0x7f81e8061e00 msgr2=0x7f81e8062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.556+0000 7f81edcde640 1 -- 172.21.15.29:0/483298306 shutdown_connections 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.556+0000 7f81edcde640 1 -- 172.21.15.29:0/483298306 wait complete. 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.557+0000 7f81edcde640 1 Processor -- start 2024-04-15T01:10:56.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.557+0000 7f81edcde640 1 -- start start 2024-04-15T01:10:56.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81edcde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81edcde640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f81e8070980 0x7f81e80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81edcde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e81436b0 0x7f81e80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81edcde640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f81e815c060 con 0x7f81e8070530 2024-04-15T01:10:56.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81edcde640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81e815a2b0 con 0x7f81e81436b0 2024-04-15T01:10:56.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81edcde640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f81e815c1e0 con 0x7f81e8070980 2024-04-15T01:10:56.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.558+0000 7f81e77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.559+0000 7f81e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e81436b0 0x7f81e80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.559+0000 7f81e77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36574/0 (socket says 172.21.15.29:36574) 2024-04-15T01:10:56.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.559+0000 7f81e77fe640 1 -- 172.21.15.29:0/3003416025 learned_addr learned my addr 172.21.15.29:0/3003416025 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:56.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.559+0000 7f81e6ffd640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f81e8070980 0x7f81e80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.562+0000 7f81e77fe640 1 -- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f81e8070980 msgr2=0x7f81e80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.562+0000 7f81e77fe640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f81e8070980 0x7f81e80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.562+0000 7f81e77fe640 1 -- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e81436b0 msgr2=0x7f81e80c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:56.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.562+0000 7f81e77fe640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e81436b0 0x7f81e80c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:56.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.562+0000 7f81e77fe640 1 -- 172.21.15.29:0/3003416025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e813f7d0 con 0x7f81e8070530 2024-04-15T01:10:56.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.564+0000 7f81e77fe640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cab40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c400 tx=0x7f81d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.568+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80052d0 con 0x7f81e8070530 2024-04-15T01:10:56.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.568+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8005490 con 0x7f81e8070530 2024-04-15T01:10:56.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.568+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8007260 con 0x7f81e8070530 2024-04-15T01:10:56.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.568+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e81416c0 con 0x7f81e8070530 2024-04-15T01:10:56.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.568+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e8141c80 con 0x7f81e8070530 2024-04-15T01:10:56.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.569+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e804f540 con 0x7f81e8070530 2024-04-15T01:10:56.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.589+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f81d8007400 con 0x7f81e8070530 2024-04-15T01:10:56.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.589+0000 7f81cffff640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f81d406b9e0 0x7f81d406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.589+0000 7f81e6ffd640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f81d406b9e0 0x7f81d406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.590+0000 7f81e6ffd640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f81d406b9e0 0x7f81d406dea0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81dc036000 tx=0x7f81dc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.591+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f81d8056840 con 0x7f81e8070530 2024-04-15T01:10:56.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:56.854+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f81d80587a0 con 0x7f81e8070530 2024-04-15T01:10:57.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.044+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f81e80cb260 con 0x7f81d406b9e0 2024-04-15T01:10:57.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.045+0000 7f81cffff640 1 -- 172.21.15.29:0/3003416025 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f81dc02f7f0 con 0x7f81d406b9e0 2024-04-15T01:10:57.043 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f81d406b9e0 msgr2=0x7f81d406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f81d406b9e0 0x7f81d406dea0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81dc036000 tx=0x7f81dc008030 comp rx=0 tx=0).stop 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 msgr2=0x7f81e80cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cab40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c400 tx=0x7f81d800c8c0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 shutdown_connections 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f81d406b9e0 0x7f81d406dea0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e81436b0 0x7f81e80c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f81e8070980 0x7f81e80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 --2- 172.21.15.29:0/3003416025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e8070530 0x7f81e80cab40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 >> 172.21.15.29:0/3003416025 conn(0x7f81e8061e00 msgr2=0x7f81e815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 shutdown_connections 2024-04-15T01:10:57.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.047+0000 7f81edcde640 1 -- 172.21.15.29:0/3003416025 wait complete. 2024-04-15T01:10:57.057 INFO:tasks.ceph:Scrubbing osd.4 2024-04-15T01:10:57.057 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:57.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.166+0000 7f9af0436640 1 Processor -- start 2024-04-15T01:10:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.166+0000 7f9af0436640 1 -- start start 2024-04-15T01:10:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.167+0000 7f9af0436640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ae80ce040 0x7f9ae8070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.167+0000 7f9af0436640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ae80ce420 0x7f9ae8070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.167+0000 7f9af0436640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae8158260 con 0x7f9ae80c35e0 2024-04-15T01:10:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.167+0000 7f9af0436640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae8159150 con 0x7f9ae80ce040 2024-04-15T01:10:57.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.167+0000 7f9af0436640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae8158540 con 0x7f9ae80ce420 2024-04-15T01:10:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.167+0000 7f9aee1d2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ae80ce040 0x7f9ae8070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.168+0000 7f9aed9d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ae80ce420 0x7f9ae8070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.168+0000 7f9aee1d2640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9ae80ce040 0x7f9ae8070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36590/0 (socket says 172.21.15.29:36590) 2024-04-15T01:10:57.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.168+0000 7f9aee1d2640 1 -- 172.21.15.29:0/2973641955 learned_addr learned my addr 172.21.15.29:0/2973641955 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:57.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.170+0000 7f9aee1d2640 1 -- 172.21.15.29:0/2973641955 >> v2:172.21.15.37:3300/0 conn(0x7f9ae80ce420 msgr2=0x7f9ae8070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:57.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.170+0000 7f9aee1d2640 1 --2- 172.21.15.29:0/2973641955 >> v2:172.21.15.37:3300/0 conn(0x7f9ae80ce420 0x7f9ae8070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.170+0000 7f9aee1d2640 1 -- 172.21.15.29:0/2973641955 >> v1:172.21.15.37:6789/0 conn(0x7f9ae80c35e0 legacy=0x7f9ae815ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.170+0000 7f9aee1d2640 1 -- 172.21.15.29:0/2973641955 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae8158820 con 0x7f9ae80ce040 2024-04-15T01:10:57.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.172+0000 7f9aee1d2640 1 --2- 172.21.15.29:0/2973641955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae8070590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9ae806fb60 tx=0x7f9ae002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57a9f6ef50b4e8d server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.176+0000 7f9aed1d0640 1 -- 172.21.15.29:0/2973641955 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae002f850 con 0x7f9ae80ce040 2024-04-15T01:10:57.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.176+0000 7f9aed1d0640 1 -- 172.21.15.29:0/2973641955 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae002f9f0 con 0x7f9ae80ce040 2024-04-15T01:10:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.176+0000 7f9aed1d0640 1 -- 172.21.15.29:0/2973641955 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae002fdc0 con 0x7f9ae80ce040 2024-04-15T01:10:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.176+0000 7f9af0436640 1 -- 172.21.15.29:0/2973641955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 msgr2=0x7f9ae8070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.176+0000 7f9af0436640 1 --2- 172.21.15.29:0/2973641955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae8070590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9ae806fb60 tx=0x7f9ae002ba30 comp rx=0 tx=0).stop 2024-04-15T01:10:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.177+0000 7f9af0436640 1 -- 172.21.15.29:0/2973641955 shutdown_connections 2024-04-15T01:10:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.177+0000 7f9af0436640 1 --2- 172.21.15.29:0/2973641955 >> v2:172.21.15.37:3300/0 conn(0x7f9ae80ce420 0x7f9ae8070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.177+0000 7f9af0436640 1 --2- 172.21.15.29:0/2973641955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae8070590 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.177+0000 7f9af0436640 1 -- 172.21.15.29:0/2973641955 >> 172.21.15.29:0/2973641955 conn(0x7f9ae80715a0 msgr2=0x7f9ae80719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.177+0000 7f9af0436640 1 -- 172.21.15.29:0/2973641955 shutdown_connections 2024-04-15T01:10:57.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.177+0000 7f9af0436640 1 -- 172.21.15.29:0/2973641955 wait complete. 2024-04-15T01:10:57.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.178+0000 7f9af0436640 1 Processor -- start 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.178+0000 7f9af0436640 1 -- start start 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9af0436640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae80c35e0 0x7f9ae81f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9af0436640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9af0436640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9ae80ce420 0x7f9ae81575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9af0436640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae815c130 con 0x7f9ae80ce040 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9af0436640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae8158de0 con 0x7f9ae80c35e0 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9af0436640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae815c2b0 con 0x7f9ae80ce420 2024-04-15T01:10:57.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.179+0000 7f9aed9d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.180+0000 7f9aee1d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae80c35e0 0x7f9ae81f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.180+0000 7f9aee9d3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9ae80ce420 0x7f9ae81575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.180+0000 7f9aed9d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae814dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36602/0 (socket says 172.21.15.29:36602) 2024-04-15T01:10:57.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.180+0000 7f9aed9d1640 1 -- 172.21.15.29:0/2504746901 learned_addr learned my addr 172.21.15.29:0/2504746901 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.183+0000 7f9aed9d1640 1 -- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9ae80ce420 msgr2=0x7f9ae81575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.183+0000 7f9aed9d1640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9ae80ce420 0x7f9ae81575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.183+0000 7f9aed9d1640 1 -- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae80c35e0 msgr2=0x7f9ae81f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.183+0000 7f9aed9d1640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae80c35e0 0x7f9ae81f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.183+0000 7f9aed9d1640 1 -- 172.21.15.29:0/2504746901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae80ada20 con 0x7f9ae80ce040 2024-04-15T01:10:57.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.186+0000 7f9aed9d1640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae814dfb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800e9b0 tx=0x7f9ad800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.190+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8017070 con 0x7f9ae80ce040 2024-04-15T01:10:57.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.190+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad800c9a0 con 0x7f9ae80ce040 2024-04-15T01:10:57.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.190+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae80b2600 con 0x7f9ae80ce040 2024-04-15T01:10:57.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.190+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800cd90 con 0x7f9ae80ce040 2024-04-15T01:10:57.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.190+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae80b2bc0 con 0x7f9ae80ce040 2024-04-15T01:10:57.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.190+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ae814db90 con 0x7f9ae80ce040 2024-04-15T01:10:57.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.214+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9ad801a070 con 0x7f9ae80ce040 2024-04-15T01:10:57.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.214+0000 7f9adeffd640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9acc06b9e0 0x7f9acc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.215+0000 7f9aee1d2640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9acc06b9e0 0x7f9acc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.215+0000 7f9aee1d2640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9acc06b9e0 0x7f9acc06dea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0036000 tx=0x7f9ae0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.219+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f9ad80575d0 con 0x7f9ae80ce040 2024-04-15T01:10:57.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.219+0000 7f9adeffd640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f9acc0753f0 0x7f9acc077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.219+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 --> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9acc077f60 con 0x7f9acc0753f0 2024-04-15T01:10:57.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.219+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9ad80557d0 con 0x7f9ae80ce040 2024-04-15T01:10:57.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.220+0000 7f9aee9d3640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f9acc0753f0 0x7f9acc077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.220+0000 7f9aee9d3640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f9acc0753f0 0x7f9acc077890 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.221+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== osd.4 v2:172.21.15.37:6802/3398267610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9acc077f60 con 0x7f9acc0753f0 2024-04-15T01:10:57.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.234+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 --> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9ae804f540 con 0x7f9acc0753f0 2024-04-15T01:10:57.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9adeffd640 1 -- 172.21.15.29:0/2504746901 <== osd.4 v2:172.21.15.37:6802/3398267610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9ae804f540 con 0x7f9acc0753f0 2024-04-15T01:10:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:57.234 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:57.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f9acc0753f0 msgr2=0x7f9acc077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6802/3398267610,v1:172.21.15.37:6803/3398267610] conn(0x7f9acc0753f0 0x7f9acc077890 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9acc06b9e0 msgr2=0x7f9acc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f9acc06b9e0 0x7f9acc06dea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0036000 tx=0x7f9ae0008030 comp rx=0 tx=0).stop 2024-04-15T01:10:57.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 msgr2=0x7f9ae814dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 --2- 172.21.15.29:0/2504746901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ae80ce040 0x7f9ae814dfb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800e9b0 tx=0x7f9ad800ee70 comp rx=0 tx=0).stop 2024-04-15T01:10:57.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9aee9d3640 1 -- 172.21.15.29:0/2504746901 reap_dead start 2024-04-15T01:10:57.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 shutdown_connections 2024-04-15T01:10:57.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 >> 172.21.15.29:0/2504746901 conn(0x7f9ae80715a0 msgr2=0x7f9ae8070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:57.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 shutdown_connections 2024-04-15T01:10:57.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.235+0000 7f9af0436640 1 -- 172.21.15.29:0/2504746901 wait complete. 2024-04-15T01:10:57.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-15T01:10:57.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.352+0000 7ff794b68640 1 Processor -- start 2024-04-15T01:10:57.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.352+0000 7ff794b68640 1 -- start start 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff794b68640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7900c4930 0x7ff7900c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff794b68640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff790072cd0 0x7ff7900c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff794b68640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7900c5870 con 0x7ff7901511a0 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff794b68640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7ff7900c5b50 con 0x7ff790072cd0 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff794b68640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff7900c2cf0 con 0x7ff7900c4930 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff787fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7900c4930 0x7ff7900c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.353+0000 7ff78ed9d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff790072cd0 0x7ff7900c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.354+0000 7ff787fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7900c4930 0x7ff7900c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39438/0 (socket says 172.21.15.29:39438) 2024-04-15T01:10:57.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.354+0000 7ff787fff640 1 -- 172.21.15.29:0/483291707 learned_addr learned my addr 172.21.15.29:0/483291707 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.356+0000 7ff78ed9d640 1 -- 172.21.15.29:0/483291707 >> v2:172.21.15.37:3300/0 conn(0x7ff7900c4930 msgr2=0x7ff7900c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.356+0000 7ff78ed9d640 1 --2- 172.21.15.29:0/483291707 >> v2:172.21.15.37:3300/0 conn(0x7ff7900c4930 0x7ff7900c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.356+0000 7ff78ed9d640 1 -- 172.21.15.29:0/483291707 >> v1:172.21.15.37:6789/0 conn(0x7ff7901511a0 legacy=0x7ff7900c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.356+0000 7ff78ed9d640 1 -- 172.21.15.29:0/483291707 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7900c2fd0 con 0x7ff790072cd0 2024-04-15T01:10:57.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.358+0000 7ff78ed9d640 1 --2- 172.21.15.29:0/483291707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff790072cd0 0x7ff7900c8720 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7900c4340 tx=0x7ff78802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cbf30d0a5536f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff78dd9b640 1 -- 172.21.15.29:0/483291707 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788039070 con 0x7ff790072cd0 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff78dd9b640 1 -- 172.21.15.29:0/483291707 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78802cc80 con 0x7ff790072cd0 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff78dd9b640 1 -- 172.21.15.29:0/483291707 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788034660 con 0x7ff790072cd0 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 -- 172.21.15.29:0/483291707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff790072cd0 msgr2=0x7ff7900c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 --2- 172.21.15.29:0/483291707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff790072cd0 0x7ff7900c8720 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7900c4340 tx=0x7ff78802bed0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 -- 172.21.15.29:0/483291707 shutdown_connections 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 --2- 172.21.15.29:0/483291707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff790072cd0 0x7ff7900c8720 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 --2- 172.21.15.29:0/483291707 >> v2:172.21.15.37:3300/0 conn(0x7ff7900c4930 0x7ff7900c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 -- 172.21.15.29:0/483291707 >> 172.21.15.29:0/483291707 conn(0x7ff79006fca0 msgr2=0x7ff79006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 -- 172.21.15.29:0/483291707 shutdown_connections 2024-04-15T01:10:57.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.362+0000 7ff794b68640 1 -- 172.21.15.29:0/483291707 wait complete. 2024-04-15T01:10:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 Processor -- start 2024-04-15T01:10:57.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 -- start start 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff790072cd0 0x7ff79013d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 0x7ff7900c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff7901511a0 0x7ff79013c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff790151580 con 0x7ff7900c4930 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900c3590 con 0x7ff790072cd0 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.364+0000 7ff794b68640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff790151700 con 0x7ff7901511a0 2024-04-15T01:10:57.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.365+0000 7ff787fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 0x7ff7900c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.365+0000 7ff787fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 0x7ff7900c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36620/0 (socket says 172.21.15.29:36620) 2024-04-15T01:10:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.365+0000 7ff787fff640 1 -- 172.21.15.29:0/866398178 learned_addr learned my addr 172.21.15.29:0/866398178 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.365+0000 7ff78e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff790072cd0 0x7ff79013d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.365+0000 7ff78ed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff7901511a0 0x7ff79013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.368+0000 7ff787fff640 1 -- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff7901511a0 msgr2=0x7ff79013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.368+0000 7ff787fff640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff7901511a0 0x7ff79013c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.368+0000 7ff787fff640 1 -- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff790072cd0 msgr2=0x7ff79013d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.368+0000 7ff787fff640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff790072cd0 0x7ff79013d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.368+0000 7ff787fff640 1 -- 172.21.15.29:0/866398178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7901e1ce0 con 0x7ff7900c4930 2024-04-15T01:10:57.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.371+0000 7ff787fff640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 0x7ff7900c1830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff77800e8e0 tx=0x7ff77800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.374+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778017070 con 0x7ff7900c4930 2024-04-15T01:10:57.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.374+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77800c940 con 0x7ff7900c4930 2024-04-15T01:10:57.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.374+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7901e1fc0 con 0x7ff7900c4930 2024-04-15T01:10:57.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.374+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800cd30 con 0x7ff7900c4930 2024-04-15T01:10:57.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.375+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7901e2580 con 0x7ff7900c4930 2024-04-15T01:10:57.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.375+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79004f540 con 0x7ff7900c4930 2024-04-15T01:10:57.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.643+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff77801a070 con 0x7ff7900c4930 2024-04-15T01:10:57.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.644+0000 7ff786ffd640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff77006b9e0 0x7ff77006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.644+0000 7ff78e59c640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff77006b9e0 0x7ff77006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.645+0000 7ff78e59c640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff77006b9e0 0x7ff77006dea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff7800016e0 tx=0x7ff780009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.657+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff778057660 con 0x7ff7900c4930 2024-04-15T01:10:57.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.657+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff7780595c0 con 0x7ff7900c4930 2024-04-15T01:10:57.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.848+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff7900c26c0 con 0x7ff77006b9e0 2024-04-15T01:10:57.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.849+0000 7ff786ffd640 1 -- 172.21.15.29:0/866398178 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7900c26c0 con 0x7ff77006b9e0 2024-04-15T01:10:57.847 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff77006b9e0 msgr2=0x7ff77006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff77006b9e0 0x7ff77006dea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff7800016e0 tx=0x7ff780009040 comp rx=0 tx=0).stop 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 msgr2=0x7ff7900c1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 0x7ff7900c1830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff77800e8e0 tx=0x7ff77800eda0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 shutdown_connections 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff77006b9e0 0x7ff77006dea0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff7901511a0 0x7ff79013c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7900c4930 0x7ff7900c1830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 --2- 172.21.15.29:0/866398178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff790072cd0 0x7ff79013d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 >> 172.21.15.29:0/866398178 conn(0x7ff79006fca0 msgr2=0x7ff7901401c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:57.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 shutdown_connections 2024-04-15T01:10:57.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.851+0000 7ff794b68640 1 -- 172.21.15.29:0/866398178 wait complete. 2024-04-15T01:10:57.861 INFO:tasks.ceph:Scrubbing osd.5 2024-04-15T01:10:57.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:57.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.970+0000 7fe07ec0f640 1 Processor -- start 2024-04-15T01:10:57.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.970+0000 7fe07ec0f640 1 -- start start 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.971+0000 7fe07ec0f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0781547f0 0x7fe0780ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.971+0000 7fe07ec0f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe07806d760 0x7fe07815a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.971+0000 7fe07ec0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.971+0000 7fe07ec0f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fe07815b370 con 0x7fe0781547f0 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.971+0000 7fe07ec0f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe0780ccb20 con 0x7fe07806d760 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.971+0000 7fe07ec0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe078154bd0 con 0x7fe0780cdfe0 2024-04-15T01:10:57.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.972+0000 7fe07c9ab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0781547f0 0x7fe0780ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.972+0000 7fe07d1ac640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.972+0000 7fe07c9ab640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0781547f0 0x7fe0780ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36622/0 (socket says 172.21.15.29:36622) 2024-04-15T01:10:57.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.972+0000 7fe07c9ab640 1 -- 172.21.15.29:0/2299664635 learned_addr learned my addr 172.21.15.29:0/2299664635 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:57.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.972+0000 7fe077fff640 1 --2- 172.21.15.29:0/2299664635 >> v2:172.21.15.37:3300/0 conn(0x7fe07806d760 0x7fe07815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.974+0000 7fe07c9ab640 1 -- 172.21.15.29:0/2299664635 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 msgr2=0x7fe0780ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:57.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.974+0000 7fe07c9ab640 1 --2- 172.21.15.29:0/2299664635 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.974+0000 7fe07c9ab640 1 -- 172.21.15.29:0/2299664635 >> v2:172.21.15.37:3300/0 conn(0x7fe07806d760 msgr2=0x7fe07815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:57.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.974+0000 7fe07c9ab640 1 --2- 172.21.15.29:0/2299664635 >> v2:172.21.15.37:3300/0 conn(0x7fe07806d760 0x7fe07815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.974+0000 7fe07c9ab640 1 -- 172.21.15.29:0/2299664635 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07815adb0 con 0x7fe0781547f0 2024-04-15T01:10:57.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.976+0000 7fe07c9ab640 1 --2- 172.21.15.29:0/2299664635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0781547f0 0x7fe0780ccfb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0780ca190 tx=0x7fe07002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d674f535574cae6f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe0777fe640 1 -- 172.21.15.29:0/2299664635 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07002cb00 con 0x7fe0781547f0 2024-04-15T01:10:57.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe0777fe640 1 -- 172.21.15.29:0/2299664635 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07002cca0 con 0x7fe0781547f0 2024-04-15T01:10:57.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe0777fe640 1 -- 172.21.15.29:0/2299664635 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070034610 con 0x7fe0781547f0 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2299664635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0781547f0 msgr2=0x7fe0780ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2299664635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0781547f0 0x7fe0780ccfb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0780ca190 tx=0x7fe07002bf60 comp rx=0 tx=0).stop 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2299664635 shutdown_connections 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2299664635 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2299664635 >> v2:172.21.15.37:3300/0 conn(0x7fe07806d760 0x7fe07815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2299664635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0781547f0 0x7fe0780ccfb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2299664635 >> 172.21.15.29:0/2299664635 conn(0x7fe078061c20 msgr2=0x7fe078062030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:57.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2299664635 shutdown_connections 2024-04-15T01:10:57.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.980+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2299664635 wait complete. 2024-04-15T01:10:57.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.982+0000 7fe07ec0f640 1 Processor -- start 2024-04-15T01:10:57.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.982+0000 7fe07ec0f640 1 -- start start 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07ec0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe07806d760 0x7fe078157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07ec0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07ec0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0781547f0 0x7fe07814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07ec0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe0780cc7b0 con 0x7fe07806d760 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07ec0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0780cc4d0 con 0x7fe0781547f0 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07ec0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe07806dbf0 con 0x7fe0780cdfe0 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07c9ab640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe07806d760 0x7fe078157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe077fff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.983+0000 7fe07d1ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0781547f0 0x7fe07814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.984+0000 7fe07d1ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0781547f0 0x7fe07814fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39476/0 (socket says 172.21.15.29:39476) 2024-04-15T01:10:57.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.984+0000 7fe07d1ac640 1 -- 172.21.15.29:0/2535021201 learned_addr learned my addr 172.21.15.29:0/2535021201 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.987+0000 7fe07d1ac640 1 -- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 msgr2=0x7fe0780c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.987+0000 7fe07d1ac640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe0780cdfe0 0x7fe0780c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.987+0000 7fe07d1ac640 1 -- 172.21.15.29:0/2535021201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe07806d760 msgr2=0x7fe078157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.987+0000 7fe07d1ac640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe07806d760 0x7fe078157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.987+0000 7fe07d1ac640 1 -- 172.21.15.29:0/2535021201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0780c88e0 con 0x7fe0781547f0 2024-04-15T01:10:57.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.987+0000 7fe07c9ab640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe07806d760 0x7fe078157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-15T01:10:57.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.990+0000 7fe07d1ac640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0781547f0 0x7fe07814fef0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe06000e930 tx=0x7fe06000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.994+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060017070 con 0x7fe0781547f0 2024-04-15T01:10:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.994+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06000c980 con 0x7fe0781547f0 2024-04-15T01:10:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.994+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06000cd70 con 0x7fe0781547f0 2024-04-15T01:10:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.994+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0780c8320 con 0x7fe0781547f0 2024-04-15T01:10:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.994+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0780c4200 con 0x7fe0781547f0 2024-04-15T01:10:57.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:57.995+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe07804f540 con 0x7fe0781547f0 2024-04-15T01:10:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.015+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe06001a070 con 0x7fe0781547f0 2024-04-15T01:10:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.016+0000 7fe0757fa640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe05806ba10 0x7fe05806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.016+0000 7fe07c9ab640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe05806ba10 0x7fe05806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.016+0000 7fe07c9ab640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe05806ba10 0x7fe05806ded0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe070035000 tx=0x7fe070030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.021+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe060057540 con 0x7fe0781547f0 2024-04-15T01:10:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.021+0000 7fe0757fa640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7fe0580753a0 0x7fe058077840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.021+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 --> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe060013e50 con 0x7fe0580753a0 2024-04-15T01:10:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.021+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe060055740 con 0x7fe0781547f0 2024-04-15T01:10:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.021+0000 7fe077fff640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7fe0580753a0 0x7fe058077840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.022+0000 7fe077fff640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7fe0580753a0 0x7fe058077840 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.022+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== osd.5 v2:172.21.15.37:6826/3779753926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe060013e50 con 0x7fe0580753a0 2024-04-15T01:10:58.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.038+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 --> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe078157390 con 0x7fe0580753a0 2024-04-15T01:10:58.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.038+0000 7fe0757fa640 1 -- 172.21.15.29:0/2535021201 <== osd.5 v2:172.21.15.37:6826/3779753926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe078157390 con 0x7fe0580753a0 2024-04-15T01:10:58.037 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:58.037 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:58.037 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.038+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7fe0580753a0 msgr2=0x7fe058077840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.038+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6826/3779753926,v1:172.21.15.37:6827/3779753926] conn(0x7fe0580753a0 0x7fe058077840 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe05806ba10 msgr2=0x7fe05806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe05806ba10 0x7fe05806ded0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe070035000 tx=0x7fe070030000 comp rx=0 tx=0).stop 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0781547f0 msgr2=0x7fe07814fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 --2- 172.21.15.29:0/2535021201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0781547f0 0x7fe07814fef0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe06000e930 tx=0x7fe06000edf0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07d1ac640 1 -- 172.21.15.29:0/2535021201 reap_dead start 2024-04-15T01:10:58.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 shutdown_connections 2024-04-15T01:10:58.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 >> 172.21.15.29:0/2535021201 conn(0x7fe078061c20 msgr2=0x7fe078152010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:58.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 shutdown_connections 2024-04-15T01:10:58.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.039+0000 7fe07ec0f640 1 -- 172.21.15.29:0/2535021201 wait complete. 2024-04-15T01:10:58.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-15T01:10:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.156+0000 7fa14e5e0640 1 Processor -- start 2024-04-15T01:10:58.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.156+0000 7fa14e5e0640 1 -- start start 2024-04-15T01:10:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa14e5e0640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1480ce0d0 0x7fa1480cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa14e5e0640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa148154cb0 con 0x7fa14806c420 2024-04-15T01:10:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa14e5e0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1480d0870 con 0x7fa1481548d0 2024-04-15T01:10:58.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa14e5e0640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fa1480cee70 con 0x7fa1480ce0d0 2024-04-15T01:10:58.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa14cb7d640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1480ce0d0 0x7fa1480cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa147fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa1481548d0 0x7fa14815aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:39024/0 (socket says 172.21.15.29:39024) 2024-04-15T01:10:58.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.157+0000 7fa147fff640 1 -- 172.21.15.29:0/923591954 learned_addr learned my addr 172.21.15.29:0/923591954 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:58.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.159+0000 7fa146ffd640 1 -- 172.21.15.29:0/923591954 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516855749 0 0) 0x7fa1480d0870 con 0x7fa1481548d0 2024-04-15T01:10:58.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.159+0000 7fa146ffd640 1 -- 172.21.15.29:0/923591954 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa130003520 con 0x7fa1481548d0 2024-04-15T01:10:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.161+0000 7fa14cb7d640 1 -- 172.21.15.29:0/923591954 >> v1:172.21.15.37:6789/0 conn(0x7fa1481548d0 legacy=0x7fa14815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.161+0000 7fa14cb7d640 1 -- 172.21.15.29:0/923591954 >> v1:172.21.15.29:6789/0 conn(0x7fa14806c420 legacy=0x7fa1480cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.161+0000 7fa14cb7d640 1 -- 172.21.15.29:0/923591954 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14815a720 con 0x7fa1480ce0d0 2024-04-15T01:10:58.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.163+0000 7fa14cb7d640 1 --2- 172.21.15.29:0/923591954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1480ce0d0 0x7fa1480cc4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa140009d90 tx=0x7fa14002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e847b11dd6af6c server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.169+0000 7fa146ffd640 1 -- 172.21.15.29:0/923591954 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140039070 con 0x7fa1480ce0d0 2024-04-15T01:10:58.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.169+0000 7fa146ffd640 1 -- 172.21.15.29:0/923591954 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14002cd80 con 0x7fa1480ce0d0 2024-04-15T01:10:58.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.169+0000 7fa146ffd640 1 -- 172.21.15.29:0/923591954 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140034660 con 0x7fa1480ce0d0 2024-04-15T01:10:58.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 -- 172.21.15.29:0/923591954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1480ce0d0 msgr2=0x7fa1480cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/923591954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1480ce0d0 0x7fa1480cc4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa140009d90 tx=0x7fa14002bfd0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 -- 172.21.15.29:0/923591954 shutdown_connections 2024-04-15T01:10:58.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/923591954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1480ce0d0 0x7fa1480cc4a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 -- 172.21.15.29:0/923591954 >> 172.21.15.29:0/923591954 conn(0x7fa1480cfb00 msgr2=0x7fa1480cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 -- 172.21.15.29:0/923591954 shutdown_connections 2024-04-15T01:10:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.170+0000 7fa14e5e0640 1 -- 172.21.15.29:0/923591954 wait complete. 2024-04-15T01:10:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.172+0000 7fa14e5e0640 1 Processor -- start 2024-04-15T01:10:58.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.172+0000 7fa14e5e0640 1 -- start start 2024-04-15T01:10:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14e5e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa14806c420 0x7fa1481505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14e5e0640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa1480ce0d0 0x7fa14814be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14e5e0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1481548d0 0x7fa14814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14e5e0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa1480ceb90 con 0x7fa1481548d0 2024-04-15T01:10:58.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14e5e0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1480ce8b0 con 0x7fa14806c420 2024-04-15T01:10:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14e5e0640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fa14815a9c0 con 0x7fa1480ce0d0 2024-04-15T01:10:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa147fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa14806c420 0x7fa1481505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.173+0000 7fa14cb7d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1481548d0 0x7fa14814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.174+0000 7fa147fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa14806c420 0x7fa1481505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39478/0 (socket says 172.21.15.29:39478) 2024-04-15T01:10:58.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.174+0000 7fa147fff640 1 -- 172.21.15.29:0/479543807 learned_addr learned my addr 172.21.15.29:0/479543807 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:58.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.175+0000 7fa1477fe640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa1480ce0d0 0x7fa14814be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.178+0000 7fa14cb7d640 1 -- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa1480ce0d0 msgr2=0x7fa14814be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.178+0000 7fa14cb7d640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa1480ce0d0 0x7fa14814be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.178+0000 7fa14cb7d640 1 -- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa14806c420 msgr2=0x7fa1481505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.178+0000 7fa14cb7d640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa14806c420 0x7fa1481505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.178+0000 7fa14cb7d640 1 -- 172.21.15.29:0/479543807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1481517b0 con 0x7fa1481548d0 2024-04-15T01:10:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.180+0000 7fa14cb7d640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1481548d0 0x7fa14814c3b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa1480c3410 tx=0x7fa140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.184+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140044020 con 0x7fa1481548d0 2024-04-15T01:10:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.184+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14003f470 con 0x7fa1481548d0 2024-04-15T01:10:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.184+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140039040 con 0x7fa1481548d0 2024-04-15T01:10:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.184+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa148150f10 con 0x7fa1481548d0 2024-04-15T01:10:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.184+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1481514d0 con 0x7fa1481548d0 2024-04-15T01:10:58.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.185+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14804f540 con 0x7fa1481548d0 2024-04-15T01:10:58.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.205+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa140047020 con 0x7fa1481548d0 2024-04-15T01:10:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.205+0000 7fa144ff9640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa13406b9e0 0x7fa13406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.206+0000 7fa147fff640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa13406b9e0 0x7fa13406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.206+0000 7fa147fff640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa13406b9e0 0x7fa13406dea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa138005880 tx=0x7fa138009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.468+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fa140079b70 con 0x7fa1481548d0 2024-04-15T01:10:58.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.468+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa14004e030 con 0x7fa1481548d0 2024-04-15T01:10:58.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.653+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa14806e000 con 0x7fa13406b9e0 2024-04-15T01:10:58.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.653+0000 7fa144ff9640 1 -- 172.21.15.29:0/479543807 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa14806e000 con 0x7fa13406b9e0 2024-04-15T01:10:58.652 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2024-04-15T01:10:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa13406b9e0 msgr2=0x7fa13406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa13406b9e0 0x7fa13406dea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa138005880 tx=0x7fa138009040 comp rx=0 tx=0).stop 2024-04-15T01:10:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1481548d0 msgr2=0x7fa14814c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1481548d0 0x7fa14814c3b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa1480c3410 tx=0x7fa140004a40 comp rx=0 tx=0).stop 2024-04-15T01:10:58.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 shutdown_connections 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fa13406b9e0 0x7fa13406dea0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1481548d0 0x7fa14814c3b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fa1480ce0d0 0x7fa14814be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 --2- 172.21.15.29:0/479543807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa14806c420 0x7fa1481505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.655+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 >> 172.21.15.29:0/479543807 conn(0x7fa1480cfb00 msgr2=0x7fa1480b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.656+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 shutdown_connections 2024-04-15T01:10:58.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.656+0000 7fa14e5e0640 1 -- 172.21.15.29:0/479543807 wait complete. 2024-04-15T01:10:58.665 INFO:tasks.ceph:Scrubbing osd.6 2024-04-15T01:10:58.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:58.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.774+0000 7f78f1069640 1 Processor -- start 2024-04-15T01:10:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.774+0000 7f78f1069640 1 -- start start 2024-04-15T01:10:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.775+0000 7f78f1069640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78ec0715c0 0x7f78ec15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.775+0000 7f78f1069640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec15b1d0 0x7f78ec0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.775+0000 7f78f1069640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ec0c3810 con 0x7f78ec1402c0 2024-04-15T01:10:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.775+0000 7f78f1069640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f78ec15a800 con 0x7f78ec0715c0 2024-04-15T01:10:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.775+0000 7f78f1069640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec0c50a0 con 0x7f78ec15b1d0 2024-04-15T01:10:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.776+0000 7f78ea59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78ec0715c0 0x7f78ec15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.776+0000 7f78eb59e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec15b1d0 0x7f78ec0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.776+0000 7f78ea59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78ec0715c0 0x7f78ec15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39480/0 (socket says 172.21.15.29:39480) 2024-04-15T01:10:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.776+0000 7f78ea59c640 1 -- 172.21.15.29:0/1400932636 learned_addr learned my addr 172.21.15.29:0/1400932636 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:58.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.779+0000 7f78eb59e640 1 -- 172.21.15.29:0/1400932636 >> v2:172.21.15.37:3300/0 conn(0x7f78ec0715c0 msgr2=0x7f78ec15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:58.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.779+0000 7f78eb59e640 1 --2- 172.21.15.29:0/1400932636 >> v2:172.21.15.37:3300/0 conn(0x7f78ec0715c0 0x7f78ec15ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.779+0000 7f78eb59e640 1 -- 172.21.15.29:0/1400932636 >> v1:172.21.15.37:6789/0 conn(0x7f78ec1402c0 legacy=0x7f78ec0c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:58.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.779+0000 7f78eb59e640 1 -- 172.21.15.29:0/1400932636 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec0c5380 con 0x7f78ec15b1d0 2024-04-15T01:10:58.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.782+0000 7f78eb59e640 1 --2- 172.21.15.29:0/1400932636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec15b1d0 0x7f78ec0c8390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009d90 tx=0x7f78dc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b934a10877a0b11f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78e9d9b640 1 -- 172.21.15.29:0/1400932636 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc039070 con 0x7f78ec15b1d0 2024-04-15T01:10:58.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78e9d9b640 1 -- 172.21.15.29:0/1400932636 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78dc02cbc0 con 0x7f78ec15b1d0 2024-04-15T01:10:58.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78e9d9b640 1 -- 172.21.15.29:0/1400932636 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc034440 con 0x7f78ec15b1d0 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 -- 172.21.15.29:0/1400932636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec15b1d0 msgr2=0x7f78ec0c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 --2- 172.21.15.29:0/1400932636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec15b1d0 0x7f78ec0c8390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009d90 tx=0x7f78dc02be10 comp rx=0 tx=0).stop 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 -- 172.21.15.29:0/1400932636 shutdown_connections 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 --2- 172.21.15.29:0/1400932636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec15b1d0 0x7f78ec0c8390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 --2- 172.21.15.29:0/1400932636 >> v2:172.21.15.37:3300/0 conn(0x7f78ec0715c0 0x7f78ec15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 -- 172.21.15.29:0/1400932636 >> 172.21.15.29:0/1400932636 conn(0x7f78ec06b3e0 msgr2=0x7f78ec06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 -- 172.21.15.29:0/1400932636 shutdown_connections 2024-04-15T01:10:58.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.787+0000 7f78f1069640 1 -- 172.21.15.29:0/1400932636 wait complete. 2024-04-15T01:10:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 Processor -- start 2024-04-15T01:10:58.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 -- start start 2024-04-15T01:10:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78ec0715c0 0x7f78ec153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec1402c0 0x7f78ec1ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78ec15b1d0 0x7f78ec0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec0c4d40 con 0x7f78ec15b1d0 2024-04-15T01:10:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec0c5940 con 0x7f78ec0715c0 2024-04-15T01:10:58.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.789+0000 7f78f1069640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec1406a0 con 0x7f78ec1402c0 2024-04-15T01:10:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.790+0000 7f78eb59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78ec15b1d0 0x7f78ec0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.790+0000 7f78ead9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78ec0715c0 0x7f78ec153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.790+0000 7f78ea59c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec1402c0 0x7f78ec1ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.791+0000 7f78ead9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78ec0715c0 0x7f78ec153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39492/0 (socket says 172.21.15.29:39492) 2024-04-15T01:10:58.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.791+0000 7f78ead9d640 1 -- 172.21.15.29:0/3288873869 learned_addr learned my addr 172.21.15.29:0/3288873869 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:58.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.795+0000 7f78eb59e640 1 -- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec1402c0 msgr2=0x7f78ec1ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.795+0000 7f78eb59e640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78ec1402c0 0x7f78ec1ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.795+0000 7f78eb59e640 1 -- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78ec0715c0 msgr2=0x7f78ec153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.795+0000 7f78eb59e640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78ec0715c0 0x7f78ec153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.795+0000 7f78eb59e640 1 -- 172.21.15.29:0/3288873869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec155d60 con 0x7f78ec15b1d0 2024-04-15T01:10:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.797+0000 7f78eb59e640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78ec15b1d0 0x7f78ec0cba10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78ec15a980 tx=0x7f78dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.801+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc044020 con 0x7f78ec15b1d0 2024-04-15T01:10:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.801+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78dc03f470 con 0x7f78ec15b1d0 2024-04-15T01:10:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.801+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc039040 con 0x7f78ec15b1d0 2024-04-15T01:10:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.801+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec1544e0 con 0x7f78ec15b1d0 2024-04-15T01:10:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.801+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec154aa0 con 0x7f78ec15b1d0 2024-04-15T01:10:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.802+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78ec0c4110 con 0x7f78ec15b1d0 2024-04-15T01:10:58.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.821+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f78dc047020 con 0x7f78ec15b1d0 2024-04-15T01:10:58.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.822+0000 7f78d37fe640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f78d806b9e0 0x7f78d806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.822+0000 7f78ead9d640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f78d806b9e0 0x7f78d806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.823+0000 7f78ead9d640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f78d806b9e0 0x7f78d806dea0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78e4005020 tx=0x7f78e4007ef0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.826+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f78dc079ce0 con 0x7f78ec15b1d0 2024-04-15T01:10:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.826+0000 7f78d37fe640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f78d8075400 0x7f78d80778a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.826+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 --> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78dc0020b0 con 0x7f78d8075400 2024-04-15T01:10:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.826+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f78dc077ee0 con 0x7f78ec15b1d0 2024-04-15T01:10:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.826+0000 7f78ea59c640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f78d8075400 0x7f78d80778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.827+0000 7f78ea59c640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f78d8075400 0x7f78d80778a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.828+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== osd.6 v2:172.21.15.37:6811/4118171972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78dc0020b0 con 0x7f78d8075400 2024-04-15T01:10:58.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.841+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 --> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f78ec04f540 con 0x7f78d8075400 2024-04-15T01:10:58.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78d37fe640 1 -- 172.21.15.29:0/3288873869 <== osd.6 v2:172.21.15.37:6811/4118171972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f78ec04f540 con 0x7f78d8075400 2024-04-15T01:10:58.840 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:58.840 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:58.840 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:58.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f78d8075400 msgr2=0x7f78d80778a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6811/4118171972,v1:172.21.15.37:6813/4118171972] conn(0x7f78d8075400 0x7f78d80778a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f78d806b9e0 msgr2=0x7f78d806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f78d806b9e0 0x7f78d806dea0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78e4005020 tx=0x7f78e4007ef0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78ec15b1d0 msgr2=0x7f78ec0cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 --2- 172.21.15.29:0/3288873869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78ec15b1d0 0x7f78ec0cba10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78ec15a980 tx=0x7f78dc004a40 comp rx=0 tx=0).stop 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78eb59e640 1 -- 172.21.15.29:0/3288873869 reap_dead start 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 shutdown_connections 2024-04-15T01:10:58.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 >> 172.21.15.29:0/3288873869 conn(0x7f78ec06b3e0 msgr2=0x7f78ec156750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:58.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 shutdown_connections 2024-04-15T01:10:58.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.842+0000 7f78f1069640 1 -- 172.21.15.29:0/3288873869 wait complete. 2024-04-15T01:10:58.854 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-15T01:10:58.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.960+0000 7f3899076640 1 Processor -- start 2024-04-15T01:10:58.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.960+0000 7f3899076640 1 -- start start 2024-04-15T01:10:58.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.961+0000 7f3899076640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f38940cc530 0x7f38940cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.961+0000 7f3899076640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38940cdff0 0x7f38940ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.961+0000 7f3899076640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38940cf910 con 0x7f389415b110 2024-04-15T01:10:58.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.961+0000 7f3899076640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f38940cf350 con 0x7f38940cdff0 2024-04-15T01:10:58.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.961+0000 7f3899076640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f38940cf630 con 0x7f38940cc530 2024-04-15T01:10:58.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.962+0000 7f389359e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38940cdff0 0x7f38940ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.962+0000 7f3892d9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f38940cc530 0x7f38940cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.962+0000 7f389359e640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38940cdff0 0x7f38940ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36674/0 (socket says 172.21.15.29:36674) 2024-04-15T01:10:58.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.962+0000 7f389359e640 1 -- 172.21.15.29:0/46334667 learned_addr learned my addr 172.21.15.29:0/46334667 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:58.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.965+0000 7f389359e640 1 -- 172.21.15.29:0/46334667 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f38940cc530 msgr2=0x7f38940cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:58.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.965+0000 7f389359e640 1 --2- 172.21.15.29:0/46334667 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f38940cc530 0x7f38940cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.965+0000 7f389359e640 1 -- 172.21.15.29:0/46334667 >> v1:172.21.15.29:6789/0 conn(0x7f389415b110 legacy=0x7f389406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.965+0000 7f389359e640 1 -- 172.21.15.29:0/46334667 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389415a630 con 0x7f38940cdff0 2024-04-15T01:10:58.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.967+0000 7f389359e640 1 --2- 172.21.15.29:0/46334667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cdff0 0x7f38940ce420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3884009e50 tx=0x7f388402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f538076a0e01304f server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.972+0000 7f3891d9b640 1 -- 172.21.15.29:0/46334667 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388402cb00 con 0x7f38940cdff0 2024-04-15T01:10:58.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.972+0000 7f3891d9b640 1 -- 172.21.15.29:0/46334667 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388402cca0 con 0x7f38940cdff0 2024-04-15T01:10:58.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.972+0000 7f3891d9b640 1 -- 172.21.15.29:0/46334667 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884034610 con 0x7f38940cdff0 2024-04-15T01:10:58.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 -- 172.21.15.29:0/46334667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cdff0 msgr2=0x7f38940ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 --2- 172.21.15.29:0/46334667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cdff0 0x7f38940ce420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3884009e50 tx=0x7f388402bf60 comp rx=0 tx=0).stop 2024-04-15T01:10:58.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 -- 172.21.15.29:0/46334667 shutdown_connections 2024-04-15T01:10:58.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 --2- 172.21.15.29:0/46334667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cdff0 0x7f38940ce420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 --2- 172.21.15.29:0/46334667 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f38940cc530 0x7f38940cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 -- 172.21.15.29:0/46334667 >> 172.21.15.29:0/46334667 conn(0x7f38940cfb20 msgr2=0x7f38940cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:58.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 -- 172.21.15.29:0/46334667 shutdown_connections 2024-04-15T01:10:58.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.973+0000 7f3899076640 1 -- 172.21.15.29:0/46334667 wait complete. 2024-04-15T01:10:58.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.974+0000 7f3899076640 1 Processor -- start 2024-04-15T01:10:58.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.974+0000 7f3899076640 1 -- start start 2024-04-15T01:10:58.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3899076640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 0x7f3894159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3899076640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38940cdff0 0x7f38940af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3899076640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f389415b110 0x7f38940afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:58.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3899076640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f38940cebc0 con 0x7f38940cc530 2024-04-15T01:10:58.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3899076640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f389415abf0 con 0x7f38940cdff0 2024-04-15T01:10:58.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3899076640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f3894154b10 con 0x7f389415b110 2024-04-15T01:10:58.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.975+0000 7f3892d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 0x7f3894159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.976+0000 7f389359e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f389415b110 0x7f38940afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.976+0000 7f3892d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 0x7f3894159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36678/0 (socket says 172.21.15.29:36678) 2024-04-15T01:10:58.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.976+0000 7f3892d9d640 1 -- 172.21.15.29:0/3121802660 learned_addr learned my addr 172.21.15.29:0/3121802660 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.976+0000 7f389259c640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38940cdff0 0x7f38940af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.979+0000 7f3892d9d640 1 -- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f389415b110 msgr2=0x7f38940afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.979+0000 7f3892d9d640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f389415b110 0x7f38940afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.979+0000 7f3892d9d640 1 -- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38940cdff0 msgr2=0x7f38940af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.979+0000 7f3892d9d640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38940cdff0 0x7f38940af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.979+0000 7f3892d9d640 1 -- 172.21.15.29:0/3121802660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38940c7100 con 0x7f38940cc530 2024-04-15T01:10:58.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.982+0000 7f3892d9d640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 0x7f3894159160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f388c00e9b0 tx=0x7f388c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:58.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.985+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c017070 con 0x7f38940cc530 2024-04-15T01:10:58.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.985+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c00c9a0 con 0x7f38940cc530 2024-04-15T01:10:58.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.985+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c00cd90 con 0x7f38940cc530 2024-04-15T01:10:58.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.986+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38940c6e20 con 0x7f38940cc530 2024-04-15T01:10:58.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.986+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3894158680 con 0x7f38940cc530 2024-04-15T01:10:58.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:58.986+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3894158d90 con 0x7f38940cc530 2024-04-15T01:10:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.253+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f388c01a070 con 0x7f38940cc530 2024-04-15T01:10:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.253+0000 7f388b7fe640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f387406b9e0 0x7f387406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.254+0000 7f389259c640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f387406b9e0 0x7f387406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.254+0000 7f389259c640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f387406b9e0 0x7f387406dea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3894152710 tx=0x7f387c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.269+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f388c057680 con 0x7f38940cc530 2024-04-15T01:10:59.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.269+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f388c0595e0 con 0x7f38940cc530 2024-04-15T01:10:59.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.463+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f389404f540 con 0x7f387406b9e0 2024-04-15T01:10:59.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.464+0000 7f388b7fe640 1 -- 172.21.15.29:0/3121802660 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f389404f540 con 0x7f387406b9e0 2024-04-15T01:10:59.463 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f387406b9e0 msgr2=0x7f387406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f387406b9e0 0x7f387406dea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3894152710 tx=0x7f387c009040 comp rx=0 tx=0).stop 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 msgr2=0x7f3894159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 0x7f3894159160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f388c00e9b0 tx=0x7f388c00ee70 comp rx=0 tx=0).stop 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 shutdown_connections 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f387406b9e0 0x7f387406dea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f389415b110 0x7f38940afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38940cdff0 0x7f38940af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 --2- 172.21.15.29:0/3121802660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38940cc530 0x7f3894159160 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 >> 172.21.15.29:0/3121802660 conn(0x7f38940cfb20 msgr2=0x7f389414f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 shutdown_connections 2024-04-15T01:10:59.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.466+0000 7f3899076640 1 -- 172.21.15.29:0/3121802660 wait complete. 2024-04-15T01:10:59.476 INFO:tasks.ceph:Scrubbing osd.7 2024-04-15T01:10:59.476 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-15T01:10:59.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.585+0000 7f42b2636640 1 Processor -- start 2024-04-15T01:10:59.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.585+0000 7f42b2636640 1 -- start start 2024-04-15T01:10:59.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.586+0000 7f42b2636640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.586+0000 7f42b2636640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42ac070d00 0x7f42ac15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.586+0000 7f42b2636640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac15db10 con 0x7f42ac070920 2024-04-15T01:10:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.586+0000 7f42b2636640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac15ddf0 con 0x7f42ac070d00 2024-04-15T01:10:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.586+0000 7f42b2636640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac15e0d0 con 0x7f42ac143a10 2024-04-15T01:10:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.587+0000 7f42ab7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.587+0000 7f42b0bd3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42ac070d00 0x7f42ac15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.587+0000 7f42b0bd3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42ac070d00 0x7f42ac15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39510/0 (socket says 172.21.15.29:39510) 2024-04-15T01:10:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.587+0000 7f42ab7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac15a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:33058/0 (socket says 172.21.15.29:33058) 2024-04-15T01:10:59.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.587+0000 7f42b0bd3640 1 -- 172.21.15.29:0/42942628 learned_addr learned my addr 172.21.15.29:0/42942628 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.590+0000 7f42ab7fe640 1 -- 172.21.15.29:0/42942628 >> v2:172.21.15.37:3300/0 conn(0x7f42ac070d00 msgr2=0x7f42ac15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.590+0000 7f42ab7fe640 1 --2- 172.21.15.29:0/42942628 >> v2:172.21.15.37:3300/0 conn(0x7f42ac070d00 0x7f42ac15ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.590+0000 7f42ab7fe640 1 -- 172.21.15.29:0/42942628 >> v1:172.21.15.37:6789/0 conn(0x7f42ac070920 legacy=0x7f42ac143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.590+0000 7f42ab7fe640 1 -- 172.21.15.29:0/42942628 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac15e3b0 con 0x7f42ac143a10 2024-04-15T01:10:59.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.592+0000 7f42ab7fe640 1 --2- 172.21.15.29:0/42942628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac15a7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f429c0097a0 tx=0x7f429c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a54558f842aefb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.596+0000 7f42aaffd640 1 -- 172.21.15.29:0/42942628 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0315a0 con 0x7f42ac143a10 2024-04-15T01:10:59.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.596+0000 7f42aaffd640 1 -- 172.21.15.29:0/42942628 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c037070 con 0x7f42ac143a10 2024-04-15T01:10:59.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.596+0000 7f42aaffd640 1 -- 172.21.15.29:0/42942628 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c031960 con 0x7f42ac143a10 2024-04-15T01:10:59.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.596+0000 7f42b2636640 1 -- 172.21.15.29:0/42942628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 msgr2=0x7f42ac15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.596+0000 7f42b2636640 1 --2- 172.21.15.29:0/42942628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac15a7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f429c0097a0 tx=0x7f429c02b840 comp rx=0 tx=0).stop 2024-04-15T01:10:59.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.597+0000 7f42b2636640 1 -- 172.21.15.29:0/42942628 shutdown_connections 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.597+0000 7f42b2636640 1 --2- 172.21.15.29:0/42942628 >> v2:172.21.15.37:3300/0 conn(0x7f42ac070d00 0x7f42ac15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.597+0000 7f42b2636640 1 --2- 172.21.15.29:0/42942628 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac15a7f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.597+0000 7f42b2636640 1 -- 172.21.15.29:0/42942628 >> 172.21.15.29:0/42942628 conn(0x7f42ac0715a0 msgr2=0x7f42ac0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.597+0000 7f42b2636640 1 -- 172.21.15.29:0/42942628 shutdown_connections 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.597+0000 7f42b2636640 1 -- 172.21.15.29:0/42942628 wait complete. 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.598+0000 7f42b2636640 1 Processor -- start 2024-04-15T01:10:59.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.598+0000 7f42b2636640 1 -- start start 2024-04-15T01:10:59.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b2636640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac070920 0x7f42ac0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b2636640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42ac070d00 0x7f42ac156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b2636640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b2636640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac06c650 con 0x7f42ac070d00 2024-04-15T01:10:59.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b2636640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac06c4d0 con 0x7f42ac070920 2024-04-15T01:10:59.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b2636640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac06c7d0 con 0x7f42ac143a10 2024-04-15T01:10:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42b0bd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac070920 0x7f42ac0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.599+0000 7f42ab7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42ac070d00 0x7f42ac156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.600+0000 7f42b0bd3640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:33074/0 (socket says 172.21.15.29:33074) 2024-04-15T01:10:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.600+0000 7f42abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac070920 0x7f42ac0b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39526/0 (socket says 172.21.15.29:39526) 2024-04-15T01:10:59.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.600+0000 7f42b0bd3640 1 -- 172.21.15.29:0/3098759352 learned_addr learned my addr 172.21.15.29:0/3098759352 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.603+0000 7f42b0bd3640 1 -- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac070920 msgr2=0x7f42ac0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.603+0000 7f42b0bd3640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ac070920 0x7f42ac0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.603+0000 7f42b0bd3640 1 -- 172.21.15.29:0/3098759352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42ac070d00 msgr2=0x7f42ac156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.603+0000 7f42b0bd3640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42ac070d00 0x7f42ac156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.603+0000 7f42b0bd3640 1 -- 172.21.15.29:0/3098759352 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac0b0150 con 0x7f42ac143a10 2024-04-15T01:10:59.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.606+0000 7f42b0bd3640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac155fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009df0 tx=0x7f42a400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.610+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a400cd20 con 0x7f42ac143a10 2024-04-15T01:10:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.610+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a4003990 con 0x7f42ac143a10 2024-04-15T01:10:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.610+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4003d80 con 0x7f42ac143a10 2024-04-15T01:10:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.610+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac0b0410 con 0x7f42ac143a10 2024-04-15T01:10:59.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.610+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac1f01e0 con 0x7f42ac143a10 2024-04-15T01:10:59.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.611+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42ac04f540 con 0x7f42ac143a10 2024-04-15T01:10:59.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.631+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f42a4005d10 con 0x7f42ac143a10 2024-04-15T01:10:59.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.631+0000 7f42a8ff9640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f428c06ba10 0x7f428c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.631+0000 7f42abfff640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f428c06ba10 0x7f428c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.632+0000 7f42abfff640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f428c06ba10 0x7f428c06ded0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4294001780 tx=0x7f4294009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.634+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f42a4058010 con 0x7f42ac143a10 2024-04-15T01:10:59.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.634+0000 7f42a8ff9640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f428c0753a0 0x7f428c077840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.634+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 --> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f428c077f10 con 0x7f428c0753a0 2024-04-15T01:10:59.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.634+0000 7f42ab7fe640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f428c0753a0 0x7f428c077840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.634+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f42a4056210 con 0x7f42ac143a10 2024-04-15T01:10:59.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.634+0000 7f42ab7fe640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f428c0753a0 0x7f428c077840 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.635+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== osd.7 v2:172.21.15.37:6810/68685228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f428c077f10 con 0x7f428c0753a0 2024-04-15T01:10:59.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.648+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 --> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42ac141e90 con 0x7f428c0753a0 2024-04-15T01:10:59.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42a8ff9640 1 -- 172.21.15.29:0/3098759352 <== osd.7 v2:172.21.15.37:6810/68685228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42ac141e90 con 0x7f428c0753a0 2024-04-15T01:10:59.647 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-15T01:10:59.647 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T01:10:59.647 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-15T01:10:59.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f428c0753a0 msgr2=0x7f428c077840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6810/68685228,v1:172.21.15.37:6812/68685228] conn(0x7f428c0753a0 0x7f428c077840 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f428c06ba10 msgr2=0x7f428c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f428c06ba10 0x7f428c06ded0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4294001780 tx=0x7f4294009040 comp rx=0 tx=0).stop 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 msgr2=0x7f42ac155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 --2- 172.21.15.29:0/3098759352 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42ac143a10 0x7f42ac155fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009df0 tx=0x7f42a400c490 comp rx=0 tx=0).stop 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b0bd3640 1 -- 172.21.15.29:0/3098759352 reap_dead start 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 shutdown_connections 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 >> 172.21.15.29:0/3098759352 conn(0x7f42ac0715a0 msgr2=0x7f42ac06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 shutdown_connections 2024-04-15T01:10:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.649+0000 7f42b2636640 1 -- 172.21.15.29:0/3098759352 wait complete. 2024-04-15T01:10:59.658 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-15T01:10:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.763+0000 7f0df9684640 1 Processor -- start 2024-04-15T01:10:59.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.764+0000 7f0df9684640 1 -- start start 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.764+0000 7f0df9684640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.764+0000 7f0df9684640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0df40ce1e0 0x7f0df41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.764+0000 7f0df9684640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df4157fb0 con 0x7f0df40cddc0 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.764+0000 7f0df9684640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0df40ce650 con 0x7f0df40ce1e0 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.764+0000 7f0df9684640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0df4158230 con 0x7f0df414ea00 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.765+0000 7f0df27fc640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0df40cddc0 0x7f0df4070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:60904/0 (socket says 172.21.15.29:60904) 2024-04-15T01:10:59.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.765+0000 7f0df27fc640 1 -- 172.21.15.29:0/1972699709 learned_addr learned my addr 172.21.15.29:0/1972699709 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:10:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.765+0000 7f0df2ffd640 1 --2- 172.21.15.29:0/1972699709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.765+0000 7f0df37fe640 1 --2- 172.21.15.29:0/1972699709 >> v2:172.21.15.37:3300/0 conn(0x7f0df40ce1e0 0x7f0df41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.767+0000 7f0df1ffb640 1 -- 172.21.15.29:0/1972699709 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235012769 0 0) 0x7f0de8001110 con 0x7f0df40cddc0 2024-04-15T01:10:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.767+0000 7f0df1ffb640 1 -- 172.21.15.29:0/1972699709 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ddc003520 con 0x7f0df40cddc0 2024-04-15T01:10:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.768+0000 7f0df2ffd640 1 -- 172.21.15.29:0/1972699709 >> v2:172.21.15.37:3300/0 conn(0x7f0df40ce1e0 msgr2=0x7f0df41596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:10:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.768+0000 7f0df2ffd640 1 --2- 172.21.15.29:0/1972699709 >> v2:172.21.15.37:3300/0 conn(0x7f0df40ce1e0 0x7f0df41596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.768+0000 7f0df2ffd640 1 -- 172.21.15.29:0/1972699709 >> v1:172.21.15.29:6789/0 conn(0x7f0df40cddc0 legacy=0x7f0df4070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.768+0000 7f0df2ffd640 1 -- 172.21.15.29:0/1972699709 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df4158510 con 0x7f0df414ea00 2024-04-15T01:10:59.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.770+0000 7f0df2ffd640 1 --2- 172.21.15.29:0/1972699709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c3550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0097a0 tx=0x7f0dec02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cceb57b3a9eb9712 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.773+0000 7f0df1ffb640 1 -- 172.21.15.29:0/1972699709 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec034070 con 0x7f0df414ea00 2024-04-15T01:10:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df1ffb640 1 -- 172.21.15.29:0/1972699709 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec030610 con 0x7f0df414ea00 2024-04-15T01:10:59.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df1ffb640 1 -- 172.21.15.29:0/1972699709 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0309e0 con 0x7f0df414ea00 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 -- 172.21.15.29:0/1972699709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 msgr2=0x7f0df40c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 --2- 172.21.15.29:0/1972699709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c3550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0097a0 tx=0x7f0dec02b960 comp rx=0 tx=0).stop 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 -- 172.21.15.29:0/1972699709 shutdown_connections 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 --2- 172.21.15.29:0/1972699709 >> v2:172.21.15.37:3300/0 conn(0x7f0df40ce1e0 0x7f0df41596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 --2- 172.21.15.29:0/1972699709 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c3550 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 -- 172.21.15.29:0/1972699709 >> 172.21.15.29:0/1972699709 conn(0x7f0df4061e00 msgr2=0x7f0df4062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:10:59.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 -- 172.21.15.29:0/1972699709 shutdown_connections 2024-04-15T01:10:59.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.774+0000 7f0df9684640 1 -- 172.21.15.29:0/1972699709 wait complete. 2024-04-15T01:10:59.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.775+0000 7f0df9684640 1 Processor -- start 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 -- start start 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40cddc0 0x7f0df414cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df40ce1e0 0x7f0df40c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4158db0 con 0x7f0df40cddc0 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4158ad0 con 0x7f0df40ce1e0 2024-04-15T01:10:59.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.776+0000 7f0df9684640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f0df414ede0 con 0x7f0df414ea00 2024-04-15T01:10:59.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.777+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.777+0000 7f0df27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df40ce1e0 0x7f0df40c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.777+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40cddc0 0x7f0df414cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.777+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:33096/0 (socket says 172.21.15.29:33096) 2024-04-15T01:10:59.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.777+0000 7f0df37fe640 1 -- 172.21.15.29:0/1507066759 learned_addr learned my addr 172.21.15.29:0/1507066759 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:10:59.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.780+0000 7f0df37fe640 1 -- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df40ce1e0 msgr2=0x7f0df40c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.780+0000 7f0df37fe640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df40ce1e0 0x7f0df40c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.780+0000 7f0df37fe640 1 -- 172.21.15.29:0/1507066759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40cddc0 msgr2=0x7f0df414cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:10:59.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.780+0000 7f0df37fe640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40cddc0 0x7f0df414cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:10:59.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.780+0000 7f0df37fe640 1 -- 172.21.15.29:0/1507066759 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df41edd50 con 0x7f0df414ea00 2024-04-15T01:10:59.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.783+0000 7f0df37fe640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c9c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0de400efc0 tx=0x7f0de400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:10:59.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.787+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4018020 con 0x7f0df414ea00 2024-04-15T01:10:59.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.787+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4014480 con 0x7f0df414ea00 2024-04-15T01:10:59.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.787+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df40c8990 con 0x7f0df414ea00 2024-04-15T01:10:59.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.787+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df40c8f50 con 0x7f0df414ea00 2024-04-15T01:10:59.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.787+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4014870 con 0x7f0df414ea00 2024-04-15T01:10:59.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.788+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df404f540 con 0x7f0df414ea00 2024-04-15T01:10:59.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.811+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0de4005d10 con 0x7f0df414ea00 2024-04-15T01:10:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.811+0000 7f0ddb7fe640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0de006b990 0x7f0de006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:10:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.812+0000 7f0df2ffd640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0de006b990 0x7f0de006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:10:59.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:10:59.812+0000 7f0df2ffd640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0de006b990 0x7f0de006de50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0dec036000 tx=0x7f0dec03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:00.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.074+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0de4058100 con 0x7f0df414ea00 2024-04-15T01:11:00.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.085+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0de4022030 con 0x7f0df414ea00 2024-04-15T01:11:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.273+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0df415a5b0 con 0x7f0de006b990 2024-04-15T01:11:00.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.274+0000 7f0ddb7fe640 1 -- 172.21.15.29:0/1507066759 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0df415a5b0 con 0x7f0de006b990 2024-04-15T01:11:00.272 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2024-04-15T01:11:00.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0de006b990 msgr2=0x7f0de006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0de006b990 0x7f0de006de50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0dec036000 tx=0x7f0dec03b040 comp rx=0 tx=0).stop 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 msgr2=0x7f0df40c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c9c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0de400efc0 tx=0x7f0de400c490 comp rx=0 tx=0).stop 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 shutdown_connections 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f0de006b990 0x7f0de006de50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f0df414ea00 0x7f0df40c9c90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df40ce1e0 0x7f0df40c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 --2- 172.21.15.29:0/1507066759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0df40cddc0 0x7f0df414cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 >> 172.21.15.29:0/1507066759 conn(0x7f0df4061e00 msgr2=0x7f0df4156020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 shutdown_connections 2024-04-15T01:11:00.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.276+0000 7f0df9684640 1 -- 172.21.15.29:0/1507066759 wait complete. 2024-04-15T01:11:00.286 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T01:11:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.420+0000 7fc961a95640 1 Processor -- start 2024-04-15T01:11:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.420+0000 7fc961a95640 1 -- start start 2024-04-15T01:11:00.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.421+0000 7fc961a95640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc95c0cc530 0x7fc95c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.421+0000 7fc961a95640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc95c0cdff0 0x7fc95c0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.421+0000 7fc961a95640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c0cf910 con 0x7fc95c15b110 2024-04-15T01:11:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.421+0000 7fc961a95640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fc95c0cf350 con 0x7fc95c0cdff0 2024-04-15T01:11:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.421+0000 7fc961a95640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc95c0cf630 con 0x7fc95c0cc530 2024-04-15T01:11:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.421+0000 7fc95b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc95c0cc530 0x7fc95c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.422+0000 7fc95b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc95c0cc530 0x7fc95c0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39564/0 (socket says 172.21.15.29:39564) 2024-04-15T01:11:00.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.422+0000 7fc95b7fe640 1 -- 172.21.15.29:0/1184717800 learned_addr learned my addr 172.21.15.29:0/1184717800 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:00.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.424+0000 7fc95b7fe640 1 -- 172.21.15.29:0/1184717800 >> v2:172.21.15.29:3300/0 conn(0x7fc95c0cdff0 msgr2=0x7fc95c0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:00.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.424+0000 7fc95b7fe640 1 --2- 172.21.15.29:0/1184717800 >> v2:172.21.15.29:3300/0 conn(0x7fc95c0cdff0 0x7fc95c0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.424+0000 7fc95b7fe640 1 -- 172.21.15.29:0/1184717800 >> v1:172.21.15.37:6789/0 conn(0x7fc95c15b110 legacy=0x7fc95c06c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:00.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.424+0000 7fc95b7fe640 1 -- 172.21.15.29:0/1184717800 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c15a630 con 0x7fc95c0cc530 2024-04-15T01:11:00.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.428+0000 7fc95b7fe640 1 --2- 172.21.15.29:0/1184717800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c0cc530 0x7fc95c0cc910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0cd350 tx=0x7fc94c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=514da7dd3d5a3886 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:00.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.437+0000 7fc95a7fc640 1 -- 172.21.15.29:0/1184717800 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c035020 con 0x7fc95c0cc530 2024-04-15T01:11:00.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.437+0000 7fc95a7fc640 1 -- 172.21.15.29:0/1184717800 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c031870 con 0x7fc95c0cc530 2024-04-15T01:11:00.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.437+0000 7fc95a7fc640 1 -- 172.21.15.29:0/1184717800 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c031c40 con 0x7fc95c0cc530 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 -- 172.21.15.29:0/1184717800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c0cc530 msgr2=0x7fc95c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 --2- 172.21.15.29:0/1184717800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c0cc530 0x7fc95c0cc910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0cd350 tx=0x7fc94c02b910 comp rx=0 tx=0).stop 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 -- 172.21.15.29:0/1184717800 shutdown_connections 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 --2- 172.21.15.29:0/1184717800 >> v2:172.21.15.29:3300/0 conn(0x7fc95c0cdff0 0x7fc95c0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 --2- 172.21.15.29:0/1184717800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c0cc530 0x7fc95c0cc910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 -- 172.21.15.29:0/1184717800 >> 172.21.15.29:0/1184717800 conn(0x7fc95c0cfb20 msgr2=0x7fc95c0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 -- 172.21.15.29:0/1184717800 shutdown_connections 2024-04-15T01:11:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.438+0000 7fc961a95640 1 -- 172.21.15.29:0/1184717800 wait complete. 2024-04-15T01:11:00.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.439+0000 7fc961a95640 1 Processor -- start 2024-04-15T01:11:00.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 -- start start 2024-04-15T01:11:00.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95c0cc530 0x7fc95c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc95c0cdff0 0x7fc95c1f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 0x7fc95c1f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c0cebc0 con 0x7fc95c0cc530 2024-04-15T01:11:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c15abf0 con 0x7fc95c15b110 2024-04-15T01:11:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.440+0000 7fc961a95640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fc95c154b10 con 0x7fc95c0cdff0 2024-04-15T01:11:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.441+0000 7fc95bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 0x7fc95c1f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.441+0000 7fc95affd640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc95c0cdff0 0x7fc95c1f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.441+0000 7fc95bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 0x7fc95c1f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:39572/0 (socket says 172.21.15.29:39572) 2024-04-15T01:11:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.441+0000 7fc95bfff640 1 -- 172.21.15.29:0/2062188800 learned_addr learned my addr 172.21.15.29:0/2062188800 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:00.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.445+0000 7fc95bfff640 1 -- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc95c0cdff0 msgr2=0x7fc95c1f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.445+0000 7fc95bfff640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc95c0cdff0 0x7fc95c1f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.445+0000 7fc95bfff640 1 -- 172.21.15.29:0/2062188800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95c0cc530 msgr2=0x7fc95c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.445+0000 7fc95bfff640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95c0cc530 0x7fc95c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.445+0000 7fc95bfff640 1 -- 172.21.15.29:0/2062188800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c154ea0 con 0x7fc95c15b110 2024-04-15T01:11:00.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.447+0000 7fc95bfff640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 0x7fc95c1f18c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc95400b970 tx=0x7fc95400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:00.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.451+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954019070 con 0x7fc95c15b110 2024-04-15T01:11:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.451+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95400cb60 con 0x7fc95c15b110 2024-04-15T01:11:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.451+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954014440 con 0x7fc95c15b110 2024-04-15T01:11:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.451+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c155140 con 0x7fc95c15b110 2024-04-15T01:11:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.451+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1556c0 con 0x7fc95c15b110 2024-04-15T01:11:00.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.452+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c04f540 con 0x7fc95c15b110 2024-04-15T01:11:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.471+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc95401c070 con 0x7fc95c15b110 2024-04-15T01:11:00.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.471+0000 7fc943fff640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc94806b990 0x7fc94806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.471+0000 7fc95b7fe640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc94806b990 0x7fc94806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:00.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.472+0000 7fc95b7fe640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc94806b990 0x7fc94806de50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc94c036000 tx=0x7fc94c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:00.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.474+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc954056fd0 con 0x7fc95c15b110 2024-04-15T01:11:00.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.745+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc954023020 con 0x7fc95c15b110 2024-04-15T01:11:00.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.925+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc95c14ec90 con 0x7fc94806b990 2024-04-15T01:11:00.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.934+0000 7fc943fff640 1 -- 172.21.15.29:0/2062188800 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333861 (secure 0 0 0) 0x7fc95c14ec90 con 0x7fc94806b990 2024-04-15T01:11:00.937 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:11:00.939 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc94806b990 msgr2=0x7fc94806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc94806b990 0x7fc94806de50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc94c036000 tx=0x7fc94c030000 comp rx=0 tx=0).stop 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 msgr2=0x7fc95c1f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 0x7fc95c1f18c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc95400b970 tx=0x7fc95400be30 comp rx=0 tx=0).stop 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 shutdown_connections 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fc94806b990 0x7fc94806de50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc95c15b110 0x7fc95c1f18c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fc95c0cdff0 0x7fc95c1f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 --2- 172.21.15.29:0/2062188800 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc95c0cc530 0x7fc95c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 >> 172.21.15.29:0/2062188800 conn(0x7fc95c0cfb20 msgr2=0x7fc95c06c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 shutdown_connections 2024-04-15T01:11:00.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:00.938+0000 7fc961a95640 1 -- 172.21.15.29:0/2062188800 wait complete. 2024-04-15T01:11:00.947 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2125,"stamp":"2024-04-15T01:11:00.026489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182212376,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":6016,"num_read_kb":1595737,"num_write":54695,"num_write_kb":4529750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63540,"ondisk_log_size":63540,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1089112,"kb_used_data":171032,"kb_used_omap":12,"kb_used_meta":918003,"kb_avail":753885608,"statfs":{"total":773094113280,"available":771978862592,"internally_reserved":0,"allocated":175136768,"data_stored":365444512,"data_compressed":48398084,"data_compressed_allocated":63004672,"data_compressed_original":255000576,"omap_allocated":12751,"internal_metadata":940035633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003443"},"pg_stats":[{"pgid":"2.1f","version":"29'509","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.536897+0000","last_change":"2024-04-15T01:10:56.536932+0000","last_active":"2024-04-15T01:10:56.536897+0000","last_peered":"2024-04-15T01:10:56.536897+0000","last_clean":"2024-04-15T01:10:56.536897+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T01:10:56.536897+0000","last_undegraded":"2024-04-15T01:10:56.536897+0000","last_fullsized":"2024-04-15T01:10:56.536897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'509","last_scrub_stamp":"2024-04-15T01:10:56.536832+0000","last_deep_scrub":"29'509","last_deep_scrub_stamp":"2024-04-15T01:10:56.536832+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.536832+0000","objects_scrubbed":8,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:27:28.178951+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'200","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024578+0000","last_change":"2024-04-15T00:01:12.994811+0000","last_active":"2024-04-15T01:10:44.024578+0000","last_peered":"2024-04-15T01:10:44.024578+0000","last_clean":"2024-04-15T01:10:44.024578+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T01:10:44.024578+0000","last_undegraded":"2024-04-15T01:10:44.024578+0000","last_fullsized":"2024-04-15T01:10:44.024578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'821","reported_seq":962,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.274399+0000","last_change":"2024-04-15T00:01:18.980732+0000","last_active":"2024-04-15T01:10:33.274399+0000","last_peered":"2024-04-15T01:10:33.274399+0000","last_clean":"2024-04-15T01:10:33.274399+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T01:10:33.274399+0000","last_undegraded":"2024-04-15T01:10:33.274399+0000","last_fullsized":"2024-04-15T01:10:33.274399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":55758,"num_write":811,"num_write_kb":161190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'216","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:21.424765+0000","last_change":"2024-04-15T00:01:11.981382+0000","last_active":"2024-04-15T01:09:21.424765+0000","last_peered":"2024-04-15T01:09:21.424765+0000","last_clean":"2024-04-15T01:09:21.424765+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T01:09:21.424765+0000","last_undegraded":"2024-04-15T01:09:21.424765+0000","last_fullsized":"2024-04-15T01:09:21.424765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'182","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100999+0000","last_change":"2024-04-15T00:01:12.891517+0000","last_active":"2024-04-15T01:10:44.100999+0000","last_peered":"2024-04-15T01:10:44.100999+0000","last_clean":"2024-04-15T01:10:44.100999+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T01:10:44.100999+0000","last_undegraded":"2024-04-15T01:10:44.100999+0000","last_fullsized":"2024-04-15T01:10:44.100999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'760","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326809+0000","last_change":"2024-04-15T00:01:18.978187+0000","last_active":"2024-04-15T01:10:31.326809+0000","last_peered":"2024-04-15T01:10:31.326809+0000","last_clean":"2024-04-15T01:10:31.326809+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:31.326809+0000","last_undegraded":"2024-04-15T01:10:31.326809+0000","last_fullsized":"2024-04-15T01:10:31.326809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:19.134802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42531,"num_write":744,"num_write_kb":122981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1119","reported_seq":1174,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.796641+0000","last_change":"2024-04-15T00:01:11.987166+0000","last_active":"2024-04-15T01:10:23.796641+0000","last_peered":"2024-04-15T01:10:23.796641+0000","last_clean":"2024-04-15T01:10:23.796641+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T01:10:23.796641+0000","last_undegraded":"2024-04-15T01:10:23.796641+0000","last_fullsized":"2024-04-15T01:10:23.796641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":12823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.096991+0000","last_change":"2024-04-15T00:01:12.995991+0000","last_active":"2024-04-15T01:10:44.096991+0000","last_peered":"2024-04-15T01:10:44.096991+0000","last_clean":"2024-04-15T01:10:44.096991+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T01:10:44.096991+0000","last_undegraded":"2024-04-15T01:10:44.096991+0000","last_fullsized":"2024-04-15T01:10:44.096991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:47.350126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'741","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.169772+0000","last_change":"2024-04-15T00:01:18.988391+0000","last_active":"2024-04-15T01:10:30.169772+0000","last_peered":"2024-04-15T01:10:30.169772+0000","last_clean":"2024-04-15T01:10:30.169772+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T01:10:30.169772+0000","last_undegraded":"2024-04-15T01:10:30.169772+0000","last_fullsized":"2024-04-15T01:10:30.169772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8438,"num_write":729,"num_write_kb":110173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'784","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:06.691411+0000","last_change":"2024-04-15T00:01:11.990696+0000","last_active":"2024-04-15T01:10:06.691411+0000","last_peered":"2024-04-15T01:10:06.691411+0000","last_clean":"2024-04-15T01:10:06.691411+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T01:10:06.691411+0000","last_undegraded":"2024-04-15T01:10:06.691411+0000","last_fullsized":"2024-04-15T01:10:06.691411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.101557+0000","last_change":"2024-04-15T00:01:12.995618+0000","last_active":"2024-04-15T01:10:44.101557+0000","last_peered":"2024-04-15T01:10:44.101557+0000","last_clean":"2024-04-15T01:10:44.101557+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T01:10:44.101557+0000","last_undegraded":"2024-04-15T01:10:44.101557+0000","last_fullsized":"2024-04-15T01:10:44.101557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'759","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.552677+0000","last_change":"2024-04-15T00:01:18.982730+0000","last_active":"2024-04-15T01:10:30.552677+0000","last_peered":"2024-04-15T01:10:30.552677+0000","last_clean":"2024-04-15T01:10:30.552677+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T01:10:30.552677+0000","last_undegraded":"2024-04-15T01:10:30.552677+0000","last_fullsized":"2024-04-15T01:10:30.552677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:07.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":36806,"num_write":750,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'207","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119457+0000","last_change":"2024-04-15T00:01:12.997474+0000","last_active":"2024-04-15T01:10:44.119457+0000","last_peered":"2024-04-15T01:10:44.119457+0000","last_clean":"2024-04-15T01:10:44.119457+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T01:10:44.119457+0000","last_undegraded":"2024-04-15T01:10:44.119457+0000","last_fullsized":"2024-04-15T01:10:44.119457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:46:31.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'916","reported_seq":974,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:47.677285+0000","last_change":"2024-04-15T00:01:11.988893+0000","last_active":"2024-04-15T01:09:47.677285+0000","last_peered":"2024-04-15T01:09:47.677285+0000","last_clean":"2024-04-15T01:09:47.677285+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T01:09:47.677285+0000","last_undegraded":"2024-04-15T01:09:47.677285+0000","last_fullsized":"2024-04-15T01:09:47.677285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:07:21.612379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":8649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'809","reported_seq":996,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.791696+0000","last_change":"2024-04-15T00:01:18.976188+0000","last_active":"2024-04-15T01:10:23.791696+0000","last_peered":"2024-04-15T01:10:23.791696+0000","last_clean":"2024-04-15T01:10:23.791696+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T01:10:23.791696+0000","last_undegraded":"2024-04-15T01:10:23.791696+0000","last_fullsized":"2024-04-15T01:10:23.791696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":99885,"num_write":793,"num_write_kb":204639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'209","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.027855+0000","last_change":"2024-04-15T00:01:12.990704+0000","last_active":"2024-04-15T01:10:44.027855+0000","last_peered":"2024-04-15T01:10:44.027855+0000","last_clean":"2024-04-15T01:10:44.027855+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T01:10:44.027855+0000","last_undegraded":"2024-04-15T01:10:44.027855+0000","last_fullsized":"2024-04-15T01:10:44.027855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'780","reported_seq":841,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:46.239447+0000","last_change":"2024-04-15T00:01:11.980017+0000","last_active":"2024-04-15T01:10:46.239447+0000","last_peered":"2024-04-15T01:10:46.239447+0000","last_clean":"2024-04-15T01:10:46.239447+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T01:10:46.239447+0000","last_undegraded":"2024-04-15T01:10:46.239447+0000","last_fullsized":"2024-04-15T01:10:46.239447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'885","reported_seq":1047,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.324900+0000","last_change":"2024-04-15T00:01:18.981687+0000","last_active":"2024-04-15T01:10:33.324900+0000","last_peered":"2024-04-15T01:10:33.324900+0000","last_clean":"2024-04-15T01:10:33.324900+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T01:10:33.324900+0000","last_undegraded":"2024-04-15T01:10:33.324900+0000","last_fullsized":"2024-04-15T01:10:33.324900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:21.264607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52186,"num_write":871,"num_write_kb":181200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'202","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.028940+0000","last_change":"2024-04-15T00:01:12.989887+0000","last_active":"2024-04-15T01:10:44.028940+0000","last_peered":"2024-04-15T01:10:44.028940+0000","last_clean":"2024-04-15T01:10:44.028940+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T01:10:44.028940+0000","last_undegraded":"2024-04-15T01:10:44.028940+0000","last_fullsized":"2024-04-15T01:10:44.028940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:07:47.112311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'195","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.237914+0000","last_change":"2024-04-15T00:01:11.982605+0000","last_active":"2024-04-15T01:10:31.237914+0000","last_peered":"2024-04-15T01:10:31.237914+0000","last_clean":"2024-04-15T01:10:31.237914+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T01:10:31.237914+0000","last_undegraded":"2024-04-15T01:10:31.237914+0000","last_fullsized":"2024-04-15T01:10:31.237914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'743","reported_seq":910,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.325003+0000","last_change":"2024-04-15T00:01:18.975197+0000","last_active":"2024-04-15T01:10:31.325003+0000","last_peered":"2024-04-15T01:10:31.325003+0000","last_clean":"2024-04-15T01:10:31.325003+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T01:10:31.325003+0000","last_undegraded":"2024-04-15T01:10:31.325003+0000","last_fullsized":"2024-04-15T01:10:31.325003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58288,"num_write":731,"num_write_kb":102006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'221","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.113964+0000","last_change":"2024-04-15T00:01:12.993216+0000","last_active":"2024-04-15T01:10:44.113964+0000","last_peered":"2024-04-15T01:10:44.113964+0000","last_clean":"2024-04-15T01:10:44.113964+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T01:10:44.113964+0000","last_undegraded":"2024-04-15T01:10:44.113964+0000","last_fullsized":"2024-04-15T01:10:44.113964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:10.796492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'783","reported_seq":843,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:07.669537+0000","last_change":"2024-04-15T00:01:11.983167+0000","last_active":"2024-04-15T01:10:07.669537+0000","last_peered":"2024-04-15T01:10:07.669537+0000","last_clean":"2024-04-15T01:10:07.669537+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T01:10:07.669537+0000","last_undegraded":"2024-04-15T01:10:07.669537+0000","last_fullsized":"2024-04-15T01:10:07.669537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'723","reported_seq":860,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.247777+0000","last_change":"2024-04-15T00:01:18.988590+0000","last_active":"2024-04-15T01:10:35.247777+0000","last_peered":"2024-04-15T01:10:35.247777+0000","last_clean":"2024-04-15T01:10:35.247777+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T01:10:35.247777+0000","last_undegraded":"2024-04-15T01:10:35.247777+0000","last_fullsized":"2024-04-15T01:10:35.247777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:27.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":38800,"num_write":705,"num_write_kb":106309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'224","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088752+0000","last_change":"2024-04-15T00:01:12.887219+0000","last_active":"2024-04-15T01:10:44.088752+0000","last_peered":"2024-04-15T01:10:44.088752+0000","last_clean":"2024-04-15T01:10:44.088752+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T01:10:44.088752+0000","last_undegraded":"2024-04-15T01:10:44.088752+0000","last_fullsized":"2024-04-15T01:10:44.088752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'194","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.402360+0000","last_change":"2024-04-15T00:01:11.988202+0000","last_active":"2024-04-15T01:10:35.402360+0000","last_peered":"2024-04-15T01:10:35.402360+0000","last_clean":"2024-04-15T01:10:35.402360+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T01:10:35.402360+0000","last_undegraded":"2024-04-15T01:10:35.402360+0000","last_fullsized":"2024-04-15T01:10:35.402360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:08.019801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'797","reported_seq":968,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:31.326928+0000","last_change":"2024-04-15T00:01:18.983738+0000","last_active":"2024-04-15T01:10:31.326928+0000","last_peered":"2024-04-15T01:10:31.326928+0000","last_clean":"2024-04-15T01:10:31.326928+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T01:10:31.326928+0000","last_undegraded":"2024-04-15T01:10:31.326928+0000","last_fullsized":"2024-04-15T01:10:31.326928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:56.193841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60896,"num_write":782,"num_write_kb":175614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'173","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.037149+0000","last_change":"2024-04-15T00:01:12.991404+0000","last_active":"2024-04-15T01:10:44.037149+0000","last_peered":"2024-04-15T01:10:44.037149+0000","last_clean":"2024-04-15T01:10:44.037149+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T01:10:44.037149+0000","last_undegraded":"2024-04-15T01:10:44.037149+0000","last_fullsized":"2024-04-15T01:10:44.037149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3598","reported_seq":3659,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:37.737053+0000","last_change":"2024-04-15T00:01:11.984172+0000","last_active":"2024-04-15T01:10:37.737053+0000","last_peered":"2024-04-15T01:10:37.737053+0000","last_clean":"2024-04-15T01:10:37.737053+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T01:10:37.737053+0000","last_undegraded":"2024-04-15T01:10:37.737053+0000","last_fullsized":"2024-04-15T01:10:37.737053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10014,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'787","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.786208+0000","last_change":"2024-04-15T00:01:50.325887+0000","last_active":"2024-04-15T01:10:23.786208+0000","last_peered":"2024-04-15T01:10:23.786208+0000","last_clean":"2024-04-15T01:10:23.786208+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T01:10:23.786208+0000","last_undegraded":"2024-04-15T01:10:23.786208+0000","last_fullsized":"2024-04-15T01:10:23.786208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:56:24.766876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27446,"num_write":780,"num_write_kb":102026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'200","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.254175+0000","last_change":"2024-04-15T00:01:12.980507+0000","last_active":"2024-04-15T01:10:44.254175+0000","last_peered":"2024-04-15T01:10:44.254175+0000","last_clean":"2024-04-15T01:10:44.254175+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T01:10:44.254175+0000","last_undegraded":"2024-04-15T01:10:44.254175+0000","last_fullsized":"2024-04-15T01:10:44.254175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'592","reported_seq":653,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:20.369577+0000","last_change":"2024-04-15T00:01:11.986921+0000","last_active":"2024-04-15T01:10:20.369577+0000","last_peered":"2024-04-15T01:10:20.369577+0000","last_clean":"2024-04-15T01:10:20.369577+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T01:10:20.369577+0000","last_undegraded":"2024-04-15T01:10:20.369577+0000","last_fullsized":"2024-04-15T01:10:20.369577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:52.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'736","reported_seq":888,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.440396+0000","last_change":"2024-04-15T00:01:18.975377+0000","last_active":"2024-04-15T01:10:33.440396+0000","last_peered":"2024-04-15T01:10:33.440396+0000","last_clean":"2024-04-15T01:10:33.440396+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T01:10:33.440396+0000","last_undegraded":"2024-04-15T01:10:33.440396+0000","last_fullsized":"2024-04-15T01:10:33.440396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":59617,"num_write":721,"num_write_kb":101495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.088748+0000","last_change":"2024-04-15T00:01:12.992102+0000","last_active":"2024-04-15T01:10:44.088748+0000","last_peered":"2024-04-15T01:10:44.088748+0000","last_clean":"2024-04-15T01:10:44.088748+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T01:10:44.088748+0000","last_undegraded":"2024-04-15T01:10:44.088748+0000","last_fullsized":"2024-04-15T01:10:44.088748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:04:23.490821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'304","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:56.234409+0000","last_change":"2024-04-15T00:01:11.963673+0000","last_active":"2024-04-15T01:09:56.234409+0000","last_peered":"2024-04-15T01:09:56.234409+0000","last_clean":"2024-04-15T01:09:56.234409+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T01:09:56.234409+0000","last_undegraded":"2024-04-15T01:09:56.234409+0000","last_fullsized":"2024-04-15T01:09:56.234409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'778","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.253439+0000","last_change":"2024-04-15T00:01:18.976366+0000","last_active":"2024-04-15T01:10:35.253439+0000","last_peered":"2024-04-15T01:10:35.253439+0000","last_clean":"2024-04-15T01:10:35.253439+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T01:10:35.253439+0000","last_undegraded":"2024-04-15T01:10:35.253439+0000","last_fullsized":"2024-04-15T01:10:35.253439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":54040,"num_write":767,"num_write_kb":142606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'203","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.117642+0000","last_change":"2024-04-15T00:01:12.994504+0000","last_active":"2024-04-15T01:10:44.117642+0000","last_peered":"2024-04-15T01:10:44.117642+0000","last_clean":"2024-04-15T01:10:44.117642+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T01:10:44.117642+0000","last_undegraded":"2024-04-15T01:10:44.117642+0000","last_fullsized":"2024-04-15T01:10:44.117642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:53.526796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'988","reported_seq":1049,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:34.095462+0000","last_change":"2024-04-15T00:01:11.983406+0000","last_active":"2024-04-15T01:08:34.095462+0000","last_peered":"2024-04-15T01:08:34.095462+0000","last_clean":"2024-04-15T01:08:34.095462+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T01:08:34.095462+0000","last_undegraded":"2024-04-15T01:08:34.095462+0000","last_fullsized":"2024-04-15T01:08:34.095462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":8655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'695","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324605+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T01:10:36.324605+0000","last_peered":"2024-04-15T01:10:36.324605+0000","last_clean":"2024-04-15T01:10:36.324605+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T01:10:36.324605+0000","last_undegraded":"2024-04-15T01:10:36.324605+0000","last_fullsized":"2024-04-15T01:10:36.324605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:49.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22523,"num_write":688,"num_write_kb":89336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"29'209","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120574+0000","last_change":"2024-04-15T00:01:12.980958+0000","last_active":"2024-04-15T01:10:44.120574+0000","last_peered":"2024-04-15T01:10:44.120574+0000","last_clean":"2024-04-15T01:10:44.120574+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T01:10:44.120574+0000","last_undegraded":"2024-04-15T01:10:44.120574+0000","last_fullsized":"2024-04-15T01:10:44.120574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3013","reported_seq":6022,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:38.153294+0000","last_change":"2024-04-15T00:01:11.980071+0000","last_active":"2024-04-15T01:10:38.153294+0000","last_peered":"2024-04-15T01:10:38.153294+0000","last_clean":"2024-04-15T01:10:38.153294+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T01:10:38.153294+0000","last_undegraded":"2024-04-15T01:10:38.153294+0000","last_fullsized":"2024-04-15T01:10:38.153294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":3013,"log_dups_size":0,"ondisk_log_size":3013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":2955,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'697","reported_seq":790,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:41.238895+0000","last_change":"2024-04-15T00:01:18.978070+0000","last_active":"2024-04-15T01:10:41.238895+0000","last_peered":"2024-04-15T01:10:41.238895+0000","last_clean":"2024-04-15T01:10:41.238895+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T01:10:41.238895+0000","last_undegraded":"2024-04-15T01:10:41.238895+0000","last_fullsized":"2024-04-15T01:10:41.238895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19611,"num_write":689,"num_write_kb":76681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094259+0000","last_change":"2024-04-15T00:01:12.993321+0000","last_active":"2024-04-15T01:10:44.094259+0000","last_peered":"2024-04-15T01:10:44.094259+0000","last_clean":"2024-04-15T01:10:44.094259+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T01:10:44.094259+0000","last_undegraded":"2024-04-15T01:10:44.094259+0000","last_fullsized":"2024-04-15T01:10:44.094259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'490","reported_seq":552,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.155539+0000","last_change":"2024-04-15T00:01:11.982661+0000","last_active":"2024-04-15T01:09:40.155539+0000","last_peered":"2024-04-15T01:09:40.155539+0000","last_clean":"2024-04-15T01:09:40.155539+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T01:09:40.155539+0000","last_undegraded":"2024-04-15T01:09:40.155539+0000","last_fullsized":"2024-04-15T01:09:40.155539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:32.053882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'862","reported_seq":1065,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:39.204522+0000","last_change":"2024-04-15T00:01:18.975456+0000","last_active":"2024-04-15T01:10:39.204522+0000","last_peered":"2024-04-15T01:10:39.204522+0000","last_clean":"2024-04-15T01:10:39.204522+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T01:10:39.204522+0000","last_undegraded":"2024-04-15T01:10:39.204522+0000","last_fullsized":"2024-04-15T01:10:39.204522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":84642,"num_write":849,"num_write_kb":128022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'185","reported_seq":229,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122895+0000","last_change":"2024-04-15T00:01:49.998011+0000","last_active":"2024-04-15T01:10:44.122895+0000","last_peered":"2024-04-15T01:10:44.122895+0000","last_clean":"2024-04-15T01:10:44.122895+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T01:10:44.122895+0000","last_undegraded":"2024-04-15T01:10:44.122895+0000","last_fullsized":"2024-04-15T01:10:44.122895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"29'299","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:23.787521+0000","last_change":"2024-04-15T00:01:11.984120+0000","last_active":"2024-04-15T01:10:23.787521+0000","last_peered":"2024-04-15T01:10:23.787521+0000","last_clean":"2024-04-15T01:10:23.787521+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T01:10:23.787521+0000","last_undegraded":"2024-04-15T01:10:23.787521+0000","last_fullsized":"2024-04-15T01:10:23.787521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:27:46.170523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:07:20.354724+0000","last_change":"2024-04-15T00:00:57.663039+0000","last_active":"2024-04-15T01:07:20.354724+0000","last_peered":"2024-04-15T01:07:20.354724+0000","last_clean":"2024-04-15T01:07:20.354724+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T01:07:20.354724+0000","last_undegraded":"2024-04-15T01:07:20.354724+0000","last_fullsized":"2024-04-15T01:07:20.354724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:00:56.185619+0000","last_clean_scrub_stamp":"2024-04-15T00:00:56.185619+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:35:19.689214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'808","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.400673+0000","last_change":"2024-04-15T00:01:18.978905+0000","last_active":"2024-04-15T01:10:33.400673+0000","last_peered":"2024-04-15T01:10:33.400673+0000","last_clean":"2024-04-15T01:10:33.400673+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T01:10:33.400673+0000","last_undegraded":"2024-04-15T01:10:33.400673+0000","last_fullsized":"2024-04-15T01:10:33.400673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":51109,"num_write":790,"num_write_kb":155353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103744+0000","last_change":"2024-04-15T00:01:12.983208+0000","last_active":"2024-04-15T01:10:44.103744+0000","last_peered":"2024-04-15T01:10:44.103744+0000","last_clean":"2024-04-15T01:10:44.103744+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T01:10:44.103744+0000","last_undegraded":"2024-04-15T01:10:44.103744+0000","last_fullsized":"2024-04-15T01:10:44.103744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:52.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'252","reported_seq":310,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.841722+0000","last_change":"2024-04-15T00:01:11.982647+0000","last_active":"2024-04-15T01:10:43.841722+0000","last_peered":"2024-04-15T01:10:43.841722+0000","last_clean":"2024-04-15T01:10:43.841722+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T01:10:43.841722+0000","last_undegraded":"2024-04-15T01:10:43.841722+0000","last_fullsized":"2024-04-15T01:10:43.841722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3902566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'818","reported_seq":999,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.401547+0000","last_change":"2024-04-15T00:01:18.986061+0000","last_active":"2024-04-15T01:10:33.401547+0000","last_peered":"2024-04-15T01:10:33.401547+0000","last_clean":"2024-04-15T01:10:33.401547+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T01:10:33.401547+0000","last_undegraded":"2024-04-15T01:10:33.401547+0000","last_fullsized":"2024-04-15T01:10:33.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:45:58.219667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":80804,"num_write":805,"num_write_kb":188613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081875+0000","last_change":"2024-04-15T00:01:12.991538+0000","last_active":"2024-04-15T01:10:44.081875+0000","last_peered":"2024-04-15T01:10:44.081875+0000","last_clean":"2024-04-15T01:10:44.081875+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T01:10:44.081875+0000","last_undegraded":"2024-04-15T01:10:44.081875+0000","last_fullsized":"2024-04-15T01:10:44.081875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:19:17.893014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'781","reported_seq":841,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:55.421492+0000","last_change":"2024-04-15T00:01:11.985916+0000","last_active":"2024-04-15T01:10:55.421492+0000","last_peered":"2024-04-15T01:10:55.421492+0000","last_clean":"2024-04-15T01:10:55.421492+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T01:10:55.421492+0000","last_undegraded":"2024-04-15T01:10:55.421492+0000","last_fullsized":"2024-04-15T01:10:55.421492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'763","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.347374+0000","last_change":"2024-04-15T00:01:18.975647+0000","last_active":"2024-04-15T01:10:36.347374+0000","last_peered":"2024-04-15T01:10:36.347374+0000","last_clean":"2024-04-15T01:10:36.347374+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T01:10:36.347374+0000","last_undegraded":"2024-04-15T01:10:36.347374+0000","last_fullsized":"2024-04-15T01:10:36.347374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":61965,"num_write":764,"num_write_kb":101545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095025+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T01:10:44.095025+0000","last_peered":"2024-04-15T01:10:44.095025+0000","last_clean":"2024-04-15T01:10:44.095025+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T01:10:44.095025+0000","last_undegraded":"2024-04-15T01:10:44.095025+0000","last_fullsized":"2024-04-15T01:10:44.095025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:51:58.245346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'783","reported_seq":841,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:08:55.148414+0000","last_change":"2024-04-15T00:01:11.979388+0000","last_active":"2024-04-15T01:08:55.148414+0000","last_peered":"2024-04-15T01:08:55.148414+0000","last_clean":"2024-04-15T01:08:55.148414+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T01:08:55.148414+0000","last_undegraded":"2024-04-15T01:08:55.148414+0000","last_fullsized":"2024-04-15T01:08:55.148414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:18:18.549939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'786","reported_seq":924,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.389363+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T01:10:36.389363+0000","last_peered":"2024-04-15T01:10:36.389363+0000","last_clean":"2024-04-15T01:10:36.389363+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T01:10:36.389363+0000","last_undegraded":"2024-04-15T01:10:36.389363+0000","last_fullsized":"2024-04-15T01:10:36.389363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":35671,"num_write":777,"num_write_kb":118402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.092714+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T01:10:44.092714+0000","last_peered":"2024-04-15T01:10:44.092714+0000","last_clean":"2024-04-15T01:10:44.092714+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T01:10:44.092714+0000","last_undegraded":"2024-04-15T01:10:44.092714+0000","last_fullsized":"2024-04-15T01:10:44.092714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:23.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'765","reported_seq":823,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.767966+0000","last_change":"2024-04-15T00:01:11.984137+0000","last_active":"2024-04-15T01:10:17.767966+0000","last_peered":"2024-04-15T01:10:17.767966+0000","last_clean":"2024-04-15T01:10:17.767966+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T01:10:17.767966+0000","last_undegraded":"2024-04-15T01:10:17.767966+0000","last_fullsized":"2024-04-15T01:10:17.767966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:17.834231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'816","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.220146+0000","last_change":"2024-04-15T00:01:18.982931+0000","last_active":"2024-04-15T01:10:33.220146+0000","last_peered":"2024-04-15T01:10:33.220146+0000","last_clean":"2024-04-15T01:10:33.220146+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T01:10:33.220146+0000","last_undegraded":"2024-04-15T01:10:33.220146+0000","last_fullsized":"2024-04-15T01:10:33.220146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:04.347563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39992,"num_write":799,"num_write_kb":139135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'231","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093976+0000","last_change":"2024-04-15T00:01:12.993725+0000","last_active":"2024-04-15T01:10:44.093976+0000","last_peered":"2024-04-15T01:10:44.093976+0000","last_clean":"2024-04-15T01:10:44.093976+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T01:10:44.093976+0000","last_undegraded":"2024-04-15T01:10:44.093976+0000","last_fullsized":"2024-04-15T01:10:44.093976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:30:50.331749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'473","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.338706+0000","last_change":"2024-04-15T00:01:11.959342+0000","last_active":"2024-04-15T01:10:36.338706+0000","last_peered":"2024-04-15T01:10:36.338706+0000","last_clean":"2024-04-15T01:10:36.338706+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T01:10:36.338706+0000","last_undegraded":"2024-04-15T01:10:36.338706+0000","last_fullsized":"2024-04-15T01:10:36.338706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":8414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'762","reported_seq":910,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.385042+0000","last_change":"2024-04-15T00:01:18.977458+0000","last_active":"2024-04-15T01:10:36.385042+0000","last_peered":"2024-04-15T01:10:36.385042+0000","last_clean":"2024-04-15T01:10:36.385042+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T01:10:36.385042+0000","last_undegraded":"2024-04-15T01:10:36.385042+0000","last_fullsized":"2024-04-15T01:10:36.385042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":53894,"num_write":751,"num_write_kb":106228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.109035+0000","last_change":"2024-04-15T00:01:12.980006+0000","last_active":"2024-04-15T01:10:44.109035+0000","last_peered":"2024-04-15T01:10:44.109035+0000","last_clean":"2024-04-15T01:10:44.109035+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T01:10:44.109035+0000","last_undegraded":"2024-04-15T01:10:44.109035+0000","last_fullsized":"2024-04-15T01:10:44.109035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:48:32.663040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'63","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:08.497363+0000","last_change":"2024-04-15T00:01:11.988749+0000","last_active":"2024-04-15T01:09:08.497363+0000","last_peered":"2024-04-15T01:09:08.497363+0000","last_clean":"2024-04-15T01:09:08.497363+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T01:09:08.497363+0000","last_undegraded":"2024-04-15T01:09:08.497363+0000","last_fullsized":"2024-04-15T01:09:08.497363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:44:35.366164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'778","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.966740+0000","last_change":"2024-04-15T00:01:50.326200+0000","last_active":"2024-04-15T01:10:21.966740+0000","last_peered":"2024-04-15T01:10:21.966740+0000","last_clean":"2024-04-15T01:10:21.966740+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T01:10:21.966740+0000","last_undegraded":"2024-04-15T01:10:21.966740+0000","last_fullsized":"2024-04-15T01:10:21.966740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:32:27.554366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":41754,"num_write":768,"num_write_kb":168968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'200","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094807+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T01:10:44.094807+0000","last_peered":"2024-04-15T01:10:44.094807+0000","last_clean":"2024-04-15T01:10:44.094807+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T01:10:44.094807+0000","last_undegraded":"2024-04-15T01:10:44.094807+0000","last_fullsized":"2024-04-15T01:10:44.094807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:01:15.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'60","reported_seq":117,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.324199+0000","last_change":"2024-04-15T00:01:11.982674+0000","last_active":"2024-04-15T01:10:36.324199+0000","last_peered":"2024-04-15T01:10:36.324199+0000","last_clean":"2024-04-15T01:10:36.324199+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T01:10:36.324199+0000","last_undegraded":"2024-04-15T01:10:36.324199+0000","last_fullsized":"2024-04-15T01:10:36.324199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:56:48.401192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'697","reported_seq":801,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:29.054816+0000","last_change":"2024-04-15T00:01:18.979406+0000","last_active":"2024-04-15T01:10:29.054816+0000","last_peered":"2024-04-15T01:10:29.054816+0000","last_clean":"2024-04-15T01:10:29.054816+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T01:10:29.054816+0000","last_undegraded":"2024-04-15T01:10:29.054816+0000","last_fullsized":"2024-04-15T01:10:29.054816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:00.920068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":31143,"num_write":687,"num_write_kb":101153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'209","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.104384+0000","last_change":"2024-04-15T00:01:12.978064+0000","last_active":"2024-04-15T01:10:44.104384+0000","last_peered":"2024-04-15T01:10:44.104384+0000","last_clean":"2024-04-15T01:10:44.104384+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T01:10:44.104384+0000","last_undegraded":"2024-04-15T01:10:44.104384+0000","last_fullsized":"2024-04-15T01:10:44.104384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'398","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.509326+0000","last_change":"2024-04-15T01:10:57.509382+0000","last_active":"2024-04-15T01:10:57.509326+0000","last_peered":"2024-04-15T01:10:57.509326+0000","last_clean":"2024-04-15T01:10:57.509326+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T01:10:57.509326+0000","last_undegraded":"2024-04-15T01:10:57.509326+0000","last_fullsized":"2024-04-15T01:10:57.509326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'398","last_scrub_stamp":"2024-04-15T01:10:57.509229+0000","last_deep_scrub":"29'398","last_deep_scrub_stamp":"2024-04-15T01:10:57.509229+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.509229+0000","objects_scrubbed":8,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:17:47.284689+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'747","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.144852+0000","last_change":"2024-04-15T00:01:18.975558+0000","last_active":"2024-04-15T01:10:33.144852+0000","last_peered":"2024-04-15T01:10:33.144852+0000","last_clean":"2024-04-15T01:10:33.144852+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T01:10:33.144852+0000","last_undegraded":"2024-04-15T01:10:33.144852+0000","last_fullsized":"2024-04-15T01:10:33.144852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:56:06.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":56791,"num_write":733,"num_write_kb":134490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.100391+0000","last_change":"2024-04-15T00:01:12.991079+0000","last_active":"2024-04-15T01:10:44.100391+0000","last_peered":"2024-04-15T01:10:44.100391+0000","last_clean":"2024-04-15T01:10:44.100391+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T01:10:44.100391+0000","last_undegraded":"2024-04-15T01:10:44.100391+0000","last_fullsized":"2024-04-15T01:10:44.100391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1423","reported_seq":1480,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:21.623835+0000","last_change":"2024-04-15T00:01:11.985723+0000","last_active":"2024-04-15T01:10:21.623835+0000","last_peered":"2024-04-15T01:10:21.623835+0000","last_clean":"2024-04-15T01:10:21.623835+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T01:10:21.623835+0000","last_undegraded":"2024-04-15T01:10:21.623835+0000","last_fullsized":"2024-04-15T01:10:21.623835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:25.985785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":13127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'798","reported_seq":934,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.174622+0000","last_change":"2024-04-15T00:01:18.983789+0000","last_active":"2024-04-15T01:10:35.174622+0000","last_peered":"2024-04-15T01:10:35.174622+0000","last_clean":"2024-04-15T01:10:35.174622+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T01:10:35.174622+0000","last_undegraded":"2024-04-15T01:10:35.174622+0000","last_fullsized":"2024-04-15T01:10:35.174622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":58877,"num_write":785,"num_write_kb":152322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'203","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124028+0000","last_change":"2024-04-15T00:01:12.994063+0000","last_active":"2024-04-15T01:10:44.124028+0000","last_peered":"2024-04-15T01:10:44.124028+0000","last_clean":"2024-04-15T01:10:44.124028+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T01:10:44.124028+0000","last_undegraded":"2024-04-15T01:10:44.124028+0000","last_fullsized":"2024-04-15T01:10:44.124028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:05:33.183702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1844","reported_seq":1901,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:38.161698+0000","last_change":"2024-04-15T00:01:11.990555+0000","last_active":"2024-04-15T01:10:38.161698+0000","last_peered":"2024-04-15T01:10:38.161698+0000","last_clean":"2024-04-15T01:10:38.161698+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T01:10:38.161698+0000","last_undegraded":"2024-04-15T01:10:38.161698+0000","last_fullsized":"2024-04-15T01:10:38.161698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":5818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'701","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.553388+0000","last_change":"2024-04-15T00:01:18.987848+0000","last_active":"2024-04-15T01:10:30.553388+0000","last_peered":"2024-04-15T01:10:30.553388+0000","last_clean":"2024-04-15T01:10:30.553388+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T01:10:30.553388+0000","last_undegraded":"2024-04-15T01:10:30.553388+0000","last_fullsized":"2024-04-15T01:10:30.553388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:33.116516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35520,"num_write":691,"num_write_kb":85742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.098214+0000","last_change":"2024-04-15T00:01:12.891599+0000","last_active":"2024-04-15T01:10:44.098214+0000","last_peered":"2024-04-15T01:10:44.098214+0000","last_clean":"2024-04-15T01:10:44.098214+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T01:10:44.098214+0000","last_undegraded":"2024-04-15T01:10:44.098214+0000","last_fullsized":"2024-04-15T01:10:44.098214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'396","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:13.065031+0000","last_change":"2024-04-15T00:01:11.985954+0000","last_active":"2024-04-15T01:10:13.065031+0000","last_peered":"2024-04-15T01:10:13.065031+0000","last_clean":"2024-04-15T01:10:13.065031+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T01:10:13.065031+0000","last_undegraded":"2024-04-15T01:10:13.065031+0000","last_fullsized":"2024-04-15T01:10:13.065031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:52.567912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'858","reported_seq":983,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.214354+0000","last_change":"2024-04-15T00:01:18.977196+0000","last_active":"2024-04-15T01:10:33.214354+0000","last_peered":"2024-04-15T01:10:33.214354+0000","last_clean":"2024-04-15T01:10:33.214354+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T01:10:33.214354+0000","last_undegraded":"2024-04-15T01:10:33.214354+0000","last_fullsized":"2024-04-15T01:10:33.214354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:53:52.321305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":40736,"num_write":845,"num_write_kb":155666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'215","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112020+0000","last_change":"2024-04-15T00:01:12.979569+0000","last_active":"2024-04-15T01:10:44.112020+0000","last_peered":"2024-04-15T01:10:44.112020+0000","last_clean":"2024-04-15T01:10:44.112020+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T01:10:44.112020+0000","last_undegraded":"2024-04-15T01:10:44.112020+0000","last_fullsized":"2024-04-15T01:10:44.112020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:23:44.560545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'69","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:43.837447+0000","last_change":"2024-04-15T00:01:11.985583+0000","last_active":"2024-04-15T01:10:43.837447+0000","last_peered":"2024-04-15T01:10:43.837447+0000","last_clean":"2024-04-15T01:10:43.837447+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T01:10:43.837447+0000","last_undegraded":"2024-04-15T01:10:43.837447+0000","last_fullsized":"2024-04-15T01:10:43.837447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:13:09.666672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'833","reported_seq":967,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:33.445684+0000","last_change":"2024-04-15T00:01:18.981034+0000","last_active":"2024-04-15T01:10:33.445684+0000","last_peered":"2024-04-15T01:10:33.445684+0000","last_clean":"2024-04-15T01:10:33.445684+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T01:10:33.445684+0000","last_undegraded":"2024-04-15T01:10:33.445684+0000","last_fullsized":"2024-04-15T01:10:33.445684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:23:22.099072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":38336,"num_write":816,"num_write_kb":147104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'791","reported_seq":944,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.361056+0000","last_change":"2024-04-15T00:01:18.975222+0000","last_active":"2024-04-15T01:10:36.361056+0000","last_peered":"2024-04-15T01:10:36.361056+0000","last_clean":"2024-04-15T01:10:36.361056+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T01:10:36.361056+0000","last_undegraded":"2024-04-15T01:10:36.361056+0000","last_fullsized":"2024-04-15T01:10:36.361056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":55193,"num_write":783,"num_write_kb":131702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'213","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.254809+0000","last_change":"2024-04-15T00:01:12.990765+0000","last_active":"2024-04-15T01:10:44.254809+0000","last_peered":"2024-04-15T01:10:44.254809+0000","last_clean":"2024-04-15T01:10:44.254809+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T01:10:44.254809+0000","last_undegraded":"2024-04-15T01:10:44.254809+0000","last_fullsized":"2024-04-15T01:10:44.254809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1370","reported_seq":1426,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:26.576298+0000","last_change":"2024-04-15T00:01:11.986782+0000","last_active":"2024-04-15T01:09:26.576298+0000","last_peered":"2024-04-15T01:09:26.576298+0000","last_clean":"2024-04-15T01:09:26.576298+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T01:09:26.576298+0000","last_undegraded":"2024-04-15T01:09:26.576298+0000","last_fullsized":"2024-04-15T01:09:26.576298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:48:01.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'758","reported_seq":905,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:17.626649+0000","last_change":"2024-04-15T00:01:18.978202+0000","last_active":"2024-04-15T01:10:17.626649+0000","last_peered":"2024-04-15T01:10:17.626649+0000","last_clean":"2024-04-15T01:10:17.626649+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:10:17.626649+0000","last_undegraded":"2024-04-15T01:10:17.626649+0000","last_fullsized":"2024-04-15T01:10:17.626649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:07:29.179057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":41433,"num_write":747,"num_write_kb":139089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'219","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032800+0000","last_change":"2024-04-15T00:01:12.991943+0000","last_active":"2024-04-15T01:10:44.032800+0000","last_peered":"2024-04-15T01:10:44.032800+0000","last_clean":"2024-04-15T01:10:44.032800+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T01:10:44.032800+0000","last_undegraded":"2024-04-15T01:10:44.032800+0000","last_fullsized":"2024-04-15T01:10:44.032800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:56:02.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'580","reported_seq":636,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:32.070004+0000","last_change":"2024-04-15T00:01:11.985810+0000","last_active":"2024-04-15T01:09:32.070004+0000","last_peered":"2024-04-15T01:09:32.070004+0000","last_clean":"2024-04-15T01:09:32.070004+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T01:09:32.070004+0000","last_undegraded":"2024-04-15T01:09:32.070004+0000","last_fullsized":"2024-04-15T01:09:32.070004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:17:04.726329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1197","reported_seq":1252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:17.007966+0000","last_change":"2024-04-15T00:01:11.988833+0000","last_active":"2024-04-15T01:09:17.007966+0000","last_peered":"2024-04-15T01:09:17.007966+0000","last_clean":"2024-04-15T01:09:17.007966+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T01:09:17.007966+0000","last_undegraded":"2024-04-15T01:09:17.007966+0000","last_fullsized":"2024-04-15T01:09:17.007966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:48.501042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'187","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.094152+0000","last_change":"2024-04-15T00:01:12.995148+0000","last_active":"2024-04-15T01:10:44.094152+0000","last_peered":"2024-04-15T01:10:44.094152+0000","last_clean":"2024-04-15T01:10:44.094152+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T01:10:44.094152+0000","last_undegraded":"2024-04-15T01:10:44.094152+0000","last_fullsized":"2024-04-15T01:10:44.094152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'744","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:30.393810+0000","last_change":"2024-04-15T00:01:18.973971+0000","last_active":"2024-04-15T01:10:30.393810+0000","last_peered":"2024-04-15T01:10:30.393810+0000","last_clean":"2024-04-15T01:10:30.393810+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T01:10:30.393810+0000","last_undegraded":"2024-04-15T01:10:30.393810+0000","last_fullsized":"2024-04-15T01:10:30.393810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:22.100661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":84659,"num_write":735,"num_write_kb":176000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'220","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:09:40.168273+0000","last_change":"2024-04-15T00:01:11.986510+0000","last_active":"2024-04-15T01:09:40.168273+0000","last_peered":"2024-04-15T01:09:40.168273+0000","last_clean":"2024-04-15T01:09:40.168273+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T01:09:40.168273+0000","last_undegraded":"2024-04-15T01:09:40.168273+0000","last_fullsized":"2024-04-15T01:09:40.168273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:10.673886+0000","last_clean_scrub_stamp":"2024-04-15T00:01:10.673886+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:05.076099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'202","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122471+0000","last_change":"2024-04-15T00:01:12.993384+0000","last_active":"2024-04-15T01:10:44.122471+0000","last_peered":"2024-04-15T01:10:44.122471+0000","last_clean":"2024-04-15T01:10:44.122471+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T01:10:44.122471+0000","last_undegraded":"2024-04-15T01:10:44.122471+0000","last_fullsized":"2024-04-15T01:10:44.122471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:13:27.115605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'759","reported_seq":920,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:25.904298+0000","last_change":"2024-04-15T00:01:18.974456+0000","last_active":"2024-04-15T01:10:25.904298+0000","last_peered":"2024-04-15T01:10:25.904298+0000","last_clean":"2024-04-15T01:10:25.904298+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T01:10:25.904298+0000","last_undegraded":"2024-04-15T01:10:25.904298+0000","last_fullsized":"2024-04-15T01:10:25.904298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:24:47.958004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62677,"num_write":745,"num_write_kb":206027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'216","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.115518+0000","last_change":"2024-04-15T00:01:12.980522+0000","last_active":"2024-04-15T01:10:44.115518+0000","last_peered":"2024-04-15T01:10:44.115518+0000","last_clean":"2024-04-15T01:10:44.115518+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T01:10:44.115518+0000","last_undegraded":"2024-04-15T01:10:44.115518+0000","last_fullsized":"2024-04-15T01:10:44.115518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:59:40.375728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'222","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103511+0000","last_change":"2024-04-15T00:01:12.983221+0000","last_active":"2024-04-15T01:10:44.103511+0000","last_peered":"2024-04-15T01:10:44.103511+0000","last_clean":"2024-04-15T01:10:44.103511+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T01:10:44.103511+0000","last_undegraded":"2024-04-15T01:10:44.103511+0000","last_fullsized":"2024-04-15T01:10:44.103511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:37.662618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'232","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.080669+0000","last_change":"2024-04-15T00:01:12.992042+0000","last_active":"2024-04-15T01:10:44.080669+0000","last_peered":"2024-04-15T01:10:44.080669+0000","last_clean":"2024-04-15T01:10:44.080669+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T01:10:44.080669+0000","last_undegraded":"2024-04-15T01:10:44.080669+0000","last_fullsized":"2024-04-15T01:10:44.080669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:55:10.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'207","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.084431+0000","last_change":"2024-04-15T00:01:12.990599+0000","last_active":"2024-04-15T01:10:44.084431+0000","last_peered":"2024-04-15T01:10:44.084431+0000","last_clean":"2024-04-15T01:10:44.084431+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T01:10:44.084431+0000","last_undegraded":"2024-04-15T01:10:44.084431+0000","last_fullsized":"2024-04-15T01:10:44.084431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.040848+0000","last_change":"2024-04-15T00:01:12.995520+0000","last_active":"2024-04-15T01:10:44.040848+0000","last_peered":"2024-04-15T01:10:44.040848+0000","last_clean":"2024-04-15T01:10:44.040848+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T01:10:44.040848+0000","last_undegraded":"2024-04-15T01:10:44.040848+0000","last_fullsized":"2024-04-15T01:10:44.040848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:50:15.579870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'207","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.120816+0000","last_change":"2024-04-15T00:01:12.990160+0000","last_active":"2024-04-15T01:10:44.120816+0000","last_peered":"2024-04-15T01:10:44.120816+0000","last_clean":"2024-04-15T01:10:44.120816+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T01:10:44.120816+0000","last_undegraded":"2024-04-15T01:10:44.120816+0000","last_fullsized":"2024-04-15T01:10:44.120816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'241","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.123430+0000","last_change":"2024-04-15T00:01:12.982275+0000","last_active":"2024-04-15T01:10:44.123430+0000","last_peered":"2024-04-15T01:10:44.123430+0000","last_clean":"2024-04-15T01:10:44.123430+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T01:10:44.123430+0000","last_undegraded":"2024-04-15T01:10:44.123430+0000","last_fullsized":"2024-04-15T01:10:44.123430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:35:58.485470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'192","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.024735+0000","last_change":"2024-04-15T00:01:12.996114+0000","last_active":"2024-04-15T01:10:44.024735+0000","last_peered":"2024-04-15T01:10:44.024735+0000","last_clean":"2024-04-15T01:10:44.024735+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T01:10:44.024735+0000","last_undegraded":"2024-04-15T01:10:44.024735+0000","last_fullsized":"2024-04-15T01:10:44.024735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:33.880388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.087057+0000","last_change":"2024-04-15T00:01:12.992037+0000","last_active":"2024-04-15T01:10:44.087057+0000","last_peered":"2024-04-15T01:10:44.087057+0000","last_clean":"2024-04-15T01:10:44.087057+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T01:10:44.087057+0000","last_undegraded":"2024-04-15T01:10:44.087057+0000","last_fullsized":"2024-04-15T01:10:44.087057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:54:17.259441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.032553+0000","last_change":"2024-04-15T00:01:12.995534+0000","last_active":"2024-04-15T01:10:44.032553+0000","last_peered":"2024-04-15T01:10:44.032553+0000","last_clean":"2024-04-15T01:10:44.032553+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T01:10:44.032553+0000","last_undegraded":"2024-04-15T01:10:44.032553+0000","last_fullsized":"2024-04-15T01:10:44.032553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.238569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'215","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095159+0000","last_change":"2024-04-15T00:01:50.325599+0000","last_active":"2024-04-15T01:10:44.095159+0000","last_peered":"2024-04-15T01:10:44.095159+0000","last_clean":"2024-04-15T01:10:44.095159+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T01:10:44.095159+0000","last_undegraded":"2024-04-15T01:10:44.095159+0000","last_fullsized":"2024-04-15T01:10:44.095159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:06:53.830578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'212","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:54.612843+0000","last_change":"2024-04-15T00:01:12.977963+0000","last_active":"2024-04-15T01:10:54.612843+0000","last_peered":"2024-04-15T01:10:54.612843+0000","last_clean":"2024-04-15T01:10:54.612843+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T01:10:54.612843+0000","last_undegraded":"2024-04-15T01:10:54.612843+0000","last_fullsized":"2024-04-15T01:10:54.612843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'223","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.119670+0000","last_change":"2024-04-15T00:01:12.995825+0000","last_active":"2024-04-15T01:10:44.119670+0000","last_peered":"2024-04-15T01:10:44.119670+0000","last_clean":"2024-04-15T01:10:44.119670+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T01:10:44.119670+0000","last_undegraded":"2024-04-15T01:10:44.119670+0000","last_fullsized":"2024-04-15T01:10:44.119670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:39:27.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.081817+0000","last_change":"2024-04-15T00:01:12.982278+0000","last_active":"2024-04-15T01:10:44.081817+0000","last_peered":"2024-04-15T01:10:44.081817+0000","last_clean":"2024-04-15T01:10:44.081817+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T01:10:44.081817+0000","last_undegraded":"2024-04-15T01:10:44.081817+0000","last_fullsized":"2024-04-15T01:10:44.081817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:27.254423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.114261+0000","last_change":"2024-04-15T00:01:12.982453+0000","last_active":"2024-04-15T01:10:44.114261+0000","last_peered":"2024-04-15T01:10:44.114261+0000","last_clean":"2024-04-15T01:10:44.114261+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T01:10:44.114261+0000","last_undegraded":"2024-04-15T01:10:44.114261+0000","last_fullsized":"2024-04-15T01:10:44.114261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:45:59.448321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'199","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.111859+0000","last_change":"2024-04-15T00:01:12.979469+0000","last_active":"2024-04-15T01:10:44.111859+0000","last_peered":"2024-04-15T01:10:44.111859+0000","last_clean":"2024-04-15T01:10:44.111859+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T01:10:44.111859+0000","last_undegraded":"2024-04-15T01:10:44.111859+0000","last_fullsized":"2024-04-15T01:10:44.111859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'222","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097146+0000","last_change":"2024-04-15T00:01:12.889213+0000","last_active":"2024-04-15T01:10:44.097146+0000","last_peered":"2024-04-15T01:10:44.097146+0000","last_clean":"2024-04-15T01:10:44.097146+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T01:10:44.097146+0000","last_undegraded":"2024-04-15T01:10:44.097146+0000","last_fullsized":"2024-04-15T01:10:44.097146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:20:29.017624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'215","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.124083+0000","last_change":"2024-04-15T00:01:12.994028+0000","last_active":"2024-04-15T01:10:44.124083+0000","last_peered":"2024-04-15T01:10:44.124083+0000","last_clean":"2024-04-15T01:10:44.124083+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T01:10:44.124083+0000","last_undegraded":"2024-04-15T01:10:44.124083+0000","last_fullsized":"2024-04-15T01:10:44.124083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.439668+0000","last_change":"2024-04-15T01:10:58.439689+0000","last_active":"2024-04-15T01:10:58.439668+0000","last_peered":"2024-04-15T01:10:58.439668+0000","last_clean":"2024-04-15T01:10:58.439668+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T01:10:58.439668+0000","last_undegraded":"2024-04-15T01:10:58.439668+0000","last_fullsized":"2024-04-15T01:10:58.439668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:10:58.439596+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:10:58.439596+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.439596+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:19:30.922504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.039555+0000","last_change":"2024-04-15T00:01:12.994724+0000","last_active":"2024-04-15T01:10:44.039555+0000","last_peered":"2024-04-15T01:10:44.039555+0000","last_clean":"2024-04-15T01:10:44.039555+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T01:10:44.039555+0000","last_undegraded":"2024-04-15T01:10:44.039555+0000","last_fullsized":"2024-04-15T01:10:44.039555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:23:15.356299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'185","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122630+0000","last_change":"2024-04-15T00:01:12.994036+0000","last_active":"2024-04-15T01:10:44.122630+0000","last_peered":"2024-04-15T01:10:44.122630+0000","last_clean":"2024-04-15T01:10:44.122630+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T01:10:44.122630+0000","last_undegraded":"2024-04-15T01:10:44.122630+0000","last_fullsized":"2024-04-15T01:10:44.122630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:26:09.149622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'188","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.112221+0000","last_change":"2024-04-15T00:01:12.989163+0000","last_active":"2024-04-15T01:10:44.112221+0000","last_peered":"2024-04-15T01:10:44.112221+0000","last_clean":"2024-04-15T01:10:44.112221+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T01:10:44.112221+0000","last_undegraded":"2024-04-15T01:10:44.112221+0000","last_fullsized":"2024-04-15T01:10:44.112221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:01.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.122116+0000","last_change":"2024-04-15T00:01:49.997896+0000","last_active":"2024-04-15T01:10:44.122116+0000","last_peered":"2024-04-15T01:10:44.122116+0000","last_clean":"2024-04-15T01:10:44.122116+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T01:10:44.122116+0000","last_undegraded":"2024-04-15T01:10:44.122116+0000","last_fullsized":"2024-04-15T01:10:44.122116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:52:44.356891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'211","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.103209+0000","last_change":"2024-04-15T00:01:12.983355+0000","last_active":"2024-04-15T01:10:44.103209+0000","last_peered":"2024-04-15T01:10:44.103209+0000","last_clean":"2024-04-15T01:10:44.103209+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T01:10:44.103209+0000","last_undegraded":"2024-04-15T01:10:44.103209+0000","last_fullsized":"2024-04-15T01:10:44.103209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:00:42.009341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.038221+0000","last_change":"2024-04-15T00:01:12.992847+0000","last_active":"2024-04-15T01:10:44.038221+0000","last_peered":"2024-04-15T01:10:44.038221+0000","last_clean":"2024-04-15T01:10:44.038221+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T01:10:44.038221+0000","last_undegraded":"2024-04-15T01:10:44.038221+0000","last_fullsized":"2024-04-15T01:10:44.038221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:41:26.437742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.060783+0000","last_change":"2024-04-15T00:01:12.981071+0000","last_active":"2024-04-15T01:10:44.060783+0000","last_peered":"2024-04-15T01:10:44.060783+0000","last_clean":"2024-04-15T01:10:44.060783+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T01:10:44.060783+0000","last_undegraded":"2024-04-15T01:10:44.060783+0000","last_fullsized":"2024-04-15T01:10:44.060783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:48:13.272709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'197","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.097300+0000","last_change":"2024-04-15T00:01:12.891383+0000","last_active":"2024-04-15T01:10:44.097300+0000","last_peered":"2024-04-15T01:10:44.097300+0000","last_clean":"2024-04-15T01:10:44.097300+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T01:10:44.097300+0000","last_undegraded":"2024-04-15T01:10:44.097300+0000","last_fullsized":"2024-04-15T01:10:44.097300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:35:01.525377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.085102+0000","last_change":"2024-04-15T00:01:12.980945+0000","last_active":"2024-04-15T01:10:44.085102+0000","last_peered":"2024-04-15T01:10:44.085102+0000","last_clean":"2024-04-15T01:10:44.085102+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T01:10:44.085102+0000","last_undegraded":"2024-04-15T01:10:44.085102+0000","last_fullsized":"2024-04-15T01:10:44.085102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:10:21.989085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'195","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.093604+0000","last_change":"2024-04-15T00:01:50.003849+0000","last_active":"2024-04-15T01:10:44.093604+0000","last_peered":"2024-04-15T01:10:44.093604+0000","last_clean":"2024-04-15T01:10:44.093604+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T01:10:44.093604+0000","last_undegraded":"2024-04-15T01:10:44.093604+0000","last_fullsized":"2024-04-15T01:10:44.093604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:34.802923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'194","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:55.561877+0000","last_change":"2024-04-15T01:10:55.561899+0000","last_active":"2024-04-15T01:10:55.561877+0000","last_peered":"2024-04-15T01:10:55.561877+0000","last_clean":"2024-04-15T01:10:55.561877+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T01:10:55.561877+0000","last_undegraded":"2024-04-15T01:10:55.561877+0000","last_fullsized":"2024-04-15T01:10:55.561877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'194","last_scrub_stamp":"2024-04-15T01:10:55.561805+0000","last_deep_scrub":"29'194","last_deep_scrub_stamp":"2024-04-15T01:10:55.561805+0000","last_clean_scrub_stamp":"2024-04-15T01:10:55.561805+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:17.928986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'214","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.254446+0000","last_change":"2024-04-15T00:01:12.888115+0000","last_active":"2024-04-15T01:10:44.254446+0000","last_peered":"2024-04-15T01:10:44.254446+0000","last_clean":"2024-04-15T01:10:44.254446+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T01:10:44.254446+0000","last_undegraded":"2024-04-15T01:10:44.254446+0000","last_fullsized":"2024-04-15T01:10:44.254446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'211","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.091482+0000","last_change":"2024-04-15T00:01:12.983911+0000","last_active":"2024-04-15T01:10:44.091482+0000","last_peered":"2024-04-15T01:10:44.091482+0000","last_clean":"2024-04-15T01:10:44.091482+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T01:10:44.091482+0000","last_undegraded":"2024-04-15T01:10:44.091482+0000","last_fullsized":"2024-04-15T01:10:44.091482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:59.517900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2952,"num_read_kb":1592021,"num_write":24431,"num_write_kb":4334185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24810,"ondisk_log_size":24810,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13159,"ondisk_log_size":13159,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":181622008,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":30105,"num_write_kb":193149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172548096,"data_stored":363244016,"data_compressed":48333034,"data_compressed_allocated":62914560,"data_compressed_original":253853696,"omap_allocated":0,"internal_metadata":0},"log_size":25454,"ondisk_log_size":25454,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542988,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137664,"kb_used_data":30200,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94234176,"statfs":{"total":96636764160,"available":96495796224,"internally_reserved":0,"allocated":30924800,"data_stored":72023688,"data_compressed":9942585,"data_compressed_allocated":12574720,"data_compressed_original":53891072,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542988,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157088,"kb_used_data":23256,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94214752,"statfs":{"total":96636764160,"available":96475906048,"internally_reserved":0,"allocated":23814144,"data_stored":50461162,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542988,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136936,"kb_used_data":21152,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94234904,"statfs":{"total":96636764160,"available":96496541696,"internally_reserved":0,"allocated":21659648,"data_stored":41781534,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542989,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125000,"kb_used_data":25856,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94246840,"statfs":{"total":96636764160,"available":96508764160,"internally_reserved":0,"allocated":26476544,"data_stored":50461030,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510285,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144168,"kb_used_data":18592,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94227672,"statfs":{"total":96636764160,"available":96489136128,"internally_reserved":0,"allocated":19038208,"data_stored":35235566,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510283,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":11480,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":11755520,"data_stored":22359130,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510285,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169692,"kb_used_data":21972,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94202148,"statfs":{"total":96636764160,"available":96462999552,"internally_reserved":0,"allocated":22499328,"data_stored":50460650,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575693,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103780,"kb_used_data":18524,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94268060,"statfs":{"total":96636764160,"available":96530493440,"internally_reserved":0,"allocated":18968576,"data_stored":42661752,"data_compressed":5896627,"data_compressed_allocated":7761920,"data_compressed_original":31666176,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18595840,"data_stored":41943914,"data_compressed":5864102,"data_compressed_allocated":7716864,"data_compressed_original":31092736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":50333180,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11448320,"data_stored":22231660,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18731008,"data_stored":35108096,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":50333560,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21352448,"data_stored":41654064,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":50333692,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30552064,"data_stored":71305850,"data_compressed":9910060,"data_compressed_allocated":12529664,"data_compressed_original":53317632,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.956 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.957 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.958 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.959 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.960 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-15T00:00:56.185619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=0, tm_sec=56, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.961 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.962 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.963 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.964 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-15T00:01:10.673886+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=10, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.965 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.966 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.967 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.968 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.969 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.969 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.969 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:00.969 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T01:11:06.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:11:06.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:11:20.970 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T01:11:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.085+0000 7f42692d5640 1 Processor -- start 2024-04-15T01:11:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.086+0000 7f42692d5640 1 -- start start 2024-04-15T01:11:21.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.086+0000 7f42692d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42640c1cd0 0x7f4264158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:21.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.086+0000 7f42692d5640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4264158120 con 0x7f42640c50d0 2024-04-15T01:11:21.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.086+0000 7f42692d5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42640c67e0 con 0x7f42640c54b0 2024-04-15T01:11:21.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.086+0000 7f42692d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f42640c6aa0 con 0x7f42640c1cd0 2024-04-15T01:11:21.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.087+0000 7f4262ffd640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f42640c50d0 0x7f4264140fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50108/0 (socket says 172.21.15.29:50108) 2024-04-15T01:11:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.087+0000 7f4262ffd640 1 -- 172.21.15.29:0/1068493521 learned_addr learned my addr 172.21.15.29:0/1068493521 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:21.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.087+0000 7f42637fe640 1 --2- 172.21.15.29:0/1068493521 >> v2:172.21.15.37:3300/0 conn(0x7f42640c1cd0 0x7f4264158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:21.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.090+0000 7f4261ffb640 1 -- 172.21.15.29:0/1068493521 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675935154 0 0) 0x7f4264158120 con 0x7f42640c50d0 2024-04-15T01:11:21.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.090+0000 7f4261ffb640 1 -- 172.21.15.29:0/1068493521 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4250003520 con 0x7f42640c50d0 2024-04-15T01:11:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.091+0000 7f42637fe640 1 -- 172.21.15.29:0/1068493521 >> v1:172.21.15.37:6789/0 conn(0x7f42640c54b0 legacy=0x7f42640c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.091+0000 7f42637fe640 1 -- 172.21.15.29:0/1068493521 >> v1:172.21.15.29:6789/0 conn(0x7f42640c50d0 legacy=0x7f4264140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.091+0000 7f42637fe640 1 -- 172.21.15.29:0/1068493521 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42641583c0 con 0x7f42640c1cd0 2024-04-15T01:11:21.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.096+0000 7f42637fe640 1 --2- 172.21.15.29:0/1068493521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f4264158bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f425c009800 tx=0x7f425c02b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d35c583f5b6e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.101+0000 7f4261ffb640 1 -- 172.21.15.29:0/1068493521 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c035020 con 0x7f42640c1cd0 2024-04-15T01:11:21.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.101+0000 7f4261ffb640 1 -- 172.21.15.29:0/1068493521 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c031890 con 0x7f42640c1cd0 2024-04-15T01:11:21.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.101+0000 7f4261ffb640 1 -- 172.21.15.29:0/1068493521 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c031c60 con 0x7f42640c1cd0 2024-04-15T01:11:21.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 -- 172.21.15.29:0/1068493521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 msgr2=0x7f4264158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 --2- 172.21.15.29:0/1068493521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f4264158bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f425c009800 tx=0x7f425c02b930 comp rx=0 tx=0).stop 2024-04-15T01:11:21.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 -- 172.21.15.29:0/1068493521 shutdown_connections 2024-04-15T01:11:21.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 --2- 172.21.15.29:0/1068493521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f4264158bc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 -- 172.21.15.29:0/1068493521 >> 172.21.15.29:0/1068493521 conn(0x7f426406fca0 msgr2=0x7f426406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 -- 172.21.15.29:0/1068493521 shutdown_connections 2024-04-15T01:11:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.102+0000 7f42692d5640 1 -- 172.21.15.29:0/1068493521 wait complete. 2024-04-15T01:11:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.103+0000 7f42692d5640 1 Processor -- start 2024-04-15T01:11:21.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.103+0000 7f42692d5640 1 -- start start 2024-04-15T01:11:21.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.104+0000 7f42692d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f42641efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:21.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.104+0000 7f42692d5640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42640c50d0 0x7f42640ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:21.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.104+0000 7f42692d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 0x7f42640c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:21.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.104+0000 7f42692d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f42641416c0 con 0x7f42640c54b0 2024-04-15T01:11:21.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.104+0000 7f42692d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42640c6d80 con 0x7f42640c1cd0 2024-04-15T01:11:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.104+0000 7f42692d5640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f4264141840 con 0x7f42640c50d0 2024-04-15T01:11:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.105+0000 7f42637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 0x7f42640c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.105+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f42641efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.105+0000 7f42627fc640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42640c50d0 0x7f42640ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:21.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.105+0000 7f42637fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 0x7f42640c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39572/0 (socket says 172.21.15.29:39572) 2024-04-15T01:11:21.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.105+0000 7f42637fe640 1 -- 172.21.15.29:0/3002316578 learned_addr learned my addr 172.21.15.29:0/3002316578 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.109+0000 7f42637fe640 1 -- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42640c50d0 msgr2=0x7f42640ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.109+0000 7f42637fe640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42640c50d0 0x7f42640ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.109+0000 7f42637fe640 1 -- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 msgr2=0x7f42641efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.109+0000 7f42637fe640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f42641efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.109+0000 7f42637fe640 1 -- 172.21.15.29:0/3002316578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264152b90 con 0x7f42640c54b0 2024-04-15T01:11:21.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.114+0000 7f42637fe640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 0x7f42640c3c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f425c009920 tx=0x7f425c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:21.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.117+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c035040 con 0x7f42640c54b0 2024-04-15T01:11:21.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.117+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c030ca0 con 0x7f42640c54b0 2024-04-15T01:11:21.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.117+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0466a0 con 0x7f42640c54b0 2024-04-15T01:11:21.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.117+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42641f36a0 con 0x7f42640c54b0 2024-04-15T01:11:21.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.118+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42641f3f40 con 0x7f42640c54b0 2024-04-15T01:11:21.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.118+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426404f540 con 0x7f42640c54b0 2024-04-15T01:11:21.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.137+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f425c038020 con 0x7f42640c54b0 2024-04-15T01:11:21.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.137+0000 7f425b7fe640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f424406b9e0 0x7f424406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:21.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.138+0000 7f4262ffd640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f424406b9e0 0x7f424406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:21.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.138+0000 7f4262ffd640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f424406b9e0 0x7f424406dea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4254005c00 tx=0x7f4254009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:21.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.141+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f425c030e50 con 0x7f42640c54b0 2024-04-15T01:11:21.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.402+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f425c02d040 con 0x7f42640c54b0 2024-04-15T01:11:21.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.588+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f426406d290 con 0x7f424406b9e0 2024-04-15T01:11:21.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.597+0000 7f425b7fe640 1 -- 172.21.15.29:0/3002316578 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335517 (secure 0 0 0) 0x7f426406d290 con 0x7f424406b9e0 2024-04-15T01:11:21.600 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:11:21.601 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T01:11:21.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f424406b9e0 msgr2=0x7f424406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f424406b9e0 0x7f424406dea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4254005c00 tx=0x7f4254009040 comp rx=0 tx=0).stop 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 msgr2=0x7f42640c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 0x7f42640c3c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f425c009920 tx=0x7f425c0046c0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 shutdown_connections 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f424406b9e0 0x7f424406dea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640c54b0 0x7f42640c3c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f42640c50d0 0x7f42640ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 --2- 172.21.15.29:0/3002316578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640c1cd0 0x7f42641efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 >> 172.21.15.29:0/3002316578 conn(0x7f426406fca0 msgr2=0x7f426406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 shutdown_connections 2024-04-15T01:11:21.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:21.600+0000 7f42692d5640 1 -- 172.21.15.29:0/3002316578 wait complete. 2024-04-15T01:11:21.611 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2135,"stamp":"2024-04-15T01:11:20.032387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182212376,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":6016,"num_read_kb":1595737,"num_write":54695,"num_write_kb":4529750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63655,"ondisk_log_size":63655,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1055832,"kb_used_data":171032,"kb_used_omap":12,"kb_used_meta":884723,"kb_avail":753918888,"statfs":{"total":773094113280,"available":772012941312,"internally_reserved":0,"allocated":175136768,"data_stored":365444512,"data_compressed":48398084,"data_compressed_allocated":63004672,"data_compressed_original":255000576,"omap_allocated":12751,"internal_metadata":905956913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003822"},"pg_stats":[{"pgid":"2.1f","version":"29'509","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.536897+0000","last_change":"2024-04-15T01:10:56.536932+0000","last_active":"2024-04-15T01:10:56.536897+0000","last_peered":"2024-04-15T01:10:56.536897+0000","last_clean":"2024-04-15T01:10:56.536897+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T01:10:56.536897+0000","last_undegraded":"2024-04-15T01:10:56.536897+0000","last_fullsized":"2024-04-15T01:10:56.536897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'509","last_scrub_stamp":"2024-04-15T01:10:56.536832+0000","last_deep_scrub":"29'509","last_deep_scrub_stamp":"2024-04-15T01:10:56.536832+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.536832+0000","objects_scrubbed":8,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:27:28.178951+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'200","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.793968+0000","last_change":"2024-04-15T01:10:58.793990+0000","last_active":"2024-04-15T01:10:58.793968+0000","last_peered":"2024-04-15T01:10:58.793968+0000","last_clean":"2024-04-15T01:10:58.793968+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T01:10:58.793968+0000","last_undegraded":"2024-04-15T01:10:58.793968+0000","last_fullsized":"2024-04-15T01:10:58.793968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:10:58.793894+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:10:58.793894+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.793894+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:07.404877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'821","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.910007+0000","last_change":"2024-04-15T01:11:13.910031+0000","last_active":"2024-04-15T01:11:13.910007+0000","last_peered":"2024-04-15T01:11:13.910007+0000","last_clean":"2024-04-15T01:11:13.910007+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T01:11:13.910007+0000","last_undegraded":"2024-04-15T01:11:13.910007+0000","last_fullsized":"2024-04-15T01:11:13.910007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'821","last_scrub_stamp":"2024-04-15T01:11:13.909923+0000","last_deep_scrub":"29'821","last_deep_scrub_stamp":"2024-04-15T01:11:13.909923+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.909923+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:39:23.876251+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":55758,"num_write":811,"num_write_kb":161190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'217","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.871929+0000","last_change":"2024-04-15T01:11:01.871960+0000","last_active":"2024-04-15T01:11:01.871929+0000","last_peered":"2024-04-15T01:11:01.871929+0000","last_clean":"2024-04-15T01:11:01.871929+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T01:11:01.871929+0000","last_undegraded":"2024-04-15T01:11:01.871929+0000","last_fullsized":"2024-04-15T01:11:01.871929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'217","last_scrub_stamp":"2024-04-15T01:11:01.871867+0000","last_deep_scrub":"29'217","last_deep_scrub_stamp":"2024-04-15T01:11:01.871867+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.871867+0000","objects_scrubbed":1,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:59:02.722892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'182","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.467298+0000","last_change":"2024-04-15T01:11:00.467320+0000","last_active":"2024-04-15T01:11:00.467298+0000","last_peered":"2024-04-15T01:11:00.467298+0000","last_clean":"2024-04-15T01:11:00.467298+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T01:11:00.467298+0000","last_undegraded":"2024-04-15T01:11:00.467298+0000","last_fullsized":"2024-04-15T01:11:00.467298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2024-04-15T01:11:00.467226+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2024-04-15T01:11:00.467226+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.467226+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:30.188360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'760","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.589931+0000","last_change":"2024-04-15T01:11:05.589961+0000","last_active":"2024-04-15T01:11:05.589931+0000","last_peered":"2024-04-15T01:11:05.589931+0000","last_clean":"2024-04-15T01:11:05.589931+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:11:05.589931+0000","last_undegraded":"2024-04-15T01:11:05.589931+0000","last_fullsized":"2024-04-15T01:11:05.589931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'760","last_scrub_stamp":"2024-04-15T01:11:05.589842+0000","last_deep_scrub":"29'760","last_deep_scrub_stamp":"2024-04-15T01:11:05.589842+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.589842+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:24:03.373295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42531,"num_write":744,"num_write_kb":122981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1129","reported_seq":1194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.165274+0000","last_change":"2024-04-15T01:11:07.165274+0000","last_active":"2024-04-15T01:11:07.165274+0000","last_peered":"2024-04-15T01:11:07.165274+0000","last_clean":"2024-04-15T01:11:07.165274+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T01:11:07.165274+0000","last_undegraded":"2024-04-15T01:11:07.165274+0000","last_fullsized":"2024-04-15T01:11:07.165274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1129","last_scrub_stamp":"2024-04-15T01:11:07.165168+0000","last_deep_scrub":"29'1129","last_deep_scrub_stamp":"2024-04-15T01:11:07.165168+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.165168+0000","objects_scrubbed":10,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:36:14.626695+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":12823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'190","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.461548+0000","last_change":"2024-04-15T01:11:13.461548+0000","last_active":"2024-04-15T01:11:13.461548+0000","last_peered":"2024-04-15T01:11:13.461548+0000","last_clean":"2024-04-15T01:11:13.461548+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T01:11:13.461548+0000","last_undegraded":"2024-04-15T01:11:13.461548+0000","last_fullsized":"2024-04-15T01:11:13.461548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'190","last_scrub_stamp":"2024-04-15T01:11:13.461445+0000","last_deep_scrub":"29'190","last_deep_scrub_stamp":"2024-04-15T01:11:13.461445+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.461445+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:13:54.094848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'741","reported_seq":819,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.616748+0000","last_change":"2024-04-15T01:11:11.616793+0000","last_active":"2024-04-15T01:11:11.616748+0000","last_peered":"2024-04-15T01:11:11.616748+0000","last_clean":"2024-04-15T01:11:11.616748+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T01:11:11.616748+0000","last_undegraded":"2024-04-15T01:11:11.616748+0000","last_fullsized":"2024-04-15T01:11:11.616748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'741","last_scrub_stamp":"2024-04-15T01:11:11.616652+0000","last_deep_scrub":"29'741","last_deep_scrub_stamp":"2024-04-15T01:11:11.616652+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.616652+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:24:19.394614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8438,"num_write":729,"num_write_kb":110173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'788","reported_seq":853,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.104023+0000","last_change":"2024-04-15T01:11:09.104023+0000","last_active":"2024-04-15T01:11:09.104023+0000","last_peered":"2024-04-15T01:11:09.104023+0000","last_clean":"2024-04-15T01:11:09.104023+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T01:11:09.104023+0000","last_undegraded":"2024-04-15T01:11:09.104023+0000","last_fullsized":"2024-04-15T01:11:09.104023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'788","last_scrub_stamp":"2024-04-15T01:11:09.103925+0000","last_deep_scrub":"29'788","last_deep_scrub_stamp":"2024-04-15T01:11:09.103925+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.103925+0000","objects_scrubbed":4,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:40:05.080889+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.430217+0000","last_change":"2024-04-15T01:11:12.430217+0000","last_active":"2024-04-15T01:11:12.430217+0000","last_peered":"2024-04-15T01:11:12.430217+0000","last_clean":"2024-04-15T01:11:12.430217+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T01:11:12.430217+0000","last_undegraded":"2024-04-15T01:11:12.430217+0000","last_fullsized":"2024-04-15T01:11:12.430217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-04-15T01:11:12.430089+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-04-15T01:11:12.430089+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.430089+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:47:26.460347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'759","reported_seq":876,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.651533+0000","last_change":"2024-04-15T01:11:07.651562+0000","last_active":"2024-04-15T01:11:07.651533+0000","last_peered":"2024-04-15T01:11:07.651533+0000","last_clean":"2024-04-15T01:11:07.651533+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T01:11:07.651533+0000","last_undegraded":"2024-04-15T01:11:07.651533+0000","last_fullsized":"2024-04-15T01:11:07.651533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'759","last_scrub_stamp":"2024-04-15T01:11:07.651437+0000","last_deep_scrub":"29'759","last_deep_scrub_stamp":"2024-04-15T01:11:07.651437+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.651437+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:40:03.353547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":36806,"num_write":750,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'207","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.180928+0000","last_change":"2024-04-15T01:11:10.180952+0000","last_active":"2024-04-15T01:11:10.180928+0000","last_peered":"2024-04-15T01:11:10.180928+0000","last_clean":"2024-04-15T01:11:10.180928+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T01:11:10.180928+0000","last_undegraded":"2024-04-15T01:11:10.180928+0000","last_fullsized":"2024-04-15T01:11:10.180928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:10.180838+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:10.180838+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.180838+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:27.799703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'920","reported_seq":988,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.132442+0000","last_change":"2024-04-15T01:11:08.132497+0000","last_active":"2024-04-15T01:11:08.132442+0000","last_peered":"2024-04-15T01:11:08.132442+0000","last_clean":"2024-04-15T01:11:08.132442+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T01:11:08.132442+0000","last_undegraded":"2024-04-15T01:11:08.132442+0000","last_fullsized":"2024-04-15T01:11:08.132442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'920","last_scrub_stamp":"2024-04-15T01:11:08.132348+0000","last_deep_scrub":"29'920","last_deep_scrub_stamp":"2024-04-15T01:11:08.132348+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.132348+0000","objects_scrubbed":4,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:03:15.333033+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":8649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'809","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.565580+0000","last_change":"2024-04-15T01:11:04.565580+0000","last_active":"2024-04-15T01:11:04.565580+0000","last_peered":"2024-04-15T01:11:04.565580+0000","last_clean":"2024-04-15T01:11:04.565580+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T01:11:04.565580+0000","last_undegraded":"2024-04-15T01:11:04.565580+0000","last_fullsized":"2024-04-15T01:11:04.565580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'809","last_scrub_stamp":"2024-04-15T01:11:04.565459+0000","last_deep_scrub":"29'809","last_deep_scrub_stamp":"2024-04-15T01:11:04.565459+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.565459+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:00:41.673390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":99885,"num_write":793,"num_write_kb":204639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'209","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.877340+0000","last_change":"2024-04-15T01:11:05.877361+0000","last_active":"2024-04-15T01:11:05.877340+0000","last_peered":"2024-04-15T01:11:05.877340+0000","last_clean":"2024-04-15T01:11:05.877340+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T01:11:05.877340+0000","last_undegraded":"2024-04-15T01:11:05.877340+0000","last_fullsized":"2024-04-15T01:11:05.877340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-04-15T01:11:05.877252+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-04-15T01:11:05.877252+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.877252+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:06:54.845694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'782","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.427100+0000","last_change":"2024-04-15T01:10:58.427127+0000","last_active":"2024-04-15T01:10:58.427100+0000","last_peered":"2024-04-15T01:10:58.427100+0000","last_clean":"2024-04-15T01:10:58.427100+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T01:10:58.427100+0000","last_undegraded":"2024-04-15T01:10:58.427100+0000","last_fullsized":"2024-04-15T01:10:58.427100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'782","last_scrub_stamp":"2024-04-15T01:10:58.427033+0000","last_deep_scrub":"29'782","last_deep_scrub_stamp":"2024-04-15T01:10:58.427033+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.427033+0000","objects_scrubbed":3,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:18:22.842557+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'885","reported_seq":1057,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.626607+0000","last_change":"2024-04-15T01:11:06.626634+0000","last_active":"2024-04-15T01:11:06.626607+0000","last_peered":"2024-04-15T01:11:06.626607+0000","last_clean":"2024-04-15T01:11:06.626607+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T01:11:06.626607+0000","last_undegraded":"2024-04-15T01:11:06.626607+0000","last_fullsized":"2024-04-15T01:11:06.626607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'885","last_scrub_stamp":"2024-04-15T01:11:06.626511+0000","last_deep_scrub":"29'885","last_deep_scrub_stamp":"2024-04-15T01:11:06.626511+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.626511+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:55:53.428811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52186,"num_write":871,"num_write_kb":181200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'202","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.849277+0000","last_change":"2024-04-15T01:11:04.849299+0000","last_active":"2024-04-15T01:11:04.849277+0000","last_peered":"2024-04-15T01:11:04.849277+0000","last_clean":"2024-04-15T01:11:04.849277+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T01:11:04.849277+0000","last_undegraded":"2024-04-15T01:11:04.849277+0000","last_fullsized":"2024-04-15T01:11:04.849277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-04-15T01:11:04.849208+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-04-15T01:11:04.849208+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.849208+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:10:11.454619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'200","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.433769+0000","last_change":"2024-04-15T01:10:59.433826+0000","last_active":"2024-04-15T01:10:59.433769+0000","last_peered":"2024-04-15T01:10:59.433769+0000","last_clean":"2024-04-15T01:10:59.433769+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T01:10:59.433769+0000","last_undegraded":"2024-04-15T01:10:59.433769+0000","last_fullsized":"2024-04-15T01:10:59.433769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:10:59.433659+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:10:59.433659+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.433659+0000","objects_scrubbed":5,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:44:05.065904+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'743","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.339200+0000","last_change":"2024-04-15T01:11:08.339223+0000","last_active":"2024-04-15T01:11:08.339200+0000","last_peered":"2024-04-15T01:11:08.339200+0000","last_clean":"2024-04-15T01:11:08.339200+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T01:11:08.339200+0000","last_undegraded":"2024-04-15T01:11:08.339200+0000","last_fullsized":"2024-04-15T01:11:08.339200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'743","last_scrub_stamp":"2024-04-15T01:11:08.339121+0000","last_deep_scrub":"29'743","last_deep_scrub_stamp":"2024-04-15T01:11:08.339121+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.339121+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:43:25.279905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58288,"num_write":731,"num_write_kb":102006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'221","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.540747+0000","last_change":"2024-04-15T01:10:59.540769+0000","last_active":"2024-04-15T01:10:59.540747+0000","last_peered":"2024-04-15T01:10:59.540747+0000","last_clean":"2024-04-15T01:10:59.540747+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T01:10:59.540747+0000","last_undegraded":"2024-04-15T01:10:59.540747+0000","last_fullsized":"2024-04-15T01:10:59.540747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'221","last_scrub_stamp":"2024-04-15T01:10:59.540679+0000","last_deep_scrub":"29'221","last_deep_scrub_stamp":"2024-04-15T01:10:59.540679+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.540679+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:43:38.623855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'785","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.215797+0000","last_change":"2024-04-15T01:11:05.215829+0000","last_active":"2024-04-15T01:11:05.215797+0000","last_peered":"2024-04-15T01:11:05.215797+0000","last_clean":"2024-04-15T01:11:05.215797+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T01:11:05.215797+0000","last_undegraded":"2024-04-15T01:11:05.215797+0000","last_fullsized":"2024-04-15T01:11:05.215797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'785","last_scrub_stamp":"2024-04-15T01:11:05.215725+0000","last_deep_scrub":"29'785","last_deep_scrub_stamp":"2024-04-15T01:11:05.215725+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.215725+0000","objects_scrubbed":2,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:55:52.018026+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'723","reported_seq":870,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.578758+0000","last_change":"2024-04-15T01:11:12.578785+0000","last_active":"2024-04-15T01:11:12.578758+0000","last_peered":"2024-04-15T01:11:12.578758+0000","last_clean":"2024-04-15T01:11:12.578758+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T01:11:12.578758+0000","last_undegraded":"2024-04-15T01:11:12.578758+0000","last_fullsized":"2024-04-15T01:11:12.578758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'723","last_scrub_stamp":"2024-04-15T01:11:12.578667+0000","last_deep_scrub":"29'723","last_deep_scrub_stamp":"2024-04-15T01:11:12.578667+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.578667+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:14:19.024027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":38800,"num_write":705,"num_write_kb":106309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'224","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.437480+0000","last_change":"2024-04-15T01:10:59.437527+0000","last_active":"2024-04-15T01:10:59.437480+0000","last_peered":"2024-04-15T01:10:59.437480+0000","last_clean":"2024-04-15T01:10:59.437480+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T01:10:59.437480+0000","last_undegraded":"2024-04-15T01:10:59.437480+0000","last_fullsized":"2024-04-15T01:10:59.437480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'224","last_scrub_stamp":"2024-04-15T01:10:59.437374+0000","last_deep_scrub":"29'224","last_deep_scrub_stamp":"2024-04-15T01:10:59.437374+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.437374+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:31:34.373883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'199","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.211269+0000","last_change":"2024-04-15T01:11:02.211303+0000","last_active":"2024-04-15T01:11:02.211269+0000","last_peered":"2024-04-15T01:11:02.211269+0000","last_clean":"2024-04-15T01:11:02.211269+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T01:11:02.211269+0000","last_undegraded":"2024-04-15T01:11:02.211269+0000","last_fullsized":"2024-04-15T01:11:02.211269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-04-15T01:11:02.211196+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-04-15T01:11:02.211196+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.211196+0000","objects_scrubbed":5,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:17:51.986656+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'797","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.623582+0000","last_change":"2024-04-15T01:11:09.623610+0000","last_active":"2024-04-15T01:11:09.623582+0000","last_peered":"2024-04-15T01:11:09.623582+0000","last_clean":"2024-04-15T01:11:09.623582+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T01:11:09.623582+0000","last_undegraded":"2024-04-15T01:11:09.623582+0000","last_fullsized":"2024-04-15T01:11:09.623582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'797","last_scrub_stamp":"2024-04-15T01:11:09.623497+0000","last_deep_scrub":"29'797","last_deep_scrub_stamp":"2024-04-15T01:11:09.623497+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.623497+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:03:16.824182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60896,"num_write":782,"num_write_kb":175614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'173","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.892705+0000","last_change":"2024-04-15T01:11:06.892755+0000","last_active":"2024-04-15T01:11:06.892705+0000","last_peered":"2024-04-15T01:11:06.892705+0000","last_clean":"2024-04-15T01:11:06.892705+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T01:11:06.892705+0000","last_undegraded":"2024-04-15T01:11:06.892705+0000","last_fullsized":"2024-04-15T01:11:06.892705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'173","last_scrub_stamp":"2024-04-15T01:11:06.892624+0000","last_deep_scrub":"29'173","last_deep_scrub_stamp":"2024-04-15T01:11:06.892624+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.892624+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:37:41.197869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3601","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.407855+0000","last_change":"2024-04-15T01:11:00.407903+0000","last_active":"2024-04-15T01:11:00.407855+0000","last_peered":"2024-04-15T01:11:00.407855+0000","last_clean":"2024-04-15T01:11:00.407855+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T01:11:00.407855+0000","last_undegraded":"2024-04-15T01:11:00.407855+0000","last_fullsized":"2024-04-15T01:11:00.407855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3601","last_scrub_stamp":"2024-04-15T01:11:00.407776+0000","last_deep_scrub":"29'3601","last_deep_scrub_stamp":"2024-04-15T01:11:00.407776+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.407776+0000","objects_scrubbed":4,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:09.018759+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10014,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'787","reported_seq":910,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:15.875209+0000","last_change":"2024-04-15T01:11:15.875269+0000","last_active":"2024-04-15T01:11:15.875209+0000","last_peered":"2024-04-15T01:11:15.875209+0000","last_clean":"2024-04-15T01:11:15.875209+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T01:11:15.875209+0000","last_undegraded":"2024-04-15T01:11:15.875209+0000","last_fullsized":"2024-04-15T01:11:15.875209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'787","last_scrub_stamp":"2024-04-15T01:11:15.875080+0000","last_deep_scrub":"29'787","last_deep_scrub_stamp":"2024-04-15T01:11:15.875080+0000","last_clean_scrub_stamp":"2024-04-15T01:11:15.875080+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:03.854813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27446,"num_write":780,"num_write_kb":102026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'200","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.316250+0000","last_change":"2024-04-15T01:11:04.316291+0000","last_active":"2024-04-15T01:11:04.316250+0000","last_peered":"2024-04-15T01:11:04.316250+0000","last_clean":"2024-04-15T01:11:04.316250+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T01:11:04.316250+0000","last_undegraded":"2024-04-15T01:11:04.316250+0000","last_fullsized":"2024-04-15T01:11:04.316250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:11:04.316147+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:11:04.316147+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.316147+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:41:58.928246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'597","reported_seq":667,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.180655+0000","last_change":"2024-04-15T01:11:06.180691+0000","last_active":"2024-04-15T01:11:06.180655+0000","last_peered":"2024-04-15T01:11:06.180655+0000","last_clean":"2024-04-15T01:11:06.180655+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T01:11:06.180655+0000","last_undegraded":"2024-04-15T01:11:06.180655+0000","last_fullsized":"2024-04-15T01:11:06.180655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'597","last_scrub_stamp":"2024-04-15T01:11:06.180585+0000","last_deep_scrub":"29'597","last_deep_scrub_stamp":"2024-04-15T01:11:06.180585+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.180585+0000","objects_scrubbed":5,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:40:01.882695+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'736","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.479540+0000","last_change":"2024-04-15T01:11:08.479563+0000","last_active":"2024-04-15T01:11:08.479540+0000","last_peered":"2024-04-15T01:11:08.479540+0000","last_clean":"2024-04-15T01:11:08.479540+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T01:11:08.479540+0000","last_undegraded":"2024-04-15T01:11:08.479540+0000","last_fullsized":"2024-04-15T01:11:08.479540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'736","last_scrub_stamp":"2024-04-15T01:11:08.479472+0000","last_deep_scrub":"29'736","last_deep_scrub_stamp":"2024-04-15T01:11:08.479472+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.479472+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:20.615454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":59617,"num_write":721,"num_write_kb":101495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'222","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.418014+0000","last_change":"2024-04-15T01:11:11.418056+0000","last_active":"2024-04-15T01:11:11.418014+0000","last_peered":"2024-04-15T01:11:11.418014+0000","last_clean":"2024-04-15T01:11:11.418014+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T01:11:11.418014+0000","last_undegraded":"2024-04-15T01:11:11.418014+0000","last_fullsized":"2024-04-15T01:11:11.418014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:11.417929+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:11.417929+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.417929+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:27:36.022108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'305","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.388014+0000","last_change":"2024-04-15T01:10:57.388064+0000","last_active":"2024-04-15T01:10:57.388014+0000","last_peered":"2024-04-15T01:10:57.388014+0000","last_clean":"2024-04-15T01:10:57.388014+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T01:10:57.388014+0000","last_undegraded":"2024-04-15T01:10:57.388014+0000","last_fullsized":"2024-04-15T01:10:57.388014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'305","last_scrub_stamp":"2024-04-15T01:10:57.387931+0000","last_deep_scrub":"29'305","last_deep_scrub_stamp":"2024-04-15T01:10:57.387931+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.387931+0000","objects_scrubbed":1,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:25:35.153942+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'778","reported_seq":921,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.344730+0000","last_change":"2024-04-15T01:11:09.344754+0000","last_active":"2024-04-15T01:11:09.344730+0000","last_peered":"2024-04-15T01:11:09.344730+0000","last_clean":"2024-04-15T01:11:09.344730+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T01:11:09.344730+0000","last_undegraded":"2024-04-15T01:11:09.344730+0000","last_fullsized":"2024-04-15T01:11:09.344730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'778","last_scrub_stamp":"2024-04-15T01:11:09.344649+0000","last_deep_scrub":"29'778","last_deep_scrub_stamp":"2024-04-15T01:11:09.344649+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.344649+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:44:27.620741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":54040,"num_write":767,"num_write_kb":142606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'203","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.566448+0000","last_change":"2024-04-15T01:11:03.566473+0000","last_active":"2024-04-15T01:11:03.566448+0000","last_peered":"2024-04-15T01:11:03.566448+0000","last_clean":"2024-04-15T01:11:03.566448+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T01:11:03.566448+0000","last_undegraded":"2024-04-15T01:11:03.566448+0000","last_fullsized":"2024-04-15T01:11:03.566448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-04-15T01:11:03.566361+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-04-15T01:11:03.566361+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.566361+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:26:58.505142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'992","reported_seq":1062,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.478976+0000","last_change":"2024-04-15T01:11:02.479005+0000","last_active":"2024-04-15T01:11:02.478976+0000","last_peered":"2024-04-15T01:11:02.478976+0000","last_clean":"2024-04-15T01:11:02.478976+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T01:11:02.478976+0000","last_undegraded":"2024-04-15T01:11:02.478976+0000","last_fullsized":"2024-04-15T01:11:02.478976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'992","last_scrub_stamp":"2024-04-15T01:11:02.478908+0000","last_deep_scrub":"29'992","last_deep_scrub_stamp":"2024-04-15T01:11:02.478908+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.478908+0000","objects_scrubbed":4,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:45:47.514918+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":8655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'695","reported_seq":786,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:36.352383+0000","last_change":"2024-04-15T00:01:50.003001+0000","last_active":"2024-04-15T01:10:36.352383+0000","last_peered":"2024-04-15T01:10:36.352383+0000","last_clean":"2024-04-15T01:10:36.352383+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T01:10:36.352383+0000","last_undegraded":"2024-04-15T01:10:36.352383+0000","last_fullsized":"2024-04-15T01:10:36.352383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22523,"num_write":688,"num_write_kb":89336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"29'209","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.335550+0000","last_change":"2024-04-15T01:10:56.335592+0000","last_active":"2024-04-15T01:10:56.335550+0000","last_peered":"2024-04-15T01:10:56.335550+0000","last_clean":"2024-04-15T01:10:56.335550+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T01:10:56.335550+0000","last_undegraded":"2024-04-15T01:10:56.335550+0000","last_fullsized":"2024-04-15T01:10:56.335550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-04-15T01:10:56.335446+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-04-15T01:10:56.335446+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.335446+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:52.089612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3015","reported_seq":6033,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.853997+0000","last_change":"2024-04-15T01:10:58.854028+0000","last_active":"2024-04-15T01:10:58.853997+0000","last_peered":"2024-04-15T01:10:58.853997+0000","last_clean":"2024-04-15T01:10:58.853997+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T01:10:58.853997+0000","last_undegraded":"2024-04-15T01:10:58.853997+0000","last_fullsized":"2024-04-15T01:10:58.853997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3015","last_scrub_stamp":"2024-04-15T01:10:58.853928+0000","last_deep_scrub":"29'3015","last_deep_scrub_stamp":"2024-04-15T01:10:58.853928+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.853928+0000","objects_scrubbed":4,"log_size":3015,"log_dups_size":0,"ondisk_log_size":3015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:17:17.023375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":2955,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'697","reported_seq":798,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.332494+0000","last_change":"2024-04-15T01:11:10.332517+0000","last_active":"2024-04-15T01:11:10.332494+0000","last_peered":"2024-04-15T01:11:10.332494+0000","last_clean":"2024-04-15T01:11:10.332494+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T01:11:10.332494+0000","last_undegraded":"2024-04-15T01:11:10.332494+0000","last_fullsized":"2024-04-15T01:11:10.332494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2024-04-15T01:11:10.332418+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2024-04-15T01:11:10.332418+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.332418+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:47:24.362676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19611,"num_write":689,"num_write_kb":76681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.487581+0000","last_change":"2024-04-15T01:11:05.487604+0000","last_active":"2024-04-15T01:11:05.487581+0000","last_peered":"2024-04-15T01:11:05.487581+0000","last_clean":"2024-04-15T01:11:05.487581+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T01:11:05.487581+0000","last_undegraded":"2024-04-15T01:11:05.487581+0000","last_fullsized":"2024-04-15T01:11:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'198","last_scrub_stamp":"2024-04-15T01:11:05.487511+0000","last_deep_scrub":"29'198","last_deep_scrub_stamp":"2024-04-15T01:11:05.487511+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.487511+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:23.106376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'494","reported_seq":565,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.185556+0000","last_change":"2024-04-15T01:11:04.185629+0000","last_active":"2024-04-15T01:11:04.185556+0000","last_peered":"2024-04-15T01:11:04.185556+0000","last_clean":"2024-04-15T01:11:04.185556+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T01:11:04.185556+0000","last_undegraded":"2024-04-15T01:11:04.185556+0000","last_fullsized":"2024-04-15T01:11:04.185556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'494","last_scrub_stamp":"2024-04-15T01:11:04.185463+0000","last_deep_scrub":"29'494","last_deep_scrub_stamp":"2024-04-15T01:11:04.185463+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.185463+0000","objects_scrubbed":4,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:24:01.968916+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'862","reported_seq":1073,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.493434+0000","last_change":"2024-04-15T01:11:09.493459+0000","last_active":"2024-04-15T01:11:09.493434+0000","last_peered":"2024-04-15T01:11:09.493434+0000","last_clean":"2024-04-15T01:11:09.493434+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T01:11:09.493434+0000","last_undegraded":"2024-04-15T01:11:09.493434+0000","last_fullsized":"2024-04-15T01:11:09.493434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'862","last_scrub_stamp":"2024-04-15T01:11:09.493356+0000","last_deep_scrub":"29'862","last_deep_scrub_stamp":"2024-04-15T01:11:09.493356+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.493356+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:00.021790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":84642,"num_write":849,"num_write_kb":128022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'185","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.347201+0000","last_change":"2024-04-15T01:11:12.347226+0000","last_active":"2024-04-15T01:11:12.347201+0000","last_peered":"2024-04-15T01:11:12.347201+0000","last_clean":"2024-04-15T01:11:12.347201+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T01:11:12.347201+0000","last_undegraded":"2024-04-15T01:11:12.347201+0000","last_fullsized":"2024-04-15T01:11:12.347201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'185","last_scrub_stamp":"2024-04-15T01:11:12.347120+0000","last_deep_scrub":"29'185","last_deep_scrub_stamp":"2024-04-15T01:11:12.347120+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.347120+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:39.206718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"29'305","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.431483+0000","last_change":"2024-04-15T01:11:03.431516+0000","last_active":"2024-04-15T01:11:03.431483+0000","last_peered":"2024-04-15T01:11:03.431483+0000","last_clean":"2024-04-15T01:11:03.431483+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T01:11:03.431483+0000","last_undegraded":"2024-04-15T01:11:03.431483+0000","last_fullsized":"2024-04-15T01:11:03.431483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'305","last_scrub_stamp":"2024-04-15T01:11:03.431406+0000","last_deep_scrub":"29'305","last_deep_scrub_stamp":"2024-04-15T01:11:03.431406+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.431406+0000","objects_scrubbed":6,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:35:37.791948+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":229,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.118393+0000","last_change":"2024-04-15T01:11:03.118420+0000","last_active":"2024-04-15T01:11:03.118393+0000","last_peered":"2024-04-15T01:11:03.118393+0000","last_clean":"2024-04-15T01:11:03.118393+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T01:11:03.118393+0000","last_undegraded":"2024-04-15T01:11:03.118393+0000","last_fullsized":"2024-04-15T01:11:03.118393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-15T01:11:03.118329+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-15T01:11:03.118329+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.118329+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:00:40.226260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'808","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.190765+0000","last_change":"2024-04-15T01:11:12.190790+0000","last_active":"2024-04-15T01:11:12.190765+0000","last_peered":"2024-04-15T01:11:12.190765+0000","last_clean":"2024-04-15T01:11:12.190765+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T01:11:12.190765+0000","last_undegraded":"2024-04-15T01:11:12.190765+0000","last_fullsized":"2024-04-15T01:11:12.190765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'808","last_scrub_stamp":"2024-04-15T01:11:12.190685+0000","last_deep_scrub":"29'808","last_deep_scrub_stamp":"2024-04-15T01:11:12.190685+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.190685+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:18.022611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":51109,"num_write":790,"num_write_kb":155353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'208","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.140862+0000","last_change":"2024-04-15T01:11:11.140910+0000","last_active":"2024-04-15T01:11:11.140862+0000","last_peered":"2024-04-15T01:11:11.140862+0000","last_clean":"2024-04-15T01:11:11.140862+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T01:11:11.140862+0000","last_undegraded":"2024-04-15T01:11:11.140862+0000","last_fullsized":"2024-04-15T01:11:11.140862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:11:11.140743+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:11:11.140743+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.140743+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:23.276726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'254","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.811401+0000","last_change":"2024-04-15T01:10:59.811401+0000","last_active":"2024-04-15T01:10:59.811401+0000","last_peered":"2024-04-15T01:10:59.811401+0000","last_clean":"2024-04-15T01:10:59.811401+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T01:10:59.811401+0000","last_undegraded":"2024-04-15T01:10:59.811401+0000","last_fullsized":"2024-04-15T01:10:59.811401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'254","last_scrub_stamp":"2024-04-15T01:10:59.811315+0000","last_deep_scrub":"29'254","last_deep_scrub_stamp":"2024-04-15T01:10:59.811315+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.811315+0000","objects_scrubbed":4,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:23:31.516435+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3902566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'818","reported_seq":1009,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.177993+0000","last_change":"2024-04-15T01:11:13.178016+0000","last_active":"2024-04-15T01:11:13.177993+0000","last_peered":"2024-04-15T01:11:13.177993+0000","last_clean":"2024-04-15T01:11:13.177993+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T01:11:13.177993+0000","last_undegraded":"2024-04-15T01:11:13.177993+0000","last_fullsized":"2024-04-15T01:11:13.177993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'818","last_scrub_stamp":"2024-04-15T01:11:13.177916+0000","last_deep_scrub":"29'818","last_deep_scrub_stamp":"2024-04-15T01:11:13.177916+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.177916+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:25.313899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":80804,"num_write":805,"num_write_kb":188613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.504114+0000","last_change":"2024-04-15T01:10:59.504114+0000","last_active":"2024-04-15T01:10:59.504114+0000","last_peered":"2024-04-15T01:10:59.504114+0000","last_clean":"2024-04-15T01:10:59.504114+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T01:10:59.504114+0000","last_undegraded":"2024-04-15T01:10:59.504114+0000","last_fullsized":"2024-04-15T01:10:59.504114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'226","last_scrub_stamp":"2024-04-15T01:10:59.504018+0000","last_deep_scrub":"29'226","last_deep_scrub_stamp":"2024-04-15T01:10:59.504018+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.504018+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:37:26.107162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'783","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.420525+0000","last_change":"2024-04-15T01:11:01.420551+0000","last_active":"2024-04-15T01:11:01.420525+0000","last_peered":"2024-04-15T01:11:01.420525+0000","last_clean":"2024-04-15T01:11:01.420525+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T01:11:01.420525+0000","last_undegraded":"2024-04-15T01:11:01.420525+0000","last_fullsized":"2024-04-15T01:11:01.420525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'783","last_scrub_stamp":"2024-04-15T01:11:01.420466+0000","last_deep_scrub":"29'783","last_deep_scrub_stamp":"2024-04-15T01:11:01.420466+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.420466+0000","objects_scrubbed":2,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:45:39.666097+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'763","reported_seq":920,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.469621+0000","last_change":"2024-04-15T01:11:10.469669+0000","last_active":"2024-04-15T01:11:10.469621+0000","last_peered":"2024-04-15T01:11:10.469621+0000","last_clean":"2024-04-15T01:11:10.469621+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T01:11:10.469621+0000","last_undegraded":"2024-04-15T01:11:10.469621+0000","last_fullsized":"2024-04-15T01:11:10.469621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'763","last_scrub_stamp":"2024-04-15T01:11:10.469532+0000","last_deep_scrub":"29'763","last_deep_scrub_stamp":"2024-04-15T01:11:10.469532+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.469532+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:53.924048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":61965,"num_write":764,"num_write_kb":101545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:44.095097+0000","last_change":"2024-04-15T00:01:12.996040+0000","last_active":"2024-04-15T01:10:44.095097+0000","last_peered":"2024-04-15T01:10:44.095097+0000","last_clean":"2024-04-15T01:10:44.095097+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T01:10:44.095097+0000","last_undegraded":"2024-04-15T01:10:44.095097+0000","last_fullsized":"2024-04-15T01:10:44.095097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'786","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.832224+0000","last_change":"2024-04-15T01:10:57.832224+0000","last_active":"2024-04-15T01:10:57.832224+0000","last_peered":"2024-04-15T01:10:57.832224+0000","last_clean":"2024-04-15T01:10:57.832224+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T01:10:57.832224+0000","last_undegraded":"2024-04-15T01:10:57.832224+0000","last_fullsized":"2024-04-15T01:10:57.832224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'786","last_scrub_stamp":"2024-04-15T01:10:57.832132+0000","last_deep_scrub":"29'786","last_deep_scrub_stamp":"2024-04-15T01:10:57.832132+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.832132+0000","objects_scrubbed":3,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:06:07.506490+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'786","reported_seq":925,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:40.354296+0000","last_change":"2024-04-15T00:01:18.979280+0000","last_active":"2024-04-15T01:10:40.354296+0000","last_peered":"2024-04-15T01:10:40.354296+0000","last_clean":"2024-04-15T01:10:40.354296+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T01:10:40.354296+0000","last_undegraded":"2024-04-15T01:10:40.354296+0000","last_fullsized":"2024-04-15T01:10:40.354296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":35671,"num_write":777,"num_write_kb":118402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.275315+0000","last_change":"2024-04-15T00:01:12.995840+0000","last_active":"2024-04-15T01:11:00.275315+0000","last_peered":"2024-04-15T01:11:00.275315+0000","last_clean":"2024-04-15T01:11:00.275315+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T01:11:00.275315+0000","last_undegraded":"2024-04-15T01:11:00.275315+0000","last_fullsized":"2024-04-15T01:11:00.275315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'768","reported_seq":835,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.520991+0000","last_change":"2024-04-15T01:10:58.521021+0000","last_active":"2024-04-15T01:10:58.520991+0000","last_peered":"2024-04-15T01:10:58.520991+0000","last_clean":"2024-04-15T01:10:58.520991+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T01:10:58.520991+0000","last_undegraded":"2024-04-15T01:10:58.520991+0000","last_fullsized":"2024-04-15T01:10:58.520991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'768","last_scrub_stamp":"2024-04-15T01:10:58.520922+0000","last_deep_scrub":"29'768","last_deep_scrub_stamp":"2024-04-15T01:10:58.520922+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.520922+0000","objects_scrubbed":3,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:47:08.375904+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'816","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.645994+0000","last_change":"2024-04-15T01:11:08.646017+0000","last_active":"2024-04-15T01:11:08.645994+0000","last_peered":"2024-04-15T01:11:08.645994+0000","last_clean":"2024-04-15T01:11:08.645994+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T01:11:08.645994+0000","last_undegraded":"2024-04-15T01:11:08.645994+0000","last_fullsized":"2024-04-15T01:11:08.645994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'816","last_scrub_stamp":"2024-04-15T01:11:08.645917+0000","last_deep_scrub":"29'816","last_deep_scrub_stamp":"2024-04-15T01:11:08.645917+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.645917+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:36:16.107444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39992,"num_write":799,"num_write_kb":139135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'231","reported_seq":296,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:15.188421+0000","last_change":"2024-04-15T01:11:15.188421+0000","last_active":"2024-04-15T01:11:15.188421+0000","last_peered":"2024-04-15T01:11:15.188421+0000","last_clean":"2024-04-15T01:11:15.188421+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T01:11:15.188421+0000","last_undegraded":"2024-04-15T01:11:15.188421+0000","last_fullsized":"2024-04-15T01:11:15.188421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'231","last_scrub_stamp":"2024-04-15T01:11:15.188330+0000","last_deep_scrub":"29'231","last_deep_scrub_stamp":"2024-04-15T01:11:15.188330+0000","last_clean_scrub_stamp":"2024-04-15T01:11:15.188330+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:20:22.331172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'483","reported_seq":550,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.793211+0000","last_change":"2024-04-15T01:10:56.793211+0000","last_active":"2024-04-15T01:10:56.793211+0000","last_peered":"2024-04-15T01:10:56.793211+0000","last_clean":"2024-04-15T01:10:56.793211+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T01:10:56.793211+0000","last_undegraded":"2024-04-15T01:10:56.793211+0000","last_fullsized":"2024-04-15T01:10:56.793211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'483","last_scrub_stamp":"2024-04-15T01:10:56.793112+0000","last_deep_scrub":"29'483","last_deep_scrub_stamp":"2024-04-15T01:10:56.793112+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.793112+0000","objects_scrubbed":10,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:03.529617+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":8414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'762","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.440271+0000","last_change":"2024-04-15T01:11:11.440294+0000","last_active":"2024-04-15T01:11:11.440271+0000","last_peered":"2024-04-15T01:11:11.440271+0000","last_clean":"2024-04-15T01:11:11.440271+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T01:11:11.440271+0000","last_undegraded":"2024-04-15T01:11:11.440271+0000","last_fullsized":"2024-04-15T01:11:11.440271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'762","last_scrub_stamp":"2024-04-15T01:11:11.440201+0000","last_deep_scrub":"29'762","last_deep_scrub_stamp":"2024-04-15T01:11:11.440201+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.440201+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:12:17.772861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":53894,"num_write":751,"num_write_kb":106228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.198797+0000","last_change":"2024-04-15T01:11:05.198797+0000","last_active":"2024-04-15T01:11:05.198797+0000","last_peered":"2024-04-15T01:11:05.198797+0000","last_clean":"2024-04-15T01:11:05.198797+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T01:11:05.198797+0000","last_undegraded":"2024-04-15T01:11:05.198797+0000","last_fullsized":"2024-04-15T01:11:05.198797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-04-15T01:11:05.198658+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-04-15T01:11:05.198658+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.198658+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:34.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'65","reported_seq":132,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.195324+0000","last_change":"2024-04-15T01:11:03.195324+0000","last_active":"2024-04-15T01:11:03.195324+0000","last_peered":"2024-04-15T01:11:03.195324+0000","last_clean":"2024-04-15T01:11:03.195324+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T01:11:03.195324+0000","last_undegraded":"2024-04-15T01:11:03.195324+0000","last_fullsized":"2024-04-15T01:11:03.195324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-04-15T01:11:03.195226+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-04-15T01:11:03.195226+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.195226+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:19:35.678133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'778","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:35.206222+0000","last_change":"2024-04-15T00:01:50.326200+0000","last_active":"2024-04-15T01:10:35.206222+0000","last_peered":"2024-04-15T01:10:35.206222+0000","last_clean":"2024-04-15T01:10:35.206222+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T01:10:35.206222+0000","last_undegraded":"2024-04-15T01:10:35.206222+0000","last_fullsized":"2024-04-15T01:10:35.206222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:17.665799+0000","last_clean_scrub_stamp":"2024-04-15T00:01:17.665799+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":41754,"num_write":768,"num_write_kb":168968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'200","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.275321+0000","last_change":"2024-04-15T00:01:12.995510+0000","last_active":"2024-04-15T01:11:00.275321+0000","last_peered":"2024-04-15T01:11:00.275321+0000","last_clean":"2024-04-15T01:11:00.275321+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T01:11:00.275321+0000","last_undegraded":"2024-04-15T01:11:00.275321+0000","last_fullsized":"2024-04-15T01:11:00.275321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T00:01:11.803706+0000","last_clean_scrub_stamp":"2024-04-15T00:01:11.803706+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'63","reported_seq":130,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.493312+0000","last_change":"2024-04-15T01:11:01.493312+0000","last_active":"2024-04-15T01:11:01.493312+0000","last_peered":"2024-04-15T01:11:01.493312+0000","last_clean":"2024-04-15T01:11:01.493312+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T01:11:01.493312+0000","last_undegraded":"2024-04-15T01:11:01.493312+0000","last_fullsized":"2024-04-15T01:11:01.493312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-15T01:11:01.493199+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-15T01:11:01.493199+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.493199+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:48.146319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'697","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.889201+0000","last_change":"2024-04-15T01:11:12.889230+0000","last_active":"2024-04-15T01:11:12.889201+0000","last_peered":"2024-04-15T01:11:12.889201+0000","last_clean":"2024-04-15T01:11:12.889201+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T01:11:12.889201+0000","last_undegraded":"2024-04-15T01:11:12.889201+0000","last_fullsized":"2024-04-15T01:11:12.889201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2024-04-15T01:11:12.889103+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2024-04-15T01:11:12.889103+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.889103+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:29:19.791447+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":31143,"num_write":687,"num_write_kb":101153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'209","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.418317+0000","last_change":"2024-04-15T01:11:03.418317+0000","last_active":"2024-04-15T01:11:03.418317+0000","last_peered":"2024-04-15T01:11:03.418317+0000","last_clean":"2024-04-15T01:11:03.418317+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T01:11:03.418317+0000","last_undegraded":"2024-04-15T01:11:03.418317+0000","last_fullsized":"2024-04-15T01:11:03.418317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-04-15T01:11:03.418233+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-04-15T01:11:03.418233+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.418233+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:05:49.129167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'398","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.509382+0000","last_change":"2024-04-15T01:10:57.509382+0000","last_active":"2024-04-15T01:10:57.509382+0000","last_peered":"2024-04-15T01:10:57.509382+0000","last_clean":"2024-04-15T01:10:57.509382+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T01:10:57.509382+0000","last_undegraded":"2024-04-15T01:10:57.509382+0000","last_fullsized":"2024-04-15T01:10:57.509382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'398","last_scrub_stamp":"2024-04-15T01:10:57.509229+0000","last_deep_scrub":"29'398","last_deep_scrub_stamp":"2024-04-15T01:10:57.509229+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.509229+0000","objects_scrubbed":8,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:17:47.284689+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'747","reported_seq":916,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.468276+0000","last_change":"2024-04-15T01:11:14.468298+0000","last_active":"2024-04-15T01:11:14.468276+0000","last_peered":"2024-04-15T01:11:14.468276+0000","last_clean":"2024-04-15T01:11:14.468276+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T01:11:14.468276+0000","last_undegraded":"2024-04-15T01:11:14.468276+0000","last_fullsized":"2024-04-15T01:11:14.468276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'747","last_scrub_stamp":"2024-04-15T01:11:14.468204+0000","last_deep_scrub":"29'747","last_deep_scrub_stamp":"2024-04-15T01:11:14.468204+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.468204+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:28:20.128198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":56791,"num_write":733,"num_write_kb":134490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.172695+0000","last_change":"2024-04-15T01:11:14.172718+0000","last_active":"2024-04-15T01:11:14.172695+0000","last_peered":"2024-04-15T01:11:14.172695+0000","last_clean":"2024-04-15T01:11:14.172695+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T01:11:14.172695+0000","last_undegraded":"2024-04-15T01:11:14.172695+0000","last_fullsized":"2024-04-15T01:11:14.172695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:14.172629+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:14.172629+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.172629+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:12:20.505289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1430","reported_seq":1496,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.256437+0000","last_change":"2024-04-15T01:11:01.256474+0000","last_active":"2024-04-15T01:11:01.256437+0000","last_peered":"2024-04-15T01:11:01.256437+0000","last_clean":"2024-04-15T01:11:01.256437+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T01:11:01.256437+0000","last_undegraded":"2024-04-15T01:11:01.256437+0000","last_fullsized":"2024-04-15T01:11:01.256437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1430","last_scrub_stamp":"2024-04-15T01:11:01.256371+0000","last_deep_scrub":"29'1430","last_deep_scrub_stamp":"2024-04-15T01:11:01.256371+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.256371+0000","objects_scrubbed":8,"log_size":1430,"log_dups_size":0,"ondisk_log_size":1430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:15.898347+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":13127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'798","reported_seq":942,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.299646+0000","last_change":"2024-04-15T01:11:11.299671+0000","last_active":"2024-04-15T01:11:11.299646+0000","last_peered":"2024-04-15T01:11:11.299646+0000","last_clean":"2024-04-15T01:11:11.299646+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T01:11:11.299646+0000","last_undegraded":"2024-04-15T01:11:11.299646+0000","last_fullsized":"2024-04-15T01:11:11.299646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'798","last_scrub_stamp":"2024-04-15T01:11:11.299568+0000","last_deep_scrub":"29'798","last_deep_scrub_stamp":"2024-04-15T01:11:11.299568+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.299568+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:24:13.051537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":58877,"num_write":785,"num_write_kb":152322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'203","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.586352+0000","last_change":"2024-04-15T01:11:02.586373+0000","last_active":"2024-04-15T01:11:02.586352+0000","last_peered":"2024-04-15T01:11:02.586352+0000","last_clean":"2024-04-15T01:11:02.586352+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T01:11:02.586352+0000","last_undegraded":"2024-04-15T01:11:02.586352+0000","last_fullsized":"2024-04-15T01:11:02.586352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-04-15T01:11:02.586284+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-04-15T01:11:02.586284+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.586284+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:07:04.301268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1848","reported_seq":1914,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.383896+0000","last_change":"2024-04-15T01:11:02.383896+0000","last_active":"2024-04-15T01:11:02.383896+0000","last_peered":"2024-04-15T01:11:02.383896+0000","last_clean":"2024-04-15T01:11:02.383896+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T01:11:02.383896+0000","last_undegraded":"2024-04-15T01:11:02.383896+0000","last_fullsized":"2024-04-15T01:11:02.383896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1848","last_scrub_stamp":"2024-04-15T01:11:02.383807+0000","last_deep_scrub":"29'1848","last_deep_scrub_stamp":"2024-04-15T01:11:02.383807+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.383807+0000","objects_scrubbed":5,"log_size":1848,"log_dups_size":0,"ondisk_log_size":1848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:05.447791+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":5818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'701","reported_seq":819,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.586580+0000","last_change":"2024-04-15T01:11:10.586604+0000","last_active":"2024-04-15T01:11:10.586580+0000","last_peered":"2024-04-15T01:11:10.586580+0000","last_clean":"2024-04-15T01:11:10.586580+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T01:11:10.586580+0000","last_undegraded":"2024-04-15T01:11:10.586580+0000","last_fullsized":"2024-04-15T01:11:10.586580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'701","last_scrub_stamp":"2024-04-15T01:11:10.586507+0000","last_deep_scrub":"29'701","last_deep_scrub_stamp":"2024-04-15T01:11:10.586507+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.586507+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:40:06.563471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35520,"num_write":691,"num_write_kb":85742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.435934+0000","last_change":"2024-04-15T01:11:01.435934+0000","last_active":"2024-04-15T01:11:01.435934+0000","last_peered":"2024-04-15T01:11:01.435934+0000","last_clean":"2024-04-15T01:11:01.435934+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T01:11:01.435934+0000","last_undegraded":"2024-04-15T01:11:01.435934+0000","last_fullsized":"2024-04-15T01:11:01.435934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'192","last_scrub_stamp":"2024-04-15T01:11:01.435849+0000","last_deep_scrub":"29'192","last_deep_scrub_stamp":"2024-04-15T01:11:01.435849+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.435849+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:35:59.555166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'399","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.393761+0000","last_change":"2024-04-15T01:11:04.393815+0000","last_active":"2024-04-15T01:11:04.393761+0000","last_peered":"2024-04-15T01:11:04.393761+0000","last_clean":"2024-04-15T01:11:04.393761+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T01:11:04.393761+0000","last_undegraded":"2024-04-15T01:11:04.393761+0000","last_fullsized":"2024-04-15T01:11:04.393761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'399","last_scrub_stamp":"2024-04-15T01:11:04.393645+0000","last_deep_scrub":"29'399","last_deep_scrub_stamp":"2024-04-15T01:11:04.393645+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.393645+0000","objects_scrubbed":3,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:59:05.244670+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'858","reported_seq":992,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.894638+0000","last_change":"2024-04-15T01:11:11.894662+0000","last_active":"2024-04-15T01:11:11.894638+0000","last_peered":"2024-04-15T01:11:11.894638+0000","last_clean":"2024-04-15T01:11:11.894638+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T01:11:11.894638+0000","last_undegraded":"2024-04-15T01:11:11.894638+0000","last_fullsized":"2024-04-15T01:11:11.894638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'858","last_scrub_stamp":"2024-04-15T01:11:11.894555+0000","last_deep_scrub":"29'858","last_deep_scrub_stamp":"2024-04-15T01:11:11.894555+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.894555+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:32:26.165533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":40736,"num_write":845,"num_write_kb":155666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'215","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.522558+0000","last_change":"2024-04-15T01:11:00.522581+0000","last_active":"2024-04-15T01:11:00.522558+0000","last_peered":"2024-04-15T01:11:00.522558+0000","last_clean":"2024-04-15T01:11:00.522558+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T01:11:00.522558+0000","last_undegraded":"2024-04-15T01:11:00.522558+0000","last_fullsized":"2024-04-15T01:11:00.522558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-04-15T01:11:00.522492+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-04-15T01:11:00.522492+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.522492+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:15:04.430537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'70","reported_seq":135,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.252185+0000","last_change":"2024-04-15T01:11:00.252212+0000","last_active":"2024-04-15T01:11:00.252185+0000","last_peered":"2024-04-15T01:11:00.252185+0000","last_clean":"2024-04-15T01:11:00.252185+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T01:11:00.252185+0000","last_undegraded":"2024-04-15T01:11:00.252185+0000","last_fullsized":"2024-04-15T01:11:00.252185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'70","last_scrub_stamp":"2024-04-15T01:11:00.252121+0000","last_deep_scrub":"29'70","last_deep_scrub_stamp":"2024-04-15T01:11:00.252121+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.252121+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:22.619302+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'833","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.889074+0000","last_change":"2024-04-15T01:11:14.889108+0000","last_active":"2024-04-15T01:11:14.889074+0000","last_peered":"2024-04-15T01:11:14.889074+0000","last_clean":"2024-04-15T01:11:14.889074+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T01:11:14.889074+0000","last_undegraded":"2024-04-15T01:11:14.889074+0000","last_fullsized":"2024-04-15T01:11:14.889074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'833","last_scrub_stamp":"2024-04-15T01:11:14.888997+0000","last_deep_scrub":"29'833","last_deep_scrub_stamp":"2024-04-15T01:11:14.888997+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.888997+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:17:13.081184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":38336,"num_write":816,"num_write_kb":147104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'791","reported_seq":952,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.518582+0000","last_change":"2024-04-15T01:11:07.518603+0000","last_active":"2024-04-15T01:11:07.518582+0000","last_peered":"2024-04-15T01:11:07.518582+0000","last_clean":"2024-04-15T01:11:07.518582+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T01:11:07.518582+0000","last_undegraded":"2024-04-15T01:11:07.518582+0000","last_fullsized":"2024-04-15T01:11:07.518582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'791","last_scrub_stamp":"2024-04-15T01:11:07.518514+0000","last_deep_scrub":"29'791","last_deep_scrub_stamp":"2024-04-15T01:11:07.518514+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.518514+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:13.350440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":55193,"num_write":783,"num_write_kb":131702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'213","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.345995+0000","last_change":"2024-04-15T01:11:06.346016+0000","last_active":"2024-04-15T01:11:06.345995+0000","last_peered":"2024-04-15T01:11:06.345995+0000","last_clean":"2024-04-15T01:11:06.345995+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T01:11:06.345995+0000","last_undegraded":"2024-04-15T01:11:06.345995+0000","last_fullsized":"2024-04-15T01:11:06.345995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'213","last_scrub_stamp":"2024-04-15T01:11:06.345918+0000","last_deep_scrub":"29'213","last_deep_scrub_stamp":"2024-04-15T01:11:06.345918+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.345918+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:10:12.951329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1374","reported_seq":1439,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.438168+0000","last_change":"2024-04-15T01:11:05.438203+0000","last_active":"2024-04-15T01:11:05.438168+0000","last_peered":"2024-04-15T01:11:05.438168+0000","last_clean":"2024-04-15T01:11:05.438168+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T01:11:05.438168+0000","last_undegraded":"2024-04-15T01:11:05.438168+0000","last_fullsized":"2024-04-15T01:11:05.438168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1374","last_scrub_stamp":"2024-04-15T01:11:05.438090+0000","last_deep_scrub":"29'1374","last_deep_scrub_stamp":"2024-04-15T01:11:05.438090+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.438090+0000","objects_scrubbed":4,"log_size":1374,"log_dups_size":0,"ondisk_log_size":1374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:18:29.824337+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'758","reported_seq":914,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.206856+0000","last_change":"2024-04-15T01:11:11.206904+0000","last_active":"2024-04-15T01:11:11.206856+0000","last_peered":"2024-04-15T01:11:11.206856+0000","last_clean":"2024-04-15T01:11:11.206856+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:11:11.206856+0000","last_undegraded":"2024-04-15T01:11:11.206856+0000","last_fullsized":"2024-04-15T01:11:11.206856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'758","last_scrub_stamp":"2024-04-15T01:11:11.206735+0000","last_deep_scrub":"29'758","last_deep_scrub_stamp":"2024-04-15T01:11:11.206735+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.206735+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:21:36.589846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":41433,"num_write":747,"num_write_kb":139089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'219","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.842995+0000","last_change":"2024-04-15T01:11:07.843019+0000","last_active":"2024-04-15T01:11:07.842995+0000","last_peered":"2024-04-15T01:11:07.842995+0000","last_clean":"2024-04-15T01:11:07.842995+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T01:11:07.842995+0000","last_undegraded":"2024-04-15T01:11:07.842995+0000","last_fullsized":"2024-04-15T01:11:07.842995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'219","last_scrub_stamp":"2024-04-15T01:11:07.842923+0000","last_deep_scrub":"29'219","last_deep_scrub_stamp":"2024-04-15T01:11:07.842923+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.842923+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:09:31.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'583","reported_seq":648,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.857389+0000","last_change":"2024-04-15T01:11:02.857415+0000","last_active":"2024-04-15T01:11:02.857389+0000","last_peered":"2024-04-15T01:11:02.857389+0000","last_clean":"2024-04-15T01:11:02.857389+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T01:11:02.857389+0000","last_undegraded":"2024-04-15T01:11:02.857389+0000","last_fullsized":"2024-04-15T01:11:02.857389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'583","last_scrub_stamp":"2024-04-15T01:11:02.857321+0000","last_deep_scrub":"29'583","last_deep_scrub_stamp":"2024-04-15T01:11:02.857321+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.857321+0000","objects_scrubbed":3,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:41:57.469419+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1203","reported_seq":1268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.269856+0000","last_change":"2024-04-15T01:11:04.269856+0000","last_active":"2024-04-15T01:11:04.269856+0000","last_peered":"2024-04-15T01:11:04.269856+0000","last_clean":"2024-04-15T01:11:04.269856+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T01:11:04.269856+0000","last_undegraded":"2024-04-15T01:11:04.269856+0000","last_fullsized":"2024-04-15T01:11:04.269856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1203","last_scrub_stamp":"2024-04-15T01:11:04.269701+0000","last_deep_scrub":"29'1203","last_deep_scrub_stamp":"2024-04-15T01:11:04.269701+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.269701+0000","objects_scrubbed":6,"log_size":1203,"log_dups_size":0,"ondisk_log_size":1203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:26:59.208482+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'187","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.510115+0000","last_change":"2024-04-15T01:11:06.510115+0000","last_active":"2024-04-15T01:11:06.510115+0000","last_peered":"2024-04-15T01:11:06.510115+0000","last_clean":"2024-04-15T01:11:06.510115+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T01:11:06.510115+0000","last_undegraded":"2024-04-15T01:11:06.510115+0000","last_fullsized":"2024-04-15T01:11:06.510115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2024-04-15T01:11:06.510018+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2024-04-15T01:11:06.510018+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.510018+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:21:31.893130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'744","reported_seq":965,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.795787+0000","last_change":"2024-04-15T01:11:02.795828+0000","last_active":"2024-04-15T01:11:02.795787+0000","last_peered":"2024-04-15T01:11:02.795787+0000","last_clean":"2024-04-15T01:11:02.795787+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T01:11:02.795787+0000","last_undegraded":"2024-04-15T01:11:02.795787+0000","last_fullsized":"2024-04-15T01:11:02.795787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'744","last_scrub_stamp":"2024-04-15T01:11:02.795691+0000","last_deep_scrub":"29'744","last_deep_scrub_stamp":"2024-04-15T01:11:02.795691+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.795691+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:24:14.418872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":84659,"num_write":735,"num_write_kb":176000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'222","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.900741+0000","last_change":"2024-04-15T01:11:03.900741+0000","last_active":"2024-04-15T01:11:03.900741+0000","last_peered":"2024-04-15T01:11:03.900741+0000","last_clean":"2024-04-15T01:11:03.900741+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T01:11:03.900741+0000","last_undegraded":"2024-04-15T01:11:03.900741+0000","last_fullsized":"2024-04-15T01:11:03.900741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:03.900648+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:03.900648+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.900648+0000","objects_scrubbed":3,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:49:55.386284+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'202","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.590970+0000","last_change":"2024-04-15T01:11:00.590970+0000","last_active":"2024-04-15T01:11:00.590970+0000","last_peered":"2024-04-15T01:11:00.590970+0000","last_clean":"2024-04-15T01:11:00.590970+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T01:11:00.590970+0000","last_undegraded":"2024-04-15T01:11:00.590970+0000","last_fullsized":"2024-04-15T01:11:00.590970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-04-15T01:11:00.590876+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-04-15T01:11:00.590876+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.590876+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:14:38.983346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'759","reported_seq":929,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.852816+0000","last_change":"2024-04-15T01:11:10.852843+0000","last_active":"2024-04-15T01:11:10.852816+0000","last_peered":"2024-04-15T01:11:10.852816+0000","last_clean":"2024-04-15T01:11:10.852816+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T01:11:10.852816+0000","last_undegraded":"2024-04-15T01:11:10.852816+0000","last_fullsized":"2024-04-15T01:11:10.852816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'759","last_scrub_stamp":"2024-04-15T01:11:10.852722+0000","last_deep_scrub":"29'759","last_deep_scrub_stamp":"2024-04-15T01:11:10.852722+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.852722+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:28:16.512716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62677,"num_write":745,"num_write_kb":206027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'216","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.176210+0000","last_change":"2024-04-15T01:11:06.176253+0000","last_active":"2024-04-15T01:11:06.176210+0000","last_peered":"2024-04-15T01:11:06.176210+0000","last_clean":"2024-04-15T01:11:06.176210+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T01:11:06.176210+0000","last_undegraded":"2024-04-15T01:11:06.176210+0000","last_fullsized":"2024-04-15T01:11:06.176210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-04-15T01:11:06.176105+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-04-15T01:11:06.176105+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.176105+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:36:04.295422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'222","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.807985+0000","last_change":"2024-04-15T01:11:01.808012+0000","last_active":"2024-04-15T01:11:01.807985+0000","last_peered":"2024-04-15T01:11:01.807985+0000","last_clean":"2024-04-15T01:11:01.807985+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T01:11:01.807985+0000","last_undegraded":"2024-04-15T01:11:01.807985+0000","last_fullsized":"2024-04-15T01:11:01.807985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:01.807913+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:01.807913+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.807913+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:06:23.293973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'232","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.409115+0000","last_change":"2024-04-15T01:11:09.409137+0000","last_active":"2024-04-15T01:11:09.409115+0000","last_peered":"2024-04-15T01:11:09.409115+0000","last_clean":"2024-04-15T01:11:09.409115+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T01:11:09.409115+0000","last_undegraded":"2024-04-15T01:11:09.409115+0000","last_fullsized":"2024-04-15T01:11:09.409115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'232","last_scrub_stamp":"2024-04-15T01:11:09.409049+0000","last_deep_scrub":"29'232","last_deep_scrub_stamp":"2024-04-15T01:11:09.409049+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.409049+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:18:59.976742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'207","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.464177+0000","last_change":"2024-04-15T01:11:04.464217+0000","last_active":"2024-04-15T01:11:04.464177+0000","last_peered":"2024-04-15T01:11:04.464177+0000","last_clean":"2024-04-15T01:11:04.464177+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T01:11:04.464177+0000","last_undegraded":"2024-04-15T01:11:04.464177+0000","last_fullsized":"2024-04-15T01:11:04.464177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:04.464085+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:04.464085+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.464085+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:43:39.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.798034+0000","last_change":"2024-04-15T01:10:57.798075+0000","last_active":"2024-04-15T01:10:57.798034+0000","last_peered":"2024-04-15T01:10:57.798034+0000","last_clean":"2024-04-15T01:10:57.798034+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T01:10:57.798034+0000","last_undegraded":"2024-04-15T01:10:57.798034+0000","last_fullsized":"2024-04-15T01:10:57.798034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'183","last_scrub_stamp":"2024-04-15T01:10:57.797934+0000","last_deep_scrub":"29'183","last_deep_scrub_stamp":"2024-04-15T01:10:57.797934+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.797934+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:15:01.705979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'207","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.314647+0000","last_change":"2024-04-15T01:11:05.314669+0000","last_active":"2024-04-15T01:11:05.314647+0000","last_peered":"2024-04-15T01:11:05.314647+0000","last_clean":"2024-04-15T01:11:05.314647+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T01:11:05.314647+0000","last_undegraded":"2024-04-15T01:11:05.314647+0000","last_fullsized":"2024-04-15T01:11:05.314647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:05.314573+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:05.314573+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.314573+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:56:52.357476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'241","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.191975+0000","last_change":"2024-04-15T01:11:07.191995+0000","last_active":"2024-04-15T01:11:07.191975+0000","last_peered":"2024-04-15T01:11:07.191975+0000","last_clean":"2024-04-15T01:11:07.191975+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T01:11:07.191975+0000","last_undegraded":"2024-04-15T01:11:07.191975+0000","last_fullsized":"2024-04-15T01:11:07.191975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'241","last_scrub_stamp":"2024-04-15T01:11:07.191909+0000","last_deep_scrub":"29'241","last_deep_scrub_stamp":"2024-04-15T01:11:07.191909+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.191909+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:46:16.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'192","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.841283+0000","last_change":"2024-04-15T01:11:09.841310+0000","last_active":"2024-04-15T01:11:09.841283+0000","last_peered":"2024-04-15T01:11:09.841283+0000","last_clean":"2024-04-15T01:11:09.841283+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T01:11:09.841283+0000","last_undegraded":"2024-04-15T01:11:09.841283+0000","last_fullsized":"2024-04-15T01:11:09.841283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'192","last_scrub_stamp":"2024-04-15T01:11:09.841164+0000","last_deep_scrub":"29'192","last_deep_scrub_stamp":"2024-04-15T01:11:09.841164+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.841164+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:13:50.474567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.374153+0000","last_change":"2024-04-15T01:11:10.374177+0000","last_active":"2024-04-15T01:11:10.374153+0000","last_peered":"2024-04-15T01:11:10.374153+0000","last_clean":"2024-04-15T01:11:10.374153+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T01:11:10.374153+0000","last_undegraded":"2024-04-15T01:11:10.374153+0000","last_fullsized":"2024-04-15T01:11:10.374153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'213","last_scrub_stamp":"2024-04-15T01:11:10.374081+0000","last_deep_scrub":"29'213","last_deep_scrub_stamp":"2024-04-15T01:11:10.374081+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.374081+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:37:44.679327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'204","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.788850+0000","last_change":"2024-04-15T01:10:59.788850+0000","last_active":"2024-04-15T01:10:59.788850+0000","last_peered":"2024-04-15T01:10:59.788850+0000","last_clean":"2024-04-15T01:10:59.788850+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T01:10:59.788850+0000","last_undegraded":"2024-04-15T01:10:59.788850+0000","last_fullsized":"2024-04-15T01:10:59.788850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-04-15T01:10:59.788689+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-04-15T01:10:59.788689+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.788689+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:25:53.178335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'215","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.774697+0000","last_change":"2024-04-15T01:11:04.774736+0000","last_active":"2024-04-15T01:11:04.774697+0000","last_peered":"2024-04-15T01:11:04.774697+0000","last_clean":"2024-04-15T01:11:04.774697+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T01:11:04.774697+0000","last_undegraded":"2024-04-15T01:11:04.774697+0000","last_fullsized":"2024-04-15T01:11:04.774697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-04-15T01:11:04.774602+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-04-15T01:11:04.774602+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.774602+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:42:54.455335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'212","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.408775+0000","last_change":"2024-04-15T01:11:02.408798+0000","last_active":"2024-04-15T01:11:02.408775+0000","last_peered":"2024-04-15T01:11:02.408775+0000","last_clean":"2024-04-15T01:11:02.408775+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T01:11:02.408775+0000","last_undegraded":"2024-04-15T01:11:02.408775+0000","last_fullsized":"2024-04-15T01:11:02.408775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'212","last_scrub_stamp":"2024-04-15T01:11:02.408707+0000","last_deep_scrub":"29'212","last_deep_scrub_stamp":"2024-04-15T01:11:02.408707+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.408707+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:46:11.976567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'223","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.199717+0000","last_change":"2024-04-15T01:11:09.199739+0000","last_active":"2024-04-15T01:11:09.199717+0000","last_peered":"2024-04-15T01:11:09.199717+0000","last_clean":"2024-04-15T01:11:09.199717+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T01:11:09.199717+0000","last_undegraded":"2024-04-15T01:11:09.199717+0000","last_fullsized":"2024-04-15T01:11:09.199717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'223","last_scrub_stamp":"2024-04-15T01:11:09.199646+0000","last_deep_scrub":"29'223","last_deep_scrub_stamp":"2024-04-15T01:11:09.199646+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.199646+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:36:16.661173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'208","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.187194+0000","last_change":"2024-04-15T01:11:01.187235+0000","last_active":"2024-04-15T01:11:01.187194+0000","last_peered":"2024-04-15T01:11:01.187194+0000","last_clean":"2024-04-15T01:11:01.187194+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T01:11:01.187194+0000","last_undegraded":"2024-04-15T01:11:01.187194+0000","last_fullsized":"2024-04-15T01:11:01.187194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:11:01.187079+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:11:01.187079+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.187079+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:07:02.902062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.806507+0000","last_change":"2024-04-15T01:11:00.806507+0000","last_active":"2024-04-15T01:11:00.806507+0000","last_peered":"2024-04-15T01:11:00.806507+0000","last_clean":"2024-04-15T01:11:00.806507+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T01:11:00.806507+0000","last_undegraded":"2024-04-15T01:11:00.806507+0000","last_fullsized":"2024-04-15T01:11:00.806507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:00.806416+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:00.806416+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.806416+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:28:04.053691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'199","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.402357+0000","last_change":"2024-04-15T01:11:08.402357+0000","last_active":"2024-04-15T01:11:08.402357+0000","last_peered":"2024-04-15T01:11:08.402357+0000","last_clean":"2024-04-15T01:11:08.402357+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T01:11:08.402357+0000","last_undegraded":"2024-04-15T01:11:08.402357+0000","last_fullsized":"2024-04-15T01:11:08.402357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-04-15T01:11:08.402251+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-04-15T01:11:08.402251+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.402251+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:13.719854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'222","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.412519+0000","last_change":"2024-04-15T01:11:06.412519+0000","last_active":"2024-04-15T01:11:06.412519+0000","last_peered":"2024-04-15T01:11:06.412519+0000","last_clean":"2024-04-15T01:11:06.412519+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T01:11:06.412519+0000","last_undegraded":"2024-04-15T01:11:06.412519+0000","last_fullsized":"2024-04-15T01:11:06.412519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:06.412423+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:06.412423+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.412423+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:54:30.647531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'215","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.370503+0000","last_change":"2024-04-15T01:11:07.370503+0000","last_active":"2024-04-15T01:11:07.370503+0000","last_peered":"2024-04-15T01:11:07.370503+0000","last_clean":"2024-04-15T01:11:07.370503+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T01:11:07.370503+0000","last_undegraded":"2024-04-15T01:11:07.370503+0000","last_fullsized":"2024-04-15T01:11:07.370503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-04-15T01:11:07.370402+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-04-15T01:11:07.370402+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.370402+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:06:56.338844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.439668+0000","last_change":"2024-04-15T01:10:58.439689+0000","last_active":"2024-04-15T01:10:58.439668+0000","last_peered":"2024-04-15T01:10:58.439668+0000","last_clean":"2024-04-15T01:10:58.439668+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T01:10:58.439668+0000","last_undegraded":"2024-04-15T01:10:58.439668+0000","last_fullsized":"2024-04-15T01:10:58.439668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:10:58.439596+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:10:58.439596+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.439596+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:19:30.922504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.838641+0000","last_change":"2024-04-15T01:11:00.838663+0000","last_active":"2024-04-15T01:11:00.838641+0000","last_peered":"2024-04-15T01:11:00.838641+0000","last_clean":"2024-04-15T01:11:00.838641+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T01:11:00.838641+0000","last_undegraded":"2024-04-15T01:11:00.838641+0000","last_fullsized":"2024-04-15T01:11:00.838641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-04-15T01:11:00.838576+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-04-15T01:11:00.838576+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.838576+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:35:35.199118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'185","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.592417+0000","last_change":"2024-04-15T01:11:01.592438+0000","last_active":"2024-04-15T01:11:01.592417+0000","last_peered":"2024-04-15T01:11:01.592417+0000","last_clean":"2024-04-15T01:11:01.592417+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T01:11:01.592417+0000","last_undegraded":"2024-04-15T01:11:01.592417+0000","last_fullsized":"2024-04-15T01:11:01.592417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'185","last_scrub_stamp":"2024-04-15T01:11:01.592339+0000","last_deep_scrub":"29'185","last_deep_scrub_stamp":"2024-04-15T01:11:01.592339+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.592339+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.234314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'188","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.165424+0000","last_change":"2024-04-15T01:11:08.165447+0000","last_active":"2024-04-15T01:11:08.165424+0000","last_peered":"2024-04-15T01:11:08.165424+0000","last_clean":"2024-04-15T01:11:08.165424+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T01:11:08.165424+0000","last_undegraded":"2024-04-15T01:11:08.165424+0000","last_fullsized":"2024-04-15T01:11:08.165424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'188","last_scrub_stamp":"2024-04-15T01:11:08.165341+0000","last_deep_scrub":"29'188","last_deep_scrub_stamp":"2024-04-15T01:11:08.165341+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.165341+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:05:53.876276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.175036+0000","last_change":"2024-04-15T01:11:14.175075+0000","last_active":"2024-04-15T01:11:14.175036+0000","last_peered":"2024-04-15T01:11:14.175036+0000","last_clean":"2024-04-15T01:11:14.175036+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T01:11:14.175036+0000","last_undegraded":"2024-04-15T01:11:14.175036+0000","last_fullsized":"2024-04-15T01:11:14.175036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:14.174943+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:14.174943+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.174943+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:04.703376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'211","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.163533+0000","last_change":"2024-04-15T01:11:12.163556+0000","last_active":"2024-04-15T01:11:12.163533+0000","last_peered":"2024-04-15T01:11:12.163533+0000","last_clean":"2024-04-15T01:11:12.163533+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T01:11:12.163533+0000","last_undegraded":"2024-04-15T01:11:12.163533+0000","last_fullsized":"2024-04-15T01:11:12.163533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-04-15T01:11:12.163440+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-04-15T01:11:12.163440+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.163440+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:02.691873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'190","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.850600+0000","last_change":"2024-04-15T01:11:08.850600+0000","last_active":"2024-04-15T01:11:08.850600+0000","last_peered":"2024-04-15T01:11:08.850600+0000","last_clean":"2024-04-15T01:11:08.850600+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T01:11:08.850600+0000","last_undegraded":"2024-04-15T01:11:08.850600+0000","last_fullsized":"2024-04-15T01:11:08.850600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'190","last_scrub_stamp":"2024-04-15T01:11:08.850498+0000","last_deep_scrub":"29'190","last_deep_scrub_stamp":"2024-04-15T01:11:08.850498+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.850498+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:45:11.294572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'205","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.152059+0000","last_change":"2024-04-15T01:11:02.152059+0000","last_active":"2024-04-15T01:11:02.152059+0000","last_peered":"2024-04-15T01:11:02.152059+0000","last_clean":"2024-04-15T01:11:02.152059+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T01:11:02.152059+0000","last_undegraded":"2024-04-15T01:11:02.152059+0000","last_fullsized":"2024-04-15T01:11:02.152059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:02.151942+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:02.151942+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.151942+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:59:10.839870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'197","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.399114+0000","last_change":"2024-04-15T01:11:07.399114+0000","last_active":"2024-04-15T01:11:07.399114+0000","last_peered":"2024-04-15T01:11:07.399114+0000","last_clean":"2024-04-15T01:11:07.399114+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T01:11:07.399114+0000","last_undegraded":"2024-04-15T01:11:07.399114+0000","last_fullsized":"2024-04-15T01:11:07.399114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'197","last_scrub_stamp":"2024-04-15T01:11:07.399015+0000","last_deep_scrub":"29'197","last_deep_scrub_stamp":"2024-04-15T01:11:07.399015+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.399015+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:49:58.884651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.093151+0000","last_change":"2024-04-15T01:11:10.093151+0000","last_active":"2024-04-15T01:11:10.093151+0000","last_peered":"2024-04-15T01:11:10.093151+0000","last_clean":"2024-04-15T01:11:10.093151+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T01:11:10.093151+0000","last_undegraded":"2024-04-15T01:11:10.093151+0000","last_fullsized":"2024-04-15T01:11:10.093151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:10.093044+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:10.093044+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.093044+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:24:17.871007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'195","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.815537+0000","last_change":"2024-04-15T01:11:03.815559+0000","last_active":"2024-04-15T01:11:03.815537+0000","last_peered":"2024-04-15T01:11:03.815537+0000","last_clean":"2024-04-15T01:11:03.815537+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T01:11:03.815537+0000","last_undegraded":"2024-04-15T01:11:03.815537+0000","last_fullsized":"2024-04-15T01:11:03.815537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-04-15T01:11:03.815470+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-04-15T01:11:03.815470+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.815470+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:36:31.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'194","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:55.561877+0000","last_change":"2024-04-15T01:10:55.561899+0000","last_active":"2024-04-15T01:10:55.561877+0000","last_peered":"2024-04-15T01:10:55.561877+0000","last_clean":"2024-04-15T01:10:55.561877+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T01:10:55.561877+0000","last_undegraded":"2024-04-15T01:10:55.561877+0000","last_fullsized":"2024-04-15T01:10:55.561877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'194","last_scrub_stamp":"2024-04-15T01:10:55.561805+0000","last_deep_scrub":"29'194","last_deep_scrub_stamp":"2024-04-15T01:10:55.561805+0000","last_clean_scrub_stamp":"2024-04-15T01:10:55.561805+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:17.928986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'214","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.339574+0000","last_change":"2024-04-15T01:11:03.339622+0000","last_active":"2024-04-15T01:11:03.339574+0000","last_peered":"2024-04-15T01:11:03.339574+0000","last_clean":"2024-04-15T01:11:03.339574+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T01:11:03.339574+0000","last_undegraded":"2024-04-15T01:11:03.339574+0000","last_fullsized":"2024-04-15T01:11:03.339574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'214","last_scrub_stamp":"2024-04-15T01:11:03.339483+0000","last_deep_scrub":"29'214","last_deep_scrub_stamp":"2024-04-15T01:11:03.339483+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.339483+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:41:55.869491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'211","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.180084+0000","last_change":"2024-04-15T01:11:13.180106+0000","last_active":"2024-04-15T01:11:13.180084+0000","last_peered":"2024-04-15T01:11:13.180084+0000","last_clean":"2024-04-15T01:11:13.180084+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T01:11:13.180084+0000","last_undegraded":"2024-04-15T01:11:13.180084+0000","last_fullsized":"2024-04-15T01:11:13.180084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-04-15T01:11:13.180015+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-04-15T01:11:13.180015+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.180015+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:56.634531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2952,"num_read_kb":1592021,"num_write":24431,"num_write_kb":4334185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24810,"ondisk_log_size":24810,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13159,"ondisk_log_size":13159,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":181622008,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":30105,"num_write_kb":193149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172548096,"data_stored":363244016,"data_compressed":48333034,"data_compressed_allocated":62914560,"data_compressed_original":253853696,"omap_allocated":0,"internal_metadata":0},"log_size":25567,"ondisk_log_size":25567,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542992,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137664,"kb_used_data":30200,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94234176,"statfs":{"total":96636764160,"available":96495796224,"internally_reserved":0,"allocated":30924800,"data_stored":72023688,"data_compressed":9942585,"data_compressed_allocated":12574720,"data_compressed_original":53891072,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542992,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140448,"kb_used_data":23256,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94231392,"statfs":{"total":96636764160,"available":96492945408,"internally_reserved":0,"allocated":23814144,"data_stored":50461162,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542992,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120296,"kb_used_data":21152,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94251544,"statfs":{"total":96636764160,"available":96513581056,"internally_reserved":0,"allocated":21659648,"data_stored":41781534,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542993,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125000,"kb_used_data":25856,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94246840,"statfs":{"total":96636764160,"available":96508764160,"internally_reserved":0,"allocated":26476544,"data_stored":50461030,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510289,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144168,"kb_used_data":18592,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94227672,"statfs":{"total":96636764160,"available":96489136128,"internally_reserved":0,"allocated":19038208,"data_stored":35235566,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510287,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":11480,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":11755520,"data_stored":22359130,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510289,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169692,"kb_used_data":21972,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94202148,"statfs":{"total":96636764160,"available":96462999552,"internally_reserved":0,"allocated":22499328,"data_stored":50460650,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575697,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103780,"kb_used_data":18524,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94268060,"statfs":{"total":96636764160,"available":96530493440,"internally_reserved":0,"allocated":18968576,"data_stored":42661752,"data_compressed":5896627,"data_compressed_allocated":7761920,"data_compressed_original":31666176,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18595840,"data_stored":41943914,"data_compressed":5864102,"data_compressed_allocated":7716864,"data_compressed_original":31092736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":50333180,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11448320,"data_stored":22231660,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18731008,"data_stored":35108096,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":50333560,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21352448,"data_stored":41654064,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":50333692,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30552064,"data_stored":71305850,"data_compressed":9910060,"data_compressed_allocated":12529664,"data_compressed_original":53317632,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T01:11:21.618 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:21.618 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:21.618 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:21.618 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:21.619 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-15T00:01:17.665799+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=17, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:21.619 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-15T00:01:11.803706+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=0, tm_min=1, tm_sec=11, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=1, tm_min=10, tm_sec=52, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T01:11:21.619 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T01:11:36.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:11:36.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:11:41.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T01:11:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.738+0000 7fe995005640 1 Processor -- start 2024-04-15T01:11:41.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.738+0000 7fe995005640 1 -- start start 2024-04-15T01:11:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.738+0000 7fe995005640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9900c50d0 0x7fe990158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.738+0000 7fe995005640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c6150 0x7fe99015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.739+0000 7fe995005640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe990158120 con 0x7fe9900c54b0 2024-04-15T01:11:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.739+0000 7fe995005640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe9900c65a0 con 0x7fe9900c50d0 2024-04-15T01:11:41.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.739+0000 7fe995005640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe9900c67e0 con 0x7fe9900c6150 2024-04-15T01:11:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.739+0000 7fe98ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9900c50d0 0x7fe990158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.739+0000 7fe98f59e640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c6150 0x7fe99015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.740+0000 7fe98ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9900c50d0 0x7fe990158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:45522/0 (socket says 172.21.15.29:45522) 2024-04-15T01:11:41.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.740+0000 7fe98ed9d640 1 -- 172.21.15.29:0/908213266 learned_addr learned my addr 172.21.15.29:0/908213266 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.743+0000 7fe98f59e640 1 -- 172.21.15.29:0/908213266 >> v2:172.21.15.37:3300/0 conn(0x7fe9900c50d0 msgr2=0x7fe990158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.743+0000 7fe98f59e640 1 --2- 172.21.15.29:0/908213266 >> v2:172.21.15.37:3300/0 conn(0x7fe9900c50d0 0x7fe990158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.743+0000 7fe98f59e640 1 -- 172.21.15.29:0/908213266 >> v1:172.21.15.37:6789/0 conn(0x7fe9900c54b0 legacy=0x7fe990140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:41.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.743+0000 7fe98f59e640 1 -- 172.21.15.29:0/908213266 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9900c6aa0 con 0x7fe9900c6150 2024-04-15T01:11:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.745+0000 7fe98f59e640 1 --2- 172.21.15.29:0/908213266 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c6150 0x7fe99015b570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe988009dc0 tx=0x7fe98802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d6ea9bea2e4f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe98dd9b640 1 -- 172.21.15.29:0/908213266 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988039070 con 0x7fe9900c6150 2024-04-15T01:11:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe98dd9b640 1 -- 172.21.15.29:0/908213266 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98802cc40 con 0x7fe9900c6150 2024-04-15T01:11:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe98dd9b640 1 -- 172.21.15.29:0/908213266 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988034440 con 0x7fe9900c6150 2024-04-15T01:11:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 -- 172.21.15.29:0/908213266 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c6150 msgr2=0x7fe99015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 --2- 172.21.15.29:0/908213266 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c6150 0x7fe99015b570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe988009dc0 tx=0x7fe98802be90 comp rx=0 tx=0).stop 2024-04-15T01:11:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 -- 172.21.15.29:0/908213266 shutdown_connections 2024-04-15T01:11:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 --2- 172.21.15.29:0/908213266 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c6150 0x7fe99015b570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 --2- 172.21.15.29:0/908213266 >> v2:172.21.15.37:3300/0 conn(0x7fe9900c50d0 0x7fe990158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:41.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 -- 172.21.15.29:0/908213266 >> 172.21.15.29:0/908213266 conn(0x7fe99006fca0 msgr2=0x7fe99006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:41.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 -- 172.21.15.29:0/908213266 shutdown_connections 2024-04-15T01:11:41.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.749+0000 7fe995005640 1 -- 172.21.15.29:0/908213266 wait complete. 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 Processor -- start 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 -- start start 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c50d0 0x7fe9901546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9900c54b0 0x7fe9901e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 0x7fe9901e1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe9900c6d80 con 0x7fe9900c6150 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9901586a0 con 0x7fe9900c54b0 2024-04-15T01:11:41.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.751+0000 7fe995005640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fe9901416c0 con 0x7fe9900c50d0 2024-04-15T01:11:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.752+0000 7fe98e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9900c54b0 0x7fe9901e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.752+0000 7fe98f59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 0x7fe9901e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.752+0000 7fe98ed9d640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c50d0 0x7fe9901546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.752+0000 7fe98f59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 0x7fe9901e1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41502/0 (socket says 172.21.15.29:41502) 2024-04-15T01:11:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.752+0000 7fe98e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9900c54b0 0x7fe9901e4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:45526/0 (socket says 172.21.15.29:45526) 2024-04-15T01:11:41.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.752+0000 7fe98f59e640 1 -- 172.21.15.29:0/2075591853 learned_addr learned my addr 172.21.15.29:0/2075591853 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:41.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.756+0000 7fe98f59e640 1 -- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c50d0 msgr2=0x7fe9901546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:41.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.756+0000 7fe98f59e640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c50d0 0x7fe9901546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:41.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.756+0000 7fe98f59e640 1 -- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9900c54b0 msgr2=0x7fe9901e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:41.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.756+0000 7fe98f59e640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9900c54b0 0x7fe9901e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:41.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.756+0000 7fe98f59e640 1 -- 172.21.15.29:0/2075591853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9901f13e0 con 0x7fe9900c6150 2024-04-15T01:11:41.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.759+0000 7fe98f59e640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 0x7fe9901e1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe988009dc0 tx=0x7fe988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.762+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988039050 con 0x7fe9900c6150 2024-04-15T01:11:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.763+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe988045070 con 0x7fe9900c6150 2024-04-15T01:11:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.763+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988009450 con 0x7fe9900c6150 2024-04-15T01:11:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.763+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9901f16c0 con 0x7fe9900c6150 2024-04-15T01:11:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.763+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9901f1c80 con 0x7fe9900c6150 2024-04-15T01:11:41.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.764+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99004f540 con 0x7fe9900c6150 2024-04-15T01:11:41.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.785+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe988040690 con 0x7fe9900c6150 2024-04-15T01:11:41.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.785+0000 7fe9777fe640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe97c06ba10 0x7fe97c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:41.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.785+0000 7fe98ed9d640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe97c06ba10 0x7fe97c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:41.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.786+0000 7fe98ed9d640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe97c06ba10 0x7fe97c06ded0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe980009bd0 tx=0x7fe980009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:41.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:41.788+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe98807a310 con 0x7fe9900c6150 2024-04-15T01:11:42.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.048+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe98807c270 con 0x7fe9900c6150 2024-04-15T01:11:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.234+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 --> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe99006d6a0 con 0x7fe97c06ba10 2024-04-15T01:11:42.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.243+0000 7fe9777fe640 1 -- 172.21.15.29:0/2075591853 <== mgr.4113 v2:172.21.15.37:6800/4102667027 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335771 (secure 0 0 0) 0x7fe99006d6a0 con 0x7fe97c06ba10 2024-04-15T01:11:42.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:11:42.249 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe97c06ba10 msgr2=0x7fe97c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe97c06ba10 0x7fe97c06ded0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe980009bd0 tx=0x7fe980009240 comp rx=0 tx=0).stop 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 msgr2=0x7fe9901e1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 0x7fe9901e1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe988009dc0 tx=0x7fe988004a40 comp rx=0 tx=0).stop 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 shutdown_connections 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fe97c06ba10 0x7fe97c06ded0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9900c6150 0x7fe9901e1610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9900c54b0 0x7fe9901e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 --2- 172.21.15.29:0/2075591853 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fe9900c50d0 0x7fe9901546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 >> 172.21.15.29:0/2075591853 conn(0x7fe99006fca0 msgr2=0x7fe9900c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 shutdown_connections 2024-04-15T01:11:42.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.246+0000 7fe995005640 1 -- 172.21.15.29:0/2075591853 wait complete. 2024-04-15T01:11:42.255 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2146,"stamp":"2024-04-15T01:11:42.038380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182212376,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":6016,"num_read_kb":1595737,"num_write":54695,"num_write_kb":4529750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63655,"ondisk_log_size":63655,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1055832,"kb_used_data":171032,"kb_used_omap":12,"kb_used_meta":884723,"kb_avail":753918888,"statfs":{"total":773094113280,"available":772012941312,"internally_reserved":0,"allocated":175136768,"data_stored":365444512,"data_compressed":48398084,"data_compressed_allocated":63004672,"data_compressed_original":255000576,"omap_allocated":12751,"internal_metadata":905956913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003036"},"pg_stats":[{"pgid":"2.1f","version":"29'509","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.536897+0000","last_change":"2024-04-15T01:10:56.536932+0000","last_active":"2024-04-15T01:10:56.536897+0000","last_peered":"2024-04-15T01:10:56.536897+0000","last_clean":"2024-04-15T01:10:56.536897+0000","last_became_active":"2024-04-15T00:01:11.986847+0000","last_became_peered":"2024-04-15T00:01:11.986847+0000","last_unstale":"2024-04-15T01:10:56.536897+0000","last_undegraded":"2024-04-15T01:10:56.536897+0000","last_fullsized":"2024-04-15T01:10:56.536897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'509","last_scrub_stamp":"2024-04-15T01:10:56.536832+0000","last_deep_scrub":"29'509","last_deep_scrub_stamp":"2024-04-15T01:10:56.536832+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.536832+0000","objects_scrubbed":8,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:27:28.178951+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":8417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'200","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.793990+0000","last_change":"2024-04-15T01:10:58.793990+0000","last_active":"2024-04-15T01:10:58.793990+0000","last_peered":"2024-04-15T01:10:58.793990+0000","last_clean":"2024-04-15T01:10:58.793990+0000","last_became_active":"2024-04-15T00:01:12.994564+0000","last_became_peered":"2024-04-15T00:01:12.994564+0000","last_unstale":"2024-04-15T01:10:58.793990+0000","last_undegraded":"2024-04-15T01:10:58.793990+0000","last_fullsized":"2024-04-15T01:10:58.793990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:10:58.793894+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:10:58.793894+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.793894+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:07.404877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'821","reported_seq":972,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.910031+0000","last_change":"2024-04-15T01:11:13.910031+0000","last_active":"2024-04-15T01:11:13.910031+0000","last_peered":"2024-04-15T01:11:13.910031+0000","last_clean":"2024-04-15T01:11:13.910031+0000","last_became_active":"2024-04-15T00:01:18.979917+0000","last_became_peered":"2024-04-15T00:01:18.979917+0000","last_unstale":"2024-04-15T01:11:13.910031+0000","last_undegraded":"2024-04-15T01:11:13.910031+0000","last_fullsized":"2024-04-15T01:11:13.910031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'821","last_scrub_stamp":"2024-04-15T01:11:13.909923+0000","last_deep_scrub":"29'821","last_deep_scrub_stamp":"2024-04-15T01:11:13.909923+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.909923+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:39:23.876251+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":55758,"num_write":811,"num_write_kb":161190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'217","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.871960+0000","last_change":"2024-04-15T01:11:01.871960+0000","last_active":"2024-04-15T01:11:01.871960+0000","last_peered":"2024-04-15T01:11:01.871960+0000","last_clean":"2024-04-15T01:11:01.871960+0000","last_became_active":"2024-04-15T00:01:11.981113+0000","last_became_peered":"2024-04-15T00:01:11.981113+0000","last_unstale":"2024-04-15T01:11:01.871960+0000","last_undegraded":"2024-04-15T01:11:01.871960+0000","last_fullsized":"2024-04-15T01:11:01.871960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'217","last_scrub_stamp":"2024-04-15T01:11:01.871867+0000","last_deep_scrub":"29'217","last_deep_scrub_stamp":"2024-04-15T01:11:01.871867+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.871867+0000","objects_scrubbed":1,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:59:02.722892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'182","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.467298+0000","last_change":"2024-04-15T01:11:00.467320+0000","last_active":"2024-04-15T01:11:00.467298+0000","last_peered":"2024-04-15T01:11:00.467298+0000","last_clean":"2024-04-15T01:11:00.467298+0000","last_became_active":"2024-04-15T00:01:12.891345+0000","last_became_peered":"2024-04-15T00:01:12.891345+0000","last_unstale":"2024-04-15T01:11:00.467298+0000","last_undegraded":"2024-04-15T01:11:00.467298+0000","last_fullsized":"2024-04-15T01:11:00.467298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2024-04-15T01:11:00.467226+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2024-04-15T01:11:00.467226+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.467226+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:30.188360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'760","reported_seq":897,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.589961+0000","last_change":"2024-04-15T01:11:05.589961+0000","last_active":"2024-04-15T01:11:05.589961+0000","last_peered":"2024-04-15T01:11:05.589961+0000","last_clean":"2024-04-15T01:11:05.589961+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:11:05.589961+0000","last_undegraded":"2024-04-15T01:11:05.589961+0000","last_fullsized":"2024-04-15T01:11:05.589961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'760","last_scrub_stamp":"2024-04-15T01:11:05.589842+0000","last_deep_scrub":"29'760","last_deep_scrub_stamp":"2024-04-15T01:11:05.589842+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.589842+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:24:03.373295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":42531,"num_write":744,"num_write_kb":122981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1129","reported_seq":1194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.165274+0000","last_change":"2024-04-15T01:11:07.165274+0000","last_active":"2024-04-15T01:11:07.165274+0000","last_peered":"2024-04-15T01:11:07.165274+0000","last_clean":"2024-04-15T01:11:07.165274+0000","last_became_active":"2024-04-15T00:01:11.986634+0000","last_became_peered":"2024-04-15T00:01:11.986634+0000","last_unstale":"2024-04-15T01:11:07.165274+0000","last_undegraded":"2024-04-15T01:11:07.165274+0000","last_fullsized":"2024-04-15T01:11:07.165274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1129","last_scrub_stamp":"2024-04-15T01:11:07.165168+0000","last_deep_scrub":"29'1129","last_deep_scrub_stamp":"2024-04-15T01:11:07.165168+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.165168+0000","objects_scrubbed":10,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:36:14.626695+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":12823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'190","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.461548+0000","last_change":"2024-04-15T01:11:13.461548+0000","last_active":"2024-04-15T01:11:13.461548+0000","last_peered":"2024-04-15T01:11:13.461548+0000","last_clean":"2024-04-15T01:11:13.461548+0000","last_became_active":"2024-04-15T00:01:12.995590+0000","last_became_peered":"2024-04-15T00:01:12.995590+0000","last_unstale":"2024-04-15T01:11:13.461548+0000","last_undegraded":"2024-04-15T01:11:13.461548+0000","last_fullsized":"2024-04-15T01:11:13.461548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'190","last_scrub_stamp":"2024-04-15T01:11:13.461445+0000","last_deep_scrub":"29'190","last_deep_scrub_stamp":"2024-04-15T01:11:13.461445+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.461445+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:13:54.094848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'741","reported_seq":820,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.616793+0000","last_change":"2024-04-15T01:11:11.616793+0000","last_active":"2024-04-15T01:11:11.616793+0000","last_peered":"2024-04-15T01:11:11.616793+0000","last_clean":"2024-04-15T01:11:11.616793+0000","last_became_active":"2024-04-15T00:01:18.987982+0000","last_became_peered":"2024-04-15T00:01:18.987982+0000","last_unstale":"2024-04-15T01:11:11.616793+0000","last_undegraded":"2024-04-15T01:11:11.616793+0000","last_fullsized":"2024-04-15T01:11:11.616793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'741","last_scrub_stamp":"2024-04-15T01:11:11.616652+0000","last_deep_scrub":"29'741","last_deep_scrub_stamp":"2024-04-15T01:11:11.616652+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.616652+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:24:19.394614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8438,"num_write":729,"num_write_kb":110173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'788","reported_seq":853,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.104023+0000","last_change":"2024-04-15T01:11:09.104023+0000","last_active":"2024-04-15T01:11:09.104023+0000","last_peered":"2024-04-15T01:11:09.104023+0000","last_clean":"2024-04-15T01:11:09.104023+0000","last_became_active":"2024-04-15T00:01:11.990415+0000","last_became_peered":"2024-04-15T00:01:11.990415+0000","last_unstale":"2024-04-15T01:11:09.104023+0000","last_undegraded":"2024-04-15T01:11:09.104023+0000","last_fullsized":"2024-04-15T01:11:09.104023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'788","last_scrub_stamp":"2024-04-15T01:11:09.103925+0000","last_deep_scrub":"29'788","last_deep_scrub_stamp":"2024-04-15T01:11:09.103925+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.103925+0000","objects_scrubbed":4,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:40:05.080889+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.430217+0000","last_change":"2024-04-15T01:11:12.430217+0000","last_active":"2024-04-15T01:11:12.430217+0000","last_peered":"2024-04-15T01:11:12.430217+0000","last_clean":"2024-04-15T01:11:12.430217+0000","last_became_active":"2024-04-15T00:01:12.994150+0000","last_became_peered":"2024-04-15T00:01:12.994150+0000","last_unstale":"2024-04-15T01:11:12.430217+0000","last_undegraded":"2024-04-15T01:11:12.430217+0000","last_fullsized":"2024-04-15T01:11:12.430217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-04-15T01:11:12.430089+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-04-15T01:11:12.430089+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.430089+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:47:26.460347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'759","reported_seq":877,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.651562+0000","last_change":"2024-04-15T01:11:07.651562+0000","last_active":"2024-04-15T01:11:07.651562+0000","last_peered":"2024-04-15T01:11:07.651562+0000","last_clean":"2024-04-15T01:11:07.651562+0000","last_became_active":"2024-04-15T00:01:18.980460+0000","last_became_peered":"2024-04-15T00:01:18.980460+0000","last_unstale":"2024-04-15T01:11:07.651562+0000","last_undegraded":"2024-04-15T01:11:07.651562+0000","last_fullsized":"2024-04-15T01:11:07.651562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'759","last_scrub_stamp":"2024-04-15T01:11:07.651437+0000","last_deep_scrub":"29'759","last_deep_scrub_stamp":"2024-04-15T01:11:07.651437+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.651437+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:40:03.353547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":36806,"num_write":750,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'207","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.180928+0000","last_change":"2024-04-15T01:11:10.180952+0000","last_active":"2024-04-15T01:11:10.180928+0000","last_peered":"2024-04-15T01:11:10.180928+0000","last_clean":"2024-04-15T01:11:10.180928+0000","last_became_active":"2024-04-15T00:01:12.997213+0000","last_became_peered":"2024-04-15T00:01:12.997213+0000","last_unstale":"2024-04-15T01:11:10.180928+0000","last_undegraded":"2024-04-15T01:11:10.180928+0000","last_fullsized":"2024-04-15T01:11:10.180928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:10.180838+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:10.180838+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.180838+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:27.799703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'920","reported_seq":988,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.132442+0000","last_change":"2024-04-15T01:11:08.132497+0000","last_active":"2024-04-15T01:11:08.132442+0000","last_peered":"2024-04-15T01:11:08.132442+0000","last_clean":"2024-04-15T01:11:08.132442+0000","last_became_active":"2024-04-15T00:01:11.988628+0000","last_became_peered":"2024-04-15T00:01:11.988628+0000","last_unstale":"2024-04-15T01:11:08.132442+0000","last_undegraded":"2024-04-15T01:11:08.132442+0000","last_fullsized":"2024-04-15T01:11:08.132442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'920","last_scrub_stamp":"2024-04-15T01:11:08.132348+0000","last_deep_scrub":"29'920","last_deep_scrub_stamp":"2024-04-15T01:11:08.132348+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.132348+0000","objects_scrubbed":4,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:03:15.333033+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":8649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'809","reported_seq":1006,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.565580+0000","last_change":"2024-04-15T01:11:04.565580+0000","last_active":"2024-04-15T01:11:04.565580+0000","last_peered":"2024-04-15T01:11:04.565580+0000","last_clean":"2024-04-15T01:11:04.565580+0000","last_became_active":"2024-04-15T00:01:18.975787+0000","last_became_peered":"2024-04-15T00:01:18.975787+0000","last_unstale":"2024-04-15T01:11:04.565580+0000","last_undegraded":"2024-04-15T01:11:04.565580+0000","last_fullsized":"2024-04-15T01:11:04.565580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'809","last_scrub_stamp":"2024-04-15T01:11:04.565459+0000","last_deep_scrub":"29'809","last_deep_scrub_stamp":"2024-04-15T01:11:04.565459+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.565459+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:00:41.673390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":99885,"num_write":793,"num_write_kb":204639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'209","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.877340+0000","last_change":"2024-04-15T01:11:05.877361+0000","last_active":"2024-04-15T01:11:05.877340+0000","last_peered":"2024-04-15T01:11:05.877340+0000","last_clean":"2024-04-15T01:11:05.877340+0000","last_became_active":"2024-04-15T00:01:12.990433+0000","last_became_peered":"2024-04-15T00:01:12.990433+0000","last_unstale":"2024-04-15T01:11:05.877340+0000","last_undegraded":"2024-04-15T01:11:05.877340+0000","last_fullsized":"2024-04-15T01:11:05.877340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-04-15T01:11:05.877252+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-04-15T01:11:05.877252+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.877252+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:06:54.845694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'782","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.427100+0000","last_change":"2024-04-15T01:10:58.427127+0000","last_active":"2024-04-15T01:10:58.427100+0000","last_peered":"2024-04-15T01:10:58.427100+0000","last_clean":"2024-04-15T01:10:58.427100+0000","last_became_active":"2024-04-15T00:01:11.979732+0000","last_became_peered":"2024-04-15T00:01:11.979732+0000","last_unstale":"2024-04-15T01:10:58.427100+0000","last_undegraded":"2024-04-15T01:10:58.427100+0000","last_fullsized":"2024-04-15T01:10:58.427100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'782","last_scrub_stamp":"2024-04-15T01:10:58.427033+0000","last_deep_scrub":"29'782","last_deep_scrub_stamp":"2024-04-15T01:10:58.427033+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.427033+0000","objects_scrubbed":3,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:18:22.842557+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'885","reported_seq":1057,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.626607+0000","last_change":"2024-04-15T01:11:06.626634+0000","last_active":"2024-04-15T01:11:06.626607+0000","last_peered":"2024-04-15T01:11:06.626607+0000","last_clean":"2024-04-15T01:11:06.626607+0000","last_became_active":"2024-04-15T00:01:18.981324+0000","last_became_peered":"2024-04-15T00:01:18.981324+0000","last_unstale":"2024-04-15T01:11:06.626607+0000","last_undegraded":"2024-04-15T01:11:06.626607+0000","last_fullsized":"2024-04-15T01:11:06.626607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'885","last_scrub_stamp":"2024-04-15T01:11:06.626511+0000","last_deep_scrub":"29'885","last_deep_scrub_stamp":"2024-04-15T01:11:06.626511+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.626511+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:55:53.428811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":52186,"num_write":871,"num_write_kb":181200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'202","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.849277+0000","last_change":"2024-04-15T01:11:04.849299+0000","last_active":"2024-04-15T01:11:04.849277+0000","last_peered":"2024-04-15T01:11:04.849277+0000","last_clean":"2024-04-15T01:11:04.849277+0000","last_became_active":"2024-04-15T00:01:12.989602+0000","last_became_peered":"2024-04-15T00:01:12.989602+0000","last_unstale":"2024-04-15T01:11:04.849277+0000","last_undegraded":"2024-04-15T01:11:04.849277+0000","last_fullsized":"2024-04-15T01:11:04.849277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-04-15T01:11:04.849208+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-04-15T01:11:04.849208+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.849208+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:10:11.454619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'200","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.433769+0000","last_change":"2024-04-15T01:10:59.433826+0000","last_active":"2024-04-15T01:10:59.433769+0000","last_peered":"2024-04-15T01:10:59.433769+0000","last_clean":"2024-04-15T01:10:59.433769+0000","last_became_active":"2024-04-15T00:01:11.982340+0000","last_became_peered":"2024-04-15T00:01:11.982340+0000","last_unstale":"2024-04-15T01:10:59.433769+0000","last_undegraded":"2024-04-15T01:10:59.433769+0000","last_fullsized":"2024-04-15T01:10:59.433769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:10:59.433659+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:10:59.433659+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.433659+0000","objects_scrubbed":5,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:44:05.065904+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'743","reported_seq":919,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.339223+0000","last_change":"2024-04-15T01:11:08.339223+0000","last_active":"2024-04-15T01:11:08.339223+0000","last_peered":"2024-04-15T01:11:08.339223+0000","last_clean":"2024-04-15T01:11:08.339223+0000","last_became_active":"2024-04-15T00:01:18.974798+0000","last_became_peered":"2024-04-15T00:01:18.974798+0000","last_unstale":"2024-04-15T01:11:08.339223+0000","last_undegraded":"2024-04-15T01:11:08.339223+0000","last_fullsized":"2024-04-15T01:11:08.339223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'743","last_scrub_stamp":"2024-04-15T01:11:08.339121+0000","last_deep_scrub":"29'743","last_deep_scrub_stamp":"2024-04-15T01:11:08.339121+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.339121+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:43:25.279905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":58288,"num_write":731,"num_write_kb":102006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'221","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.540747+0000","last_change":"2024-04-15T01:10:59.540769+0000","last_active":"2024-04-15T01:10:59.540747+0000","last_peered":"2024-04-15T01:10:59.540747+0000","last_clean":"2024-04-15T01:10:59.540747+0000","last_became_active":"2024-04-15T00:01:12.992929+0000","last_became_peered":"2024-04-15T00:01:12.992929+0000","last_unstale":"2024-04-15T01:10:59.540747+0000","last_undegraded":"2024-04-15T01:10:59.540747+0000","last_fullsized":"2024-04-15T01:10:59.540747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'221","last_scrub_stamp":"2024-04-15T01:10:59.540679+0000","last_deep_scrub":"29'221","last_deep_scrub_stamp":"2024-04-15T01:10:59.540679+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.540679+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:43:38.623855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'785","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.215797+0000","last_change":"2024-04-15T01:11:05.215829+0000","last_active":"2024-04-15T01:11:05.215797+0000","last_peered":"2024-04-15T01:11:05.215797+0000","last_clean":"2024-04-15T01:11:05.215797+0000","last_became_active":"2024-04-15T00:01:11.982888+0000","last_became_peered":"2024-04-15T00:01:11.982888+0000","last_unstale":"2024-04-15T01:11:05.215797+0000","last_undegraded":"2024-04-15T01:11:05.215797+0000","last_fullsized":"2024-04-15T01:11:05.215797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'785","last_scrub_stamp":"2024-04-15T01:11:05.215725+0000","last_deep_scrub":"29'785","last_deep_scrub_stamp":"2024-04-15T01:11:05.215725+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.215725+0000","objects_scrubbed":2,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:55:52.018026+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'723","reported_seq":870,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.578758+0000","last_change":"2024-04-15T01:11:12.578785+0000","last_active":"2024-04-15T01:11:12.578758+0000","last_peered":"2024-04-15T01:11:12.578758+0000","last_clean":"2024-04-15T01:11:12.578758+0000","last_became_active":"2024-04-15T00:01:18.987892+0000","last_became_peered":"2024-04-15T00:01:18.987892+0000","last_unstale":"2024-04-15T01:11:12.578758+0000","last_undegraded":"2024-04-15T01:11:12.578758+0000","last_fullsized":"2024-04-15T01:11:12.578758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'723","last_scrub_stamp":"2024-04-15T01:11:12.578667+0000","last_deep_scrub":"29'723","last_deep_scrub_stamp":"2024-04-15T01:11:12.578667+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.578667+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:14:19.024027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":38800,"num_write":705,"num_write_kb":106309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'224","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.437480+0000","last_change":"2024-04-15T01:10:59.437527+0000","last_active":"2024-04-15T01:10:59.437480+0000","last_peered":"2024-04-15T01:10:59.437480+0000","last_clean":"2024-04-15T01:10:59.437480+0000","last_became_active":"2024-04-15T00:01:12.886963+0000","last_became_peered":"2024-04-15T00:01:12.886963+0000","last_unstale":"2024-04-15T01:10:59.437480+0000","last_undegraded":"2024-04-15T01:10:59.437480+0000","last_fullsized":"2024-04-15T01:10:59.437480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'224","last_scrub_stamp":"2024-04-15T01:10:59.437374+0000","last_deep_scrub":"29'224","last_deep_scrub_stamp":"2024-04-15T01:10:59.437374+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.437374+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:31:34.373883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'199","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.211269+0000","last_change":"2024-04-15T01:11:02.211303+0000","last_active":"2024-04-15T01:11:02.211269+0000","last_peered":"2024-04-15T01:11:02.211269+0000","last_clean":"2024-04-15T01:11:02.211269+0000","last_became_active":"2024-04-15T00:01:11.987931+0000","last_became_peered":"2024-04-15T00:01:11.987931+0000","last_unstale":"2024-04-15T01:11:02.211269+0000","last_undegraded":"2024-04-15T01:11:02.211269+0000","last_fullsized":"2024-04-15T01:11:02.211269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-04-15T01:11:02.211196+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-04-15T01:11:02.211196+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.211196+0000","objects_scrubbed":5,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:17:51.986656+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'797","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.623582+0000","last_change":"2024-04-15T01:11:09.623610+0000","last_active":"2024-04-15T01:11:09.623582+0000","last_peered":"2024-04-15T01:11:09.623582+0000","last_clean":"2024-04-15T01:11:09.623582+0000","last_became_active":"2024-04-15T00:01:18.983358+0000","last_became_peered":"2024-04-15T00:01:18.983358+0000","last_unstale":"2024-04-15T01:11:09.623582+0000","last_undegraded":"2024-04-15T01:11:09.623582+0000","last_fullsized":"2024-04-15T01:11:09.623582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'797","last_scrub_stamp":"2024-04-15T01:11:09.623497+0000","last_deep_scrub":"29'797","last_deep_scrub_stamp":"2024-04-15T01:11:09.623497+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.623497+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:03:16.824182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60896,"num_write":782,"num_write_kb":175614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'173","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.892705+0000","last_change":"2024-04-15T01:11:06.892755+0000","last_active":"2024-04-15T01:11:06.892705+0000","last_peered":"2024-04-15T01:11:06.892705+0000","last_clean":"2024-04-15T01:11:06.892705+0000","last_became_active":"2024-04-15T00:01:12.991167+0000","last_became_peered":"2024-04-15T00:01:12.991167+0000","last_unstale":"2024-04-15T01:11:06.892705+0000","last_undegraded":"2024-04-15T01:11:06.892705+0000","last_fullsized":"2024-04-15T01:11:06.892705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'173","last_scrub_stamp":"2024-04-15T01:11:06.892624+0000","last_deep_scrub":"29'173","last_deep_scrub_stamp":"2024-04-15T01:11:06.892624+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.892624+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:37:41.197869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3601","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.407855+0000","last_change":"2024-04-15T01:11:00.407903+0000","last_active":"2024-04-15T01:11:00.407855+0000","last_peered":"2024-04-15T01:11:00.407855+0000","last_clean":"2024-04-15T01:11:00.407855+0000","last_became_active":"2024-04-15T00:01:11.983912+0000","last_became_peered":"2024-04-15T00:01:11.983912+0000","last_unstale":"2024-04-15T01:11:00.407855+0000","last_undegraded":"2024-04-15T01:11:00.407855+0000","last_fullsized":"2024-04-15T01:11:00.407855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3601","last_scrub_stamp":"2024-04-15T01:11:00.407776+0000","last_deep_scrub":"29'3601","last_deep_scrub_stamp":"2024-04-15T01:11:00.407776+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.407776+0000","objects_scrubbed":4,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:09.018759+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10014,"num_write_kb":4007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'787","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:15.875269+0000","last_change":"2024-04-15T01:11:15.875269+0000","last_active":"2024-04-15T01:11:15.875269+0000","last_peered":"2024-04-15T01:11:15.875269+0000","last_clean":"2024-04-15T01:11:15.875269+0000","last_became_active":"2024-04-15T00:01:50.325409+0000","last_became_peered":"2024-04-15T00:01:50.325409+0000","last_unstale":"2024-04-15T01:11:15.875269+0000","last_undegraded":"2024-04-15T01:11:15.875269+0000","last_fullsized":"2024-04-15T01:11:15.875269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'787","last_scrub_stamp":"2024-04-15T01:11:15.875080+0000","last_deep_scrub":"29'787","last_deep_scrub_stamp":"2024-04-15T01:11:15.875080+0000","last_clean_scrub_stamp":"2024-04-15T01:11:15.875080+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:26:03.854813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27446,"num_write":780,"num_write_kb":102026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'200","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.316250+0000","last_change":"2024-04-15T01:11:04.316291+0000","last_active":"2024-04-15T01:11:04.316250+0000","last_peered":"2024-04-15T01:11:04.316250+0000","last_clean":"2024-04-15T01:11:04.316250+0000","last_became_active":"2024-04-15T00:01:12.980233+0000","last_became_peered":"2024-04-15T00:01:12.980233+0000","last_unstale":"2024-04-15T01:11:04.316250+0000","last_undegraded":"2024-04-15T01:11:04.316250+0000","last_fullsized":"2024-04-15T01:11:04.316250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:11:04.316147+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:11:04.316147+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.316147+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:41:58.928246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'597","reported_seq":667,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.180655+0000","last_change":"2024-04-15T01:11:06.180691+0000","last_active":"2024-04-15T01:11:06.180655+0000","last_peered":"2024-04-15T01:11:06.180655+0000","last_clean":"2024-04-15T01:11:06.180655+0000","last_became_active":"2024-04-15T00:01:11.986342+0000","last_became_peered":"2024-04-15T00:01:11.986342+0000","last_unstale":"2024-04-15T01:11:06.180655+0000","last_undegraded":"2024-04-15T01:11:06.180655+0000","last_fullsized":"2024-04-15T01:11:06.180655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'597","last_scrub_stamp":"2024-04-15T01:11:06.180585+0000","last_deep_scrub":"29'597","last_deep_scrub_stamp":"2024-04-15T01:11:06.180585+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.180585+0000","objects_scrubbed":5,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:40:01.882695+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":8484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'736","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.479540+0000","last_change":"2024-04-15T01:11:08.479563+0000","last_active":"2024-04-15T01:11:08.479540+0000","last_peered":"2024-04-15T01:11:08.479540+0000","last_clean":"2024-04-15T01:11:08.479540+0000","last_became_active":"2024-04-15T00:01:18.974916+0000","last_became_peered":"2024-04-15T00:01:18.974916+0000","last_unstale":"2024-04-15T01:11:08.479540+0000","last_undegraded":"2024-04-15T01:11:08.479540+0000","last_fullsized":"2024-04-15T01:11:08.479540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'736","last_scrub_stamp":"2024-04-15T01:11:08.479472+0000","last_deep_scrub":"29'736","last_deep_scrub_stamp":"2024-04-15T01:11:08.479472+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.479472+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:20.615454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":59617,"num_write":721,"num_write_kb":101495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'222","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.418014+0000","last_change":"2024-04-15T01:11:11.418056+0000","last_active":"2024-04-15T01:11:11.418014+0000","last_peered":"2024-04-15T01:11:11.418014+0000","last_clean":"2024-04-15T01:11:11.418014+0000","last_became_active":"2024-04-15T00:01:12.991832+0000","last_became_peered":"2024-04-15T00:01:12.991832+0000","last_unstale":"2024-04-15T01:11:11.418014+0000","last_undegraded":"2024-04-15T01:11:11.418014+0000","last_fullsized":"2024-04-15T01:11:11.418014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:11.417929+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:11.417929+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.417929+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:27:36.022108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'305","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.388014+0000","last_change":"2024-04-15T01:10:57.388064+0000","last_active":"2024-04-15T01:10:57.388014+0000","last_peered":"2024-04-15T01:10:57.388014+0000","last_clean":"2024-04-15T01:10:57.388014+0000","last_became_active":"2024-04-15T00:01:11.963337+0000","last_became_peered":"2024-04-15T00:01:11.963337+0000","last_unstale":"2024-04-15T01:10:57.388014+0000","last_undegraded":"2024-04-15T01:10:57.388014+0000","last_fullsized":"2024-04-15T01:10:57.388014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'305","last_scrub_stamp":"2024-04-15T01:10:57.387931+0000","last_deep_scrub":"29'305","last_deep_scrub_stamp":"2024-04-15T01:10:57.387931+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.387931+0000","objects_scrubbed":1,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:25:35.153942+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'778","reported_seq":921,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.344730+0000","last_change":"2024-04-15T01:11:09.344754+0000","last_active":"2024-04-15T01:11:09.344730+0000","last_peered":"2024-04-15T01:11:09.344730+0000","last_clean":"2024-04-15T01:11:09.344730+0000","last_became_active":"2024-04-15T00:01:18.975824+0000","last_became_peered":"2024-04-15T00:01:18.975824+0000","last_unstale":"2024-04-15T01:11:09.344730+0000","last_undegraded":"2024-04-15T01:11:09.344730+0000","last_fullsized":"2024-04-15T01:11:09.344730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'778","last_scrub_stamp":"2024-04-15T01:11:09.344649+0000","last_deep_scrub":"29'778","last_deep_scrub_stamp":"2024-04-15T01:11:09.344649+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.344649+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:44:27.620741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":54040,"num_write":767,"num_write_kb":142606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'203","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.566448+0000","last_change":"2024-04-15T01:11:03.566473+0000","last_active":"2024-04-15T01:11:03.566448+0000","last_peered":"2024-04-15T01:11:03.566448+0000","last_clean":"2024-04-15T01:11:03.566448+0000","last_became_active":"2024-04-15T00:01:12.994234+0000","last_became_peered":"2024-04-15T00:01:12.994234+0000","last_unstale":"2024-04-15T01:11:03.566448+0000","last_undegraded":"2024-04-15T01:11:03.566448+0000","last_fullsized":"2024-04-15T01:11:03.566448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-04-15T01:11:03.566361+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-04-15T01:11:03.566361+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.566361+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:26:58.505142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'992","reported_seq":1062,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.478976+0000","last_change":"2024-04-15T01:11:02.479005+0000","last_active":"2024-04-15T01:11:02.478976+0000","last_peered":"2024-04-15T01:11:02.478976+0000","last_clean":"2024-04-15T01:11:02.478976+0000","last_became_active":"2024-04-15T00:01:11.983063+0000","last_became_peered":"2024-04-15T00:01:11.983063+0000","last_unstale":"2024-04-15T01:11:02.478976+0000","last_undegraded":"2024-04-15T01:11:02.478976+0000","last_fullsized":"2024-04-15T01:11:02.478976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'992","last_scrub_stamp":"2024-04-15T01:11:02.478908+0000","last_deep_scrub":"29'992","last_deep_scrub_stamp":"2024-04-15T01:11:02.478908+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.478908+0000","objects_scrubbed":4,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:45:47.514918+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":8655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'695","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:16.473321+0000","last_change":"2024-04-15T01:11:16.473365+0000","last_active":"2024-04-15T01:11:16.473321+0000","last_peered":"2024-04-15T01:11:16.473321+0000","last_clean":"2024-04-15T01:11:16.473321+0000","last_became_active":"2024-04-15T00:01:50.002633+0000","last_became_peered":"2024-04-15T00:01:50.002633+0000","last_unstale":"2024-04-15T01:11:16.473321+0000","last_undegraded":"2024-04-15T01:11:16.473321+0000","last_fullsized":"2024-04-15T01:11:16.473321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'695","last_scrub_stamp":"2024-04-15T01:11:16.473213+0000","last_deep_scrub":"29'695","last_deep_scrub_stamp":"2024-04-15T01:11:16.473213+0000","last_clean_scrub_stamp":"2024-04-15T01:11:16.473213+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:29:23.375557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22523,"num_write":688,"num_write_kb":89336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"29'209","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.335592+0000","last_change":"2024-04-15T01:10:56.335592+0000","last_active":"2024-04-15T01:10:56.335592+0000","last_peered":"2024-04-15T01:10:56.335592+0000","last_clean":"2024-04-15T01:10:56.335592+0000","last_became_active":"2024-04-15T00:01:12.980660+0000","last_became_peered":"2024-04-15T00:01:12.980660+0000","last_unstale":"2024-04-15T01:10:56.335592+0000","last_undegraded":"2024-04-15T01:10:56.335592+0000","last_fullsized":"2024-04-15T01:10:56.335592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-04-15T01:10:56.335446+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-04-15T01:10:56.335446+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.335446+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:13:52.089612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3015","reported_seq":6033,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.853997+0000","last_change":"2024-04-15T01:10:58.854028+0000","last_active":"2024-04-15T01:10:58.853997+0000","last_peered":"2024-04-15T01:10:58.853997+0000","last_clean":"2024-04-15T01:10:58.853997+0000","last_became_active":"2024-04-15T00:01:11.979799+0000","last_became_peered":"2024-04-15T00:01:11.979799+0000","last_unstale":"2024-04-15T01:10:58.853997+0000","last_undegraded":"2024-04-15T01:10:58.853997+0000","last_fullsized":"2024-04-15T01:10:58.853997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3015","last_scrub_stamp":"2024-04-15T01:10:58.853928+0000","last_deep_scrub":"29'3015","last_deep_scrub_stamp":"2024-04-15T01:10:58.853928+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.853928+0000","objects_scrubbed":4,"log_size":3015,"log_dups_size":0,"ondisk_log_size":3015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:17:17.023375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":2955,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'697","reported_seq":798,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.332494+0000","last_change":"2024-04-15T01:11:10.332517+0000","last_active":"2024-04-15T01:11:10.332494+0000","last_peered":"2024-04-15T01:11:10.332494+0000","last_clean":"2024-04-15T01:11:10.332494+0000","last_became_active":"2024-04-15T00:01:18.977748+0000","last_became_peered":"2024-04-15T00:01:18.977748+0000","last_unstale":"2024-04-15T01:11:10.332494+0000","last_undegraded":"2024-04-15T01:11:10.332494+0000","last_fullsized":"2024-04-15T01:11:10.332494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2024-04-15T01:11:10.332418+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2024-04-15T01:11:10.332418+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.332418+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:47:24.362676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19611,"num_write":689,"num_write_kb":76681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.487581+0000","last_change":"2024-04-15T01:11:05.487604+0000","last_active":"2024-04-15T01:11:05.487581+0000","last_peered":"2024-04-15T01:11:05.487581+0000","last_clean":"2024-04-15T01:11:05.487581+0000","last_became_active":"2024-04-15T00:01:12.993054+0000","last_became_peered":"2024-04-15T00:01:12.993054+0000","last_unstale":"2024-04-15T01:11:05.487581+0000","last_undegraded":"2024-04-15T01:11:05.487581+0000","last_fullsized":"2024-04-15T01:11:05.487581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'198","last_scrub_stamp":"2024-04-15T01:11:05.487511+0000","last_deep_scrub":"29'198","last_deep_scrub_stamp":"2024-04-15T01:11:05.487511+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.487511+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:23.106376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'494","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.185629+0000","last_change":"2024-04-15T01:11:04.185629+0000","last_active":"2024-04-15T01:11:04.185629+0000","last_peered":"2024-04-15T01:11:04.185629+0000","last_clean":"2024-04-15T01:11:04.185629+0000","last_became_active":"2024-04-15T00:01:11.982389+0000","last_became_peered":"2024-04-15T00:01:11.982389+0000","last_unstale":"2024-04-15T01:11:04.185629+0000","last_undegraded":"2024-04-15T01:11:04.185629+0000","last_fullsized":"2024-04-15T01:11:04.185629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'494","last_scrub_stamp":"2024-04-15T01:11:04.185463+0000","last_deep_scrub":"29'494","last_deep_scrub_stamp":"2024-04-15T01:11:04.185463+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.185463+0000","objects_scrubbed":4,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:24:01.968916+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'862","reported_seq":1073,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.493434+0000","last_change":"2024-04-15T01:11:09.493459+0000","last_active":"2024-04-15T01:11:09.493434+0000","last_peered":"2024-04-15T01:11:09.493434+0000","last_clean":"2024-04-15T01:11:09.493434+0000","last_became_active":"2024-04-15T00:01:18.974896+0000","last_became_peered":"2024-04-15T00:01:18.974896+0000","last_unstale":"2024-04-15T01:11:09.493434+0000","last_undegraded":"2024-04-15T01:11:09.493434+0000","last_fullsized":"2024-04-15T01:11:09.493434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'862","last_scrub_stamp":"2024-04-15T01:11:09.493356+0000","last_deep_scrub":"29'862","last_deep_scrub_stamp":"2024-04-15T01:11:09.493356+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.493356+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:00.021790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":84642,"num_write":849,"num_write_kb":128022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'185","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.347201+0000","last_change":"2024-04-15T01:11:12.347226+0000","last_active":"2024-04-15T01:11:12.347201+0000","last_peered":"2024-04-15T01:11:12.347201+0000","last_clean":"2024-04-15T01:11:12.347201+0000","last_became_active":"2024-04-15T00:01:49.997728+0000","last_became_peered":"2024-04-15T00:01:49.997728+0000","last_unstale":"2024-04-15T01:11:12.347201+0000","last_undegraded":"2024-04-15T01:11:12.347201+0000","last_fullsized":"2024-04-15T01:11:12.347201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'185","last_scrub_stamp":"2024-04-15T01:11:12.347120+0000","last_deep_scrub":"29'185","last_deep_scrub_stamp":"2024-04-15T01:11:12.347120+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.347120+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:39.206718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"29'305","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.431483+0000","last_change":"2024-04-15T01:11:03.431516+0000","last_active":"2024-04-15T01:11:03.431483+0000","last_peered":"2024-04-15T01:11:03.431483+0000","last_clean":"2024-04-15T01:11:03.431483+0000","last_became_active":"2024-04-15T00:01:11.983863+0000","last_became_peered":"2024-04-15T00:01:11.983863+0000","last_unstale":"2024-04-15T01:11:03.431483+0000","last_undegraded":"2024-04-15T01:11:03.431483+0000","last_fullsized":"2024-04-15T01:11:03.431483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'305","last_scrub_stamp":"2024-04-15T01:11:03.431406+0000","last_deep_scrub":"29'305","last_deep_scrub_stamp":"2024-04-15T01:11:03.431406+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.431406+0000","objects_scrubbed":6,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:35:37.791948+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.118420+0000","last_change":"2024-04-15T01:11:03.118420+0000","last_active":"2024-04-15T01:11:03.118420+0000","last_peered":"2024-04-15T01:11:03.118420+0000","last_clean":"2024-04-15T01:11:03.118420+0000","last_became_active":"2024-04-15T00:00:57.662766+0000","last_became_peered":"2024-04-15T00:00:57.662766+0000","last_unstale":"2024-04-15T01:11:03.118420+0000","last_undegraded":"2024-04-15T01:11:03.118420+0000","last_fullsized":"2024-04-15T01:11:03.118420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-15T01:11:03.118329+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-15T01:11:03.118329+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.118329+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:00:40.226260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'808","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.190765+0000","last_change":"2024-04-15T01:11:12.190790+0000","last_active":"2024-04-15T01:11:12.190765+0000","last_peered":"2024-04-15T01:11:12.190765+0000","last_clean":"2024-04-15T01:11:12.190765+0000","last_became_active":"2024-04-15T00:01:18.978481+0000","last_became_peered":"2024-04-15T00:01:18.978481+0000","last_unstale":"2024-04-15T01:11:12.190765+0000","last_undegraded":"2024-04-15T01:11:12.190765+0000","last_fullsized":"2024-04-15T01:11:12.190765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'808","last_scrub_stamp":"2024-04-15T01:11:12.190685+0000","last_deep_scrub":"29'808","last_deep_scrub_stamp":"2024-04-15T01:11:12.190685+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.190685+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:18.022611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":51109,"num_write":790,"num_write_kb":155353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'208","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.140862+0000","last_change":"2024-04-15T01:11:11.140910+0000","last_active":"2024-04-15T01:11:11.140862+0000","last_peered":"2024-04-15T01:11:11.140862+0000","last_clean":"2024-04-15T01:11:11.140862+0000","last_became_active":"2024-04-15T00:01:12.982947+0000","last_became_peered":"2024-04-15T00:01:12.982947+0000","last_unstale":"2024-04-15T01:11:11.140862+0000","last_undegraded":"2024-04-15T01:11:11.140862+0000","last_fullsized":"2024-04-15T01:11:11.140862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:11:11.140743+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:11:11.140743+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.140743+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:23.276726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'254","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.811401+0000","last_change":"2024-04-15T01:10:59.811401+0000","last_active":"2024-04-15T01:10:59.811401+0000","last_peered":"2024-04-15T01:10:59.811401+0000","last_clean":"2024-04-15T01:10:59.811401+0000","last_became_active":"2024-04-15T00:01:11.982383+0000","last_became_peered":"2024-04-15T00:01:11.982383+0000","last_unstale":"2024-04-15T01:10:59.811401+0000","last_undegraded":"2024-04-15T01:10:59.811401+0000","last_fullsized":"2024-04-15T01:10:59.811401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'254","last_scrub_stamp":"2024-04-15T01:10:59.811315+0000","last_deep_scrub":"29'254","last_deep_scrub_stamp":"2024-04-15T01:10:59.811315+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.811315+0000","objects_scrubbed":4,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:23:31.516435+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3902566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'818","reported_seq":1009,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.177993+0000","last_change":"2024-04-15T01:11:13.178016+0000","last_active":"2024-04-15T01:11:13.177993+0000","last_peered":"2024-04-15T01:11:13.177993+0000","last_clean":"2024-04-15T01:11:13.177993+0000","last_became_active":"2024-04-15T00:01:18.985662+0000","last_became_peered":"2024-04-15T00:01:18.985662+0000","last_unstale":"2024-04-15T01:11:13.177993+0000","last_undegraded":"2024-04-15T01:11:13.177993+0000","last_fullsized":"2024-04-15T01:11:13.177993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'818","last_scrub_stamp":"2024-04-15T01:11:13.177916+0000","last_deep_scrub":"29'818","last_deep_scrub_stamp":"2024-04-15T01:11:13.177916+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.177916+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:25.313899+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":80804,"num_write":805,"num_write_kb":188613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.504114+0000","last_change":"2024-04-15T01:10:59.504114+0000","last_active":"2024-04-15T01:10:59.504114+0000","last_peered":"2024-04-15T01:10:59.504114+0000","last_clean":"2024-04-15T01:10:59.504114+0000","last_became_active":"2024-04-15T00:01:12.991264+0000","last_became_peered":"2024-04-15T00:01:12.991264+0000","last_unstale":"2024-04-15T01:10:59.504114+0000","last_undegraded":"2024-04-15T01:10:59.504114+0000","last_fullsized":"2024-04-15T01:10:59.504114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'226","last_scrub_stamp":"2024-04-15T01:10:59.504018+0000","last_deep_scrub":"29'226","last_deep_scrub_stamp":"2024-04-15T01:10:59.504018+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.504018+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:37:26.107162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'783","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.420525+0000","last_change":"2024-04-15T01:11:01.420551+0000","last_active":"2024-04-15T01:11:01.420525+0000","last_peered":"2024-04-15T01:11:01.420525+0000","last_clean":"2024-04-15T01:11:01.420525+0000","last_became_active":"2024-04-15T00:01:11.985633+0000","last_became_peered":"2024-04-15T00:01:11.985633+0000","last_unstale":"2024-04-15T01:11:01.420525+0000","last_undegraded":"2024-04-15T01:11:01.420525+0000","last_fullsized":"2024-04-15T01:11:01.420525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'783","last_scrub_stamp":"2024-04-15T01:11:01.420466+0000","last_deep_scrub":"29'783","last_deep_scrub_stamp":"2024-04-15T01:11:01.420466+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.420466+0000","objects_scrubbed":2,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:45:39.666097+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":4474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'763","reported_seq":920,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.469621+0000","last_change":"2024-04-15T01:11:10.469669+0000","last_active":"2024-04-15T01:11:10.469621+0000","last_peered":"2024-04-15T01:11:10.469621+0000","last_clean":"2024-04-15T01:11:10.469621+0000","last_became_active":"2024-04-15T00:01:18.975209+0000","last_became_peered":"2024-04-15T00:01:18.975209+0000","last_unstale":"2024-04-15T01:11:10.469621+0000","last_undegraded":"2024-04-15T01:11:10.469621+0000","last_fullsized":"2024-04-15T01:11:10.469621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'763","last_scrub_stamp":"2024-04-15T01:11:10.469532+0000","last_deep_scrub":"29'763","last_deep_scrub_stamp":"2024-04-15T01:11:10.469532+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.469532+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:53.924048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":61965,"num_write":764,"num_write_kb":101545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:18.260978+0000","last_change":"2024-04-15T01:11:18.260978+0000","last_active":"2024-04-15T01:11:18.260978+0000","last_peered":"2024-04-15T01:11:18.260978+0000","last_clean":"2024-04-15T01:11:18.260978+0000","last_became_active":"2024-04-15T00:01:12.995700+0000","last_became_peered":"2024-04-15T00:01:12.995700+0000","last_unstale":"2024-04-15T01:11:18.260978+0000","last_undegraded":"2024-04-15T01:11:18.260978+0000","last_fullsized":"2024-04-15T01:11:18.260978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-04-15T01:11:18.260880+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-04-15T01:11:18.260880+0000","last_clean_scrub_stamp":"2024-04-15T01:11:18.260880+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:15:08.508696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'786","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.832224+0000","last_change":"2024-04-15T01:10:57.832224+0000","last_active":"2024-04-15T01:10:57.832224+0000","last_peered":"2024-04-15T01:10:57.832224+0000","last_clean":"2024-04-15T01:10:57.832224+0000","last_became_active":"2024-04-15T00:01:11.979125+0000","last_became_peered":"2024-04-15T00:01:11.979125+0000","last_unstale":"2024-04-15T01:10:57.832224+0000","last_undegraded":"2024-04-15T01:10:57.832224+0000","last_fullsized":"2024-04-15T01:10:57.832224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'786","last_scrub_stamp":"2024-04-15T01:10:57.832132+0000","last_deep_scrub":"29'786","last_deep_scrub_stamp":"2024-04-15T01:10:57.832132+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.832132+0000","objects_scrubbed":3,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:06:07.506490+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":727,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'786","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:15.451818+0000","last_change":"2024-04-15T01:11:15.451846+0000","last_active":"2024-04-15T01:11:15.451818+0000","last_peered":"2024-04-15T01:11:15.451818+0000","last_clean":"2024-04-15T01:11:15.451818+0000","last_became_active":"2024-04-15T00:01:18.978906+0000","last_became_peered":"2024-04-15T00:01:18.978906+0000","last_unstale":"2024-04-15T01:11:15.451818+0000","last_undegraded":"2024-04-15T01:11:15.451818+0000","last_fullsized":"2024-04-15T01:11:15.451818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'786","last_scrub_stamp":"2024-04-15T01:11:15.451715+0000","last_deep_scrub":"29'786","last_deep_scrub_stamp":"2024-04-15T01:11:15.451715+0000","last_clean_scrub_stamp":"2024-04-15T01:11:15.451715+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:32:29.722692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":35671,"num_write":777,"num_write_kb":118402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:17.221122+0000","last_change":"2024-04-15T01:11:17.221144+0000","last_active":"2024-04-15T01:11:17.221122+0000","last_peered":"2024-04-15T01:11:17.221122+0000","last_clean":"2024-04-15T01:11:17.221122+0000","last_became_active":"2024-04-15T00:01:12.995162+0000","last_became_peered":"2024-04-15T00:01:12.995162+0000","last_unstale":"2024-04-15T01:11:17.221122+0000","last_undegraded":"2024-04-15T01:11:17.221122+0000","last_fullsized":"2024-04-15T01:11:17.221122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2024-04-15T01:11:17.221054+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2024-04-15T01:11:17.221054+0000","last_clean_scrub_stamp":"2024-04-15T01:11:17.221054+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:55:27.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'768","reported_seq":836,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.521021+0000","last_change":"2024-04-15T01:10:58.521021+0000","last_active":"2024-04-15T01:10:58.521021+0000","last_peered":"2024-04-15T01:10:58.521021+0000","last_clean":"2024-04-15T01:10:58.521021+0000","last_became_active":"2024-04-15T00:01:11.983851+0000","last_became_peered":"2024-04-15T00:01:11.983851+0000","last_unstale":"2024-04-15T01:10:58.521021+0000","last_undegraded":"2024-04-15T01:10:58.521021+0000","last_fullsized":"2024-04-15T01:10:58.521021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'768","last_scrub_stamp":"2024-04-15T01:10:58.520922+0000","last_deep_scrub":"29'768","last_deep_scrub_stamp":"2024-04-15T01:10:58.520922+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.520922+0000","objects_scrubbed":3,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:47:08.375904+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'816","reported_seq":949,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.645994+0000","last_change":"2024-04-15T01:11:08.646017+0000","last_active":"2024-04-15T01:11:08.645994+0000","last_peered":"2024-04-15T01:11:08.645994+0000","last_clean":"2024-04-15T01:11:08.645994+0000","last_became_active":"2024-04-15T00:01:18.982470+0000","last_became_peered":"2024-04-15T00:01:18.982470+0000","last_unstale":"2024-04-15T01:11:08.645994+0000","last_undegraded":"2024-04-15T01:11:08.645994+0000","last_fullsized":"2024-04-15T01:11:08.645994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'816","last_scrub_stamp":"2024-04-15T01:11:08.645917+0000","last_deep_scrub":"29'816","last_deep_scrub_stamp":"2024-04-15T01:11:08.645917+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.645917+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:36:16.107444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39992,"num_write":799,"num_write_kb":139135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'231","reported_seq":296,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:15.188421+0000","last_change":"2024-04-15T01:11:15.188421+0000","last_active":"2024-04-15T01:11:15.188421+0000","last_peered":"2024-04-15T01:11:15.188421+0000","last_clean":"2024-04-15T01:11:15.188421+0000","last_became_active":"2024-04-15T00:01:12.993458+0000","last_became_peered":"2024-04-15T00:01:12.993458+0000","last_unstale":"2024-04-15T01:11:15.188421+0000","last_undegraded":"2024-04-15T01:11:15.188421+0000","last_fullsized":"2024-04-15T01:11:15.188421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'231","last_scrub_stamp":"2024-04-15T01:11:15.188330+0000","last_deep_scrub":"29'231","last_deep_scrub_stamp":"2024-04-15T01:11:15.188330+0000","last_clean_scrub_stamp":"2024-04-15T01:11:15.188330+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:20:22.331172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'483","reported_seq":550,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:56.793211+0000","last_change":"2024-04-15T01:10:56.793211+0000","last_active":"2024-04-15T01:10:56.793211+0000","last_peered":"2024-04-15T01:10:56.793211+0000","last_clean":"2024-04-15T01:10:56.793211+0000","last_became_active":"2024-04-15T00:01:11.959077+0000","last_became_peered":"2024-04-15T00:01:11.959077+0000","last_unstale":"2024-04-15T01:10:56.793211+0000","last_undegraded":"2024-04-15T01:10:56.793211+0000","last_fullsized":"2024-04-15T01:10:56.793211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'483","last_scrub_stamp":"2024-04-15T01:10:56.793112+0000","last_deep_scrub":"29'483","last_deep_scrub_stamp":"2024-04-15T01:10:56.793112+0000","last_clean_scrub_stamp":"2024-04-15T01:10:56.793112+0000","objects_scrubbed":10,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:04:03.529617+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":420,"num_write_kb":8414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'762","reported_seq":919,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.440294+0000","last_change":"2024-04-15T01:11:11.440294+0000","last_active":"2024-04-15T01:11:11.440294+0000","last_peered":"2024-04-15T01:11:11.440294+0000","last_clean":"2024-04-15T01:11:11.440294+0000","last_became_active":"2024-04-15T00:01:18.977114+0000","last_became_peered":"2024-04-15T00:01:18.977114+0000","last_unstale":"2024-04-15T01:11:11.440294+0000","last_undegraded":"2024-04-15T01:11:11.440294+0000","last_fullsized":"2024-04-15T01:11:11.440294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'762","last_scrub_stamp":"2024-04-15T01:11:11.440201+0000","last_deep_scrub":"29'762","last_deep_scrub_stamp":"2024-04-15T01:11:11.440201+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.440201+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:12:17.772861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":53894,"num_write":751,"num_write_kb":106228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.198797+0000","last_change":"2024-04-15T01:11:05.198797+0000","last_active":"2024-04-15T01:11:05.198797+0000","last_peered":"2024-04-15T01:11:05.198797+0000","last_clean":"2024-04-15T01:11:05.198797+0000","last_became_active":"2024-04-15T00:01:12.979678+0000","last_became_peered":"2024-04-15T00:01:12.979678+0000","last_unstale":"2024-04-15T01:11:05.198797+0000","last_undegraded":"2024-04-15T01:11:05.198797+0000","last_fullsized":"2024-04-15T01:11:05.198797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-04-15T01:11:05.198658+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-04-15T01:11:05.198658+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.198658+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:34.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'65","reported_seq":132,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.195324+0000","last_change":"2024-04-15T01:11:03.195324+0000","last_active":"2024-04-15T01:11:03.195324+0000","last_peered":"2024-04-15T01:11:03.195324+0000","last_clean":"2024-04-15T01:11:03.195324+0000","last_became_active":"2024-04-15T00:01:11.988472+0000","last_became_peered":"2024-04-15T00:01:11.988472+0000","last_unstale":"2024-04-15T01:11:03.195324+0000","last_undegraded":"2024-04-15T01:11:03.195324+0000","last_fullsized":"2024-04-15T01:11:03.195324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-04-15T01:11:03.195226+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-04-15T01:11:03.195226+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.195226+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:19:35.678133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'778","reported_seq":926,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:16.881705+0000","last_change":"2024-04-15T01:11:16.881705+0000","last_active":"2024-04-15T01:11:16.881705+0000","last_peered":"2024-04-15T01:11:16.881705+0000","last_clean":"2024-04-15T01:11:16.881705+0000","last_became_active":"2024-04-15T00:01:50.325590+0000","last_became_peered":"2024-04-15T00:01:50.325590+0000","last_unstale":"2024-04-15T01:11:16.881705+0000","last_undegraded":"2024-04-15T01:11:16.881705+0000","last_fullsized":"2024-04-15T01:11:16.881705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'778","last_scrub_stamp":"2024-04-15T01:11:16.881549+0000","last_deep_scrub":"29'778","last_deep_scrub_stamp":"2024-04-15T01:11:16.881549+0000","last_clean_scrub_stamp":"2024-04-15T01:11:16.881549+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:32:38.277028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":41754,"num_write":768,"num_write_kb":168968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'200","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:16.214559+0000","last_change":"2024-04-15T01:11:16.214607+0000","last_active":"2024-04-15T01:11:16.214559+0000","last_peered":"2024-04-15T01:11:16.214559+0000","last_clean":"2024-04-15T01:11:16.214559+0000","last_became_active":"2024-04-15T00:01:12.995261+0000","last_became_peered":"2024-04-15T00:01:12.995261+0000","last_unstale":"2024-04-15T01:11:16.214559+0000","last_undegraded":"2024-04-15T01:11:16.214559+0000","last_fullsized":"2024-04-15T01:11:16.214559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-04-15T01:11:16.214468+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-04-15T01:11:16.214468+0000","last_clean_scrub_stamp":"2024-04-15T01:11:16.214468+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:40:58.293799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'63","reported_seq":130,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.493312+0000","last_change":"2024-04-15T01:11:01.493312+0000","last_active":"2024-04-15T01:11:01.493312+0000","last_peered":"2024-04-15T01:11:01.493312+0000","last_clean":"2024-04-15T01:11:01.493312+0000","last_became_active":"2024-04-15T00:01:11.982382+0000","last_became_peered":"2024-04-15T00:01:11.982382+0000","last_unstale":"2024-04-15T01:11:01.493312+0000","last_undegraded":"2024-04-15T01:11:01.493312+0000","last_fullsized":"2024-04-15T01:11:01.493312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-04-15T01:11:01.493199+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-04-15T01:11:01.493199+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.493199+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:48.146319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'697","reported_seq":811,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.889230+0000","last_change":"2024-04-15T01:11:12.889230+0000","last_active":"2024-04-15T01:11:12.889230+0000","last_peered":"2024-04-15T01:11:12.889230+0000","last_clean":"2024-04-15T01:11:12.889230+0000","last_became_active":"2024-04-15T00:01:18.979054+0000","last_became_peered":"2024-04-15T00:01:18.979054+0000","last_unstale":"2024-04-15T01:11:12.889230+0000","last_undegraded":"2024-04-15T01:11:12.889230+0000","last_fullsized":"2024-04-15T01:11:12.889230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2024-04-15T01:11:12.889103+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2024-04-15T01:11:12.889103+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.889103+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:29:19.791447+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":31143,"num_write":687,"num_write_kb":101153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'209","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.418317+0000","last_change":"2024-04-15T01:11:03.418317+0000","last_active":"2024-04-15T01:11:03.418317+0000","last_peered":"2024-04-15T01:11:03.418317+0000","last_clean":"2024-04-15T01:11:03.418317+0000","last_became_active":"2024-04-15T00:01:12.977781+0000","last_became_peered":"2024-04-15T00:01:12.977781+0000","last_unstale":"2024-04-15T01:11:03.418317+0000","last_undegraded":"2024-04-15T01:11:03.418317+0000","last_fullsized":"2024-04-15T01:11:03.418317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-04-15T01:11:03.418233+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-04-15T01:11:03.418233+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.418233+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:05:49.129167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'398","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.509382+0000","last_change":"2024-04-15T01:10:57.509382+0000","last_active":"2024-04-15T01:10:57.509382+0000","last_peered":"2024-04-15T01:10:57.509382+0000","last_clean":"2024-04-15T01:10:57.509382+0000","last_became_active":"2024-04-15T00:01:11.988392+0000","last_became_peered":"2024-04-15T00:01:11.988392+0000","last_unstale":"2024-04-15T01:10:57.509382+0000","last_undegraded":"2024-04-15T01:10:57.509382+0000","last_fullsized":"2024-04-15T01:10:57.509382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'398","last_scrub_stamp":"2024-04-15T01:10:57.509229+0000","last_deep_scrub":"29'398","last_deep_scrub_stamp":"2024-04-15T01:10:57.509229+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.509229+0000","objects_scrubbed":8,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:17:47.284689+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'747","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.468298+0000","last_change":"2024-04-15T01:11:14.468298+0000","last_active":"2024-04-15T01:11:14.468298+0000","last_peered":"2024-04-15T01:11:14.468298+0000","last_clean":"2024-04-15T01:11:14.468298+0000","last_became_active":"2024-04-15T00:01:18.975177+0000","last_became_peered":"2024-04-15T00:01:18.975177+0000","last_unstale":"2024-04-15T01:11:14.468298+0000","last_undegraded":"2024-04-15T01:11:14.468298+0000","last_fullsized":"2024-04-15T01:11:14.468298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'747","last_scrub_stamp":"2024-04-15T01:11:14.468204+0000","last_deep_scrub":"29'747","last_deep_scrub_stamp":"2024-04-15T01:11:14.468204+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.468204+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:28:20.128198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":56791,"num_write":733,"num_write_kb":134490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.172718+0000","last_change":"2024-04-15T01:11:14.172718+0000","last_active":"2024-04-15T01:11:14.172718+0000","last_peered":"2024-04-15T01:11:14.172718+0000","last_clean":"2024-04-15T01:11:14.172718+0000","last_became_active":"2024-04-15T00:01:12.990526+0000","last_became_peered":"2024-04-15T00:01:12.990526+0000","last_unstale":"2024-04-15T01:11:14.172718+0000","last_undegraded":"2024-04-15T01:11:14.172718+0000","last_fullsized":"2024-04-15T01:11:14.172718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:14.172629+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:14.172629+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.172629+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:12:20.505289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1430","reported_seq":1497,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.256474+0000","last_change":"2024-04-15T01:11:01.256474+0000","last_active":"2024-04-15T01:11:01.256474+0000","last_peered":"2024-04-15T01:11:01.256474+0000","last_clean":"2024-04-15T01:11:01.256474+0000","last_became_active":"2024-04-15T00:01:11.985466+0000","last_became_peered":"2024-04-15T00:01:11.985466+0000","last_unstale":"2024-04-15T01:11:01.256474+0000","last_undegraded":"2024-04-15T01:11:01.256474+0000","last_fullsized":"2024-04-15T01:11:01.256474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1430","last_scrub_stamp":"2024-04-15T01:11:01.256371+0000","last_deep_scrub":"29'1430","last_deep_scrub_stamp":"2024-04-15T01:11:01.256371+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.256371+0000","objects_scrubbed":8,"log_size":1430,"log_dups_size":0,"ondisk_log_size":1430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:15.898347+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":13127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'798","reported_seq":943,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.299671+0000","last_change":"2024-04-15T01:11:11.299671+0000","last_active":"2024-04-15T01:11:11.299671+0000","last_peered":"2024-04-15T01:11:11.299671+0000","last_clean":"2024-04-15T01:11:11.299671+0000","last_became_active":"2024-04-15T00:01:18.983439+0000","last_became_peered":"2024-04-15T00:01:18.983439+0000","last_unstale":"2024-04-15T01:11:11.299671+0000","last_undegraded":"2024-04-15T01:11:11.299671+0000","last_fullsized":"2024-04-15T01:11:11.299671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'798","last_scrub_stamp":"2024-04-15T01:11:11.299568+0000","last_deep_scrub":"29'798","last_deep_scrub_stamp":"2024-04-15T01:11:11.299568+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.299568+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:24:13.051537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":58877,"num_write":785,"num_write_kb":152322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'203","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.586373+0000","last_change":"2024-04-15T01:11:02.586373+0000","last_active":"2024-04-15T01:11:02.586373+0000","last_peered":"2024-04-15T01:11:02.586373+0000","last_clean":"2024-04-15T01:11:02.586373+0000","last_became_active":"2024-04-15T00:01:12.993761+0000","last_became_peered":"2024-04-15T00:01:12.993761+0000","last_unstale":"2024-04-15T01:11:02.586373+0000","last_undegraded":"2024-04-15T01:11:02.586373+0000","last_fullsized":"2024-04-15T01:11:02.586373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-04-15T01:11:02.586284+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-04-15T01:11:02.586284+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.586284+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:07:04.301268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1848","reported_seq":1914,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.383896+0000","last_change":"2024-04-15T01:11:02.383896+0000","last_active":"2024-04-15T01:11:02.383896+0000","last_peered":"2024-04-15T01:11:02.383896+0000","last_clean":"2024-04-15T01:11:02.383896+0000","last_became_active":"2024-04-15T00:01:11.990354+0000","last_became_peered":"2024-04-15T00:01:11.990354+0000","last_unstale":"2024-04-15T01:11:02.383896+0000","last_undegraded":"2024-04-15T01:11:02.383896+0000","last_fullsized":"2024-04-15T01:11:02.383896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1848","last_scrub_stamp":"2024-04-15T01:11:02.383807+0000","last_deep_scrub":"29'1848","last_deep_scrub_stamp":"2024-04-15T01:11:02.383807+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.383807+0000","objects_scrubbed":5,"log_size":1848,"log_dups_size":0,"ondisk_log_size":1848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:21:05.447791+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":5818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'701","reported_seq":820,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.586604+0000","last_change":"2024-04-15T01:11:10.586604+0000","last_active":"2024-04-15T01:11:10.586604+0000","last_peered":"2024-04-15T01:11:10.586604+0000","last_clean":"2024-04-15T01:11:10.586604+0000","last_became_active":"2024-04-15T00:01:18.987332+0000","last_became_peered":"2024-04-15T00:01:18.987332+0000","last_unstale":"2024-04-15T01:11:10.586604+0000","last_undegraded":"2024-04-15T01:11:10.586604+0000","last_fullsized":"2024-04-15T01:11:10.586604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'701","last_scrub_stamp":"2024-04-15T01:11:10.586507+0000","last_deep_scrub":"29'701","last_deep_scrub_stamp":"2024-04-15T01:11:10.586507+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.586507+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:40:06.563471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35520,"num_write":691,"num_write_kb":85742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.435934+0000","last_change":"2024-04-15T01:11:01.435934+0000","last_active":"2024-04-15T01:11:01.435934+0000","last_peered":"2024-04-15T01:11:01.435934+0000","last_clean":"2024-04-15T01:11:01.435934+0000","last_became_active":"2024-04-15T00:01:12.891342+0000","last_became_peered":"2024-04-15T00:01:12.891342+0000","last_unstale":"2024-04-15T01:11:01.435934+0000","last_undegraded":"2024-04-15T01:11:01.435934+0000","last_fullsized":"2024-04-15T01:11:01.435934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'192","last_scrub_stamp":"2024-04-15T01:11:01.435849+0000","last_deep_scrub":"29'192","last_deep_scrub_stamp":"2024-04-15T01:11:01.435849+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.435849+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:35:59.555166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'399","reported_seq":465,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.393815+0000","last_change":"2024-04-15T01:11:04.393815+0000","last_active":"2024-04-15T01:11:04.393815+0000","last_peered":"2024-04-15T01:11:04.393815+0000","last_clean":"2024-04-15T01:11:04.393815+0000","last_became_active":"2024-04-15T00:01:11.985651+0000","last_became_peered":"2024-04-15T00:01:11.985651+0000","last_unstale":"2024-04-15T01:11:04.393815+0000","last_undegraded":"2024-04-15T01:11:04.393815+0000","last_fullsized":"2024-04-15T01:11:04.393815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'399","last_scrub_stamp":"2024-04-15T01:11:04.393645+0000","last_deep_scrub":"29'399","last_deep_scrub_stamp":"2024-04-15T01:11:04.393645+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.393645+0000","objects_scrubbed":3,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:59:05.244670+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'858","reported_seq":993,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.894662+0000","last_change":"2024-04-15T01:11:11.894662+0000","last_active":"2024-04-15T01:11:11.894662+0000","last_peered":"2024-04-15T01:11:11.894662+0000","last_clean":"2024-04-15T01:11:11.894662+0000","last_became_active":"2024-04-15T00:01:18.976842+0000","last_became_peered":"2024-04-15T00:01:18.976842+0000","last_unstale":"2024-04-15T01:11:11.894662+0000","last_undegraded":"2024-04-15T01:11:11.894662+0000","last_fullsized":"2024-04-15T01:11:11.894662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'858","last_scrub_stamp":"2024-04-15T01:11:11.894555+0000","last_deep_scrub":"29'858","last_deep_scrub_stamp":"2024-04-15T01:11:11.894555+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.894555+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:32:26.165533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":40736,"num_write":845,"num_write_kb":155666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'215","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.522581+0000","last_change":"2024-04-15T01:11:00.522581+0000","last_active":"2024-04-15T01:11:00.522581+0000","last_peered":"2024-04-15T01:11:00.522581+0000","last_clean":"2024-04-15T01:11:00.522581+0000","last_became_active":"2024-04-15T00:01:12.979318+0000","last_became_peered":"2024-04-15T00:01:12.979318+0000","last_unstale":"2024-04-15T01:11:00.522581+0000","last_undegraded":"2024-04-15T01:11:00.522581+0000","last_fullsized":"2024-04-15T01:11:00.522581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-04-15T01:11:00.522492+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-04-15T01:11:00.522492+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.522492+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:15:04.430537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'70","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.252212+0000","last_change":"2024-04-15T01:11:00.252212+0000","last_active":"2024-04-15T01:11:00.252212+0000","last_peered":"2024-04-15T01:11:00.252212+0000","last_clean":"2024-04-15T01:11:00.252212+0000","last_became_active":"2024-04-15T00:01:11.985288+0000","last_became_peered":"2024-04-15T00:01:11.985288+0000","last_unstale":"2024-04-15T01:11:00.252212+0000","last_undegraded":"2024-04-15T01:11:00.252212+0000","last_fullsized":"2024-04-15T01:11:00.252212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'70","last_scrub_stamp":"2024-04-15T01:11:00.252121+0000","last_deep_scrub":"29'70","last_deep_scrub_stamp":"2024-04-15T01:11:00.252121+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.252121+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:22.619302+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'833","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.889108+0000","last_change":"2024-04-15T01:11:14.889108+0000","last_active":"2024-04-15T01:11:14.889108+0000","last_peered":"2024-04-15T01:11:14.889108+0000","last_clean":"2024-04-15T01:11:14.889108+0000","last_became_active":"2024-04-15T00:01:18.980433+0000","last_became_peered":"2024-04-15T00:01:18.980433+0000","last_unstale":"2024-04-15T01:11:14.889108+0000","last_undegraded":"2024-04-15T01:11:14.889108+0000","last_fullsized":"2024-04-15T01:11:14.889108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'833","last_scrub_stamp":"2024-04-15T01:11:14.888997+0000","last_deep_scrub":"29'833","last_deep_scrub_stamp":"2024-04-15T01:11:14.888997+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.888997+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:17:13.081184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":38336,"num_write":816,"num_write_kb":147104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'791","reported_seq":953,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.518603+0000","last_change":"2024-04-15T01:11:07.518603+0000","last_active":"2024-04-15T01:11:07.518603+0000","last_peered":"2024-04-15T01:11:07.518603+0000","last_clean":"2024-04-15T01:11:07.518603+0000","last_became_active":"2024-04-15T00:01:18.974817+0000","last_became_peered":"2024-04-15T00:01:18.974817+0000","last_unstale":"2024-04-15T01:11:07.518603+0000","last_undegraded":"2024-04-15T01:11:07.518603+0000","last_fullsized":"2024-04-15T01:11:07.518603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'791","last_scrub_stamp":"2024-04-15T01:11:07.518514+0000","last_deep_scrub":"29'791","last_deep_scrub_stamp":"2024-04-15T01:11:07.518514+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.518514+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:16:13.350440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":55193,"num_write":783,"num_write_kb":131702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'213","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.346016+0000","last_change":"2024-04-15T01:11:06.346016+0000","last_active":"2024-04-15T01:11:06.346016+0000","last_peered":"2024-04-15T01:11:06.346016+0000","last_clean":"2024-04-15T01:11:06.346016+0000","last_became_active":"2024-04-15T00:01:12.990523+0000","last_became_peered":"2024-04-15T00:01:12.990523+0000","last_unstale":"2024-04-15T01:11:06.346016+0000","last_undegraded":"2024-04-15T01:11:06.346016+0000","last_fullsized":"2024-04-15T01:11:06.346016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'213","last_scrub_stamp":"2024-04-15T01:11:06.345918+0000","last_deep_scrub":"29'213","last_deep_scrub_stamp":"2024-04-15T01:11:06.345918+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.345918+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:10:12.951329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1374","reported_seq":1440,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.438203+0000","last_change":"2024-04-15T01:11:05.438203+0000","last_active":"2024-04-15T01:11:05.438203+0000","last_peered":"2024-04-15T01:11:05.438203+0000","last_clean":"2024-04-15T01:11:05.438203+0000","last_became_active":"2024-04-15T00:01:11.986530+0000","last_became_peered":"2024-04-15T00:01:11.986530+0000","last_unstale":"2024-04-15T01:11:05.438203+0000","last_undegraded":"2024-04-15T01:11:05.438203+0000","last_fullsized":"2024-04-15T01:11:05.438203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1374","last_scrub_stamp":"2024-04-15T01:11:05.438090+0000","last_deep_scrub":"29'1374","last_deep_scrub_stamp":"2024-04-15T01:11:05.438090+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.438090+0000","objects_scrubbed":4,"log_size":1374,"log_dups_size":0,"ondisk_log_size":1374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:18:29.824337+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":12937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'758","reported_seq":914,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:11.206856+0000","last_change":"2024-04-15T01:11:11.206904+0000","last_active":"2024-04-15T01:11:11.206856+0000","last_peered":"2024-04-15T01:11:11.206856+0000","last_clean":"2024-04-15T01:11:11.206856+0000","last_became_active":"2024-04-15T00:01:18.977807+0000","last_became_peered":"2024-04-15T00:01:18.977807+0000","last_unstale":"2024-04-15T01:11:11.206856+0000","last_undegraded":"2024-04-15T01:11:11.206856+0000","last_fullsized":"2024-04-15T01:11:11.206856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'758","last_scrub_stamp":"2024-04-15T01:11:11.206735+0000","last_deep_scrub":"29'758","last_deep_scrub_stamp":"2024-04-15T01:11:11.206735+0000","last_clean_scrub_stamp":"2024-04-15T01:11:11.206735+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:21:36.589846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":41433,"num_write":747,"num_write_kb":139089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'219","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.843019+0000","last_change":"2024-04-15T01:11:07.843019+0000","last_active":"2024-04-15T01:11:07.843019+0000","last_peered":"2024-04-15T01:11:07.843019+0000","last_clean":"2024-04-15T01:11:07.843019+0000","last_became_active":"2024-04-15T00:01:12.991642+0000","last_became_peered":"2024-04-15T00:01:12.991642+0000","last_unstale":"2024-04-15T01:11:07.843019+0000","last_undegraded":"2024-04-15T01:11:07.843019+0000","last_fullsized":"2024-04-15T01:11:07.843019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'219","last_scrub_stamp":"2024-04-15T01:11:07.842923+0000","last_deep_scrub":"29'219","last_deep_scrub_stamp":"2024-04-15T01:11:07.842923+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.842923+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:09:31.828881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'583","reported_seq":649,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.857415+0000","last_change":"2024-04-15T01:11:02.857415+0000","last_active":"2024-04-15T01:11:02.857415+0000","last_peered":"2024-04-15T01:11:02.857415+0000","last_clean":"2024-04-15T01:11:02.857415+0000","last_became_active":"2024-04-15T00:01:11.985510+0000","last_became_peered":"2024-04-15T00:01:11.985510+0000","last_unstale":"2024-04-15T01:11:02.857415+0000","last_undegraded":"2024-04-15T01:11:02.857415+0000","last_fullsized":"2024-04-15T01:11:02.857415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'583","last_scrub_stamp":"2024-04-15T01:11:02.857321+0000","last_deep_scrub":"29'583","last_deep_scrub_stamp":"2024-04-15T01:11:02.857321+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.857321+0000","objects_scrubbed":3,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:41:57.469419+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1203","reported_seq":1268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.269856+0000","last_change":"2024-04-15T01:11:04.269856+0000","last_active":"2024-04-15T01:11:04.269856+0000","last_peered":"2024-04-15T01:11:04.269856+0000","last_clean":"2024-04-15T01:11:04.269856+0000","last_became_active":"2024-04-15T00:01:11.988537+0000","last_became_peered":"2024-04-15T00:01:11.988537+0000","last_unstale":"2024-04-15T01:11:04.269856+0000","last_undegraded":"2024-04-15T01:11:04.269856+0000","last_fullsized":"2024-04-15T01:11:04.269856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1203","last_scrub_stamp":"2024-04-15T01:11:04.269701+0000","last_deep_scrub":"29'1203","last_deep_scrub_stamp":"2024-04-15T01:11:04.269701+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.269701+0000","objects_scrubbed":6,"log_size":1203,"log_dups_size":0,"ondisk_log_size":1203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:26:59.208482+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":12880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'187","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.510115+0000","last_change":"2024-04-15T01:11:06.510115+0000","last_active":"2024-04-15T01:11:06.510115+0000","last_peered":"2024-04-15T01:11:06.510115+0000","last_clean":"2024-04-15T01:11:06.510115+0000","last_became_active":"2024-04-15T00:01:12.994831+0000","last_became_peered":"2024-04-15T00:01:12.994831+0000","last_unstale":"2024-04-15T01:11:06.510115+0000","last_undegraded":"2024-04-15T01:11:06.510115+0000","last_fullsized":"2024-04-15T01:11:06.510115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2024-04-15T01:11:06.510018+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2024-04-15T01:11:06.510018+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.510018+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:21:31.893130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'744","reported_seq":966,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.795828+0000","last_change":"2024-04-15T01:11:02.795828+0000","last_active":"2024-04-15T01:11:02.795828+0000","last_peered":"2024-04-15T01:11:02.795828+0000","last_clean":"2024-04-15T01:11:02.795828+0000","last_became_active":"2024-04-15T00:01:18.973636+0000","last_became_peered":"2024-04-15T00:01:18.973636+0000","last_unstale":"2024-04-15T01:11:02.795828+0000","last_undegraded":"2024-04-15T01:11:02.795828+0000","last_fullsized":"2024-04-15T01:11:02.795828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'744","last_scrub_stamp":"2024-04-15T01:11:02.795691+0000","last_deep_scrub":"29'744","last_deep_scrub_stamp":"2024-04-15T01:11:02.795691+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.795691+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:24:14.418872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":84659,"num_write":735,"num_write_kb":176000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'222","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.900741+0000","last_change":"2024-04-15T01:11:03.900741+0000","last_active":"2024-04-15T01:11:03.900741+0000","last_peered":"2024-04-15T01:11:03.900741+0000","last_clean":"2024-04-15T01:11:03.900741+0000","last_became_active":"2024-04-15T00:01:11.986230+0000","last_became_peered":"2024-04-15T00:01:11.986230+0000","last_unstale":"2024-04-15T01:11:03.900741+0000","last_undegraded":"2024-04-15T01:11:03.900741+0000","last_fullsized":"2024-04-15T01:11:03.900741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:03.900648+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:03.900648+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.900648+0000","objects_scrubbed":3,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:49:55.386284+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'202","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.590970+0000","last_change":"2024-04-15T01:11:00.590970+0000","last_active":"2024-04-15T01:11:00.590970+0000","last_peered":"2024-04-15T01:11:00.590970+0000","last_clean":"2024-04-15T01:11:00.590970+0000","last_became_active":"2024-04-15T00:01:12.993059+0000","last_became_peered":"2024-04-15T00:01:12.993059+0000","last_unstale":"2024-04-15T01:11:00.590970+0000","last_undegraded":"2024-04-15T01:11:00.590970+0000","last_fullsized":"2024-04-15T01:11:00.590970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-04-15T01:11:00.590876+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-04-15T01:11:00.590876+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.590876+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:14:38.983346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'759","reported_seq":930,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.852843+0000","last_change":"2024-04-15T01:11:10.852843+0000","last_active":"2024-04-15T01:11:10.852843+0000","last_peered":"2024-04-15T01:11:10.852843+0000","last_clean":"2024-04-15T01:11:10.852843+0000","last_became_active":"2024-04-15T00:01:18.974070+0000","last_became_peered":"2024-04-15T00:01:18.974070+0000","last_unstale":"2024-04-15T01:11:10.852843+0000","last_undegraded":"2024-04-15T01:11:10.852843+0000","last_fullsized":"2024-04-15T01:11:10.852843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'759","last_scrub_stamp":"2024-04-15T01:11:10.852722+0000","last_deep_scrub":"29'759","last_deep_scrub_stamp":"2024-04-15T01:11:10.852722+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.852722+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:28:16.512716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62677,"num_write":745,"num_write_kb":206027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'216","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.176210+0000","last_change":"2024-04-15T01:11:06.176253+0000","last_active":"2024-04-15T01:11:06.176210+0000","last_peered":"2024-04-15T01:11:06.176210+0000","last_clean":"2024-04-15T01:11:06.176210+0000","last_became_active":"2024-04-15T00:01:12.980250+0000","last_became_peered":"2024-04-15T00:01:12.980250+0000","last_unstale":"2024-04-15T01:11:06.176210+0000","last_undegraded":"2024-04-15T01:11:06.176210+0000","last_fullsized":"2024-04-15T01:11:06.176210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-04-15T01:11:06.176105+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-04-15T01:11:06.176105+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.176105+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:36:04.295422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'222","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.807985+0000","last_change":"2024-04-15T01:11:01.808012+0000","last_active":"2024-04-15T01:11:01.807985+0000","last_peered":"2024-04-15T01:11:01.807985+0000","last_clean":"2024-04-15T01:11:01.807985+0000","last_became_active":"2024-04-15T00:01:12.982984+0000","last_became_peered":"2024-04-15T00:01:12.982984+0000","last_unstale":"2024-04-15T01:11:01.807985+0000","last_undegraded":"2024-04-15T01:11:01.807985+0000","last_fullsized":"2024-04-15T01:11:01.807985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:01.807913+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:01.807913+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.807913+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:06:23.293973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'232","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.409115+0000","last_change":"2024-04-15T01:11:09.409137+0000","last_active":"2024-04-15T01:11:09.409115+0000","last_peered":"2024-04-15T01:11:09.409115+0000","last_clean":"2024-04-15T01:11:09.409115+0000","last_became_active":"2024-04-15T00:01:12.991744+0000","last_became_peered":"2024-04-15T00:01:12.991744+0000","last_unstale":"2024-04-15T01:11:09.409115+0000","last_undegraded":"2024-04-15T01:11:09.409115+0000","last_fullsized":"2024-04-15T01:11:09.409115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'232","last_scrub_stamp":"2024-04-15T01:11:09.409049+0000","last_deep_scrub":"29'232","last_deep_scrub_stamp":"2024-04-15T01:11:09.409049+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.409049+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:18:59.976742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'207","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.464177+0000","last_change":"2024-04-15T01:11:04.464217+0000","last_active":"2024-04-15T01:11:04.464177+0000","last_peered":"2024-04-15T01:11:04.464177+0000","last_clean":"2024-04-15T01:11:04.464177+0000","last_became_active":"2024-04-15T00:01:12.990308+0000","last_became_peered":"2024-04-15T00:01:12.990308+0000","last_unstale":"2024-04-15T01:11:04.464177+0000","last_undegraded":"2024-04-15T01:11:04.464177+0000","last_fullsized":"2024-04-15T01:11:04.464177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:04.464085+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:04.464085+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.464085+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:43:39.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:57.798034+0000","last_change":"2024-04-15T01:10:57.798075+0000","last_active":"2024-04-15T01:10:57.798034+0000","last_peered":"2024-04-15T01:10:57.798034+0000","last_clean":"2024-04-15T01:10:57.798034+0000","last_became_active":"2024-04-15T00:01:12.995249+0000","last_became_peered":"2024-04-15T00:01:12.995249+0000","last_unstale":"2024-04-15T01:10:57.798034+0000","last_undegraded":"2024-04-15T01:10:57.798034+0000","last_fullsized":"2024-04-15T01:10:57.798034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'183","last_scrub_stamp":"2024-04-15T01:10:57.797934+0000","last_deep_scrub":"29'183","last_deep_scrub_stamp":"2024-04-15T01:10:57.797934+0000","last_clean_scrub_stamp":"2024-04-15T01:10:57.797934+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:15:01.705979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'207","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:05.314647+0000","last_change":"2024-04-15T01:11:05.314669+0000","last_active":"2024-04-15T01:11:05.314647+0000","last_peered":"2024-04-15T01:11:05.314647+0000","last_clean":"2024-04-15T01:11:05.314647+0000","last_became_active":"2024-04-15T00:01:12.989905+0000","last_became_peered":"2024-04-15T00:01:12.989905+0000","last_unstale":"2024-04-15T01:11:05.314647+0000","last_undegraded":"2024-04-15T01:11:05.314647+0000","last_fullsized":"2024-04-15T01:11:05.314647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-04-15T01:11:05.314573+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-04-15T01:11:05.314573+0000","last_clean_scrub_stamp":"2024-04-15T01:11:05.314573+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:56:52.357476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'241","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.191975+0000","last_change":"2024-04-15T01:11:07.191995+0000","last_active":"2024-04-15T01:11:07.191975+0000","last_peered":"2024-04-15T01:11:07.191975+0000","last_clean":"2024-04-15T01:11:07.191975+0000","last_became_active":"2024-04-15T00:01:12.982023+0000","last_became_peered":"2024-04-15T00:01:12.982023+0000","last_unstale":"2024-04-15T01:11:07.191975+0000","last_undegraded":"2024-04-15T01:11:07.191975+0000","last_fullsized":"2024-04-15T01:11:07.191975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'241","last_scrub_stamp":"2024-04-15T01:11:07.191909+0000","last_deep_scrub":"29'241","last_deep_scrub_stamp":"2024-04-15T01:11:07.191909+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.191909+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:46:16.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'192","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.841283+0000","last_change":"2024-04-15T01:11:09.841310+0000","last_active":"2024-04-15T01:11:09.841283+0000","last_peered":"2024-04-15T01:11:09.841283+0000","last_clean":"2024-04-15T01:11:09.841283+0000","last_became_active":"2024-04-15T00:01:12.995875+0000","last_became_peered":"2024-04-15T00:01:12.995875+0000","last_unstale":"2024-04-15T01:11:09.841283+0000","last_undegraded":"2024-04-15T01:11:09.841283+0000","last_fullsized":"2024-04-15T01:11:09.841283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'192","last_scrub_stamp":"2024-04-15T01:11:09.841164+0000","last_deep_scrub":"29'192","last_deep_scrub_stamp":"2024-04-15T01:11:09.841164+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.841164+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:13:50.474567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.374153+0000","last_change":"2024-04-15T01:11:10.374177+0000","last_active":"2024-04-15T01:11:10.374153+0000","last_peered":"2024-04-15T01:11:10.374153+0000","last_clean":"2024-04-15T01:11:10.374153+0000","last_became_active":"2024-04-15T00:01:12.991750+0000","last_became_peered":"2024-04-15T00:01:12.991750+0000","last_unstale":"2024-04-15T01:11:10.374153+0000","last_undegraded":"2024-04-15T01:11:10.374153+0000","last_fullsized":"2024-04-15T01:11:10.374153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'213","last_scrub_stamp":"2024-04-15T01:11:10.374081+0000","last_deep_scrub":"29'213","last_deep_scrub_stamp":"2024-04-15T01:11:10.374081+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.374081+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:37:44.679327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'204","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:59.788850+0000","last_change":"2024-04-15T01:10:59.788850+0000","last_active":"2024-04-15T01:10:59.788850+0000","last_peered":"2024-04-15T01:10:59.788850+0000","last_clean":"2024-04-15T01:10:59.788850+0000","last_became_active":"2024-04-15T00:01:12.995245+0000","last_became_peered":"2024-04-15T00:01:12.995245+0000","last_unstale":"2024-04-15T01:10:59.788850+0000","last_undegraded":"2024-04-15T01:10:59.788850+0000","last_fullsized":"2024-04-15T01:10:59.788850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-04-15T01:10:59.788689+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-04-15T01:10:59.788689+0000","last_clean_scrub_stamp":"2024-04-15T01:10:59.788689+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:25:53.178335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'215","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:04.774736+0000","last_change":"2024-04-15T01:11:04.774736+0000","last_active":"2024-04-15T01:11:04.774736+0000","last_peered":"2024-04-15T01:11:04.774736+0000","last_clean":"2024-04-15T01:11:04.774736+0000","last_became_active":"2024-04-15T00:01:50.325211+0000","last_became_peered":"2024-04-15T00:01:50.325211+0000","last_unstale":"2024-04-15T01:11:04.774736+0000","last_undegraded":"2024-04-15T01:11:04.774736+0000","last_fullsized":"2024-04-15T01:11:04.774736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-04-15T01:11:04.774602+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-04-15T01:11:04.774602+0000","last_clean_scrub_stamp":"2024-04-15T01:11:04.774602+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:42:54.455335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"29'212","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.408775+0000","last_change":"2024-04-15T01:11:02.408798+0000","last_active":"2024-04-15T01:11:02.408775+0000","last_peered":"2024-04-15T01:11:02.408775+0000","last_clean":"2024-04-15T01:11:02.408775+0000","last_became_active":"2024-04-15T00:01:12.977718+0000","last_became_peered":"2024-04-15T00:01:12.977718+0000","last_unstale":"2024-04-15T01:11:02.408775+0000","last_undegraded":"2024-04-15T01:11:02.408775+0000","last_fullsized":"2024-04-15T01:11:02.408775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'212","last_scrub_stamp":"2024-04-15T01:11:02.408707+0000","last_deep_scrub":"29'212","last_deep_scrub_stamp":"2024-04-15T01:11:02.408707+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.408707+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:46:11.976567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'223","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:09.199717+0000","last_change":"2024-04-15T01:11:09.199739+0000","last_active":"2024-04-15T01:11:09.199717+0000","last_peered":"2024-04-15T01:11:09.199717+0000","last_clean":"2024-04-15T01:11:09.199717+0000","last_became_active":"2024-04-15T00:01:12.995556+0000","last_became_peered":"2024-04-15T00:01:12.995556+0000","last_unstale":"2024-04-15T01:11:09.199717+0000","last_undegraded":"2024-04-15T01:11:09.199717+0000","last_fullsized":"2024-04-15T01:11:09.199717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'223","last_scrub_stamp":"2024-04-15T01:11:09.199646+0000","last_deep_scrub":"29'223","last_deep_scrub_stamp":"2024-04-15T01:11:09.199646+0000","last_clean_scrub_stamp":"2024-04-15T01:11:09.199646+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:36:16.661173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'208","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.187235+0000","last_change":"2024-04-15T01:11:01.187235+0000","last_active":"2024-04-15T01:11:01.187235+0000","last_peered":"2024-04-15T01:11:01.187235+0000","last_clean":"2024-04-15T01:11:01.187235+0000","last_became_active":"2024-04-15T00:01:12.982031+0000","last_became_peered":"2024-04-15T00:01:12.982031+0000","last_unstale":"2024-04-15T01:11:01.187235+0000","last_undegraded":"2024-04-15T01:11:01.187235+0000","last_fullsized":"2024-04-15T01:11:01.187235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:11:01.187079+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:11:01.187079+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.187079+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:07:02.902062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.806507+0000","last_change":"2024-04-15T01:11:00.806507+0000","last_active":"2024-04-15T01:11:00.806507+0000","last_peered":"2024-04-15T01:11:00.806507+0000","last_clean":"2024-04-15T01:11:00.806507+0000","last_became_active":"2024-04-15T00:01:12.982229+0000","last_became_peered":"2024-04-15T00:01:12.982229+0000","last_unstale":"2024-04-15T01:11:00.806507+0000","last_undegraded":"2024-04-15T01:11:00.806507+0000","last_fullsized":"2024-04-15T01:11:00.806507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:00.806416+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:00.806416+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.806416+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:28:04.053691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'199","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.402357+0000","last_change":"2024-04-15T01:11:08.402357+0000","last_active":"2024-04-15T01:11:08.402357+0000","last_peered":"2024-04-15T01:11:08.402357+0000","last_clean":"2024-04-15T01:11:08.402357+0000","last_became_active":"2024-04-15T00:01:12.979236+0000","last_became_peered":"2024-04-15T00:01:12.979236+0000","last_unstale":"2024-04-15T01:11:08.402357+0000","last_undegraded":"2024-04-15T01:11:08.402357+0000","last_fullsized":"2024-04-15T01:11:08.402357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-04-15T01:11:08.402251+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-04-15T01:11:08.402251+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.402251+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:30:13.719854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'222","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:06.412519+0000","last_change":"2024-04-15T01:11:06.412519+0000","last_active":"2024-04-15T01:11:06.412519+0000","last_peered":"2024-04-15T01:11:06.412519+0000","last_clean":"2024-04-15T01:11:06.412519+0000","last_became_active":"2024-04-15T00:01:12.888951+0000","last_became_peered":"2024-04-15T00:01:12.888951+0000","last_unstale":"2024-04-15T01:11:06.412519+0000","last_undegraded":"2024-04-15T01:11:06.412519+0000","last_fullsized":"2024-04-15T01:11:06.412519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-04-15T01:11:06.412423+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-04-15T01:11:06.412423+0000","last_clean_scrub_stamp":"2024-04-15T01:11:06.412423+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:54:30.647531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'215","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.370503+0000","last_change":"2024-04-15T01:11:07.370503+0000","last_active":"2024-04-15T01:11:07.370503+0000","last_peered":"2024-04-15T01:11:07.370503+0000","last_clean":"2024-04-15T01:11:07.370503+0000","last_became_active":"2024-04-15T00:01:12.993723+0000","last_became_peered":"2024-04-15T00:01:12.993723+0000","last_unstale":"2024-04-15T01:11:07.370503+0000","last_undegraded":"2024-04-15T01:11:07.370503+0000","last_fullsized":"2024-04-15T01:11:07.370503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-04-15T01:11:07.370402+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-04-15T01:11:07.370402+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.370402+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:06:56.338844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:58.439689+0000","last_change":"2024-04-15T01:10:58.439689+0000","last_active":"2024-04-15T01:10:58.439689+0000","last_peered":"2024-04-15T01:10:58.439689+0000","last_clean":"2024-04-15T01:10:58.439689+0000","last_became_active":"2024-04-15T00:01:12.886015+0000","last_became_peered":"2024-04-15T00:01:12.886015+0000","last_unstale":"2024-04-15T01:10:58.439689+0000","last_undegraded":"2024-04-15T01:10:58.439689+0000","last_fullsized":"2024-04-15T01:10:58.439689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-04-15T01:10:58.439596+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-04-15T01:10:58.439596+0000","last_clean_scrub_stamp":"2024-04-15T01:10:58.439596+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:19:30.922504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:00.838663+0000","last_change":"2024-04-15T01:11:00.838663+0000","last_active":"2024-04-15T01:11:00.838663+0000","last_peered":"2024-04-15T01:11:00.838663+0000","last_clean":"2024-04-15T01:11:00.838663+0000","last_became_active":"2024-04-15T00:01:12.994501+0000","last_became_peered":"2024-04-15T00:01:12.994501+0000","last_unstale":"2024-04-15T01:11:00.838663+0000","last_undegraded":"2024-04-15T01:11:00.838663+0000","last_fullsized":"2024-04-15T01:11:00.838663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-04-15T01:11:00.838576+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-04-15T01:11:00.838576+0000","last_clean_scrub_stamp":"2024-04-15T01:11:00.838576+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:35:35.199118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'185","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:01.592438+0000","last_change":"2024-04-15T01:11:01.592438+0000","last_active":"2024-04-15T01:11:01.592438+0000","last_peered":"2024-04-15T01:11:01.592438+0000","last_clean":"2024-04-15T01:11:01.592438+0000","last_became_active":"2024-04-15T00:01:12.993756+0000","last_became_peered":"2024-04-15T00:01:12.993756+0000","last_unstale":"2024-04-15T01:11:01.592438+0000","last_undegraded":"2024-04-15T01:11:01.592438+0000","last_fullsized":"2024-04-15T01:11:01.592438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'185","last_scrub_stamp":"2024-04-15T01:11:01.592339+0000","last_deep_scrub":"29'185","last_deep_scrub_stamp":"2024-04-15T01:11:01.592339+0000","last_clean_scrub_stamp":"2024-04-15T01:11:01.592339+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:13:16.234314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'188","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.165447+0000","last_change":"2024-04-15T01:11:08.165447+0000","last_active":"2024-04-15T01:11:08.165447+0000","last_peered":"2024-04-15T01:11:08.165447+0000","last_clean":"2024-04-15T01:11:08.165447+0000","last_became_active":"2024-04-15T00:01:12.988867+0000","last_became_peered":"2024-04-15T00:01:12.988867+0000","last_unstale":"2024-04-15T01:11:08.165447+0000","last_undegraded":"2024-04-15T01:11:08.165447+0000","last_fullsized":"2024-04-15T01:11:08.165447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'188","last_scrub_stamp":"2024-04-15T01:11:08.165341+0000","last_deep_scrub":"29'188","last_deep_scrub_stamp":"2024-04-15T01:11:08.165341+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.165341+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:05:53.876276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:14.175075+0000","last_change":"2024-04-15T01:11:14.175075+0000","last_active":"2024-04-15T01:11:14.175075+0000","last_peered":"2024-04-15T01:11:14.175075+0000","last_clean":"2024-04-15T01:11:14.175075+0000","last_became_active":"2024-04-15T00:01:49.997645+0000","last_became_peered":"2024-04-15T00:01:49.997645+0000","last_unstale":"2024-04-15T01:11:14.175075+0000","last_undegraded":"2024-04-15T01:11:14.175075+0000","last_fullsized":"2024-04-15T01:11:14.175075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:14.174943+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:14.174943+0000","last_clean_scrub_stamp":"2024-04-15T01:11:14.174943+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:04.703376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'211","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:12.163556+0000","last_change":"2024-04-15T01:11:12.163556+0000","last_active":"2024-04-15T01:11:12.163556+0000","last_peered":"2024-04-15T01:11:12.163556+0000","last_clean":"2024-04-15T01:11:12.163556+0000","last_became_active":"2024-04-15T00:01:12.983037+0000","last_became_peered":"2024-04-15T00:01:12.983037+0000","last_unstale":"2024-04-15T01:11:12.163556+0000","last_undegraded":"2024-04-15T01:11:12.163556+0000","last_fullsized":"2024-04-15T01:11:12.163556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-04-15T01:11:12.163440+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-04-15T01:11:12.163440+0000","last_clean_scrub_stamp":"2024-04-15T01:11:12.163440+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:02.691873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'190","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:08.850600+0000","last_change":"2024-04-15T01:11:08.850600+0000","last_active":"2024-04-15T01:11:08.850600+0000","last_peered":"2024-04-15T01:11:08.850600+0000","last_clean":"2024-04-15T01:11:08.850600+0000","last_became_active":"2024-04-15T00:01:12.992448+0000","last_became_peered":"2024-04-15T00:01:12.992448+0000","last_unstale":"2024-04-15T01:11:08.850600+0000","last_undegraded":"2024-04-15T01:11:08.850600+0000","last_fullsized":"2024-04-15T01:11:08.850600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'190","last_scrub_stamp":"2024-04-15T01:11:08.850498+0000","last_deep_scrub":"29'190","last_deep_scrub_stamp":"2024-04-15T01:11:08.850498+0000","last_clean_scrub_stamp":"2024-04-15T01:11:08.850498+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:45:11.294572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'205","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:02.152059+0000","last_change":"2024-04-15T01:11:02.152059+0000","last_active":"2024-04-15T01:11:02.152059+0000","last_peered":"2024-04-15T01:11:02.152059+0000","last_clean":"2024-04-15T01:11:02.152059+0000","last_became_active":"2024-04-15T00:01:12.980807+0000","last_became_peered":"2024-04-15T00:01:12.980807+0000","last_unstale":"2024-04-15T01:11:02.152059+0000","last_undegraded":"2024-04-15T01:11:02.152059+0000","last_fullsized":"2024-04-15T01:11:02.152059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:02.151942+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:02.151942+0000","last_clean_scrub_stamp":"2024-04-15T01:11:02.151942+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:59:10.839870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'197","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:07.399114+0000","last_change":"2024-04-15T01:11:07.399114+0000","last_active":"2024-04-15T01:11:07.399114+0000","last_peered":"2024-04-15T01:11:07.399114+0000","last_clean":"2024-04-15T01:11:07.399114+0000","last_became_active":"2024-04-15T00:01:12.891100+0000","last_became_peered":"2024-04-15T00:01:12.891100+0000","last_unstale":"2024-04-15T01:11:07.399114+0000","last_undegraded":"2024-04-15T01:11:07.399114+0000","last_fullsized":"2024-04-15T01:11:07.399114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'197","last_scrub_stamp":"2024-04-15T01:11:07.399015+0000","last_deep_scrub":"29'197","last_deep_scrub_stamp":"2024-04-15T01:11:07.399015+0000","last_clean_scrub_stamp":"2024-04-15T01:11:07.399015+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T12:49:58.884651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:10.093151+0000","last_change":"2024-04-15T01:11:10.093151+0000","last_active":"2024-04-15T01:11:10.093151+0000","last_peered":"2024-04-15T01:11:10.093151+0000","last_clean":"2024-04-15T01:11:10.093151+0000","last_became_active":"2024-04-15T00:01:12.980564+0000","last_became_peered":"2024-04-15T00:01:12.980564+0000","last_unstale":"2024-04-15T01:11:10.093151+0000","last_undegraded":"2024-04-15T01:11:10.093151+0000","last_fullsized":"2024-04-15T01:11:10.093151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-04-15T01:11:10.093044+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-04-15T01:11:10.093044+0000","last_clean_scrub_stamp":"2024-04-15T01:11:10.093044+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:24:17.871007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'195","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.815537+0000","last_change":"2024-04-15T01:11:03.815559+0000","last_active":"2024-04-15T01:11:03.815537+0000","last_peered":"2024-04-15T01:11:03.815537+0000","last_clean":"2024-04-15T01:11:03.815537+0000","last_became_active":"2024-04-15T00:01:50.003465+0000","last_became_peered":"2024-04-15T00:01:50.003465+0000","last_unstale":"2024-04-15T01:11:03.815537+0000","last_undegraded":"2024-04-15T01:11:03.815537+0000","last_fullsized":"2024-04-15T01:11:03.815537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-04-15T01:11:03.815470+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-04-15T01:11:03.815470+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.815470+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:36:31.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'194","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:10:55.561877+0000","last_change":"2024-04-15T01:10:55.561899+0000","last_active":"2024-04-15T01:10:55.561877+0000","last_peered":"2024-04-15T01:10:55.561877+0000","last_clean":"2024-04-15T01:10:55.561877+0000","last_became_active":"2024-04-15T00:01:12.980942+0000","last_became_peered":"2024-04-15T00:01:12.980942+0000","last_unstale":"2024-04-15T01:10:55.561877+0000","last_undegraded":"2024-04-15T01:10:55.561877+0000","last_fullsized":"2024-04-15T01:10:55.561877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'194","last_scrub_stamp":"2024-04-15T01:10:55.561805+0000","last_deep_scrub":"29'194","last_deep_scrub_stamp":"2024-04-15T01:10:55.561805+0000","last_clean_scrub_stamp":"2024-04-15T01:10:55.561805+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:17.928986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'214","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:03.339574+0000","last_change":"2024-04-15T01:11:03.339622+0000","last_active":"2024-04-15T01:11:03.339574+0000","last_peered":"2024-04-15T01:11:03.339574+0000","last_clean":"2024-04-15T01:11:03.339574+0000","last_became_active":"2024-04-15T00:01:12.887815+0000","last_became_peered":"2024-04-15T00:01:12.887815+0000","last_unstale":"2024-04-15T01:11:03.339574+0000","last_undegraded":"2024-04-15T01:11:03.339574+0000","last_fullsized":"2024-04-15T01:11:03.339574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'214","last_scrub_stamp":"2024-04-15T01:11:03.339483+0000","last_deep_scrub":"29'214","last_deep_scrub_stamp":"2024-04-15T01:11:03.339483+0000","last_clean_scrub_stamp":"2024-04-15T01:11:03.339483+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:41:55.869491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'211","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T01:11:13.180084+0000","last_change":"2024-04-15T01:11:13.180106+0000","last_active":"2024-04-15T01:11:13.180084+0000","last_peered":"2024-04-15T01:11:13.180084+0000","last_clean":"2024-04-15T01:11:13.180084+0000","last_became_active":"2024-04-15T00:01:12.983634+0000","last_became_peered":"2024-04-15T00:01:12.983634+0000","last_unstale":"2024-04-15T01:11:13.180084+0000","last_undegraded":"2024-04-15T01:11:13.180084+0000","last_fullsized":"2024-04-15T01:11:13.180084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-04-15T01:11:13.180015+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-04-15T01:11:13.180015+0000","last_clean_scrub_stamp":"2024-04-15T01:11:13.180015+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:43:56.634531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2952,"num_read_kb":1592021,"num_write":24431,"num_write_kb":4334185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24810,"ondisk_log_size":24810,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13159,"ondisk_log_size":13159,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":181622008,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":2948,"num_read_kb":3616,"num_write":30105,"num_write_kb":193149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172548096,"data_stored":363244016,"data_compressed":48333034,"data_compressed_allocated":62914560,"data_compressed_original":253853696,"omap_allocated":0,"internal_metadata":0},"log_size":25567,"ondisk_log_size":25567,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65050,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542997,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137664,"kb_used_data":30200,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94234176,"statfs":{"total":96636764160,"available":96495796224,"internally_reserved":0,"allocated":30924800,"data_stored":72023688,"data_compressed":9942585,"data_compressed_allocated":12574720,"data_compressed_original":53891072,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542997,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140448,"kb_used_data":23256,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94231392,"statfs":{"total":96636764160,"available":96492945408,"internally_reserved":0,"allocated":23814144,"data_stored":50461162,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542997,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120296,"kb_used_data":21152,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94251544,"statfs":{"total":96636764160,"available":96513581056,"internally_reserved":0,"allocated":21659648,"data_stored":41781534,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542998,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125000,"kb_used_data":25856,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94246840,"statfs":{"total":96636764160,"available":96508764160,"internally_reserved":0,"allocated":26476544,"data_stored":50461030,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510294,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144168,"kb_used_data":18592,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94227672,"statfs":{"total":96636764160,"available":96489136128,"internally_reserved":0,"allocated":19038208,"data_stored":35235566,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510292,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114784,"kb_used_data":11480,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94257056,"statfs":{"total":96636764160,"available":96519225344,"internally_reserved":0,"allocated":11755520,"data_stored":22359130,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510294,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169692,"kb_used_data":21972,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94202148,"statfs":{"total":96636764160,"available":96462999552,"internally_reserved":0,"allocated":22499328,"data_stored":50460650,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575701,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103780,"kb_used_data":18524,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94268060,"statfs":{"total":96636764160,"available":96530493440,"internally_reserved":0,"allocated":18968576,"data_stored":42661752,"data_compressed":5896627,"data_compressed_allocated":7761920,"data_compressed_original":31666176,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32525,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18595840,"data_stored":41943914,"data_compressed":5864102,"data_compressed_allocated":7716864,"data_compressed_original":31092736,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22192128,"data_stored":50333180,"data_compressed":7131671,"data_compressed_allocated":9113600,"data_compressed_original":37281792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11448320,"data_stored":22231660,"data_compressed":2983352,"data_compressed_allocated":4071424,"data_compressed_original":14888960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18731008,"data_stored":35108096,"data_compressed":4177090,"data_compressed_allocated":5423104,"data_compressed_original":21827584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":50333560,"data_compressed":6203072,"data_compressed_allocated":8241152,"data_compressed_original":32428032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21352448,"data_stored":41654064,"data_compressed":5452902,"data_compressed_allocated":7344128,"data_compressed_original":27693056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":50333692,"data_compressed":6610785,"data_compressed_allocated":8474624,"data_compressed_original":35323904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30552064,"data_stored":71305850,"data_compressed":9910060,"data_compressed_allocated":12529664,"data_compressed_original":53317632,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T01:11:42.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-15T01:11:42.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.399+0000 7f685fc0f640 1 Processor -- start 2024-04-15T01:11:42.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.400+0000 7f685fc0f640 1 -- start start 2024-04-15T01:11:42.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.400+0000 7f685fc0f640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f68580c9d40 0x7f68580cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:42.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.400+0000 7f685fc0f640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68580c8d90 con 0x7f68580cd890 2024-04-15T01:11:42.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.400+0000 7f685fc0f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68580c9640 con 0x7f685815a940 2024-04-15T01:11:42.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.400+0000 7f685fc0f640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f68580c9920 con 0x7f68580c9d40 2024-04-15T01:11:42.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.401+0000 7f685d1aa640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f68580c9d40 0x7f68580cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:42.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.401+0000 7f685e1ac640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f685815a940 0x7f6858164c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:40708/0 (socket says 172.21.15.29:40708) 2024-04-15T01:11:42.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.401+0000 7f685e1ac640 1 -- 172.21.15.29:0/1524977496 learned_addr learned my addr 172.21.15.29:0/1524977496 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:42.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.404+0000 7f685c9a9640 1 -- 172.21.15.29:0/1524977496 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440094848 0 0) 0x7f68580c9640 con 0x7f685815a940 2024-04-15T01:11:42.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.404+0000 7f685c9a9640 1 -- 172.21.15.29:0/1524977496 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6844003520 con 0x7f685815a940 2024-04-15T01:11:42.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.404+0000 7f685d1aa640 1 -- 172.21.15.29:0/1524977496 >> v1:172.21.15.37:6789/0 conn(0x7f685815a940 legacy=0x7f6858164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.404+0000 7f685d1aa640 1 -- 172.21.15.29:0/1524977496 >> v1:172.21.15.29:6789/0 conn(0x7f68580cd890 legacy=0x7f685815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.404+0000 7f685d1aa640 1 -- 172.21.15.29:0/1524977496 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68580c87d0 con 0x7f68580c9d40 2024-04-15T01:11:42.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.409+0000 7f685d1aa640 1 --2- 172.21.15.29:0/1524977496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68580c9d40 0x7f68580cdc70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68480097a0 tx=0x7f684802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd94f62747212e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:42.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.413+0000 7f685c9a9640 1 -- 172.21.15.29:0/1524977496 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848035020 con 0x7f68580c9d40 2024-04-15T01:11:42.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.413+0000 7f685c9a9640 1 -- 172.21.15.29:0/1524977496 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6848031830 con 0x7f68580c9d40 2024-04-15T01:11:42.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.413+0000 7f685c9a9640 1 -- 172.21.15.29:0/1524977496 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848031c00 con 0x7f68580c9d40 2024-04-15T01:11:42.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.413+0000 7f685fc0f640 1 -- 172.21.15.29:0/1524977496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68580c9d40 msgr2=0x7f68580cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.413+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1524977496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68580c9d40 0x7f68580cdc70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68480097a0 tx=0x7f684802b8d0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.414+0000 7f685fc0f640 1 -- 172.21.15.29:0/1524977496 shutdown_connections 2024-04-15T01:11:42.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.414+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1524977496 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68580c9d40 0x7f68580cdc70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.414+0000 7f685fc0f640 1 -- 172.21.15.29:0/1524977496 >> 172.21.15.29:0/1524977496 conn(0x7f6858061c20 msgr2=0x7f6858062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:42.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.414+0000 7f685fc0f640 1 -- 172.21.15.29:0/1524977496 shutdown_connections 2024-04-15T01:11:42.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.414+0000 7f685fc0f640 1 -- 172.21.15.29:0/1524977496 wait complete. 2024-04-15T01:11:42.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.415+0000 7f685fc0f640 1 Processor -- start 2024-04-15T01:11:42.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.415+0000 7f685fc0f640 1 -- start start 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.415+0000 7f685fc0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68580c9d40 0x7f68581590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.415+0000 7f685fc0f640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f68580cd890 0x7f6858159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685fc0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 0x7f68581f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685fc0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6858154910 con 0x7f685815a940 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685fc0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f685815a420 con 0x7f68580c9d40 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685fc0f640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f685814eb70 con 0x7f68580cd890 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685e1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 0x7f68581f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685d1aa640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f68580cd890 0x7f6858159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685d9ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68580c9d40 0x7f68581590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685e1ac640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 0x7f68581f0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41528/0 (socket says 172.21.15.29:41528) 2024-04-15T01:11:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.416+0000 7f685e1ac640 1 -- 172.21.15.29:0/1346000840 learned_addr learned my addr 172.21.15.29:0/1346000840 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:42.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.420+0000 7f685e1ac640 1 -- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f68580cd890 msgr2=0x7f6858159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.420+0000 7f685e1ac640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f68580cd890 0x7f6858159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.420+0000 7f685e1ac640 1 -- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68580c9d40 msgr2=0x7f68581590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.420+0000 7f685e1ac640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68580c9d40 0x7f68581590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.420+0000 7f685e1ac640 1 -- 172.21.15.29:0/1346000840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685814edc0 con 0x7f685815a940 2024-04-15T01:11:42.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.422+0000 7f685e1ac640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 0x7f68581f0530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f685000cb40 tx=0x7f685000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.426+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850017070 con 0x7f685815a940 2024-04-15T01:11:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.426+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685000aca0 con 0x7f685815a940 2024-04-15T01:11:42.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.426+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685814f0a0 con 0x7f685815a940 2024-04-15T01:11:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.426+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850012620 con 0x7f685815a940 2024-04-15T01:11:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.426+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685814f660 con 0x7f685815a940 2024-04-15T01:11:42.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.427+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685804f540 con 0x7f685815a940 2024-04-15T01:11:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.446+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f685001a070 con 0x7f685815a940 2024-04-15T01:11:42.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.446+0000 7f684e7fc640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f683c06b990 0x7f683c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.446+0000 7f685d9ab640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f683c06b990 0x7f683c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:42.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.447+0000 7f685d9ab640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f683c06b990 0x7f683c06de50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f68540016e0 tx=0x7f6854009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:42.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.450+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f68500570d0 con 0x7f685815a940 2024-04-15T01:11:42.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.708+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6850021020 con 0x7f685815a940 2024-04-15T01:11:42.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.891+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f68580b39c0 con 0x7f685815a940 2024-04-15T01:11:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.991+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f6850059030 con 0x7f685815a940 2024-04-15T01:11:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.991+0000 7f684e7fc640 1 -- 172.21.15.29:0/1346000840 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f685005d0d0 con 0x7f685815a940 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.993+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f683c06b990 msgr2=0x7f683c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.993+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f683c06b990 0x7f683c06de50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f68540016e0 tx=0x7f6854009040 comp rx=0 tx=0).stop 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.993+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 msgr2=0x7f68581f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.993+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 0x7f68581f0530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f685000cb40 tx=0x7f685000a060 comp rx=0 tx=0).stop 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.993+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 shutdown_connections 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f683c06b990 0x7f683c06de50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685815a940 0x7f68581f0530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f68580cd890 0x7f6858159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 --2- 172.21.15.29:0/1346000840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68580c9d40 0x7f68581590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 >> 172.21.15.29:0/1346000840 conn(0x7f6858061c20 msgr2=0x7f68580c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 shutdown_connections 2024-04-15T01:11:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:42.994+0000 7f685fc0f640 1 -- 172.21.15.29:0/1346000840 wait complete. 2024-04-15T01:11:43.003 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-15T01:11:43.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T01:11:43.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.110+0000 7ff276836640 1 Processor -- start 2024-04-15T01:11:43.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.110+0000 7ff276836640 1 -- start start 2024-04-15T01:11:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.111+0000 7ff276836640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2700cc530 0x7ff2700cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.111+0000 7ff276836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff27015b110 0x7ff27006c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.111+0000 7ff276836640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27006c960 con 0x7ff2700cdff0 2024-04-15T01:11:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.111+0000 7ff276836640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff2700cf910 con 0x7ff2700cc530 2024-04-15T01:11:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.111+0000 7ff276836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff2700cf350 con 0x7ff27015b110 2024-04-15T01:11:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.111+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff27015b110 0x7ff27006c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.112+0000 7ff26ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2700cc530 0x7ff2700cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.112+0000 7ff26ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2700cc530 0x7ff2700cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:45550/0 (socket says 172.21.15.29:45550) 2024-04-15T01:11:43.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.112+0000 7ff26ffff640 1 -- 172.21.15.29:0/2452309462 learned_addr learned my addr 172.21.15.29:0/2452309462 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:43.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.114+0000 7ff26f7fe640 1 -- 172.21.15.29:0/2452309462 >> v2:172.21.15.37:3300/0 conn(0x7ff2700cc530 msgr2=0x7ff2700cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:43.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.114+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/2452309462 >> v2:172.21.15.37:3300/0 conn(0x7ff2700cc530 0x7ff2700cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.114+0000 7ff26f7fe640 1 -- 172.21.15.29:0/2452309462 >> v1:172.21.15.37:6789/0 conn(0x7ff2700cdff0 legacy=0x7ff27015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:43.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.114+0000 7ff26f7fe640 1 -- 172.21.15.29:0/2452309462 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2700cf630 con 0x7ff27015b110 2024-04-15T01:11:43.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.117+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/2452309462 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff27015b110 0x7ff27006c420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097a0 tx=0x7ff25802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ac034a0767fb1c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:43.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff26effd640 1 -- 172.21.15.29:0/2452309462 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580315a0 con 0x7ff27015b110 2024-04-15T01:11:43.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff26effd640 1 -- 172.21.15.29:0/2452309462 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff258037070 con 0x7ff27015b110 2024-04-15T01:11:43.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff26effd640 1 -- 172.21.15.29:0/2452309462 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258031980 con 0x7ff27015b110 2024-04-15T01:11:43.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 -- 172.21.15.29:0/2452309462 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff27015b110 msgr2=0x7ff27006c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 --2- 172.21.15.29:0/2452309462 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff27015b110 0x7ff27006c420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097a0 tx=0x7ff25802b840 comp rx=0 tx=0).stop 2024-04-15T01:11:43.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 -- 172.21.15.29:0/2452309462 shutdown_connections 2024-04-15T01:11:43.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 --2- 172.21.15.29:0/2452309462 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff27015b110 0x7ff27006c420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 --2- 172.21.15.29:0/2452309462 >> v2:172.21.15.37:3300/0 conn(0x7ff2700cc530 0x7ff2700cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 -- 172.21.15.29:0/2452309462 >> 172.21.15.29:0/2452309462 conn(0x7ff2700cfb20 msgr2=0x7ff2700cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:43.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 -- 172.21.15.29:0/2452309462 shutdown_connections 2024-04-15T01:11:43.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.121+0000 7ff276836640 1 -- 172.21.15.29:0/2452309462 wait complete. 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.122+0000 7ff276836640 1 Processor -- start 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 -- start start 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2700cc530 0x7ff270157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 0x7ff27014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27015b110 0x7ff2701f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff27015abf0 con 0x7ff2700cc530 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff27015a910 con 0x7ff27015b110 2024-04-15T01:11:43.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.123+0000 7ff276836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7ff2700cebc0 con 0x7ff2700cdff0 2024-04-15T01:11:43.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.124+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 0x7ff27014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.124+0000 7ff274dd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27015b110 0x7ff2701f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.124+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 0x7ff27014a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3301/0 says I am v2:172.21.15.29:44654/0 (socket says 172.21.15.29:44654) 2024-04-15T01:11:43.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.124+0000 7ff26f7fe640 1 -- 172.21.15.29:0/3913485650 learned_addr learned my addr 172.21.15.29:0/3913485650 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:43.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.128+0000 7ff26f7fe640 1 -- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27015b110 msgr2=0x7ff2701f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.128+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27015b110 0x7ff2701f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.128+0000 7ff26f7fe640 1 -- 172.21.15.29:0/3913485650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2700cc530 msgr2=0x7ff270157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.128+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2700cc530 0x7ff270157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.128+0000 7ff26f7fe640 1 -- 172.21.15.29:0/3913485650 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2700b3b50 con 0x7ff2700cdff0 2024-04-15T01:11:43.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.128+0000 7ff274dd3640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27015b110 0x7ff2701f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-15T01:11:43.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.130+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 0x7ff27014a1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff25802be50 tx=0x7ff2580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:43.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.134+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258032630 con 0x7ff2700cdff0 2024-04-15T01:11:43.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.134+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff258032810 con 0x7ff2700cdff0 2024-04-15T01:11:43.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.134+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258032c20 con 0x7ff2700cdff0 2024-04-15T01:11:43.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.134+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2700b3e30 con 0x7ff2700cdff0 2024-04-15T01:11:43.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.134+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2700b43f0 con 0x7ff2700cdff0 2024-04-15T01:11:43.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.135+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27006c750 con 0x7ff2700cdff0 2024-04-15T01:11:43.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.420+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff25804e470 con 0x7ff2700cdff0 2024-04-15T01:11:43.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.420+0000 7ff26cff9640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff25006b9c0 0x7ff25006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.420+0000 7ff26ffff640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff25006b9c0 0x7ff25006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.421+0000 7ff26ffff640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff25006b9c0 0x7ff25006de80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff2600094a0 tx=0x7ff2600093f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:43.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.428+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff25802f030 con 0x7ff2700cdff0 2024-04-15T01:11:43.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.439+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff27006c750 con 0x7ff2700cdff0 2024-04-15T01:11:43.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.665+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff27004f540 con 0x7ff2700cdff0 2024-04-15T01:11:43.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.679+0000 7ff26cff9640 1 -- 172.21.15.29:0/3913485650 <== mon.2 v2:172.21.15.37:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6912 (secure 0 0 0) 0x7ff258040070 con 0x7ff2700cdff0 2024-04-15T01:11:43.678 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:11:43.678 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:50.947697+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4275,"mds_1":4272,"mds_2":4266,"mds_3":4258,"mds_4":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4266":{"gid":4266,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4272":{"gid":4272,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4246,4272,4258,4266,4275]},"id":1}]} 2024-04-15T01:11:43.678 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-15T01:11:43.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.681+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff25006b9c0 msgr2=0x7ff25006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.681+0000 7ff276836640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff25006b9c0 0x7ff25006de80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff2600094a0 tx=0x7ff2600093f0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.681+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 msgr2=0x7ff27014a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.681+0000 7ff276836640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 0x7ff27014a1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff25802be50 tx=0x7ff2580046c0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 shutdown_connections 2024-04-15T01:11:43.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7ff25006b9c0 0x7ff25006de80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27015b110 0x7ff2701f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7ff2700cdff0 0x7ff27014a1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 --2- 172.21.15.29:0/3913485650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2700cc530 0x7ff270157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 >> 172.21.15.29:0/3913485650 conn(0x7ff2700cfb20 msgr2=0x7ff27014edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:43.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 shutdown_connections 2024-04-15T01:11:43.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.682+0000 7ff276836640 1 -- 172.21.15.29:0/3913485650 wait complete. 2024-04-15T01:11:43.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T01:11:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.795+0000 7f3043836640 1 Processor -- start 2024-04-15T01:11:43.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.795+0000 7f3043836640 1 -- start start 2024-04-15T01:11:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.796+0000 7f3043836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.796+0000 7f3043836640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303c157fb0 con 0x7f303c0709d0 2024-04-15T01:11:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.796+0000 7f3043836640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303c158230 con 0x7f303c14ea00 2024-04-15T01:11:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.796+0000 7f3043836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f303c0c3970 con 0x7f303c0c3550 2024-04-15T01:11:43.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.797+0000 7f3041dd3640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f303c0709d0 0x7f303c1596e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50968/0 (socket says 172.21.15.29:50968) 2024-04-15T01:11:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.797+0000 7f3041dd3640 1 -- 172.21.15.29:0/2766502177 learned_addr learned my addr 172.21.15.29:0/2766502177 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:43.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.797+0000 7f3040dd1640 1 --2- 172.21.15.29:0/2766502177 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.799+0000 7f3033fff640 1 -- 172.21.15.29:0/2766502177 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063668485 0 0) 0x7f3038001490 con 0x7f303c0709d0 2024-04-15T01:11:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.799+0000 7f3033fff640 1 -- 172.21.15.29:0/2766502177 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3028003520 con 0x7f303c0709d0 2024-04-15T01:11:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.800+0000 7f3040dd1640 1 -- 172.21.15.29:0/2766502177 >> v1:172.21.15.37:6789/0 conn(0x7f303c14ea00 legacy=0x7f303c0cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.800+0000 7f3040dd1640 1 -- 172.21.15.29:0/2766502177 >> v1:172.21.15.29:6789/0 conn(0x7f303c0709d0 legacy=0x7f303c1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.800+0000 7f3033fff640 1 -- 172.21.15.29:0/2766502177 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248956931 0 0) 0x7f303c158230 con 0x7f303c14ea00 2024-04-15T01:11:43.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.800+0000 7f3040dd1640 1 -- 172.21.15.29:0/2766502177 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c158510 con 0x7f303c0c3550 2024-04-15T01:11:43.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.802+0000 7f3040dd1640 1 --2- 172.21.15.29:0/2766502177 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c070490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f302c0097d0 tx=0x7f302c02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc35d9f47647016 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:43.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.805+0000 7f3033fff640 1 -- 172.21.15.29:0/2766502177 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c034070 con 0x7f303c0c3550 2024-04-15T01:11:43.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3033fff640 1 -- 172.21.15.29:0/2766502177 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f302c030880 con 0x7f303c0c3550 2024-04-15T01:11:43.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3033fff640 1 -- 172.21.15.29:0/2766502177 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c030c70 con 0x7f303c0c3550 2024-04-15T01:11:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 -- 172.21.15.29:0/2766502177 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 msgr2=0x7f303c070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 --2- 172.21.15.29:0/2766502177 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c070490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f302c0097d0 tx=0x7f302c02b9c0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 -- 172.21.15.29:0/2766502177 shutdown_connections 2024-04-15T01:11:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 --2- 172.21.15.29:0/2766502177 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c070490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 -- 172.21.15.29:0/2766502177 >> 172.21.15.29:0/2766502177 conn(0x7f303c061e00 msgr2=0x7f303c062210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:43.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 -- 172.21.15.29:0/2766502177 shutdown_connections 2024-04-15T01:11:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.806+0000 7f3043836640 1 -- 172.21.15.29:0/2766502177 wait complete. 2024-04-15T01:11:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 Processor -- start 2024-04-15T01:11:43.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 -- start start 2024-04-15T01:11:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 0x7f303c1e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c1ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f303c14ea00 0x7f303c1ee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f303c158db0 con 0x7f303c0709d0 2024-04-15T01:11:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f303c158ad0 con 0x7f303c14ea00 2024-04-15T01:11:43.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.808+0000 7f3043836640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f303c14ede0 con 0x7f303c0c3550 2024-04-15T01:11:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.809+0000 7f30415d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 0x7f303c1e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.809+0000 7f30415d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 0x7f303c1e37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41550/0 (socket says 172.21.15.29:41550) 2024-04-15T01:11:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.809+0000 7f30415d2640 1 -- 172.21.15.29:0/1012036054 learned_addr learned my addr 172.21.15.29:0/1012036054 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.809+0000 7f3040dd1640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c1ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.809+0000 7f3041dd3640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f303c14ea00 0x7f303c1ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.813+0000 7f30415d2640 1 -- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 msgr2=0x7f303c1ee320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.813+0000 7f30415d2640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c1ee320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.813+0000 7f30415d2640 1 -- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f303c14ea00 msgr2=0x7f303c1ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:43.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.813+0000 7f30415d2640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f303c14ea00 0x7f303c1ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:43.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.813+0000 7f30415d2640 1 -- 172.21.15.29:0/1012036054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c0c78e0 con 0x7f303c0709d0 2024-04-15T01:11:43.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.815+0000 7f30415d2640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 0x7f303c1e37a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f303400c440 tx=0x7f303400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.819+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034017070 con 0x7f303c0709d0 2024-04-15T01:11:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.819+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3034005480 con 0x7f303c0709d0 2024-04-15T01:11:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.819+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034003850 con 0x7f303c0709d0 2024-04-15T01:11:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.819+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303c0c7e30 con 0x7f303c0709d0 2024-04-15T01:11:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.819+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303c0c7b50 con 0x7f303c0709d0 2024-04-15T01:11:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.820+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303c04f540 con 0x7f303c0709d0 2024-04-15T01:11:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.839+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f303401a070 con 0x7f303c0709d0 2024-04-15T01:11:43.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.839+0000 7f3031ffb640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f302006b9e0 0x7f302006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.840+0000 7f3040dd1640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f302006b9e0 0x7f302006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:43.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.840+0000 7f3040dd1640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f302006b9e0 0x7f302006dea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f302c036000 tx=0x7f302c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:43.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:43.843+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3034056490 con 0x7f303c0709d0 2024-04-15T01:11:44.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.105+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3034021080 con 0x7f303c0709d0 2024-04-15T01:11:44.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.331+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f303c0c3d30 con 0x7f303c0709d0 2024-04-15T01:11:44.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.345+0000 7f3031ffb640 1 -- 172.21.15.29:0/1012036054 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6912 (secure 0 0 0) 0x7f30340583f0 con 0x7f303c0709d0 2024-04-15T01:11:44.344 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:11:44.345 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3732084094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3732084094},{"type":"v1","addr":"172.21.15.37:6837","nonce":3732084094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T00:01:12.657999+0000","modified":"2024-04-15T00:01:50.947697+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4275,"mds_1":4272,"mds_2":4266,"mds_3":4258,"mds_4":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":13,"addr":"172.21.15.29:6836/1439171275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1439171275},{"type":"v1","addr":"172.21.15.29:6836","nonce":1439171275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"d","rank":3,"incarnation":15,"state":"up:active","state_seq":12,"addr":"172.21.15.37:6839/2258878813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2258878813},{"type":"v1","addr":"172.21.15.37:6839","nonce":2258878813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4266":{"gid":4266,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.29:6833/3178649227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3178649227},{"type":"v1","addr":"172.21.15.29:6833","nonce":3178649227}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4272":{"gid":4272,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.29:6837/2229372959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6835","nonce":2229372959},{"type":"v1","addr":"172.21.15.29:6837","nonce":2229372959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/4290142859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4290142859},{"type":"v1","addr":"172.21.15.37:6835","nonce":4290142859}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4246,4272,4258,4266,4275]},"id":1}]} 2024-04-15T01:11:44.345 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 18 2024-04-15T01:11:44.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f302006b9e0 msgr2=0x7f302006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f302006b9e0 0x7f302006dea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f302c036000 tx=0x7f302c008030 comp rx=0 tx=0).stop 2024-04-15T01:11:44.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 msgr2=0x7f303c1e37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 0x7f303c1e37a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f303400c440 tx=0x7f303400c900 comp rx=0 tx=0).stop 2024-04-15T01:11:44.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 shutdown_connections 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f302006b9e0 0x7f302006dea0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f303c14ea00 0x7f303c1ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f303c0c3550 0x7f303c1ee320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 --2- 172.21.15.29:0/1012036054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f303c0709d0 0x7f303c1e37a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.347+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 >> 172.21.15.29:0/1012036054 conn(0x7f303c061e00 msgr2=0x7f303c1595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.348+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 shutdown_connections 2024-04-15T01:11:44.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.348+0000 7f3043836640 1 -- 172.21.15.29:0/1012036054 wait complete. 2024-04-15T01:11:44.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T01:11:44.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.461+0000 7f788cea6640 1 Processor -- start 2024-04-15T01:11:44.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.461+0000 7f788cea6640 1 -- start start 2024-04-15T01:11:44.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.462+0000 7f788cea6640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f78880c6ad0 0x7f78880c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:44.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.462+0000 7f788cea6640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788806e520 con 0x7f7888154590 2024-04-15T01:11:44.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.462+0000 7f788cea6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788815e390 con 0x7f788806e7b0 2024-04-15T01:11:44.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.462+0000 7f788cea6640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f78880c2910 con 0x7f78880c6ad0 2024-04-15T01:11:44.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.462+0000 7f787ffff640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f78880c6ad0 0x7f78880c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:44.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.463+0000 7f7886d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f788806e7b0 0x7f788806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:40738/0 (socket says 172.21.15.29:40738) 2024-04-15T01:11:44.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.463+0000 7f7886d9d640 1 -- 172.21.15.29:0/3901157590 learned_addr learned my addr 172.21.15.29:0/3901157590 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:44.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.465+0000 7f7885d9b640 1 -- 172.21.15.29:0/3901157590 <== mon.1 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707680183 0 0) 0x7f788815e390 con 0x7f788806e7b0 2024-04-15T01:11:44.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.465+0000 7f7885d9b640 1 -- 172.21.15.29:0/3901157590 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7874003520 con 0x7f788806e7b0 2024-04-15T01:11:44.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.465+0000 7f787ffff640 1 -- 172.21.15.29:0/3901157590 >> v1:172.21.15.37:6789/0 conn(0x7f788806e7b0 legacy=0x7f788806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.466+0000 7f787ffff640 1 -- 172.21.15.29:0/3901157590 >> v1:172.21.15.29:6789/0 conn(0x7f7888154590 legacy=0x7f788806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.466+0000 7f787ffff640 1 -- 172.21.15.29:0/3901157590 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788815e670 con 0x7f78880c6ad0 2024-04-15T01:11:44.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.470+0000 7f787ffff640 1 --2- 172.21.15.29:0/3901157590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880c6ad0 0x7f78880c23d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f78700097a0 tx=0x7f787002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918a27c3c44b6d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.474+0000 7f7885d9b640 1 -- 172.21.15.29:0/3901157590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870034070 con 0x7f78880c6ad0 2024-04-15T01:11:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.474+0000 7f7885d9b640 1 -- 172.21.15.29:0/3901157590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7870030610 con 0x7f78880c6ad0 2024-04-15T01:11:44.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.474+0000 7f7885d9b640 1 -- 172.21.15.29:0/3901157590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870030a00 con 0x7f78880c6ad0 2024-04-15T01:11:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 -- 172.21.15.29:0/3901157590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880c6ad0 msgr2=0x7f78880c23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 --2- 172.21.15.29:0/3901157590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880c6ad0 0x7f78880c23d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f78700097a0 tx=0x7f787002b960 comp rx=0 tx=0).stop 2024-04-15T01:11:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 -- 172.21.15.29:0/3901157590 shutdown_connections 2024-04-15T01:11:44.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 --2- 172.21.15.29:0/3901157590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880c6ad0 0x7f78880c23d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 -- 172.21.15.29:0/3901157590 >> 172.21.15.29:0/3901157590 conn(0x7f78880c87a0 msgr2=0x7f78880c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 -- 172.21.15.29:0/3901157590 shutdown_connections 2024-04-15T01:11:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.475+0000 7f788cea6640 1 -- 172.21.15.29:0/3901157590 wait complete. 2024-04-15T01:11:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.476+0000 7f788cea6640 1 Processor -- start 2024-04-15T01:11:44.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.476+0000 7f788cea6640 1 -- start start 2024-04-15T01:11:44.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788cea6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 0x7f78881e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:44.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788cea6640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78880c6ad0 0x7f788814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:44.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788cea6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7888154590 0x7f78881f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:44.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788cea6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f78880c18d0 con 0x7f788806e7b0 2024-04-15T01:11:44.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788cea6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f78880c1eb0 con 0x7f7888154590 2024-04-15T01:11:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788cea6640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f78880c9620 con 0x7f78880c6ad0 2024-04-15T01:11:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.477+0000 7f788659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 0x7f78881e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.478+0000 7f7886d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7888154590 0x7f78881f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.478+0000 7f787ffff640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78880c6ad0 0x7f788814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.478+0000 7f788659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 0x7f78881e5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41566/0 (socket says 172.21.15.29:41566) 2024-04-15T01:11:44.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.478+0000 7f788659c640 1 -- 172.21.15.29:0/840674363 learned_addr learned my addr 172.21.15.29:0/840674363 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.481+0000 7f788659c640 1 -- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78880c6ad0 msgr2=0x7f788814b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.481+0000 7f788659c640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78880c6ad0 0x7f788814b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.481+0000 7f788659c640 1 -- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7888154590 msgr2=0x7f78881f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.481+0000 7f788659c640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7888154590 0x7f78881f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:44.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.481+0000 7f788659c640 1 -- 172.21.15.29:0/840674363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78881e72c0 con 0x7f788806e7b0 2024-04-15T01:11:44.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.484+0000 7f788659c640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 0x7f78881e5aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f787800c3c0 tx=0x7f787800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:44.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.487+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78780052d0 con 0x7f788806e7b0 2024-04-15T01:11:44.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.487+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7878005490 con 0x7f788806e7b0 2024-04-15T01:11:44.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.487+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78881f0e20 con 0x7f788806e7b0 2024-04-15T01:11:44.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.487+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878007280 con 0x7f788806e7b0 2024-04-15T01:11:44.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.488+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78881f13e0 con 0x7f788806e7b0 2024-04-15T01:11:44.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.488+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78881f15e0 con 0x7f788806e7b0 2024-04-15T01:11:44.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.755+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7878007420 con 0x7f788806e7b0 2024-04-15T01:11:44.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.756+0000 7f787effd640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f786806b9e0 0x7f786806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:44.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.756+0000 7f787ffff640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f786806b9e0 0x7f786806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:44.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.756+0000 7f787ffff640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f786806b9e0 0x7f786806dea0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7870036000 tx=0x7f787003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.770+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f78780567f0 con 0x7f788806e7b0 2024-04-15T01:11:44.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.770+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7878058750 con 0x7f788806e7b0 2024-04-15T01:11:44.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:44.961+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f788804f540 con 0x7f788806e7b0 2024-04-15T01:11:45.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.021+0000 7f787effd640 1 -- 172.21.15.29:0/840674363 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18830 (secure 0 0 0) 0x7f787805c7f0 con 0x7f788806e7b0 2024-04-15T01:11:45.020 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-15T01:11:45.020 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":29,"fsid":"7c8df2c3-f5a8-486a-b508-c448178a0a97","created":"2024-04-15T00:00:41.199367+0000","modified":"2024-04-15T00:01:49.213358+0000","last_up_change":"2024-04-15T00:00:55.162842+0000","last_in_change":"2024-04-15T00:00:46.535961+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T00:00:55.371624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-15T00:01:09.779176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-15T00:01:11.503018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-15T00:01:16.720777+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0bce49bb-205a-47bd-9904-979946c75e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6801","nonce":1292838260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6803","nonce":1292838260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6807","nonce":1292838260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1292838260},{"type":"v1","addr":"172.21.15.29:6805","nonce":1292838260}]},"public_addr":"172.21.15.29:6801/1292838260","cluster_addr":"172.21.15.29:6803/1292838260","heartbeat_back_addr":"172.21.15.29:6807/1292838260","heartbeat_front_addr":"172.21.15.29:6805/1292838260","state":["exists","up"]},{"osd":1,"uuid":"c80833ab-3af5-4b2d-90a3-20dc0982406b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6809","nonce":367785710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6811","nonce":367785710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6815","nonce":367785710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":367785710},{"type":"v1","addr":"172.21.15.29:6813","nonce":367785710}]},"public_addr":"172.21.15.29:6809/367785710","cluster_addr":"172.21.15.29:6811/367785710","heartbeat_back_addr":"172.21.15.29:6815/367785710","heartbeat_front_addr":"172.21.15.29:6813/367785710","state":["exists","up"]},{"osd":2,"uuid":"f9d56751-42ec-4f2b-ab02-2b9b29c4255d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6825","nonce":2157921057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6827","nonce":2157921057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6831","nonce":2157921057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2157921057},{"type":"v1","addr":"172.21.15.29:6829","nonce":2157921057}]},"public_addr":"172.21.15.29:6825/2157921057","cluster_addr":"172.21.15.29:6827/2157921057","heartbeat_back_addr":"172.21.15.29:6831/2157921057","heartbeat_front_addr":"172.21.15.29:6829/2157921057","state":["exists","up"]},{"osd":3,"uuid":"fb8b7734-3e40-4883-b273-c61104c9d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6817","nonce":3034992974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6819","nonce":3034992974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6823","nonce":3034992974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3034992974},{"type":"v1","addr":"172.21.15.29:6821","nonce":3034992974}]},"public_addr":"172.21.15.29:6817/3034992974","cluster_addr":"172.21.15.29:6819/3034992974","heartbeat_back_addr":"172.21.15.29:6823/3034992974","heartbeat_front_addr":"172.21.15.29:6821/3034992974","state":["exists","up"]},{"osd":4,"uuid":"8133c6c6-e7f3-4ef6-b653-5b76ea43eba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6803","nonce":3398267610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6805","nonce":3398267610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6809","nonce":3398267610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3398267610},{"type":"v1","addr":"172.21.15.37:6807","nonce":3398267610}]},"public_addr":"172.21.15.37:6803/3398267610","cluster_addr":"172.21.15.37:6805/3398267610","heartbeat_back_addr":"172.21.15.37:6809/3398267610","heartbeat_front_addr":"172.21.15.37:6807/3398267610","state":["exists","up"]},{"osd":5,"uuid":"875f80a4-453a-4de0-aeef-59f0f1695696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6827","nonce":3779753926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6829","nonce":3779753926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6833","nonce":3779753926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3779753926},{"type":"v1","addr":"172.21.15.37:6831","nonce":3779753926}]},"public_addr":"172.21.15.37:6827/3779753926","cluster_addr":"172.21.15.37:6829/3779753926","heartbeat_back_addr":"172.21.15.37:6833/3779753926","heartbeat_front_addr":"172.21.15.37:6831/3779753926","state":["exists","up"]},{"osd":6,"uuid":"f2c8c3cb-9774-4266-a63d-5c8d982576a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6813","nonce":4118171972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6818","nonce":4118171972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6825","nonce":4118171972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":4118171972},{"type":"v1","addr":"172.21.15.37:6823","nonce":4118171972}]},"public_addr":"172.21.15.37:6813/4118171972","cluster_addr":"172.21.15.37:6818/4118171972","heartbeat_back_addr":"172.21.15.37:6825/4118171972","heartbeat_front_addr":"172.21.15.37:6823/4118171972","state":["exists","up"]},{"osd":7,"uuid":"1eddb587-14c7-42d7-b030-4bcdce6650ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6812","nonce":68685228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6815","nonce":68685228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6822","nonce":68685228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":68685228},{"type":"v1","addr":"172.21.15.37:6819","nonce":68685228}]},"public_addr":"172.21.15.37:6812/68685228","cluster_addr":"172.21.15.37:6815/68685228","heartbeat_back_addr":"172.21.15.37:6822/68685228","heartbeat_front_addr":"172.21.15.37:6819/68685228","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.643073+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.700626+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.823465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.765699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.610100+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.773435+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.732828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T00:00:51.701604+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T01:11:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f786806b9e0 msgr2=0x7f786806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f786806b9e0 0x7f786806dea0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7870036000 tx=0x7f787003b040 comp rx=0 tx=0).stop 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 msgr2=0x7f78881e5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 0x7f78881e5aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f787800c3c0 tx=0x7f787800c880 comp rx=0 tx=0).stop 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 shutdown_connections 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f786806b9e0 0x7f786806dea0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7888154590 0x7f78881f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f78880c6ad0 0x7f788814b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 --2- 172.21.15.29:0/840674363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f788806e7b0 0x7f78881e5aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 >> 172.21.15.29:0/840674363 conn(0x7f78880c87a0 msgr2=0x7f788815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 shutdown_connections 2024-04-15T01:11:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.023+0000 7f788cea6640 1 -- 172.21.15.29:0/840674363 wait complete. 2024-04-15T01:11:45.034 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-15T01:11:45.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.141+0000 7fb2dfede640 1 Processor -- start 2024-04-15T01:11:45.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.141+0000 7fb2dfede640 1 -- start start 2024-04-15T01:11:45.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.142+0000 7fb2dfede640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2d8154440 0x7fb2d8070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.142+0000 7fb2dfede640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d8154820 0x7fb2d806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.142+0000 7fb2dfede640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d815a350 con 0x7fb2d80c7680 2024-04-15T01:11:45.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.142+0000 7fb2dfede640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d815e350 con 0x7fb2d8154440 2024-04-15T01:11:45.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.142+0000 7fb2dfede640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d815e860 con 0x7fb2d8154820 2024-04-15T01:11:45.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.142+0000 7fb2ddc7a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2d8154440 0x7fb2d8070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.143+0000 7fb2dd479640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d8154820 0x7fb2d806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.143+0000 7fb2ddc7a640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb2d8154440 0x7fb2d8070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41570/0 (socket says 172.21.15.29:41570) 2024-04-15T01:11:45.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.143+0000 7fb2ddc7a640 1 -- 172.21.15.29:0/3882028636 learned_addr learned my addr 172.21.15.29:0/3882028636 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:45.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.145+0000 7fb2dd479640 1 -- 172.21.15.29:0/3882028636 >> v2:172.21.15.29:3300/0 conn(0x7fb2d8154440 msgr2=0x7fb2d8070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:45.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.145+0000 7fb2dd479640 1 --2- 172.21.15.29:0/3882028636 >> v2:172.21.15.29:3300/0 conn(0x7fb2d8154440 0x7fb2d8070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.145+0000 7fb2dd479640 1 -- 172.21.15.29:0/3882028636 >> v1:172.21.15.29:6789/0 conn(0x7fb2d80c7680 legacy=0x7fb2d815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.145+0000 7fb2dd479640 1 -- 172.21.15.29:0/3882028636 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d815e580 con 0x7fb2d8154820 2024-04-15T01:11:45.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.147+0000 7fb2dd479640 1 --2- 172.21.15.29:0/3882028636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d8154820 0x7fb2d806b200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80097a0 tx=0x7fb2c802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d15fe01e9a29a server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:45.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.151+0000 7fb2dcc78640 1 -- 172.21.15.29:0/3882028636 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80315a0 con 0x7fb2d8154820 2024-04-15T01:11:45.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.151+0000 7fb2dcc78640 1 -- 172.21.15.29:0/3882028636 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb2c8037070 con 0x7fb2d8154820 2024-04-15T01:11:45.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.151+0000 7fb2dcc78640 1 -- 172.21.15.29:0/3882028636 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8031980 con 0x7fb2d8154820 2024-04-15T01:11:45.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 -- 172.21.15.29:0/3882028636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d8154820 msgr2=0x7fb2d806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 --2- 172.21.15.29:0/3882028636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d8154820 0x7fb2d806b200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80097a0 tx=0x7fb2c802b840 comp rx=0 tx=0).stop 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 -- 172.21.15.29:0/3882028636 shutdown_connections 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 --2- 172.21.15.29:0/3882028636 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d8154820 0x7fb2d806b200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 --2- 172.21.15.29:0/3882028636 >> v2:172.21.15.29:3300/0 conn(0x7fb2d8154440 0x7fb2d8070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 -- 172.21.15.29:0/3882028636 >> 172.21.15.29:0/3882028636 conn(0x7fb2d806e540 msgr2=0x7fb2d806e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 -- 172.21.15.29:0/3882028636 shutdown_connections 2024-04-15T01:11:45.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.152+0000 7fb2dfede640 1 -- 172.21.15.29:0/3882028636 wait complete. 2024-04-15T01:11:45.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.153+0000 7fb2dfede640 1 Processor -- start 2024-04-15T01:11:45.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.153+0000 7fb2dfede640 1 -- start start 2024-04-15T01:11:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dfede640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d80c7680 0x7fb2d8150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dfede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2d8154440 0x7fb2d80cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dfede640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 0x7fb2d815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dfede640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8073470 con 0x7fb2d8154820 2024-04-15T01:11:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dfede640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8073190 con 0x7fb2d8154440 2024-04-15T01:11:45.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dfede640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d806ff70 con 0x7fb2d80c7680 2024-04-15T01:11:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2de47b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 0x7fb2d815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2ddc7a640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d80c7680 0x7fb2d8150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.154+0000 7fb2dd479640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2d8154440 0x7fb2d80cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.155+0000 7fb2de47b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 0x7fb2d815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41578/0 (socket says 172.21.15.29:41578) 2024-04-15T01:11:45.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.155+0000 7fb2de47b640 1 -- 172.21.15.29:0/1913659141 learned_addr learned my addr 172.21.15.29:0/1913659141 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:45.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.158+0000 7fb2de47b640 1 -- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d80c7680 msgr2=0x7fb2d8150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.158+0000 7fb2de47b640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d80c7680 0x7fb2d8150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.158+0000 7fb2de47b640 1 -- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2d8154440 msgr2=0x7fb2d80cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.158+0000 7fb2de47b640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2d8154440 0x7fb2d80cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.158+0000 7fb2de47b640 1 -- 172.21.15.29:0/1913659141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d80cc650 con 0x7fb2d8154820 2024-04-15T01:11:45.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.160+0000 7fb2de47b640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 0x7fb2d815a9c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000c6b0 tx=0x7fb2d000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.164+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0003b70 con 0x7fb2d8154820 2024-04-15T01:11:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.164+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb2d0003d30 con 0x7fb2d8154820 2024-04-15T01:11:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.164+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0005330 con 0x7fb2d8154820 2024-04-15T01:11:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.164+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d80ca9b0 con 0x7fb2d8154820 2024-04-15T01:11:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.164+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81f3b60 con 0x7fb2d8154820 2024-04-15T01:11:45.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.165+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d804f540 con 0x7fb2d8154820 2024-04-15T01:11:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.185+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb2d00054d0 con 0x7fb2d8154820 2024-04-15T01:11:45.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.185+0000 7fb2ce7fc640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb2bc06b9e0 0x7fb2bc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.186+0000 7fb2ddc7a640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb2bc06b9e0 0x7fb2bc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.186+0000 7fb2ddc7a640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb2bc06b9e0 0x7fb2bc06dea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009bd0 tx=0x7fb2d4009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:45.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.188+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb2d00057c0 con 0x7fb2d8154820 2024-04-15T01:11:45.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.449+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb2d0059610 con 0x7fb2d8154820 2024-04-15T01:11:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.667+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb2d815a0a0 con 0x7fb2d8154820 2024-04-15T01:11:45.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.737+0000 7fb2ce7fc640 1 -- 172.21.15.29:0/1913659141 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fb2d005d6b0 con 0x7fb2d8154820 2024-04-15T01:11:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb2bc06b9e0 msgr2=0x7fb2bc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb2bc06b9e0 0x7fb2bc06dea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009bd0 tx=0x7fb2d4009240 comp rx=0 tx=0).stop 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 msgr2=0x7fb2d815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 0x7fb2d815a9c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000c6b0 tx=0x7fb2d000cb70 comp rx=0 tx=0).stop 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 shutdown_connections 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7fb2bc06b9e0 0x7fb2bc06dea0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2d8154820 0x7fb2d815a9c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2d8154440 0x7fb2d80cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 --2- 172.21.15.29:0/1913659141 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7fb2d80c7680 0x7fb2d8150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 >> 172.21.15.29:0/1913659141 conn(0x7fb2d806e540 msgr2=0x7fb2d80c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 shutdown_connections 2024-04-15T01:11:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.739+0000 7fb2dfede640 1 -- 172.21.15.29:0/1913659141 wait complete. 2024-04-15T01:11:45.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-15T01:11:45.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.868+0000 7facdc975640 1 Processor -- start 2024-04-15T01:11:45.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.868+0000 7facdc975640 1 -- start start 2024-04-15T01:11:45.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.869+0000 7facdc975640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facd81547c0 0x7facd815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.869+0000 7facdc975640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd80cad30 con 0x7facd80ca920 2024-04-15T01:11:45.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.869+0000 7facdc975640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd80cf0c0 con 0x7facd80ca4b0 2024-04-15T01:11:45.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.869+0000 7facdc975640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7facd815a890 con 0x7facd81547c0 2024-04-15T01:11:45.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.869+0000 7facd659c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facd81547c0 0x7facd815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.870+0000 7facd6d9d640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7facd80ca920 0x7facd8164c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:50990/0 (socket says 172.21.15.29:50990) 2024-04-15T01:11:45.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.870+0000 7facd6d9d640 1 -- 172.21.15.29:0/927424225 learned_addr learned my addr 172.21.15.29:0/927424225 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:45.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.874+0000 7facd659c640 1 -- 172.21.15.29:0/927424225 >> v1:172.21.15.37:6789/0 conn(0x7facd80ca4b0 legacy=0x7facd80cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:45.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.874+0000 7facd659c640 1 -- 172.21.15.29:0/927424225 >> v1:172.21.15.29:6789/0 conn(0x7facd80ca920 legacy=0x7facd8164c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.874+0000 7facd659c640 1 -- 172.21.15.29:0/927424225 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd80cf3a0 con 0x7facd81547c0 2024-04-15T01:11:45.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.880+0000 7facd659c640 1 --2- 172.21.15.29:0/927424225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd81547c0 0x7facd815ad20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7facc80097a0 tx=0x7facc802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fb69cd41d48c5b server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.918+0000 7facd559a640 1 -- 172.21.15.29:0/927424225 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8035020 con 0x7facd81547c0 2024-04-15T01:11:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.918+0000 7facd559a640 1 -- 172.21.15.29:0/927424225 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7facc8031830 con 0x7facd81547c0 2024-04-15T01:11:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.918+0000 7facd559a640 1 -- 172.21.15.29:0/927424225 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8031c20 con 0x7facd81547c0 2024-04-15T01:11:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.919+0000 7facdc975640 1 -- 172.21.15.29:0/927424225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd81547c0 msgr2=0x7facd815ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.919+0000 7facdc975640 1 --2- 172.21.15.29:0/927424225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd81547c0 0x7facd815ad20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7facc80097a0 tx=0x7facc802b8d0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.920+0000 7facdc975640 1 -- 172.21.15.29:0/927424225 shutdown_connections 2024-04-15T01:11:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.920+0000 7facdc975640 1 --2- 172.21.15.29:0/927424225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd81547c0 0x7facd815ad20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.920+0000 7facdc975640 1 -- 172.21.15.29:0/927424225 >> 172.21.15.29:0/927424225 conn(0x7facd80cfb30 msgr2=0x7facd80cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:45.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.920+0000 7facdc975640 1 -- 172.21.15.29:0/927424225 shutdown_connections 2024-04-15T01:11:45.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.920+0000 7facdc975640 1 -- 172.21.15.29:0/927424225 wait complete. 2024-04-15T01:11:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.922+0000 7facdc975640 1 Processor -- start 2024-04-15T01:11:45.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.922+0000 7facdc975640 1 -- start start 2024-04-15T01:11:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.923+0000 7facdc975640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd80ca4b0 0x7facd814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.923+0000 7facdc975640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7facd80ca920 0x7facd81e1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.923+0000 7facdc975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 0x7facd81e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.923+0000 7facdc975640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7facd815b260 con 0x7facd80ca4b0 2024-04-15T01:11:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.923+0000 7facdc975640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7facd815a520 con 0x7facd81547c0 2024-04-15T01:11:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.923+0000 7facdc975640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7facd80ced60 con 0x7facd80ca920 2024-04-15T01:11:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.924+0000 7facd6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 0x7facd81e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.924+0000 7facd5d9b640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7facd80ca920 0x7facd81e1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.924+0000 7facd6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 0x7facd81e1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:45612/0 (socket says 172.21.15.29:45612) 2024-04-15T01:11:45.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.924+0000 7facd6d9d640 1 -- 172.21.15.29:0/1144611760 learned_addr learned my addr 172.21.15.29:0/1144611760 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.928+0000 7facd6d9d640 1 -- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7facd80ca920 msgr2=0x7facd81e1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.928+0000 7facd6d9d640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7facd80ca920 0x7facd81e1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.928+0000 7facd6d9d640 1 -- 172.21.15.29:0/1144611760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd80ca4b0 msgr2=0x7facd814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.928+0000 7facd6d9d640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd80ca4b0 0x7facd814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:45.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.928+0000 7facd6d9d640 1 -- 172.21.15.29:0/1144611760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8151330 con 0x7facd81547c0 2024-04-15T01:11:45.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.930+0000 7facd6d9d640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 0x7facd81e1b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7facd000cae0 tx=0x7facd000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.934+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0017070 con 0x7facd81547c0 2024-04-15T01:11:45.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.934+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7facd000ac40 con 0x7facd81547c0 2024-04-15T01:11:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.934+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd81515f0 con 0x7facd81547c0 2024-04-15T01:11:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.934+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0012400 con 0x7facd81547c0 2024-04-15T01:11:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.934+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd8155a80 con 0x7facd81547c0 2024-04-15T01:11:45.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.935+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd8156090 con 0x7facd81547c0 2024-04-15T01:11:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.955+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7facd001a070 con 0x7facd81547c0 2024-04-15T01:11:45.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.955+0000 7facc6ffd640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7facb806b9c0 0x7facb806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.955+0000 7facd659c640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7facb806b9c0 0x7facb806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:45.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.956+0000 7facd659c640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7facb806b9c0 0x7facb806de80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7facc8036000 tx=0x7facc8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:45.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:45.960+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7165+0+0 (secure 0 0 0) 0x7facd0057000 con 0x7facd81547c0 2024-04-15T01:11:46.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:46.236+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7facd0021020 con 0x7facd81547c0 2024-04-15T01:11:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:46.526+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7facd804f540 con 0x7facd81547c0 2024-04-15T01:11:46.981 INFO:tasks.ceph.mds.e.smithi029.stderr:==00:01:10:50.584 41132== 2024-04-15T01:11:46.981 INFO:tasks.ceph.mds.e.smithi029.stderr:==00:01:10:50.584 41132== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:11:47.009 INFO:tasks.ceph.mds.d.smithi037.stderr:==00:01:10:50.603 41245== 2024-04-15T01:11:47.009 INFO:tasks.ceph.mds.d.smithi037.stderr:==00:01:10:50.603 41245== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:11:47.024 INFO:tasks.ceph.mds.a.smithi029.stderr:==00:01:10:50.643 41130== 2024-04-15T01:11:47.024 INFO:tasks.ceph.mds.a.smithi029.stderr:==00:01:10:50.643 41130== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:11:47.031 INFO:tasks.ceph.mds.c.smithi029.stderr:==00:01:10:50.642 41131== 2024-04-15T01:11:47.031 INFO:tasks.ceph.mds.c.smithi029.stderr:==00:01:10:50.642 41131== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:11:47.047 INFO:tasks.ceph.mds.d.smithi037.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:11:47.087 INFO:tasks.ceph.mds.f.smithi037.stderr:==00:01:10:50.692 41243== 2024-04-15T01:11:47.088 INFO:tasks.ceph.mds.f.smithi037.stderr:==00:01:10:50.692 41243== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:11:47.092 INFO:tasks.ceph.mds.a.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:11:47.093 INFO:tasks.ceph.mds.c.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:11:47.093 INFO:tasks.ceph.mds.e.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:11:47.247 INFO:tasks.ceph.mds.f.smithi037.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:11:47.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.426+0000 7facc6ffd640 1 -- 172.21.15.29:0/1144611760 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7facd0058f60 con 0x7facd81547c0 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7facb806b9c0 msgr2=0x7facb806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7facb806b9c0 0x7facb806de80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7facc8036000 tx=0x7facc8030000 comp rx=0 tx=0).stop 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 msgr2=0x7facd81e1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 0x7facd81e1b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7facd000cae0 tx=0x7facd000a060 comp rx=0 tx=0).stop 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 shutdown_connections 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7facb806b9c0 0x7facb806de80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd81547c0 0x7facd81e1b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7facd80ca920 0x7facd81e1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 --2- 172.21.15.29:0/1144611760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facd80ca4b0 0x7facd814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 >> 172.21.15.29:0/1144611760 conn(0x7facd80cfb30 msgr2=0x7facd806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 shutdown_connections 2024-04-15T01:11:47.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.428+0000 7facdc975640 1 -- 172.21.15.29:0/1144611760 wait complete. 2024-04-15T01:11:47.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-15T01:11:47.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.546+0000 7f564bc95640 1 Processor -- start 2024-04-15T01:11:47.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.546+0000 7f564bc95640 1 -- start start 2024-04-15T01:11:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.547+0000 7f564bc95640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5644070070 0x7f56440cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.547+0000 7f564bc95640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f56440c6630 0x7f564415b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.547+0000 7f564bc95640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56440c7a10 con 0x7f56440c6250 2024-04-15T01:11:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.547+0000 7f564bc95640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f56440c7cf0 con 0x7f5644070070 2024-04-15T01:11:47.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.547+0000 7f564bc95640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f5644158310 con 0x7f56440c6630 2024-04-15T01:11:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.547+0000 7f564a232640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f56440c6630 0x7f564415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.548+0000 7f5649a31640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f56440c6250 0x7f5644151f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:34402/0 (socket says 172.21.15.29:34402) 2024-04-15T01:11:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.548+0000 7f5649a31640 1 -- 172.21.15.29:0/1687275486 learned_addr learned my addr 172.21.15.29:0/1687275486 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:47.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.548+0000 7f5649230640 1 --2- 172.21.15.29:0/1687275486 >> v2:172.21.15.37:3300/0 conn(0x7f5644070070 0x7f56440cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:47.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.550+0000 7f564a232640 1 -- 172.21.15.29:0/1687275486 >> v2:172.21.15.37:3300/0 conn(0x7f5644070070 msgr2=0x7f56440cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.550+0000 7f564a232640 1 --2- 172.21.15.29:0/1687275486 >> v2:172.21.15.37:3300/0 conn(0x7f5644070070 0x7f56440cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.550+0000 7f564a232640 1 -- 172.21.15.29:0/1687275486 >> v1:172.21.15.37:6789/0 conn(0x7f56440c6250 legacy=0x7f5644151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.550+0000 7f564a232640 1 -- 172.21.15.29:0/1687275486 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56441585f0 con 0x7f56440c6630 2024-04-15T01:11:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.552+0000 7f564a232640 1 --2- 172.21.15.29:0/1687275486 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f56440c6630 0x7f564415b760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f563c009d90 tx=0x7f563c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee14110b16bf706 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:47.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.556+0000 7f5648a2f640 1 -- 172.21.15.29:0/1687275486 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c039070 con 0x7f56440c6630 2024-04-15T01:11:47.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.556+0000 7f5648a2f640 1 -- 172.21.15.29:0/1687275486 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f563c02cc50 con 0x7f56440c6630 2024-04-15T01:11:47.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.556+0000 7f5648a2f640 1 -- 172.21.15.29:0/1687275486 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c034440 con 0x7f56440c6630 2024-04-15T01:11:47.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 -- 172.21.15.29:0/1687275486 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f56440c6630 msgr2=0x7f564415b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:47.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 --2- 172.21.15.29:0/1687275486 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f56440c6630 0x7f564415b760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f563c009d90 tx=0x7f563c02bea0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 -- 172.21.15.29:0/1687275486 shutdown_connections 2024-04-15T01:11:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 --2- 172.21.15.29:0/1687275486 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f56440c6630 0x7f564415b760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 --2- 172.21.15.29:0/1687275486 >> v2:172.21.15.37:3300/0 conn(0x7f5644070070 0x7f56440cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 -- 172.21.15.29:0/1687275486 >> 172.21.15.29:0/1687275486 conn(0x7f564406c310 msgr2=0x7f564406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 -- 172.21.15.29:0/1687275486 shutdown_connections 2024-04-15T01:11:47.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.557+0000 7f564bc95640 1 -- 172.21.15.29:0/1687275486 wait complete. 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.558+0000 7f564bc95640 1 Processor -- start 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.558+0000 7f564bc95640 1 -- start start 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564bc95640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5644070070 0x7f564414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564bc95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 0x7f5644150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564bc95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56440c6630 0x7f56441f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564bc95640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5644152620 con 0x7f56440c6630 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564bc95640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56440c7fd0 con 0x7f56440c6250 2024-04-15T01:11:47.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564bc95640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f56441527a0 con 0x7f5644070070 2024-04-15T01:11:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f5649230640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 0x7f5644150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f5649a31640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5644070070 0x7f564414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.559+0000 7f564a232640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56440c6630 0x7f56441f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.560+0000 7f5649230640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 0x7f5644150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.29:48932/0 (socket says 172.21.15.29:48932) 2024-04-15T01:11:47.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.560+0000 7f5649230640 1 -- 172.21.15.29:0/1497181241 learned_addr learned my addr 172.21.15.29:0/1497181241 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.563+0000 7f5649230640 1 -- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5644070070 msgr2=0x7f564414e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.563+0000 7f5649230640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5644070070 0x7f564414e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.563+0000 7f5649230640 1 -- 172.21.15.29:0/1497181241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56440c6630 msgr2=0x7f56441f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.563+0000 7f5649230640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56440c6630 0x7f56441f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:47.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.563+0000 7f5649230640 1 -- 172.21.15.29:0/1497181241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564414edd0 con 0x7f56440c6250 2024-04-15T01:11:47.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.565+0000 7f5649230640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 0x7f5644150a40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f563400e9e0 tx=0x7f563400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.569+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634017070 con 0x7f56440c6250 2024-04-15T01:11:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.569+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f563400c9d0 con 0x7f56440c6250 2024-04-15T01:11:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.569+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56441555d0 con 0x7f56440c6250 2024-04-15T01:11:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.570+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563400cde0 con 0x7f56440c6250 2024-04-15T01:11:47.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.570+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564414f350 con 0x7f56440c6250 2024-04-15T01:11:47.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.570+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564404f540 con 0x7f56440c6250 2024-04-15T01:11:47.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.848+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f563401a070 con 0x7f56440c6250 2024-04-15T01:11:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.848+0000 7f563a7fc640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f562806b9e0 0x7f562806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.848+0000 7f5649a31640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f562806b9e0 0x7f562806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:47.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.849+0000 7f5649a31640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f562806b9e0 0x7f562806dea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5640007fd0 tx=0x7f5640007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:47.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.851+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7165+0+0 (secure 0 0 0) 0x7f56340578f0 con 0x7f56440c6250 2024-04-15T01:11:47.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:47.862+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f56340595f0 con 0x7f56440c6250 2024-04-15T01:11:48.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.042+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f56440cd330 con 0x7f56440c6250 2024-04-15T01:11:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.614+0000 7f563a7fc640 1 -- 172.21.15.29:0/1497181241 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f563405d690 con 0x7f56440c6250 2024-04-15T01:11:48.613 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-04-15T01:11:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.616+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f562806b9e0 msgr2=0x7f562806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.616+0000 7f564bc95640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f562806b9e0 0x7f562806dea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5640007fd0 tx=0x7f5640007e80 comp rx=0 tx=0).stop 2024-04-15T01:11:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.616+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 msgr2=0x7f5644150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.616+0000 7f564bc95640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 0x7f5644150a40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f563400e9e0 tx=0x7f563400eea0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 shutdown_connections 2024-04-15T01:11:48.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f562806b9e0 0x7f562806dea0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f56440c6630 0x7f56441f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56440c6250 0x7f5644150a40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 --2- 172.21.15.29:0/1497181241 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f5644070070 0x7f564414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 >> 172.21.15.29:0/1497181241 conn(0x7f564406c310 msgr2=0x7f56440726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 shutdown_connections 2024-04-15T01:11:48.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.617+0000 7f564bc95640 1 -- 172.21.15.29:0/1497181241 wait complete. 2024-04-15T01:11:48.627 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-15T01:11:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.734+0000 7f4323636640 1 Processor -- start 2024-04-15T01:11:48.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.734+0000 7f4323636640 1 -- start start 2024-04-15T01:11:48.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.735+0000 7f4323636640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c154480 0x7f431c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:48.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.735+0000 7f4323636640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f431c06ce50 0x7f431c0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:48.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.735+0000 7f4323636640 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431c0c4680 con 0x7f431c0c8c40 2024-04-15T01:11:48.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.735+0000 7f4323636640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f431c15afe0 con 0x7f431c06ce50 2024-04-15T01:11:48.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.735+0000 7f4323636640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f431c15a3d0 con 0x7f431c154480 2024-04-15T01:11:48.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.735+0000 7f4321bd3640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f431c06ce50 0x7f431c0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:48.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.736+0000 7f43213d2640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c154480 0x7f431c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:48.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.736+0000 7f4320bd1640 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f431c0c8c40 0x7f431c06c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48672/0 (socket says 172.21.15.29:48672) 2024-04-15T01:11:48.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.736+0000 7f4320bd1640 1 -- 172.21.15.29:0/1001311519 learned_addr learned my addr 172.21.15.29:0/1001311519 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:48.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.738+0000 7f43213d2640 1 -- 172.21.15.29:0/1001311519 >> v2:172.21.15.29:3300/0 conn(0x7f431c06ce50 msgr2=0x7f431c0c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:48.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.738+0000 7f43213d2640 1 --2- 172.21.15.29:0/1001311519 >> v2:172.21.15.29:3300/0 conn(0x7f431c06ce50 0x7f431c0c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.738+0000 7f43213d2640 1 -- 172.21.15.29:0/1001311519 >> v1:172.21.15.29:6789/0 conn(0x7f431c0c8c40 legacy=0x7f431c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:48.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.738+0000 7f43213d2640 1 -- 172.21.15.29:0/1001311519 --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c15a6b0 con 0x7f431c154480 2024-04-15T01:11:48.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.740+0000 7f43213d2640 1 --2- 172.21.15.29:0/1001311519 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c154480 0x7f431c0c8700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f431c0c4850 tx=0x7f431402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c07876d9c7a6fd49 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:48.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.744+0000 7f4313fff640 1 -- 172.21.15.29:0/1001311519 <== mon.2 v2:172.21.15.37:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314035020 con 0x7f431c154480 2024-04-15T01:11:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.744+0000 7f4313fff640 1 -- 172.21.15.29:0/1001311519 <== mon.2 v2:172.21.15.37:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4314031890 con 0x7f431c154480 2024-04-15T01:11:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.744+0000 7f4313fff640 1 -- 172.21.15.29:0/1001311519 <== mon.2 v2:172.21.15.37:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314031c80 con 0x7f431c154480 2024-04-15T01:11:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 -- 172.21.15.29:0/1001311519 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c154480 msgr2=0x7f431c0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 --2- 172.21.15.29:0/1001311519 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c154480 0x7f431c0c8700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f431c0c4850 tx=0x7f431402b930 comp rx=0 tx=0).stop 2024-04-15T01:11:48.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 -- 172.21.15.29:0/1001311519 shutdown_connections 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 --2- 172.21.15.29:0/1001311519 >> v2:172.21.15.29:3300/0 conn(0x7f431c06ce50 0x7f431c0c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 --2- 172.21.15.29:0/1001311519 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c154480 0x7f431c0c8700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 -- 172.21.15.29:0/1001311519 >> 172.21.15.29:0/1001311519 conn(0x7f431c06f9f0 msgr2=0x7f431c061c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 -- 172.21.15.29:0/1001311519 shutdown_connections 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.745+0000 7f4323636640 1 -- 172.21.15.29:0/1001311519 wait complete. 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.746+0000 7f4323636640 1 Processor -- start 2024-04-15T01:11:48.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.746+0000 7f4323636640 1 -- start start 2024-04-15T01:11:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4323636640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 0x7f431c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4323636640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c0c8c40 0x7f431c0af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4323636640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f431c154480 0x7f431c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4323636640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f431c154860 con 0x7f431c06ce50 2024-04-15T01:11:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4323636640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f431c15ac70 con 0x7f431c154480 2024-04-15T01:11:48.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4323636640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f431c1549e0 con 0x7f431c0c8c40 2024-04-15T01:11:48.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f43213d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 0x7f431c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:48.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4320bd1640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c0c8c40 0x7f431c0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:48.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.747+0000 7f4321bd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f431c154480 0x7f431c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:48.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.748+0000 7f43213d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 0x7f431c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53876/0 (socket says 172.21.15.29:53876) 2024-04-15T01:11:48.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.748+0000 7f43213d2640 1 -- 172.21.15.29:0/79976865 learned_addr learned my addr 172.21.15.29:0/79976865 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:48.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.751+0000 7f43213d2640 1 -- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c0c8c40 msgr2=0x7f431c0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:48.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.751+0000 7f43213d2640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c0c8c40 0x7f431c0af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.751+0000 7f43213d2640 1 -- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f431c154480 msgr2=0x7f431c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:48.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.751+0000 7f43213d2640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f431c154480 0x7f431c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:48.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.751+0000 7f43213d2640 1 -- 172.21.15.29:0/79976865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c1f06d0 con 0x7f431c06ce50 2024-04-15T01:11:48.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.753+0000 7f43213d2640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 0x7f431c152ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4314000c00 tx=0x7f43140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:48.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.757+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314040070 con 0x7f431c06ce50 2024-04-15T01:11:48.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.757+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f431403a420 con 0x7f431c06ce50 2024-04-15T01:11:48.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.757+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431c1f09b0 con 0x7f431c06ce50 2024-04-15T01:11:48.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.757+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314035040 con 0x7f431c06ce50 2024-04-15T01:11:48.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.757+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431c1f0f70 con 0x7f431c06ce50 2024-04-15T01:11:48.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.758+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f431c04f540 con 0x7f431c06ce50 2024-04-15T01:11:48.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.777+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f431404b060 con 0x7f431c06ce50 2024-04-15T01:11:48.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.777+0000 7f4311ffb640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f430006b9e0 0x7f430006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:48.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.778+0000 7f4320bd1640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f430006b9e0 0x7f430006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:48.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.778+0000 7f4320bd1640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f430006b9e0 0x7f430006dea0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f431c1535c0 tx=0x7f430c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:48.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:48.780+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6727+0+0 (secure 0 0 0) 0x7f43140791f0 con 0x7f431c06ce50 2024-04-15T01:11:49.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.047+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f431402d040 con 0x7f431c06ce50 2024-04-15T01:11:49.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.230+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f431c157ce0 con 0x7f431c06ce50 2024-04-15T01:11:49.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.640+0000 7f4311ffb640 1 -- 172.21.15.29:0/79976865 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f431407aef0 con 0x7f431c06ce50 2024-04-15T01:11:49.639 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f430006b9e0 msgr2=0x7f430006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f430006b9e0 0x7f430006dea0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f431c1535c0 tx=0x7f430c009040 comp rx=0 tx=0).stop 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 msgr2=0x7f431c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 0x7f431c152ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4314000c00 tx=0x7f43140046c0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 shutdown_connections 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f430006b9e0 0x7f430006dea0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f431c154480 0x7f431c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f431c0c8c40 0x7f431c0af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 --2- 172.21.15.29:0/79976865 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f431c06ce50 0x7f431c152ce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 >> 172.21.15.29:0/79976865 conn(0x7f431c06f9f0 msgr2=0x7f431c158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 shutdown_connections 2024-04-15T01:11:49.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.642+0000 7f4323636640 1 -- 172.21.15.29:0/79976865 wait complete. 2024-04-15T01:11:49.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-15T01:11:49.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.764+0000 7f9447e1c640 1 Processor -- start 2024-04-15T01:11:49.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.764+0000 7f9447e1c640 1 -- start start 2024-04-15T01:11:49.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.765+0000 7f9447e1c640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9440154480 0x7f94400c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:49.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.765+0000 7f9447e1c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94400c8c40 0x7f944006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:49.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.765+0000 7f9447e1c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94400c4680 con 0x7f944006cc80 2024-04-15T01:11:49.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.765+0000 7f9447e1c640 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 -- 0x7f944015afe0 con 0x7f9440154480 2024-04-15T01:11:49.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.765+0000 7f9447e1c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f944015a3d0 con 0x7f94400c8c40 2024-04-15T01:11:49.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.766+0000 7f9445bb8640 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9440154480 0x7f94400c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:49.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.766+0000 7f94453b7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94400c8c40 0x7f944006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:49.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.766+0000 7f94463b9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f944006cc80 0x7f94400c3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.29:34408/0 (socket says 172.21.15.29:34408) 2024-04-15T01:11:49.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.766+0000 7f94463b9640 1 -- 172.21.15.29:0/1131901814 learned_addr learned my addr 172.21.15.29:0/1131901814 (peer_addr_for_me v1:172.21.15.29:0/0) 2024-04-15T01:11:49.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.768+0000 7f9445bb8640 1 -- 172.21.15.29:0/1131901814 >> v2:172.21.15.37:3300/0 conn(0x7f94400c8c40 msgr2=0x7f944006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T01:11:49.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.768+0000 7f9445bb8640 1 --2- 172.21.15.29:0/1131901814 >> v2:172.21.15.37:3300/0 conn(0x7f94400c8c40 0x7f944006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.768+0000 7f9445bb8640 1 -- 172.21.15.29:0/1131901814 >> v1:172.21.15.37:6789/0 conn(0x7f944006cc80 legacy=0x7f94400c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:49.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.768+0000 7f9445bb8640 1 -- 172.21.15.29:0/1131901814 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944015a6b0 con 0x7f9440154480 2024-04-15T01:11:49.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.770+0000 7f9445bb8640 1 --2- 172.21.15.29:0/1131901814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9440154480 0x7f94400c8700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f94400ce6d0 tx=0x7f943802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e04da8689461a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.774+0000 7f9444bb6640 1 -- 172.21.15.29:0/1131901814 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438034070 con 0x7f9440154480 2024-04-15T01:11:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.774+0000 7f9444bb6640 1 -- 172.21.15.29:0/1131901814 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9438030610 con 0x7f9440154480 2024-04-15T01:11:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.774+0000 7f9444bb6640 1 -- 172.21.15.29:0/1131901814 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438030a00 con 0x7f9440154480 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 -- 172.21.15.29:0/1131901814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9440154480 msgr2=0x7f94400c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 --2- 172.21.15.29:0/1131901814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9440154480 0x7f94400c8700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f94400ce6d0 tx=0x7f943802b960 comp rx=0 tx=0).stop 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 -- 172.21.15.29:0/1131901814 shutdown_connections 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 --2- 172.21.15.29:0/1131901814 >> v2:172.21.15.37:3300/0 conn(0x7f94400c8c40 0x7f944006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 --2- 172.21.15.29:0/1131901814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9440154480 0x7f94400c8700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 -- 172.21.15.29:0/1131901814 >> 172.21.15.29:0/1131901814 conn(0x7f944006f9f0 msgr2=0x7f9440061c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 -- 172.21.15.29:0/1131901814 shutdown_connections 2024-04-15T01:11:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.775+0000 7f9447e1c640 1 -- 172.21.15.29:0/1131901814 wait complete. 2024-04-15T01:11:49.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 Processor -- start 2024-04-15T01:11:49.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 -- start start 2024-04-15T01:11:49.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 0x7f94401e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 --2- >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f94400c8c40 0x7f94401f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9440154480 0x7f94401f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f944006d0a0 con 0x7f944006cc80 2024-04-15T01:11:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f944015ac70 con 0x7f9440154480 2024-04-15T01:11:49.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.777+0000 7f9447e1c640 1 -- --> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] -- mon_getmap magic: 0 -- 0x7f9440154860 con 0x7f94400c8c40 2024-04-15T01:11:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.778+0000 7f9445bb8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 0x7f94401e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.778+0000 7f9445bb8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 0x7f94401e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53892/0 (socket says 172.21.15.29:53892) 2024-04-15T01:11:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.778+0000 7f9445bb8640 1 -- 172.21.15.29:0/3871412272 learned_addr learned my addr 172.21.15.29:0/3871412272 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-04-15T01:11:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.778+0000 7f94453b7640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f94400c8c40 0x7f94401f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:49.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.778+0000 7f94463b9640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9440154480 0x7f94401f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.782+0000 7f9445bb8640 1 -- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f94400c8c40 msgr2=0x7f94401f0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.782+0000 7f9445bb8640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f94400c8c40 0x7f94401f0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.782+0000 7f9445bb8640 1 -- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9440154480 msgr2=0x7f94401f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.782+0000 7f9445bb8640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9440154480 0x7f94401f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.782+0000 7f9445bb8640 1 -- 172.21.15.29:0/3871412272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94401e5cd0 con 0x7f944006cc80 2024-04-15T01:11:49.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.784+0000 7f9445bb8640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 0x7f94401e53a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9438009890 tx=0x7f94380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:49.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.788+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438034040 con 0x7f944006cc80 2024-04-15T01:11:49.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.788+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f943803ac20 con 0x7f944006cc80 2024-04-15T01:11:49.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.788+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94380443f0 con 0x7f944006cc80 2024-04-15T01:11:49.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.788+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94401e59f0 con 0x7f944006cc80 2024-04-15T01:11:49.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.788+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94401e3ae0 con 0x7f944006cc80 2024-04-15T01:11:49.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:49.789+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944004f540 con 0x7f944006cc80 2024-04-15T01:11:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.052+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9438037070 con 0x7f944006cc80 2024-04-15T01:11:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.052+0000 7f943e7fc640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f942c06ba10 0x7f942c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-15T01:11:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.053+0000 7f94453b7640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f942c06ba10 0x7f942c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-15T01:11:50.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.053+0000 7f94453b7640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f942c06ba10 0x7f942c06ded0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f94400c8230 tx=0x7f9434009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-15T01:11:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.066+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6197+0+0 (secure 0 0 0) 0x7f9438079860 con 0x7f944006cc80 2024-04-15T01:11:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.066+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f943803f070 con 0x7f944006cc80 2024-04-15T01:11:50.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.250+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9440157ce0 con 0x7f944006cc80 2024-04-15T01:11:50.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.714+0000 7f943e7fc640 1 -- 172.21.15.29:0/3871412272 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f943807b560 con 0x7f944006cc80 2024-04-15T01:11:50.713 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f942c06ba10 msgr2=0x7f942c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f942c06ba10 0x7f942c06ded0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f94400c8230 tx=0x7f9434009190 comp rx=0 tx=0).stop 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 msgr2=0x7f94401e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 0x7f94401e53a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9438009890 tx=0x7f94380046c0 comp rx=0 tx=0).stop 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 shutdown_connections 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:6800/4102667027,v1:172.21.15.37:6801/4102667027] conn(0x7f942c06ba10 0x7f942c06ded0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9440154480 0x7f94401f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f94400c8c40 0x7f94401f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 --2- 172.21.15.29:0/3871412272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f944006cc80 0x7f94401e53a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.717+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 >> 172.21.15.29:0/3871412272 conn(0x7f944006f9f0 msgr2=0x7f94401599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T01:11:50.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.718+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 shutdown_connections 2024-04-15T01:11:50.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-15T01:11:50.718+0000 7f9447e1c640 1 -- 172.21.15.29:0/3871412272 wait complete. 2024-04-15T01:11:50.733 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-15T01:11:50.733 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-15T01:11:50.733 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:50.733 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:11:50.734 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2024-04-15T01:11:50.735 INFO:tasks.ceph.mds.a:Stopped 2024-04-15T01:11:50.735 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-15T01:11:50.735 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:50.735 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:11:50.735 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2024-04-15T01:11:50.735 INFO:tasks.ceph.mds.c:Stopped 2024-04-15T01:11:50.735 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-15T01:11:50.735 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:50.736 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:11:50.736 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-04-15T01:11:50.736 INFO:tasks.ceph.mds.e:Stopped 2024-04-15T01:11:50.736 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-15T01:11:50.736 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:50.752 INFO:tasks.ceph.mds.b.smithi037.stderr:2024-04-15T01:11:50.742+0000 b7e9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 41237) UID: 0 2024-04-15T01:11:50.752 INFO:tasks.ceph.mds.b.smithi037.stderr:2024-04-15T01:11:50.744+0000 b7e9640 -1 mds.b *** got signal Terminated *** 2024-04-15T01:11:52.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-15T01:11:52.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-15T01:11:56.838 INFO:tasks.ceph.mds.b:Stopped 2024-04-15T01:11:56.839 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-15T01:11:56.839 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:56.839 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:11:56.839 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-04-15T01:11:56.839 INFO:tasks.ceph.mds.d:Stopped 2024-04-15T01:11:56.839 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-15T01:11:56.839 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:56.840 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:11:56.840 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2024-04-15T01:11:56.840 INFO:tasks.ceph.mds.f:Stopped 2024-04-15T01:11:56.840 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-15T01:11:56.840 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-15T01:11:56.841 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:11:56.841 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-15T01:11:56.843+0000 7f2bb1ff9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37512) UID: 0 2024-04-15T01:11:56.842 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-04-15T01:11:56.843+0000 7f2bb1ff9640 -1 osd.0 34 *** Got signal Terminated *** 2024-04-15T01:11:58.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-15T01:11:58.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-15T01:12:02.942 INFO:tasks.ceph.osd.0:Stopped 2024-04-15T01:12:02.943 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-15T01:12:02.943 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:02.944 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-15T01:12:02.945+0000 7fa4a39f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37523) UID: 0 2024-04-15T01:12:02.944 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-04-15T01:12:02.945+0000 7fa4a39f9640 -1 osd.1 36 *** Got signal Terminated *** 2024-04-15T01:12:06.386 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:12:06.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:12:09.044 INFO:tasks.ceph.osd.1:Stopped 2024-04-15T01:12:09.044 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-15T01:12:09.044 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:09.045 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-15T01:12:09.047+0000 7f5952df9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37530) UID: 0 2024-04-15T01:12:09.045 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-04-15T01:12:09.047+0000 7f5952df9640 -1 osd.2 37 *** Got signal Terminated *** 2024-04-15T01:12:15.146 INFO:tasks.ceph.osd.2:Stopped 2024-04-15T01:12:15.147 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-15T01:12:15.147 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:15.147 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-15T01:12:15.149+0000 7ff3dd9f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37531) UID: 0 2024-04-15T01:12:15.147 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-04-15T01:12:15.149+0000 7ff3dd9f9640 -1 osd.3 38 *** Got signal Terminated *** 2024-04-15T01:12:21.248 INFO:tasks.ceph.osd.3:Stopped 2024-04-15T01:12:21.249 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-15T01:12:21.249 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:21.250 INFO:tasks.ceph.osd.4.smithi037.stderr:2024-04-15T01:12:21.252+0000 7fe43a1f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 37590) UID: 0 2024-04-15T01:12:21.250 INFO:tasks.ceph.osd.4.smithi037.stderr:2024-04-15T01:12:21.252+0000 7fe43a1f9640 -1 osd.4 39 *** Got signal Terminated *** 2024-04-15T01:12:27.351 INFO:tasks.ceph.osd.4:Stopped 2024-04-15T01:12:27.351 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-15T01:12:27.352 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:27.353 INFO:tasks.ceph.osd.5.smithi037.stderr:2024-04-15T01:12:27.355+0000 7f432e9f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 37591) UID: 0 2024-04-15T01:12:27.353 INFO:tasks.ceph.osd.5.smithi037.stderr:2024-04-15T01:12:27.355+0000 7f432e9f9640 -1 osd.5 40 *** Got signal Terminated *** 2024-04-15T01:12:33.453 INFO:tasks.ceph.osd.5:Stopped 2024-04-15T01:12:33.454 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-15T01:12:33.454 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:33.455 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T01:12:33.457+0000 7f45b23f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 37595) UID: 0 2024-04-15T01:12:33.455 INFO:tasks.ceph.osd.6.smithi037.stderr:2024-04-15T01:12:33.457+0000 7f45b23f9640 -1 osd.6 41 *** Got signal Terminated *** 2024-04-15T01:12:34.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-15T01:12:36.443 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:12:36.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:12:39.555 INFO:tasks.ceph.osd.6:Stopped 2024-04-15T01:12:39.556 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-15T01:12:39.556 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:39.557 INFO:tasks.ceph.osd.7.smithi037.stderr:2024-04-15T01:12:39.559+0000 7f3b20bf9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 37597) UID: 0 2024-04-15T01:12:39.557 INFO:tasks.ceph.osd.7.smithi037.stderr:2024-04-15T01:12:39.559+0000 7f3b20bf9640 -1 osd.7 41 *** Got signal Terminated *** 2024-04-15T01:12:39.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-15T01:12:39.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-15T01:12:45.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-15T01:12:45.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-15T01:12:45.657 INFO:tasks.ceph.osd.7:Stopped 2024-04-15T01:12:45.658 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-15T01:12:45.658 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-15T01:12:45.658 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:45.686 INFO:tasks.ceph.mgr.y:Stopped 2024-04-15T01:12:45.686 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-15T01:12:45.686 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:45.687 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T01:12:45.689+0000 7ff924df7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 37012) UID: 0 2024-04-15T01:12:45.687 INFO:tasks.ceph.mgr.x.smithi037.stderr:2024-04-15T01:12:45.689+0000 7ff924df7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-15T01:12:45.716 INFO:tasks.ceph.mgr.x:Stopped 2024-04-15T01:12:45.716 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-15T01:12:45.716 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-15T01:12:45.716 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:45.745 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-04-15T01:12:45.734+0000 a192640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 37220) UID: 0 2024-04-15T01:12:45.746 INFO:tasks.ceph.mon.a.smithi029.stderr:2024-04-15T01:12:45.735+0000 a192640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-15T01:12:46.528 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:12:17.048 37242== 2024-04-15T01:12:46.528 INFO:tasks.ceph.mon.a.smithi029.stderr:==00:01:12:17.048 37242== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:12:46.545 INFO:tasks.ceph.mon.a.smithi029.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:12:50.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-15T01:12:50.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-15T01:12:51.818 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:12:51.818 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-04-15T01:12:51.819 INFO:tasks.ceph.mon.a:Stopped 2024-04-15T01:12:51.820 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-15T01:12:51.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:51.836 INFO:tasks.ceph.mon.b.smithi037.stderr:2024-04-15T01:12:51.826+0000 a192640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 37007) UID: 0 2024-04-15T01:12:51.837 INFO:tasks.ceph.mon.b.smithi037.stderr:2024-04-15T01:12:51.828+0000 a192640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-15T01:12:52.444 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:12:22.945 37014== 2024-04-15T01:12:52.444 INFO:tasks.ceph.mon.b.smithi037.stderr:==00:01:12:22.945 37014== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:12:52.456 INFO:tasks.ceph.mon.b.smithi037.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:12:55.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-15T01:12:55.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-15T01:12:57.921 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:12:57.921 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-04-15T01:12:57.922 INFO:tasks.ceph.mon.b:Stopped 2024-04-15T01:12:57.922 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-15T01:12:57.922 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T01:12:57.939 INFO:tasks.ceph.mon.c.smithi037.stderr:2024-04-15T01:12:57.929+0000 a192640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 37010) UID: 0 2024-04-15T01:12:57.939 INFO:tasks.ceph.mon.c.smithi037.stderr:2024-04-15T01:12:57.930+0000 a192640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-15T01:12:58.645 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:12:29.145 37015== 2024-04-15T01:12:58.645 INFO:tasks.ceph.mon.c.smithi037.stderr:==00:01:12:29.145 37015== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T01:12:58.656 INFO:tasks.ceph.mon.c.smithi037.stderr:daemon-helper: command failed with exit status 42 2024-04-15T01:13:00.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-15T01:13:00.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-15T01:13:04.024 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T01:13:04.025 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-04-15T01:13:04.025 INFO:tasks.ceph.mon.c:Stopped 2024-04-15T01:13:04.025 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-15T01:13:04.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-15T01:13:04.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T01:13:04.064 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-15T01:13:04.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T01:13:04.214 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-15T01:13:04.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T01:13:04.283 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-15T01:13:04.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T01:13:04.364 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-15T01:13:04.451 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T01:13:04.451 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-15T01:13:04.596 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T01:13:04.596 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-15T01:13:04.660 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T01:13:04.660 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-15T01:13:04.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T01:13:04.745 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-15T01:13:04.809 INFO:tasks.ceph:Archiving mon data... 2024-04-15T01:13:04.810 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/data/mon.a.tgz 2024-04-15T01:13:04.811 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-15T01:13:04.826 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.PrOydCzBpj 2024-04-15T01:13:04.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PrOydCzBpj 2024-04-15T01:13:04.963 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.PrOydCzBpj 2024-04-15T01:13:05.048 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.PrOydCzBpj is 375KB 2024-04-15T01:13:05.146 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.PrOydCzBpj 2024-04-15T01:13:05.160 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/data/mon.b.tgz 2024-04-15T01:13:05.160 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-04-15T01:13:05.177 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.MyRVovnyV9 2024-04-15T01:13:05.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MyRVovnyV9 2024-04-15T01:13:05.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.MyRVovnyV9 2024-04-15T01:13:05.419 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.MyRVovnyV9 is 394KB 2024-04-15T01:13:05.517 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.MyRVovnyV9 2024-04-15T01:13:05.531 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/data/mon.c.tgz 2024-04-15T01:13:05.532 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-04-15T01:13:05.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-15T01:13:05.585 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.PGFyso2txd 2024-04-15T01:13:05.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PGFyso2txd 2024-04-15T01:13:05.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.PGFyso2txd 2024-04-15T01:13:05.811 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.PGFyso2txd is 394KB 2024-04-15T01:13:05.908 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.PGFyso2txd 2024-04-15T01:13:05.922 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-15T01:13:05.922 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T01:13:05.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T01:13:06.266 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-15T01:13:06.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:13:06.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:13:06.576 INFO:tasks.ceph:Archiving crash dumps... 2024-04-15T01:13:06.578 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/remote/smithi029/crash 2024-04-15T01:13:06.579 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T01:13:06.630 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/remote/smithi037/crash 2024-04-15T01:13:06.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T01:13:06.658 INFO:tasks.ceph:Shutting down logrotate 2024-04-15T01:13:06.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:13:06.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-15T01:13:06.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-15T01:13:06.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-15T01:13:06.812 INFO:tasks.ceph:Compressing logs... 2024-04-15T01:13:06.812 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T01:13:06.828 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T01:13:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37500.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37500.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.6.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37500.log.gz 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr: 57.1% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37249.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37369.log 2024-04-15T01:13:06.905 INFO:teuthology.orchestra.run.smithi037.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37249.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37369.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37249.log.gz 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37369.log.gz 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37409.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37450.log 2024-04-15T01:13:06.906 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37450.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37450.log.gz 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37289.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz/var/log/ceph/ceph-mds.f.log: 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37329.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37289.log.gz 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.x.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37329.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37329.log.gz 2024-04-15T01:13:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-15T01:13:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.b.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T01:13:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-15T01:13:06.928 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50002.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50002.log.gz 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37648.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gz 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2024-04-15T01:13:06.929 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45467.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz --verbose 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.41174.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50372.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41798.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5%/var/log/ceph/ceph-client.admin.41174.log: -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44690.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41406.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41798.log.gz 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2024-04-15T01:13:06.930 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41406.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44690.log.gz 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50414.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41406.log.gz 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44136.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44144.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31222.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44136.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gzgzip 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44136.log.gz 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.31222.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31222.log.gz 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-04-15T01:13:06.931 INFO:teuthology.orchestra.run.smithi029.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43307.log 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.44859.log 2024-04-15T01:13:06.932 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43307.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44140.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41882.log 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41882.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44859.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51988.log 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43427.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41882.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51197.log 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41576.log 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51197.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51988.log.gz 2024-04-15T01:13:06.933 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41576.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51197.log.gz 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41576.log.gz 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9%/var/log/ceph/ceph-client.admin.45173.log: -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45593.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50188.log 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41702.log 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50188.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-04-15T01:13:06.934 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41702.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50188.log.gz 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41702.log.gz 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46478.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50861.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.46478.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz --verbose 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.45809.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45809.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50861.log.gz 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45941.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41966.log 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41618.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45809.log.gz 2024-04-15T01:13:06.935 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51323.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41966.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.45941.log.gz 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50498.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41966.log.gz 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42050.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51323.log.gz 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50498.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50498.log.gz 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42092.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45341.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2024-04-15T01:13:06.936 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50945.log 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42092.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51113.log 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50945.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37259.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50945.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51612.log 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51113.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51113.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2024-04-15T01:13:06.937 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51612.log: /var/log/ceph/ceph-client.admin.42008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51612.log.gz 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45257.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41840.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5/var/log/ceph/ceph-client.admin.42955.log: --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41216.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41840.log.gz 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43039.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-04-15T01:13:06.938 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51281.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41216.log.gz 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43039.log.gz 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51281.log.gz 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51365.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44513.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51365.log.gz 2024-04-15T01:13:06.939 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44730.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44143.log: /var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44730.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42134.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44730.log.gz 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45029.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45425.log 2024-04-15T01:13:06.940 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45425.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51239.log 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50230.log 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42200.log: /var/log/ceph/ceph-client.admin.51239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51239.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42997.log 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50230.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50456.log 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2024-04-15T01:13:06.941 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50903.log 88.7% 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42997.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50456.log: /var/log/ceph/ceph-client.admin.51736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50456.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50903.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45215.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43646.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50903.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43511.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.3.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45215.log.gz 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44145.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2024-04-15T01:13:06.942 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43511.log: /var/log/ceph/ceph-client.admin.44145.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43511.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44145.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51820.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.44860.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51820.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45875.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51820.log.gz 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2024-04-15T01:13:06.943 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45875.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41534.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45875.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50639.log: /var/log/ceph/ceph-client.admin.41924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50819.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50819.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41534.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51904.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50819.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51904.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz 2024-04-15T01:13:06.944 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.43265.log 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51904.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44791.log 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43265.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41129.log 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44791.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44791.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41129.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43882.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44987.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 87.3% 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2024-04-15T01:13:06.945 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6%/var/log/ceph/ceph-mgr.y.log: -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41492.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50062.log: /var/log/ceph/ceph-client.admin.41492.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41492.log.gz 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43469.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44399.log: /var/log/ceph/ceph-client.admin.45743.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50766.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr: 90.8%/var/log/ceph/ceph-client.admin.43469.log: -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43469.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-15T01:13:06.946 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44522.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50766.log: /var/log/ceph/ceph-client.admin.45071.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50766.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45299.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44522.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45299.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45299.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43081.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44147.log: /var/log/ceph/ceph-client.admin.51407.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43081.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43081.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51778.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.51694.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50146.log 2024-04-15T01:13:06.947 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51778.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51778.log.gz 2024-04-15T01:13:06.948 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50330.log 2024-04-15T01:13:06.948 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50146.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50146.log.gz 2024-04-15T01:13:06.948 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T01:13:06.948 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50330.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50330.log.gz 2024-04-15T01:13:06.948 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41744.log 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.log: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41450.log 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41744.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41744.log.gz 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41450.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41450.log.gz 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2024-04-15T01:13:06.953 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.2.log: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-15T01:13:06.954 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45551.log 2024-04-15T01:13:06.954 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45113.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2024-04-15T01:13:06.954 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-15T01:13:06.954 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45551.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45551.log.gz 2024-04-15T01:13:06.954 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51862.log 2024-04-15T01:13:06.955 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51652.log 2024-04-15T01:13:06.956 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51862.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51862.log.gz 2024-04-15T01:13:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2024-04-15T01:13:06.969 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51652.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51652.log.gz 2024-04-15T01:13:06.978 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2024-04-15T01:13:06.990 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41014.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2024-04-15T01:13:06.994 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46087.log 2024-04-15T01:13:06.995 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45677.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2024-04-15T01:13:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51155.log 2024-04-15T01:13:07.005 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46087.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46087.log.gz 2024-04-15T01:13:07.016 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50987.log 2024-04-15T01:13:07.017 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51155.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51155.log.gz 2024-04-15T01:13:07.025 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50288.log 2024-04-15T01:13:07.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51029.log 2024-04-15T01:13:07.035 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50288.log.gz 2024-04-15T01:13:07.038 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50987.log.gz 2024-04-15T01:13:07.043 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37537.log 2024-04-15T01:13:07.057 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51029.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51029.log.gz 2024-04-15T01:13:07.062 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41660.log 2024-04-15T01:13:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37537.log.gz 2024-04-15T01:13:07.076 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2024-04-15T01:13:07.077 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.41660.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41660.log.gz 2024-04-15T01:13:07.085 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-04-15T01:13:07.098 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51071.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2024-04-15T01:13:07.100 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51946.log 2024-04-15T01:13:07.101 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.44350.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-04-15T01:13:07.109 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2024-04-15T01:13:07.119 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51946.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-15T01:13:07.119 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.43223.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2024-04-15T01:13:07.121 INFO:teuthology.orchestra.run.smithi029.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-15T01:13:07.123 INFO:teuthology.orchestra.run.smithi029.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51946.log.gz 2024-04-15T01:13:07.123 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2024-04-15T01:13:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2024-04-15T01:13:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.42913.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2024-04-15T01:13:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50723.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2024-04-15T01:13:07.174 INFO:teuthology.orchestra.run.smithi029.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-15T01:13:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-15T01:13:07.359 INFO:teuthology.orchestra.run.smithi029.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-15T01:13:07.568 INFO:teuthology.orchestra.run.smithi037.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-15T01:13:08.147 INFO:teuthology.orchestra.run.smithi037.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-15T01:13:08.449 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-15T01:13:09.836 INFO:teuthology.orchestra.run.smithi029.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-15T01:13:16.951 INFO:teuthology.orchestra.run.smithi029.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-15T01:13:17.333 INFO:teuthology.orchestra.run.smithi037.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-15T01:13:17.543 INFO:teuthology.orchestra.run.smithi029.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-15T01:13:20.214 INFO:teuthology.orchestra.run.smithi037.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-15T01:13:20.373 INFO:teuthology.orchestra.run.smithi037.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-15T01:13:21.734 INFO:teuthology.orchestra.run.smithi029.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-15T01:13:22.022 INFO:teuthology.orchestra.run.smithi037.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-15T01:13:24.696 INFO:teuthology.orchestra.run.smithi029.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-15T01:13:26.227 INFO:teuthology.orchestra.run.smithi029.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.46478.log.gz 2024-04-15T01:13:26.229 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-04-15T01:13:26.229 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m19.389s 2024-04-15T01:13:26.229 INFO:teuthology.orchestra.run.smithi029.stderr:user 1m13.830s 2024-04-15T01:13:26.229 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m2.186s 2024-04-15T01:14:07.627 INFO:teuthology.orchestra.run.smithi037.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-15T01:14:07.629 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-15T01:14:07.629 INFO:teuthology.orchestra.run.smithi037.stderr:real 1m0.762s 2024-04-15T01:14:07.629 INFO:teuthology.orchestra.run.smithi037.stderr:user 1m53.259s 2024-04-15T01:14:07.629 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m3.149s 2024-04-15T01:14:07.629 INFO:tasks.ceph:Archiving logs... 2024-04-15T01:14:07.630 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/remote/smithi029/log 2024-04-15T01:14:07.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T01:14:19.193 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/remote/smithi037/log 2024-04-15T01:14:19.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T01:14:35.881 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-15T01:14:35.882 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-15T01:14:35.906 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-15T01:14:35.906 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-15T01:14:35.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T01:14:35.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T01:14:35.993 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-15T01:14:36.004 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-15T01:14:36.005 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T01:14:36.007 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T01:14:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-04-15T01:14:36.024 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-15T01:14:36.025 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T01:14:36.026 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-04-15T01:14:36.026 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv01.front.sepia.ceph.com 3 7 377 34 +1029us[+1026us] +/- 43ms 2024-04-15T01:14:36.026 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1130us[-1130us] +/- 66ms 2024-04-15T01:14:36.026 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 29 -170us[ -170us] +/- 74ms 2024-04-15T01:14:36.026 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T01:14:36.028 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T01:14:36.028 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-15T01:14:36.028 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +923us[ +966us] +/- 43ms 2024-04-15T01:14:36.029 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1207us[-1164us] +/- 66ms 2024-04-15T01:14:36.029 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -272us[ -229us] +/- 74ms 2024-04-15T01:14:36.029 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T01:14:36.029 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-15T01:14:36.039 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-15T01:14:36.040 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-15T01:14:36.048 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T01:14:36.147 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T01:14:36.223 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T01:14:36.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T01:14:36.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T01:14:36.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T01:14:36.286 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-15T01:14:36.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-15T01:14:36.308 INFO:teuthology.task.internal:Duration was 5285.271085 seconds 2024-04-15T01:14:36.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-15T01:14:36.320 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-15T01:14:36.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T01:14:36.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T01:14:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T01:14:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T01:14:36.708 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-15T01:14:36.708 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-04-15T01:14:36.708 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T01:14:36.728 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-04-15T01:14:36.728 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T01:14:36.749 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-15T01:14:36.749 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T01:14:36.770 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T01:14:36.819 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-15T01:14:36.820 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T01:14:36.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T01:14:36.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-15T01:14:37.033 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-15T01:14:37.034 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T01:14:37.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T01:14:37.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-15T01:14:37.127 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T01:14:37.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T01:14:37.152 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-04-15T01:14:37.156 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-04-15T01:14:37.180 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T01:14:37.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T01:14:37.222 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T01:14:37.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T01:14:37.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-15T01:14:37.249 INFO:teuthology.task.internal:Transferring archived files... 2024-04-15T01:14:37.250 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/remote/smithi029 2024-04-15T01:14:37.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T01:14:37.299 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603/remote/smithi037 2024-04-15T01:14:37.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T01:14:37.335 INFO:teuthology.task.internal:Removing archive directory... 2024-04-15T01:14:37.335 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T01:14:37.337 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T01:14:37.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-15T01:14:37.395 INFO:teuthology.task.internal:Not uploading archives. 2024-04-15T01:14:37.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-15T01:14:37.407 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-15T01:14:37.407 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T01:14:37.410 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T01:14:37.422 INFO:teuthology.orchestra.run.smithi029.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 01:14 /home/ubuntu/cephtest 2024-04-15T01:14:37.438 INFO:teuthology.orchestra.run.smithi037.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 01:14 /home/ubuntu/cephtest 2024-04-15T01:14:37.439 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-15T01:14:37.449 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-15T01:14:37.461 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-15T01:14:37.461 INFO:teuthology.nuke:Checking targets against current locks 2024-04-15T01:14:37.488 DEBUG:teuthology.nuke:shortname: smithi029 2024-04-15T01:14:37.488 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T01:14:37.515 DEBUG:teuthology.nuke:shortname: smithi037 2024-04-15T01:14:37.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T01:14:37.518 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:37:25.024840', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg1QjYOm/XCwPoI964+rvcDmXRZJoCgq5O6XZklDrKVFZkARNlsIk0PfGQ8Egv9y3LEjQ8qW1HUjH4WohwvuhE='} 2024-04-15T01:14:37.548 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656603', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:37:25.023354', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPKoaKdSXSa5MDypAEXZKA09QF0pnbK88cIyQahnI0ihDdIDOOsadRfRxL4WIKmM83/pql8uGT3FmP8TmL3DAg='} 2024-04-15T01:14:37.578 INFO:teuthology.orchestra.console.smithi029:Power off 2024-04-15T01:14:37.578 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T01:14:37.601 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-04-15T01:14:37.601 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:37.616 INFO:teuthology.orchestra.console.smithi037:Power off 2024-04-15T01:14:37.616 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T01:14:37.624 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-15T01:14:37.641 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2024-04-15T01:14:37.641 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:37.664 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T01:14:41.626 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:41.665 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:41.737 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-15T01:14:41.777 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T01:14:45.738 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:45.778 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:45.851 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-15T01:14:45.887 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T01:14:45.953 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-04-15T01:14:49.890 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:14:50.001 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-04-15T01:14:50.101 INFO:teuthology.orchestra.console.smithi037:Power off completed 2024-04-15T01:14:50.206 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} duration: 5285.271085262299 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-15T01:14:50.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:14:50.314 INFO:teuthology.run:FAIL